Open source AI CLI for text generation
Open Source GPT-3 Powered CLI is an experimental software that offers an open-source CLI prompt for GPT-3 that costs $0.02 for 1K tokens. It uses facebookresearch/shumai, a fast differentiable tensor library in JavaScript and TypeScript. The library is available for software engineers and researchers to build network-connected and differentiable tensor models at a low cost. The system requires the installation of Bun + Flashlight for use. The software estimates to improve response quality and per-command cost with fine-tuning. The current prompt length is ~840 tokens. The package is only available for Linux and MacOS users, and the Linux installs default to GPU computation with CUDA while MacOS to CPU.
Features:
- Offers open-source CLI prompt for GPT-3
- Costs only $0.02 for 1K tokens
- Uses facebookresearch/shumai—a fast differentiable tensor library in JavaScript and TypeScript
- Available for software engineers and researchers
- Built for building network-connected and differentiable tensor models
- Requires the installation of Bun + Flashlight
- Promises to improve response quality and per-command cost with fine-tuning
- Only available for Linux and MacOS users
- Linux installs default to GPU computation with CUDA while MacOS to CPU
- Current prompt length is ~840 tokens.