If your model‘s inferences cost only a fraction of GPT3 (money and time!) you have a strong advantage over your competitors. including GPT variants (though not the state of the art models). 79% shorter than the post and link I'm replying to. I played around with GPT-3 for a bit with AI Dungeon premium, but it got almost every question wrong, except the questions that it asked and answered itself. I'm fairly certain there is a GPT neo, GPTJ, and possibly GPT neo x implementation that will allow you to run it.
5-Turbo, but I can't get the personality to stick. All those can be run locally or on generic cloud servers. Meta LLaMA released: LLaMA-13B outperforms OPT and GPT-3 175B on most benchmarks The weights for all models are open. I have a 3080 12GB so I would like to run the 4-bit 13B Vicuna model. … Lit-6B is a GPT-J 6B model fine-tuned on 2GB of a diverse range of light novels, erotica, and annotated literature for the purpose of generating novel-like fictional text. Though someone managed to run it with less VRAM on gpu.
If you open a new account you'll get $5 free trial valid for 3 months. 489 subscribers in the LocalGPT community.
