What the title says. Are there any good ChatGPT alts that can be self hosted?

  • frap129@lemmy.maples.dev
    51·
    1 year ago

    I use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.