petsoi@discuss.tchncs.de to Linux@lemmy.ml · 6 months agoRunning Generative AI Models Locally with Ollama and Open WebUI - Fedora Magazinefedoramagazine.org199016
74Running Generative AI Models Locally with Ollama and Open WebUI - Fedora Magazinefedoramagazine.orgpetsoi@discuss.tchncs.de to Linux@lemmy.ml · 6 months ago19
Show Contenttheshatterstone54@feddit.uk5·6 months agoPersonally I’d just recommend either Alpaca or GPT4All, both of which are on Flathub and much easier to set up (or at least GPT4All is; I haven’t tested Alpaca yet).
Show ContentAshley@lemmy.ca2·6 months agoAlpaca is great, I can even run it on my oneplus 6t, albeit slowly and the max size I got running was llama 7b
Personally I’d just recommend either Alpaca or GPT4All, both of which are on Flathub and much easier to set up (or at least GPT4All is; I haven’t tested Alpaca yet).
Alpaca is great, I can even run it on my oneplus 6t, albeit slowly and the max size I got running was llama 7b