petsoi@discuss.tchncs.de to Linux@lemmy.ml · 3 days agoRunning Generative AI Models Locally with Ollama and Open WebUI - Fedora Magazinefedoramagazine.orgexternal-linkmessage-square19fedilinkarrow-up185arrow-down116
arrow-up169arrow-down1external-linkRunning Generative AI Models Locally with Ollama and Open WebUI - Fedora Magazinefedoramagazine.orgpetsoi@discuss.tchncs.de to Linux@lemmy.ml · 3 days agomessage-square19fedilink
minus-squareThe Hobbyist@lemmy.ziplinkfedilinkarrow-up4·2 days agoAlternatively, you don’t even need podman or any containers, as open-webui can be installed simply using python/conda/pip, if you only care about serving yourself: https://docs.openwebui.com/getting-started/quick-start/ Much easier to run and maintain IMO. Works wonderfully.
minus-squareVincent@feddit.nllinkfedilinkarrow-up8·2 days agoAnd llamafile is a binary you can just download and run, no installation required. “Uninstallation” is deleting the file.
Alternatively, you don’t even need podman or any containers, as open-webui can be installed simply using python/conda/pip, if you only care about serving yourself:
https://docs.openwebui.com/getting-started/quick-start/
Much easier to run and maintain IMO. Works wonderfully.
And llamafile is a binary you can just download and run, no installation required. “Uninstallation” is deleting the file.