There are several FOSS AI options out there; but it's seemingly uncommon knowledge; so for those with the hardware, consider starting here.
Back End:
Ollama
Front End:
OpenWebUI
Personally I started with and still generally use Mixtral through ollama.
Works OFFLINE
