JPNAS.NET / Digital Resources

🤖 Local AI

Run AI models on your own computer – private, offline and without subscriptions. Larger models need a good graphics card or plenty of RAM. The tools are open source; each model you load has its own licence.

Open in the interactive Digital Resources

• Ollama

  ollama.com

  The easiest way to download and run language models locally with a single command. Works on Windows, Linux and macOS.

  • #LLM
  • #COMMAND-LINE
  • #OPEN-SOURCE

• Jan

  jan.ai

  A desktop chat app, similar to ChatGPT, that runs models fully offline on your computer.

  • #LLM
  • #DESKTOP
  • #OPEN-SOURCE

• GPT4All

  nomic.ai

  A simple desktop app for local chat models, with the option to ask questions about your own documents.

  • #LLM
  • #DESKTOP
  • #OPEN-SOURCE

• LM Studio

  lmstudio.ai

  A polished app for finding, downloading and testing local models. Free to use, but not open source.

  • #LLM
  • #DESKTOP
  • #FREE

• Open WebUI

  openwebui.com

  A self-hosted web interface for Ollama and other model servers – ideal for a home server or NAS.

  • #LLM
  • #SELF-HOSTED
  • #WEB

• AnythingLLM

  anythingllm.com

  Chat with your own files and notes using local models, with everything stored on your computer.

  • #LLM
  • #DOCUMENTS
  • #OPEN-SOURCE

• llama.cpp

  github.com

  The engine behind many local AI apps. Runs language models efficiently, even on a CPU.

  • #LLM
  • #ADVANCED
  • #OPEN-SOURCE

• LocalAI

  localai.io

  A self-hosted server that offers text, image and audio models through an OpenAI-compatible API.

  • #SELF-HOSTED
  • #API
  • #OPEN-SOURCE

• ComfyUI

  comfy.org

  A powerful node-based tool for generating images and video with Stable Diffusion, Flux and similar models.

  • #IMAGES
  • #STABLE-DIFFUSION
  • #OPEN-SOURCE

• InvokeAI

  github.com

  A more user-friendly app for local image generation, with a canvas for editing and painting.

  • #IMAGES
  • #STABLE-DIFFUSION
  • #OPEN-SOURCE

• Whisper

  github.com

  Speech-to-text model that transcribes audio in many languages, including Slovenian.

  • #AUDIO
  • #TRANSCRIPTION
  • #OPEN-SOURCE

• whisper.cpp

  github.com

  A fast, lightweight version of Whisper that runs well on ordinary computers.

  • #AUDIO
  • #TRANSCRIPTION
  • #OPEN-SOURCE

• Piper

  github.com

  A fast, local text-to-speech engine with many voices, popular with Home Assistant.

  • #AUDIO
  • #TEXT-TO-SPEECH
  • #OPEN-SOURCE

• Hugging Face

  huggingface.co

  The largest library of free AI models and datasets – the place to find models for all of the tools above.

  • #MODELS
  • #COMMUNITY
  • #REFERENCE