lemonade

🍋 Lemonade: Refreshingly fast local AI

Download | Documentation | Discord

Lemonade is the local AI server that gives you the same capabilities as cloud APIs, except 100% free and private. Use the latest models for chat, coding, speech, and image generation on your own NPU and GPU.

Lemonade comes in two flavors:

• Lemonade Server installs a service you can connect to hundreds of great apps using standard OpenAI, Anthropic, and Ollama APIs.
• Embeddable Lemonade is a portable binary you can package into your own application to give it multi-modal local AI that auto-optimizes for your user’s PC.

This project is built by the community for every PC, with optimizations by AMD engineers to get the most from Ryzen AI, Radeon, and Strix Halo PCs.

Getting Started

1. Install: Windows · Linux · macOS · Docker · Source
2. Get Models: Browse and download with the Model Manager
3. Generate: Try models with the built-in interfaces for chat, image gen, speech gen, and more
4. Mobile: Take your lemonade to go: iOS · Android · Source
5. Connect: Use Lemonade with your favorite apps:

                  

Want your app featured here? Just submit a marketplace PR!

Supported Platforms

Platform	Build

Using the CLI

To run and chat with Gemma:

lemonade run Gemma-4-E2B-it-GGUF

To code with Lemonade models:

lemonade launch claude

Multi-modality:

# image gen
lemonade run SDXL-Turbo

# speech gen
lemonade run kokoro-v1

# transcription
lemonade run Whisper-Large-v3-Turbo

To see available models and download them:

lemonade list

lemonade pull Gemma-4-E2B-it-GGUF

To manage model aliases for environment-independent naming and active-standby failover:

lemonade alias add production-llm Gemma-4-E2B-it-GGUF
lemonade alias list

# Instant active-standby failover to a different model target
lemonade alias add production-llm Qwen3-0.6B-GGUF
lemonade alias remove production-llm

To see the backends available on your PC:

lemonade backends

For hybrid setups, Lemonade can also route to any OpenAI-compatible cloud provider (Fireworks, OpenAI, OpenRouter, Together, …) alongside local models — see Cloud Offload. (Experimental.)

Model Library

Lemonade supports a wide variety of LLMs (GGUF, FLM, and ONNX), whisper, stable diffusion, etc. models across CPU, GPU, and NPU.

Use lemonade pull or the built-in Model Manager to download models. Custom GGUF/ONNX models can be pulled from Hugging Face or ModelScope, with their source retained for future updates.

Browse the included model catalog →

Supported Configurations

Lemonade supports multiple inference engines for LLM, speech, TTS, and image generation, and each has its own backend and hardware requirements.

  Modality
  Engine
  Backend
  Device
  OS

  <strong>Text generation</strong>
  <code>llamacpp</code>
  <code>system</code>
  <code>x86_64</code>/ARM64 CPU, GPU
  Linux


  <code>metal</code>
  Apple Silicon GPU
  macOS


  <code>cuda</code>
  NVIDIA GPUs (Turing or newer)**
  Windows, Linux


  <code>vulkan</code>
  <code>x86_64</code> CPU, AMD iGPU, AMD dGPU; ARM64 CPU/GPU (Linux)
  Windows, Linux


  <code>rocm</code>
  AMD GPUs supported by ROCm
  Windows, Linux


  <code>cpu</code>
  <code>x86_64</code> CPU; ARM64 CPU (Linux)
  Windows, Linux


  <code>llamacpp-hrx</code> (experimental)
  <code>hrx</code>
  AMD GPUs (gfx1100, gfx1151)
  Linux


  <code>flm</code>
  <code>npu</code>
  XDNA2 NPU
  Windows, Linux


  <code>ryzenai-llm</code>
  <code>npu</code>
  XDNA2 NPU
  Windows


  <code>vllm</code> (experimental)
  <code>rocm</code>
  Strix Halo iGPU (gfx1151)
  Linux


  <code>ds4</code> (experimental)
  <code>rocm</code>
  Prebuilt ds4 for AMD Strix Halo
  Linux


  <strong>Speech-to-text</strong>
  <code>whispercpp</code>
  <code>npu</code>
  XDNA2 NPU
  Windows


  <code>metal</code>
  Apple Silicon GPU
  macOS


  <code>vulkan</code>
  <code>x86_64</code> CPU
  Windows, Linux


  <code>rocm</code>
  Supported AMD ROCm iGPU/dGPU families*
  Windows, Linux


  <code>cpu</code>
  <code>x86_64</code> CPU
  Windows, Linux


  <code>moonshine</code>
  <code>cpu</code>
  <code>x86_64</code>/<code>arm64</code> CPU
  Windows, Linux, macOS


  <strong>Text-to-speech</strong>
  <code>kokoro</code>
  <code>metal</code>
  Apple Silicon GPU
  macOS


  <code>cpu</code>
  <code>x86_64</code> CPU
  Windows, Linux


  <code>openmoss</code> (experimental)
  <code>cuda</code>
  NVIDIA GPUs
  Windows, Linux


  <code>vulkan</code>
  Vulkan-capable GPUs
  Windows, Linux


  <strong>Audio generation</strong>
  <code>thinksound</code> (experimental)
  <code>cuda</cod