LocalAI
LocalAI is an open-source AI engine that supports running various models on any hardware.
- Type
- MCP
- Transport
- http
- Open source
- Yes
- GitHub Stars
- ★ 47.1k
- Source
- mcp-github
- Repository
- github.com/mudler/LocalAI
Overview
LocalAI is an open-source AI engine that can run diverse models on any hardware, including LLMs, vision, speech, image, and video. It does not require a GPU, and each backend is independent and loaded on demand. LocalAI provides API compatibility with OpenAI, Anthropic, and ElevenLabs, supports multi-user authentication, and role-based access control. It also includes a built-in AI agent with support for tool usage, RAG, MCP, and skills. LocalAI is ideal for developers and enterprises needing to run AI models locally.
Capabilities
- ▪Supports multiple model types
- ▪Runs without GPU
- ▪Backend loaded on demand
- ▪OpenAI API compatible
- ▪Multi-user authentication
- ▪Built-in AI agent
Use cases
Setup
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest
This information was compiled by AI from public sources and may contain inaccuracies — please refer to the source.
FAQ
What hardware does LocalAI support?
Supports NVIDIA, AMD, Intel, Apple Silicon, Vulkan, or CPU-only.
How do I install LocalAI?
It can be installed using Docker; see the documentation for specific commands.
Related skills
gemini-cli
Gemini CLI is an open-source AI agent that brings Gemini's powerful capabilities directly into the terminal.
sast-skills
Transform your AI coding assistant into a SAST scanner to automatically detect vulnerabilities in code.
antivibe
Transform AI-generated code into deep learning materials to help developers understand the code.
scientific-agent-skills
Transform any AI agent into a scientific assistant with 147 ready-to-use research skills.
susi_alexa_skill
A skill that enables question-and-answer interactions between Alexa and Susi AI.
claude-context
Provides code search capabilities for Claude Code, turning the entire codebase into context.