Local LLM Server - Edge AI

Transform your iPhone, iPad, or Mac into a private, local LLM AI server.

This powerful utility allows you to run Large Language Models (LLMs) powered by Apple Intelligence directly on your device, providing an OpenAI-compatible API for your development and testing needs. Run a local AI LLM server on your Apple Intelligence enabled device to give private, local edge AI abilities to your applications.

Note: This app requires iOS 26.0/macOS 26.0 or above to run Apple Intelligence models.

Key Features

Local Server Hosting: Run a fully functional LLM server right from your pocket. No internet connection is required.
OpenAI-Compatible API: Seamlessly integrate with existing tools and clients that support standard chat completion endpoints.
Real-Time Monitoring: Keep track of your server's information with a live status dashboard showing IP address, active port, and logs.
Live Logs: View real-time server logs to debug requests and monitor performance instantly.
Developer Friendly: Includes built-in curl command example to quickly test your server.

Perfect For

AI researchers
Developers building private apps
Enthusiasts exploring local intelligence

This app provides the local LLM AI infrastructure you need using the devices you already have.

Available now for iOS and macOS.