LLM Hoster
JoblessAiDeveloper Tools
Run AI models locally LLM's on your phone & serve over LAN.
- Downloads
- 314+
- on Google Play
- Price
- Free
- No in-app purchases
- Updated
- Jun 2
- 2026 · v1.6
Screenshots
About LLM Hoster
Turn your Android phone into a powerful, private AI server — no cloud, no subscription, no data leaving your device.
LLM Hoster lets you download and run large language models (LLMs) directly on your phone using the llama.cpp inference engine, and exposes a fully compatible API over your local network. Use it with any client that supports the baseAPI/v1API — Open WebUI, Continue.dev, Chatbox, LM Studio, or your own apps.
━━━━━━━━━━━━━━━━━━━━
🔒 COMPLETELY PRIVATE
Your data never leaves your device. No internet required for inference. No API keys, no cloud costs, no telemetry. What happens on your phone stays on your phone.
📥 ONE-TAP MODEL DOWNLOADS
Browse and download GGUF models from Hugging Face with a single tap. Just paste a repo name like "author/model_name-GGUF" — the app automatically finds and downloads the best quantized version for mobile.
🌐 /v1-COMPATIBLE API
Expose a real REST API on your LAN:
• GET /v1/models
• POST /v1/chat/completions
• POST /v1/completions
Connect from your laptop, tablet, or any device on the same network.
💬 BUILT-IN CHAT
Chat with your loaded model directly inside the app. No external client needed for quick conversations.
⚡ PERFORMANCE TUNING
Fine-tune inference for your device:
• CPU core allocation (2–8 threads)
• KV cache quantization (q4_0, q8_0)
• Context window size (2K–16K tokens)
• Batch size control
• GPU layer offloading
• Flash Attention support
🔧 RUNS IN THE BACKGROUND
A foreground service keeps the server alive even when you switch apps. Stop it anytime from the notification shade.
━━━━━━━━━━━━━━━━━━━━
SUPPORTED MODELS
Works with any GGUF-format model. Recommended starting points:
• Llama 3.2 (1B / 3B)
• Phi-3 Mini
• Gemma 2 (2B)
• Qwen 2.5 (1.5B / 3B)
• Mistral 7B (Q4 quantized)
Smaller quantized models (Q4_K_M, Q4_0) run best on phones. Models are stored locally and persist across sessions.
━━━━━━━━━━━━━━━━━━━━
USE CASES
• Private AI assistant with zero cloud dependency
• Development & testing of LLM-powered apps
• Offline AI in areas with limited connectivity
• Learning and experimenting with open-source models
• Serving AI to multiple devices on your home network
━━━━━━━━━━━━━━━━━━━━
No ads. No tracking. No accounts. Just AI on your phone.
Download LLM Hoster and start hosting your own private AI server today.
LLM Hoster lets you download and run large language models (LLMs) directly on your phone using the llama.cpp inference engine, and exposes a fully compatible API over your local network. Use it with any client that supports the baseAPI/v1API — Open WebUI, Continue.dev, Chatbox, LM Studio, or your own apps.
━━━━━━━━━━━━━━━━━━━━
🔒 COMPLETELY PRIVATE
Your data never leaves your device. No internet required for inference. No API keys, no cloud costs, no telemetry. What happens on your phone stays on your phone.
📥 ONE-TAP MODEL DOWNLOADS
Browse and download GGUF models from Hugging Face with a single tap. Just paste a repo name like "author/model_name-GGUF" — the app automatically finds and downloads the best quantized version for mobile.
🌐 /v1-COMPATIBLE API
Expose a real REST API on your LAN:
• GET /v1/models
• POST /v1/chat/completions
• POST /v1/completions
Connect from your laptop, tablet, or any device on the same network.
💬 BUILT-IN CHAT
Chat with your loaded model directly inside the app. No external client needed for quick conversations.
⚡ PERFORMANCE TUNING
Fine-tune inference for your device:
• CPU core allocation (2–8 threads)
• KV cache quantization (q4_0, q8_0)
• Context window size (2K–16K tokens)
• Batch size control
• GPU layer offloading
• Flash Attention support
🔧 RUNS IN THE BACKGROUND
A foreground service keeps the server alive even when you switch apps. Stop it anytime from the notification shade.
━━━━━━━━━━━━━━━━━━━━
SUPPORTED MODELS
Works with any GGUF-format model. Recommended starting points:
• Llama 3.2 (1B / 3B)
• Phi-3 Mini
• Gemma 2 (2B)
• Qwen 2.5 (1.5B / 3B)
• Mistral 7B (Q4 quantized)
Smaller quantized models (Q4_K_M, Q4_0) run best on phones. Models are stored locally and persist across sessions.
━━━━━━━━━━━━━━━━━━━━
USE CASES
• Private AI assistant with zero cloud dependency
• Development & testing of LLM-powered apps
• Offline AI in areas with limited connectivity
• Learning and experimenting with open-source models
• Serving AI to multiple devices on your home network
━━━━━━━━━━━━━━━━━━━━
No ads. No tracking. No accounts. Just AI on your phone.
Download LLM Hoster and start hosting your own private AI server today.
What’s new
Version 1.6 · Updated June 2, 2026
• Advanced Settings: New controls for GPU offloading, thread batches, and speculative decoding. • Stability improvements and general UI cleanup.
User reviews
Great for learning and practicing AI model and it's function
Alternatives to LLM Hoster
Looking for apps like LLM Hoster? Here are 6 similar Android apps on Google Play. The highest rated is OPNsense Manager (3.8/5), and all 6 are free to download.
-
GB Version 2026 - Status Saver
-
Attendance Tracker, Bunk count
-
OPNsense Manager 3.8
-
Woman VPN - Secure VPN Proxy
-
Smart Lens: AI OCR, Translator
-
LIDA: Lux & Flicker Meter
| App | Rating | Price | Installs | Last updated | Compare |
|---|---|---|---|---|---|
| LLM Hoster | – | Free | 100+ | Jun 2, 2026 | |
| GB Version 2026 - Status Saver | – | Free | 100+ | Aug 3, 2026 | Compare |
| Attendance Tracker, Bunk count | – | Free | 500+ | Jun 25, 2026 | Compare |
| OPNsense Manager | 3.8 / 5 | Free | 500+ | Oct 30, 2026 | Compare |
| Woman VPN - Secure VPN Proxy | – | Free | 500+ | Aug 25, 2026 | Compare |
| Smart Lens: AI OCR, Translator | – | Free | 100+ | Apr 26, 2026 | Compare |
| LIDA: Lux & Flicker Meter | – | Free | 1,000+ | Sep 8, 2026 | Compare |
Compare LLM Hoster with the top alternatives: ratings, updates, ASO score and keyword gaps →
Similar apps on Google Play
- GB Version 2026 - Status Saver
- Attendance Tracker, Bunk count
- OPNsense Manager
- Woman VPN - Secure VPN Proxy
- Smart Lens: AI OCR, Translator
- LIDA: Lux & Flicker Meter
- natbatt
- Omni: Trade Remote
- MONITOREA Personal GPS
- Create Aeronautics Mod
- Todo Note-Task & Note Manager
- MiniFlex Pro
- M-Civil: Civil Tools
- Aether-Fast & AdBlock Browser
- TrueNTP
- Thermal Printer Go
- Checkinn: NFC Work Tracker
- Máy Sạch
- AimTools
- GitVanity
- CalCount : Track Meals
- Tip & Split Saver
- Accurator - Gallery Cleaner
- BeCadence
- Yidiaccess