Local Inference OnDevice Agent
Sameer Shanbhag Productivity iPhoneiPadiPod touch
Local Inference OnDevice Agent is a free Productivity app for iPhone and iPad by Sameer Shanbhag. Rated 5.0/5 from 1 ratings. Requires iOS 16.4.
- Rating
- 5.0
- 1 ratings
- Price
- Free
- on the App Store
- Size
- 52 MB
- Age 17+
- Updated
- Aug 17
- 2026 · v1.1.1
Screenshots
About Local Inference OnDevice Agent
Your AI. Your phone. Nobody else's business. LocalInference runs powerful open AI models entirely on your device. Your conversations never leave your phone — no account, no cloud, no analytics, no tracking. Ever. PRIVATE BY ARCHITECTURE, NOT BY PROMISE • Everything runs on-device; works fully offline after a one-time model download • Zero data collection — we couldn't read your chats if we wanted to • API keys (optional) stored in the secure keychain, sent only to the provider you chose A REAL ASSISTANT, NOT JUST A CHATBOT • Tools: calculator, web search, date & time, webpage reading • Contacts & calendar integration — every write action asks you first • Ask about photos with vision models • Reads answers aloud with on-device voices BUILT FOR TINKERERS • 16 curated models from 0.5B to 8B — Qwen3, Llama, Gemma, DeepSeek R1, Phi, SmolVLM • Only models that fit your device's memory are offered • Live tok/s, time-to-first-token, and token counts per response • Thinking models show their reasoning in collapsible blocks • Bring your own keys: Anthropic, OpenAI, Google — or any OpenAI-compatible server (llama.cpp, LM Studio, Ollama) on your own network Built with Llama. Gemma models provided under the Gemma Terms of Use.
What’s new
Version 1.1.1 · Updated August 17, 2026
Stability and fixes. • Much lighter on memory. On phones with less RAM the app was loading the model at the largest possible context window, which left the system paging it in and out and could make the phone feel like it had frozen. It now sizes the model to what your device can actually hold — around 200 MB less memory in use, and far less swapping. • The app now genuinely frees the model when you switch away, instead of holding it in the background. • Photos work properly. You can send a picture without typing a caption, retrying a photo question keeps the photo, and attaching one no longer silently turns tools off. • Tools tell you why they failed instead of just saying "failed", and tools that need the internet are hidden when you're offline rather than timing out. • Chats can be renamed — press and hold a chat in the list. • Answers you stop early can now be copied and read aloud. • A reply interrupted by the app closing is no longer lost; you can retry it. • The top bar now blends into the background instead of sitting on it as a flat slab. • Web search results are no longer matched to the wrong page. • Attached images are cleaned up properly instead of taking up space forever.
App privacy
The developer, Sameer Shanbhag, reported these privacy practices to Apple.
Data Not Collected
The developer does not collect any data from this app.
Alternatives to Local Inference OnDevice Agent
Looking for apps like Local Inference OnDevice Agent? Here are 6 similar apps on the App Store. The highest rated is Sleeveworks (5.0/5), and all 6 are free to download.
-
Sleeveworks
5.0
-
Georik
5.0
-
Sphere: Multi-Model AI Chat
-
lamos
-
ChiChat AI
5.0
-
Chat Whisperer AI Assistant
| App | Rating | Price | Last updated | Compare |
|---|---|---|---|---|
| Local Inference OnDevice Agent | 5.0 / 5 (1 rating) | Free | August 17, 2026 | |
| Sleeveworks | 5.0 / 5 (1) | Free | Jul 29, 2026 | Compare |
| Georik | 5.0 / 5 (2) | Free | Apr 27, 2026 | Compare |
| Sphere: Multi-Model AI Chat | – | Free | Oct 20, 2026 | Compare |
| lamos | – | Free | Aug 27, 2026 | Compare |
| ChiChat AI | 5.0 / 5 (2) | Free | Oct 10, 2026 | Compare |
| Chat Whisperer AI Assistant | – | Free | Jul 27, 2025 | Compare |