rag-bot

RAG Bot — Private AI on Your Device Have natural conversations with locally-running large language models. Your chats stay on your device with full conversation history and search. Your Documents, AI-Powered Upload PDFs or DOCX files. RAG Bot generates embeddings so you can chat with your documents using retrieval-augmented generation. Visualize your document embeddings in an interactive 3D atlas. Choose Your Model Browse and download from three AI providers (Cactus, ExecuTorch, llama.rn). Filter by type (LLM or embedding), size, capabilities like vision and tool calling — find the right model for your hardware. Built for Performance Real-time device monitoring shows memory and storage usage so you always know what your device can handle. Optimized for Apple Silicon with multiple inference backends. Key Features 100% offline — no internet required after model download Multiple model providers and quantization options Document RAG with PDF, DOCX support Conversation history with full search Vision and tool-calling capable models Real-time device resource monitoring 3D embedding visualization