AI Runner

AI Runner: Your Local AI Powerhouse

AI Runner is an open-source, offline inference engine designed to bring the power of AI to your local machine. It supports a wide range of functionalities, including art generation, real-time voice conversations, LLM-powered chatbots, and automated workflows, all while prioritizing privacy and security.

What is AI Runner?

AI Runner is a versatile tool that allows you to run AI models directly on your computer without relying on external APIs or cloud services. This means you can enjoy the benefits of AI without compromising your data privacy or incurring additional costs.

How does AI Runner work?

AI Runner leverages your local hardware, including your CPU and GPU, to perform AI computations. It supports various AI models and frameworks, allowing you to customize and extend its capabilities to suit your specific needs. By running models locally, AI Runner eliminates the need for constant internet connectivity and reduces latency, providing a faster and more responsive AI experience.

Key Features of AI Runner

• Real-time Conversations:
  • Supports three speech engines: espeak, SpeechT5, and OpenVoice.
  • Offers auto language detection using OpenVoice.
  • Enables real-time voice chat with LLMs.
• Customizable AI Agents:
  • Allows you to create custom agent names, moods, and personalities.
  • Supports Retrieval-Augmented Generation (RAG) for enhanced knowledge retrieval.
  • Enables the creation of AI personalities and moods.
• Enhanced Knowledge Retrieval:
  • Utilizes RAG for documents and websites, allowing you to use local data to enrich chat interactions.
• Image Generation & Manipulation:
  • Supports text-to-image generation using Stable Diffusion 1.5, SDXL, and Turbo.
  • Provides drawing tools and ControlNet support for advanced image manipulation.
  • Offers LoRA & Embeddings support.
  • Includes inpainting, outpainting, and filter functionalities.
• Multi-lingual Capabilities:
  • Provides partial multi-lingual TTS/STT/interface support.
  • Supports English and Japanese GUI.
• Privacy and Security:
  • Runs locally, ensuring no external API dependencies by default.
  • Offers customizable LLM guardrails & image safety features.
  • Disables HuggingFace telemetry.
  • Restricts network access.
• Performance & Utility:
  • Offers fast generation speeds (approximately 2 seconds on RTX 2080s).
  • Provides Docker-based setup & GPU acceleration.
  • Supports theming (Light/Dark/System).
  • Includes NSFW toggles.
  • Offers an Extension API and Python library & API support.
• Language Support:
  • Supports various languages for TTS, LLM, STT, and GUI, including English, Japanese, Spanish, French, Chinese, and Korean.

How to use AI Runner?

1. Installation: Follow the detailed installation instructions provided in the Installation Wiki. The quick start involves installing system requirements, creating an airunner directory, and installing AI Runner using pip.
2. Basic Usage:
   • Run AI Runner: airunner
   • Run the downloader: airunner-setup
   • Build templates: airunner-build-ui
3. Models: Download the necessary models for text-to-speech, speech-to-text, text generation, and image generation. Organize them under the local AI Runner data directory (~/.local/share/airunner).
4. Configuration: Set up API keys for optional third-party services like Google Custom Search, Bing Web Search, and NewsAPI, if desired.
5. Slash Tools: Use slash commands in the chat prompt to quickly trigger actions like image generation (/a), code execution (/c), and web search (/s).

Why choose AI Runner?

• Privacy: Keep your data secure by running AI models locally.
• Customization: Tailor AI agents and workflows to your specific needs.
• Performance: Enjoy fast generation speeds and responsive interactions.
• Extensibility: Expand AI Runner's functionality with extensions and custom tools.

Who is AI Runner for?

AI Runner is suitable for:

• AI enthusiasts: Individuals interested in exploring and experimenting with AI technologies.
• Developers: Professionals looking to integrate AI into their applications and workflows.
• Creatives: Artists and designers seeking to generate and manipulate images using AI.
• Researchers: Academics and researchers studying AI and related fields.

Regulatory Compliance & Disclosures

AI Runner includes features to help users comply with emerging AI regulations. For example, it provides information regarding the Colorado AI Act (SB 24-205), informing users about their responsibilities as deployers of high-risk AI systems.

Command Line Tools

AI Runner provides several command-line tools for development, testing, and maintenance. These include commands for launching the GUI, downloading models, building UI files, running tests, and generating SSL certificates.

Additional Resources

• GitHub Repository: https://github.com/Capsize-Games/airunner
• Wiki: Consult the AI Runner Wiki for detailed documentation and advanced topics.
• Contributing: Contribute to the project by submitting pull requests for new features, bug fixes, or documentation improvements.

AI Runner empowers you to harness the potential of AI while maintaining control over your data and workflow. Dive in and explore the possibilities!