Open Daily: 10am - 10pm | Alley door pickup 10am - 7pm 3038 Hennepin Ave Minneapolis, MN
612-822-4611

  • Open Daily: 10am - 10pm
    Alley-side Pickup: 10am - 7pm

    3038 Hennepin Ave Minneapolis, MN
    612-822-4611

Open Daily: 10am - 10pm | Alley-side Pickup: 10am - 7pm
3038 Hennepin Ave Minneapolis, MN
612-822-4611
Build Applications with Local AI Models on a Mac: Create Private Chatbots, Voice Apps, Rag Systems, and More

Build Applications with Local AI Models on a Mac: Create Private Chatbots, Voice Apps, Rag Systems, and More

Kamigusa, Keiji

Paperback

General ComputersProgramming

PREORDER - Expected ship date November 3, 2026

ISBN10: 1633433706
ISBN13: 9781633433700
Publisher: Manning Publications
Published: Nov 3 2026
Pages: 296
Weight: 0.72
Language: English
Get the eBook free when you register your print book at Manning.

A goldmine of technical advice, with actionable project ideas and learning resources.
--C. Scott Anderson, Garmin International

Running AI applications on local hardware unlocks architecturally guaranteed privacy, eliminates costly subscriptions and API fees, and gives you the power to tune your models to your exact needs. In Build Applications with Local AI Models on a Mac, author Keiji Kamigusa guides you step-by-step as you build a voice-enabled chatbot that will run on any recent Mac--from a basic Mac mini to a top-of-the-line Mac Studio. As you set up your custom hardware and software stack, you'll experience a powerful paradigm shift that turns you from a passive consumer into an AI architect.

The book draws you in immediately with a hands-on project that connects three local technologies: audio capture, speech transcription, and language model inference. You'll start by building the foundation of your chatbot, including command-line navigation and directory management, setting up Homebrew as your package manager, and downloading your first local large language model. Then, you'll quickly review the features that make local AI on the Mac special, such as Apple Silicon's unified memory architecture. You'll also meet a Mac-optimized software suite that includes the Apple-optimized MLX Whisper speech recognition model that offers 100% offline privacy and an integrated voice AI pipeline that runs natively on M-series chips.

As you go, you'll explore universal concepts that apply to all AI applications--such as temperature configuration, context windows, and system prompts--and learn how they map to the specific needs of your local Mac environment. The book then guides you through expanding your assistant with Retrieval-Augmented Generation (RAG) and autonomous agents. You will store documents locally in ChromaDB to ground your AI's responses and prevent hallucinations. You'll also learn how to use the Python-based Streamlit framework to customize your chatbot's behavior without writing complex callbacks or HTML.

In later chapters, you'll discover how self-hosting models on your Mac provide absolute control over your workflows while keeping your infrastructure completely private. You'll explore the Unsloth-to-Ollama pipeline to fine-tune frontier models on your custom data and how to manage stateless LLMs by implementing explicit history tracking. Reviewer Arun Sivakumar of Expedia Group noted, The context window and token consumption are valuable details that many LLM users ignore, and concepts like how to fine tune models are highly relevant for day-to-day usage.

Spanning 18 chapters, this book provides a complete local AI roadmap. As reviewer C. Scott Anderson of Garmin International points out, this book gives you exactly what you need to see how the benefits of open-source models can eclipse the economic realities of proprietary models.

What's inside

- Building a fully offline, voice-enabled assistant

Also in

General Computers

View All