Sign-In
Cart
LLM Engineering with Python: Build, Test, Secure, and Deploy Production-Ready LLM Applications with Python, RAG, and AI Agents
Paperback
Series: AI Engineering, Book 5
Publisher: Independently Published
Published: Sep 15 2026
Pages: 486
Weight: 1.42
Height: 0.98 Width: 6.00 Depth: 9.00
Language: English
Includes a complete companion GitHub repository with the book. Get the source code, tests, prompts, evaluation datasets, documentation, and hands-on project implementations at github.com/masud-dot/llm-engineering-with-python. You can follow the book chapter by chapter, run the examples, inspect the tests, and build on the same engineering patterns used throughout the book.
Large language models can produce impressive results in a prototype. Turning that prototype into a reliable application is a different engineering problem.
LLM Engineering with Python takes you from working API calls to production-oriented systems that are designed to be tested, evaluated, secured, observed, and deployed.
You will learn how to:
- Design reliable LLM application architectures with Python
- Work with model APIs, streaming, asynchronous requests, retries, timeouts, fallbacks, logging, and cost controls
- Engineer prompts, context budgets, memory, and structured outputs with Pydantic
- Build embeddings, semantic search, vector-store integrations, and retrieval pipelines
- Build production-oriented RAG systems with hybrid retrieval, reranking, query rewriting, filtering, citations, grounding, and abstention
- Implement tool calling with validated contracts, execution controls, allowlists, and safety boundaries
- Build bounded AI agents with planning, tool composition, memory, approval gates, and auditable execution
- Understand and integrate Model Context Protocol (MCP) for standardized tool access
- Test nondeterministic LLM applications and evaluate the quality of generated output
- Build regression, adversarial, and CI/CD quality gates
- Defend against prompt injection, data leakage, unsafe tool use, and other application-level risks
- Control latency and cost with caching, routing, budgets, and measurement
- Add structured logging, tracing, metrics, alerting, and privacy-aware observability
- Serve applications with FastAPI and package them for containerized deployment
Learn by building real projects.
The capstone section brings the engineering concepts together through practical applications, including an AI Document Assistant, AI Test-Case Generator, AI SQL Assistant, AI Research Agent, and a production service that assembles the components into a deployable system.
This book also emphasizes something often missing from LLM tutorials: measurement and verification. You will learn to distinguish software testing from model-output evaluation, measure retrieval quality, validate security controls, track cost and latency, and build quality gates that can detect regressions.
Who is this book for?
This book is designed for Python developers, software engineers, QA and automation engineers, backend developers, AI/ML engineers, and technical professionals who want to move beyond LLM experimentation and understand how production-grade AI applications are engineered.
You should be comfortable reading and writing Python. No previous experience building LLM applications or advanced machine-learning background is required.
Stop treating the LLM as the entire application. Learn how to engineer the system around it.
Also in
Programming
Interactive Theorem Proving and Program Development: Coq'art: The Calculus of Inductive Constructions
Castéran, Pierre
Bertot, Yves
Hardcover
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Collector's Edition
Piggyback
Hardcover
Python Crash Course, 3rd Edition: A Hands-On, Project-Based Introduction to Programming
Matthes, Eric
Paperback
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Standard Edition
Piggyback
Paperback
Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations
Humble, Jez
Kim, Gene
Forsgren Phd, Nicole
Paperback
Crisis Engineering: Time-Tested Tools for Turning Chaos Into Clarity
Nitze, Marina
Weaver, Matthew
Dickerson, Mikey
Paperback
Embedded Systems with ARM Cortex-M Microcontrollers in Assembly Language and C: Fourth Edition
Zhu, Yifeng
Paperback
Fundamentals of Software Architecture: A Modern Engineering Approach
Ford, Neal
Richards, Mark
Paperback
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
Vibe Coding: Building Production-Grade Software with Genai, Chat, Agents, and Beyond
Yegge, Steve
Kim, Gene
Paperback
AI Projects with Raspberry Pi: High-Performance Artificial Intelligence for Robotics, Security, Home Automation, and Vision
Hattersley, Lucy
Jepson, Brian
Paperback
The Manager's Path: A Guide for Tech Leaders Navigating Growth and Change
Fournier, Camille
Paperback
I Have an App Idea: The Essential Guide to Building an App Without Tech Skills
Spann, Amanda
Paperback
The Devops Handbook, 2nd Edition: How to Create World-Class Agility, Reliability, & Security in Technology Organizations
Humble, Jez
Debois, Patrick
Kim, Gene
Paperback
The Return on AI: From Promise to Profit in the Age of Intelligent Business
Mittal, Ashwin
Sawhney, Mohanbir
Paperback
The Developer's Guide to AI: A Field Guide for the Working Developer
Thompson, Danny
Orshalick, Jacob
Reghunadh, Jerry M.
Paperback
The Staff Engineer's Path: A Guide for Individual Contributors Navigating Growth and Change
Reilly, Tanya
Paperback
Building Applications with AI Agents: Designing and Implementing Multiagent Systems
Albada, Michael
Paperback
Cracking the Coding Interview: 189 Programming Questions and Solutions
McDowell, Gayle Laakmann
Paperback
Software Architecture: The Hard Parts: Modern Trade-Off Analyses for Distributed Architectures
Sadalage, Pramod
Ford, Neal
Richards, Mark
Paperback
Learning Web Design: A Beginner's Guide to Html, Css, Javascript, and Web Images
Robbins, Jennifer
Paperback
Observability Engineering: Achieving Production Excellence
Miranda, George
Majors, Charity
Fong-Jones, Liz
Paperback
The New AI Cold War: Liberty vs. Tyranny in the Age of Machine Empires
Maginnis, Ltc Robert L.
Paperback
Forecasting: Principles and Practice, the Pythonic Way
Hyndman, Rob J.
Athanasopoulos, George
Paperback
Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
Building Safer Technology: A Field Guide to Failing Well
Zunger, Yonatan
Coles, Neil
Kissner, Lea
Paperback
The Pragmatic Programmer: Your Journey to Mastery, 20th Anniversary Edition
Hunt, Andrew
Thomas, David
Hardcover
A Human's Guide to Machine Intelligence: How Algorithms Are Shaping Our Lives and How We Can Stay in Control
Hosanagar, Kartik
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Hardcover
Grokking Algorithms, Second Edition: An Illustrated Guide for Programmers and Other Curious People
Bhargava, Aditya Y.
Paperback
The Official Raspberry Pi Handbook 2026: Astounding Projects with Raspberry Pi Computers
Makers of Raspberry Pi Official Magazine, The
Paperback
Generative AI Design Patterns: Solutions to Common Challenges When Building Genai Agents and Applications
Lakshmanan, Valliappa
Hapke, Hannes
Paperback
Concrete Mathematics: A Foundation for Computer Science
Knuth, Donald
Graham, Ronald
Patashnik, Oren
Hardcover
Head First Design Patterns: Building Extensible and Maintainable Object-Oriented Software
Freeman, Eric
Robson, Elisabeth
Paperback
Learning Domain-Driven Design: Aligning Software Architecture and Business Strategy
Khononov, Vlad
Paperback
The Software Architect Elevator: Redefining the Architect's Role in the Digital Enterprise
Hohpe, Gregor
Paperback
Arduino Programming for Beginners: A Comprehensive Beginner's Guide to Learn the Realms of Arduino Programming from A-Z
Protosmith, Ada
Paperback
Frictionless: 7 Steps to Remove Barriers, Unlock Value, and Outpace Your Competition in the AI Era
Noda, Abi
Forsgren, Nicole
Paperback
Learning Generative AI Tools for Excel: Speed Up Your Everyday Tasks with Microsoft Excel, Copilot, Chatgpt, and Beyond
Duca, Angelica Lo
Paperback
Building AI-Powered Products: The Essential Guide to AI and Genai Product Management
Nika, Marily
Paperback
Debugging: The 9 Indispensable Rules for Finding Even the Most Elusive Software and Hardware Problems
Agans, David J.
Paperback
Build an AI Agent (from Scratch): Agents That Reason, Plan, and ACT Autonomously
Hur, Jungjun
Song, Younghee
Paperback
Signals & Levers: Systems Thinking Tools to Unblock Software Delivery
Hendrickson, Elisabeth
Tosi, Joel
Paperback
Learning Php, MySQL & JavaScript: A Step-By-Step Guide to Creating Dynamic Websites
Nixon, Robin
Paperback
Software Engineering at Google: Lessons Learned from Programming Over Time
Manshreck, Tom
Wright, Hyrum
Winters, Titus
Paperback
Python Programming for Young Coders: A Hands-On, Project-Based Introduction to Coding for Beginners, Kids, and Teens
Pandey, Anand
Paperback
Living a Jewish Life, Revised and Updated: Jewish Traditions, Customs, and Values for Today's Families
Diamant, Anita
Cooper, Howard
Paperback
Computer Science from Scratch: Building Interpreters, Art, Emulators and ML in Python
Kopec, David
Paperback
Programming Massively Parallel Processors: A Hands-On Approach
El Hajj, Izzat
Hwu, Wen-Mei W.
Kirk, David B.
Paperback
AI Agents with MCP: Model Context Protocol for Building Clients, Servers, and End-To-End Agents
Stratis, Kyle
Paperback
Adobe Photoshop, 2nd Edition: A Complete Course and Compendium of Features
Laskevitch, Stephen
Paperback
Java in a Nutshell: A Desktop Quick Reference
Evans, Benjamin J.
Clark, Jason R.
Flanagan, David
Paperback
Site Reliability Engineering: How Google Runs Production Systems
Beyer, Betsy
Jones, Chris
Leng, Christof
Paperback
Kubernetes in Action, Second Edition: Deploying and Managing Containers and Cloud-Native Applications
Luksa, Marko
Conner, Kevin
Paperback
Electronic Music and Sound Design - Theory and Practice with Max 9 - Volume 1 (Fifth Edition)
Cipriani, Alessandro
Maurizio, Giri
Paperback
Embedded Systems with ARM Cortex-M Microcontrollers in Assembly Language and C: Third Edition
Zhu, Yifeng
Paperback