Sign-In
Cart
Harness Engineering for Data Agents on Databricks: Building Reliable Agentic Data Platforms with MCP, Databricks, Data Contracts, Governance, and Mult
Paperback
Series: AI Agents & MCP
Publisher: Independently Published
Published: Sep 6 2026
Pages: 210
Weight: 0.57
Height: 0.53 Width: 6.00 Depth: 9.00
Language: English
An AI model can explain a failed pipeline, draft SQL, and suggest a data contract[cite: 1]. However, none of those acts establishes that it should be allowed to change production[cite: 1]. As the enterprise AI landscape shifts heavily toward AgentOps and secure multi-agent workflows, the biggest challenge is no longer making AI smarter-it is building the strict environment that controls it.
Harness Engineering for Data Agents on Databricks is the definitive guide to designing the runtime and control environment in which model reasoning can safely become action[cite: 1]. Instructions shape behavior, but controls constrain behavior[cite: 1]. This book teaches you how to separate the model's probabilistic reasoning from the deterministic execution plane of your data platform[cite: 1].
Through the lens of a real-world payment company case study[cite: 1], author Leandro Calado[cite: 1] provides a deep dive into building reliable agentic data platforms[cite: 1]. You will learn how to build a harness that owns tool discovery, identity, context selection, stopping conditions, and budgets[cite: 1].
Inside this book, you will master:
- The Minimum Agency Principle: Learn to use the minimum amount of agency necessary to solve the problem[cite: 1].
- Multi-Agent Orchestration Patterns: Coordinate specialized roles like the Requirements Agent, Catalog Agent, and SQL Agent through typed, immutable handoffs[cite: 1].
- Building an MCP Gateway: Use the Model Context Protocol to expose versioned tools, authenticate callers, authorize each call, and enforce time and cost limits[cite: 1].
- Databricks Implementation: Leverage Unity Catalog as the governance and platform boundary[cite: 1]. Use Lakeflow Jobs for workflow automation and Delta Lake for transactional safety and atomic commits[cite: 1].
- The Production Autonomy Budget: Calculate operational blast radius and risk to dynamically route agent decisions to EXECUTE, PREPARE_FOR_APPROVAL, RECOMMEND_ONLY, or DENY[cite: 1].
- Data Contracts & Verification: Treat data contracts as versioned, machine-enforceable agreements[cite: 1]. Implement independent quality gates that evaluate program, data, and business correctness before promotion[cite: 1].
Harness Engineering for Data Agents on Databricks shows you how to stop treating unconstrained conversation as operational authority[cite: 1]. If you are ready to build the autonomous data platform of the future without sacrificing governance and security[cite: 1], this book provides the architecture, code, and operational rigor to get you there.
Also from
Calado, Leandro
Practical LLM Engineering with Python: Build AI Agents, RAG Pipelines, MCP Servers, and Production AI Applications
Calado, Leandro
Paperback
AI Employees: How to Automate Gmail, Jira & Figma with MCP Agents (Even If You Can't Code)
Calado, Leandro
Paperback
AWS Data Engineer's Handbook: Master the 13 Essential Services with Python and Ubuntu in Your Veins
Calado, Leandro
Paperback
Nobody Told It to Lie: The True Story of the Rogue AI Agent That Invented Two Humans and Tried to Plant Malware on GitHub
Calado, Leandro
Paperback
Amazon SEO Strategy: A Practical Guide to Ranking Higher Using Amazon's A10 Algorithm
Calado, Leandro
Paperback
Also in
Databases
Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems
Riccomini, Chris
Kleppmann, Martin
Paperback
Fundamentals of Data Engineering: Plan and Build Robust Data Systems
Housley, Matt
Reis, Joe
Paperback
Observability Engineering: Achieving Production Excellence
Fong-Jones, Liz
Miranda, George
Majors, Charity
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Hardcover
The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling
Kimball, Ralph
Ross, Margy
Paperback
Introduction to Statistics: An Intuitive Guide for Analyzing Data and Unlocking Discoveries
Frost, Jim
Paperback
Ai-Assisted Statistics for Data Scientists: 50+ Essential Concepts Using R and Python
Bruce, Peter
Bruce, Andrew
Gedeck, Peter
Paperback
Inteligencia Artificial Con Python: Sistemas de aprendizaje, Machine Learning y Deep Learning explicados de forma clara y práctica.
Selles Rodenas, Juan Ignacio
Paperback
The Data Storyteller's Handbook: How to create business impact using data storytelling
Greenbrook, Kat
Paperback
Learning Tableau 2025 - Sixth Edition: Leverage Tableau's newest features to revolutionize your data storytelling with AI-enhanced insights
Milligan, Joshua N.
Paperback
Database Systems: Introduction to Databases and Data Warehouses, Edition 2.0
Sharma, Abhishek
Jukic, Nenad
Vrbsky, Susan
Paperback
Head First Algorithms and Data Structures: A Learner's Guide to the Foundations of Computing
Freeman, Eric
Robson, Elisabeth
Paperback
Microsoft Power Bi Data Analyst Associate Study Guide: Prepare for the Pl-300 Exam and Use Power Bi Successfully
Turley, Paul
Paperback
High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark
Warren, Rachel
Karau, Holden
Polak, Adi
Paperback
SQL for Data Analysis: Advanced Techniques for Transforming Data Into Insights
Tanimura, Cathy
Paperback
Data Engineering Design Patterns: Recipes for Solving the Most Common Data Engineering Problems
Konieczny, Bartosz
Paperback
Mathletics: How Gamblers, Managers, and Fans Use Mathematics in Sports, Second Edition
Nestler, Scott
Pelechrinis, Konstantinos
Winston, Wayne L.
Paperback
Data Engineering for Cybersecurity: Build Secure Data Pipelines with Free and Open-Source Tools
Bonifield, James
Paperback
Becoming a Data Head: How to Think, Speak, and Understand Data Science, Statistics, and Machine Learning
Goldmeier, Jordan
Gutman, Alex J.
Paperback
Product Operations: How successful companies build better products at scale
Perri, Melissa
Tilles, Denise
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Paperback
Observability Engineering: Achieving Production Excellence
Fong-Jones, Liz
Miranda, George
Majors, Charity
Paperback
SQL Server 2025 Unveiled: The Ai-Ready Enterprise Database with Microsoft Fabric Integration
Ward, Bob
Paperback
Databricks Certified Data Engineer Associate Study Guide: In-Depth Guidance and Practice
Alhussein, Derar
Paperback
PR Technology, Data and Insights: Igniting a Positive Return on Your Communications Investment
Weiner, Mark
Paperback
Databricks Data Intelligence Platform: Unlocking the Genai Revolution
Gupta, Nikhil
Yip, Jason
Paperback
Kafka: The Definitive Guide: Real-Time Data and Stream Processing at Scale
Palino, Todd
Sivaram, Rajini
Shapira, Gwen
Paperback
Microsoft Power Bi Visual Calculations: Simplifying Dax
Lelijveld, Marc
Ter Heerdt, Jeroen
Stikkelorum, Madzy
Paperback
Turning Data into Wisdom: How We Can Collaborate with Data to Change Ourselves, Our Organizations, and Even the World
Hanegan, Kevin
Paperback
iPhone 11 Pro Max Guide: Learn Step-By-Step How To Use Your iPhone Pro Max Step-By-Step
Meyer, Albrecht
Paperback
SQL Cookbook: Query Solutions and Techniques for All SQL Users
Molinaro, Anthony
Graaf, Robert de
Paperback
ML and Generative AI in the Data Lakehouse: Building and Deploying AI Applications at Scale
Haelen, Bennie
Paperback
Foundations of Deep Reinforcement Learning: Theory and Practice in Python
Graesser, Laura
Keng, Wah Loon
Paperback
High Performance Python: Practical Performant Programming for Humans
Gorelick, Micha
Ozsvald, Ian
Paperback
Data Contracts: Developing Production-Grade Pipelines at Scale
Sanderson, Chad
Schmidt, B. E.
Freeman, Mark
Paperback
Non-Invasive Data Governance: The Path of Least Resistance and Greatest Success
Seiner, Robert
Paperback
Data Analytics Made Easy: Analyze and present data to make informed decisions without writing any code
Mauro, Andrea de
Paperback
The Data Center as a Computer: Designing Warehouse-Scale Machines
Hölzle, Urs
Ranganathan, Parthasarathy
Barroso, Luiz André
Hardcover
Ai-Ready Data Blueprints: From Raw Data to Ai-Driven Innovation
Pham, Kien
Sopirala, Srikanth
Shukla, Navnit
Paperback
Kafka for Architects: Event-Driven Architecture, Logs, Microservices, Real-Time Event Processing
Gorshkova, Katya
Paperback
Numerical Python: Scientific Computing and Data Science Applications with Numpy, Scipy and Matplotlib
Johansson, Robert
Paperback
Data Governance with Unity Catalog on Databricks: Implement Data and AI Governance with Databricks Data Intelligence Platform
Subbarao, Karthik
Sreekumar, Kiran
Paperback
Hands-On Data Analysis with Pandas: Efficiently perform data collection, wrangling, analysis, and visualization using Python
Molin, Stefanie
Paperback
Data Pipelines with Apache Airflow, Second Edition: Orchestration for Data and AI
Ruiter, Julian de
Cabral, Ismael
Geusebroek, Kris
Paperback
SQL Server 2025 Query Performance Tuning: Troubleshoot and Optimize Query Performance
Fritchey, Grant
Paperback
Advanced Snowflake: Processing Data, Developing Applications, and Deploying ML Models at Scale
Ullah, Muhammad Fasih
Paperback
Data Center Critical Facilities Migration from Construction to Operations
K. Tidjani, Yekini
Paperback
Learning Statistics with Jamovi: A Tutorial for Beginners in Statistical Analysis
Foxcroft, David
Navarro, Danielle
Paperback
Data Analytics & Visualization All-In-One for Dummies
Hyman, Jack A.
McFedries, Paul
Massaron, Luca
Paperback
Practical Natural Language Processing: A Comprehensive Guide to Building Real-World Nlp Systems
Majumder, Bodhisattwa
Gupta, Anuj
Vajjala, Sowmya
Paperback
Apache Iceberg: The Definitive Guide: Data Lakehouse Functionality, Performance, and Scalability on the Data Lake
Merced, Alex
Shiran, Tomer
Hughes, Jason
Paperback
Learning Ransomware Response & Recovery: Stopping Ransomware One Restore at a Time
Preston, W. Curtis
Saylor, Michael
Paperback
Diseño de Bases de Datos - Un enfoque práctico: Aprende a diseñar bases de datos desde el modelo conceptual hasta el modelo relacional con esta guía p
Garrido Barrientos, Sergio
Paperback
Delta Lake: The Definitive Guide: Modern Data Lakehouse Architectures with Data Lakes
Haines, Scott
Lee, Denny
Wentling, Tristen
Paperback
Real-Time Intelligence with Microsoft Fabric: Empowering Data-Driven Decisions in the Era of AI
Geisler, Frank
Brattã S. Johan Ludvig
Paperback
Diseño de Aplicaciones Con USO Intensivo En Datos (Spanish Edition): Las Grandes Ideas Detrás de Los Sistemas Confiables, Escalables Y Mantenibles
Kleppmann, Martin
Riccomini, Chris
Paperback
The Data Product Playbook: Designing and Delivering Data Products that Power Decisions, Analytics, and AI
Koenders, Willem
Paperback
Agile Data Warehouse Design: Collaborative Dimensional Modeling, from Whiteboard to Star Schema
Corr, Lawrence
Stagnitto, Jim
Paperback
Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World, 3rd Edition
Kent, William
Paperback
Data Governance Change Management: From Drift to Direction-Why Every Data Leader Needs an ANCHOR
Agrawal, Arvind
Agrawal, Aakriti
Paperback
Big Data in Der Mobilität: Akteure, Geschäftsmodelle Und Nutzenpotenziale Für Die Welt Von Morgen
Knorre, Susanne
Müller-Peters, Horst
Gatzert, Nadine
Paperback
Introduction to Statistics: An Intuitive Guide for Analyzing Data and Unlocking Discoveries
Frost, Jim
Hardcover
Football Analytics with Python & R: Learning Data Science Through the Lens of Sports
Eager, Eric A.
Erickson, Richard a.
Paperback
Mastering PostgreSQL 17 - Sixth Edition: Elevate your database skills with advanced deployment, optimization, and security strategies
Schönig, Hans-Jürgen
Paperback
Apache Hudi: The Definitive Guide: Building Robust, Open, and High-Performing Data Lakehouses
Wason, Prashant
Saktheeswaran, Bhavani Sudha
Xu, Shiyan
Paperback
Building Data Integration Solutions: Unifying Data for Enhanced Decision Making
Borthen, Jay
Paperback
Data Modeling with Microsoft Power BI: Self-Service and Enterprise Data Warehouse with Power BI
Ehrenmueller-Jensen, Markus
Paperback
The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition
Tibshirani, Robert
Friedman, Jerome
Hastie, Trevor
Hardcover
Everybody Lies: Big Data, New Data, and What the Internet Can Tell Us about Who We Really Are
Stephens-Davidowitz, Seth
Paperback
Practical Mlflow for Generative AI on Databricks: Build High-Quality AI Agents from Prompt Design to Production
Ganganath, Nuwan
Lim, Chang Shi
Nguyen, Julie
Paperback
SQL in a Week: A Fast-Track Guide to Writing and Optimizing Queries Like a Pro
Dubey, Devtosh
Shah, Bhumika
Paperback
Apache Polaris: The Definitive Guide: Enriching Apache Iceberg Data Lakehouses with an Open Source Catalog
Merced, Alex
Shiran, Tomer
Madson, Andrew
Paperback
Fusion Strategy: How Real-Time Data and AI Will Power the Industrial Future
Venkatraman, Venkat
Govindarajan, Vijay
Hardcover
How to Interpret Data: Using Data to Improve Your Influence and Decision-Making
Kelly, Nicholas
Paperback
SQL for Data Analytics - Fourth Edition: Analyze data effectively, uncover insights and master advanced SQL for real-world applications
Li, Haibin
Goldwasser, Matt
Shan, Jun
Paperback
PostgreSQL 16 Administration Cookbook: Solve real-world Database Administration challenges with 180+ practical recipes and best practices
Ciolli, Gianni
Mejías, Boriss
Angelakos, Jimmy
Paperback
Architecting an Apache Iceberg Lakehouse: A Scalable, Open-Source Data Platform
Merced, Alex
Paperback
Unlocking Dbt: Design and Deploy Transformations in Your Cloud Data Warehouse
Dorsey, Dustin
Cyr, Cameron
Paperback
The Data Engineer's Guide to Microsoft Fabric: Building Modern Lakehouse Solutions
Reich, Christian Henrik
Paperback
Stream Processing with Apache Flink: Fundamentals, Implementation, and Operation of Streaming Applications
Kalavri, Vasiliki
Hueske, Fabian
Paperback
Databricks Data Intelligence Platform: Powering the Agentic Era
Yip, Jason
Gupta, Nikhil
Wojtyczka, Marcin
Paperback
The Expert's Guide to SQL Server: Tuning, Security, and Cloud Migration
Pasam, Venkata Reddy
Andiappan, Petchikumar
Paperback
The Definitive Guide to Microsoft Fabric: From discovery to building a unified, secure, and scalable data platform
Maneu, Christopher
Beau, Emilie
Riehl, Jean-Pierre
Paperback
R in Action, Third Edition: Data Analysis and Graphics with R and Tidyverse
Kabacoff, Robert I.
Paperback
SAP S/4hana Financial Accounting Certification Guide: Application Associate Exam
Pougkas, Stefanos
Paperback
A Comprehensive Introduction to Python: From the Basics to Data Analytics: From the Basics to Data Analytics
Masloff, Jackie
Paperback
Analytics Engineering with SQL and Dbt: Building Meaningful Data Models at Scale
Russa, Hélder
Machado, Rui
Paperback
Data Strategy: How to Use Data and Artificial Intelligence to Transform Your Business
Marr, Bernard
Paperback
Learn PostgreSQL - Second Edition: Use, manage and build secure and scalable databases with PostgreSQL 16
Ferrari, Luca
Pirozzi, Enrico
Paperback
Practical Data Structures and Algorithms for Java Developers: From Fundamentals to Real-World Engineering
Davidovich, Mikhail
Paperback
Behind Every Good Decision: How Anyone Can Use Business Analytics to Turn Data Into Profitable Insight
Jain, Piyanka
Sharma, Puneet
Paperback
Numerical Python: Scientific Computing and Data Science Applications with Numpy, Scipy and Matplotlib
Johansson, Robert
Paperback
Natural Language Processing with Pytorch: Build Intelligent Language Applications Using Deep Learning
McMahan, Brian
Rao, Delip
Paperback