Sign-In
Cart
Noise Floor: Measure agentic coding regressions across pinned Claude Code and OpenAI Codex versions, for forward deployed engineers
Paperback
Series: Prove It Works, Book 3
Publisher: Independently Published
Published: Aug 7 2026
Pages: 424
Weight: 1.66
Height: 0.86 Width: 7.44 Depth: 9.69
Language: English
India Today reported on 2026-07-10 that this job can pay up to a million dollars a year - the same role The Economic Times reported at $200,000 two months earlier, and because that article body would not fetch, whether the million is base pay, total compensation or one outlier package is unresolved. Anthropic posts no such title at all; the phrase appears in a requirements bullet on its posting for Head of Applied AI Architecture, which states $315,000 to $380,000.
The Wall Street Journal, 2026-07-19: The hottest job in tech isn't very glamorous. You fly to somebody else's office, log into a network you do not control, and make their mess produce something.
Somebody senior at the customer says the agent got worse this week. You updated the CLI on Tuesday, the customer changed a repo, the vendor shipped four releases, and nobody in the building can tell. That argument has been had in public with no instrument in the room: four Hacker News threads on it took 4,151 points between them, and not one supplies a pinned version pair, a repeat count, or a command a stranger could run. A GitHub repository search for claude code benchmark degradation returns two repositories, one star each. The vendor settled the factual half: Anthropic's April 23 postmortem confirms a real degradation with three root causes and says it took us over a week to discover and confirm the root cause. At least one cause is server-side, which a client-version bisect cannot see.
So this book does not promise to find the regression you are angry about, and here is the limit up front. No agent ran anywhere in this book. The machine it was written on had no API key and no budget, so every program that spends money - measure.sh, arms.sh, step.sh, the model-graded judge.py - ships written, syntax-checked and never executed, and every pass rate, delta, floor and dollar figure printed here came out of a seeded coin or a number I typed, labelled a fixture on its own page. Chapter 11 says it in one line: No pin was installed. No agent ran.
What you build across seventeen chapters is bench. One fixed task suite, shipped whole. Hermetic runs under Claude Code and OpenAI Codex at versions you pin on purpose, into one store whose grain is the version. Mechanical graders, because no model grades another model. A cost writer that will not sum across billing bases. A noise floor for your own suite on your own machine class, carrying the repeat count and interval that earned it. A bisect over adjacent pinned releases. A Regression Packet with one minimal command a stranger runs without asking a question. And bench/dash.py, rendering a self-contained page whose chart draws the floor as a shaded band with both version strings and the p-value inside it.
What is proven is narrower. The contamination arithmetic that decides how many repeats your question needs is exact and offline. The graders, the store, the verdict logic, the redaction pass, the packet and issue generators and the dashboard renderer all run offline here, and every output printed beside them was diffed against a real run. So do its refusals. reports/no-boundary-found.md ships in the repository root, verdict line NO BOUNDARY FOUND, because a rig that can only find regressions is not an instrument.
The first pages list what you cannot have. No root cause. No determinism - there is no temperature=0 on the models this rig is pointed at. No cross-runtime dollar total, because the Codex side meters in credits with no documented per-run readout. Every version, price, flag, URL and thread id traces to an official page with the date it was verified. ./verify.sh re-derives what the book's programs print from its own fixtures, offline, in seconds; it asserts nothing about your machine, and an appendix names the three further tiers it does not do.
Also from
Vale, Ravi
It Doesn't Remember You: Why AI Forgets You, Invents Facts, and How to Finally Trust It
Vale, Ravi
Paperback
USB-C for Agents: AI Agent Tool Use, Function Calling, and MCP Servers Done Right
Vale, Ravi
Paperback
The Verifier's Advantage: How Leaders Verify AI Work and Turn Trust Into Advantage
Vale, Ravi
Paperback
Agents You Can Leave Running: How to Engineer Agentic Loops You Can Trust Unattended
Vale, Ravi
Paperback
Claude Code: The Fleet: Long-Horizon Autonomy, Multi-Agent Systems, and Production Scale
Vale, Ravi
Paperback
Claude Code: The Reliability Playbook: Real Projects, Patterns, and Bounded Autonomy
Vale, Ravi
Paperback
Stop Prompting, Start Designing: Build No-Code AI Agents That Finish the Job Without You
Vale, Ravi
Paperback
The 15x Problem: How AI Inference Cost Became 85% of the Bill, and the Controls That Tame It
Vale, Ravi
Paperback
The Inversion: First Principles for Building Software When Intelligence Is Cheap and Trust Is Not
Vale, Ravi
Paperback
The Verification Stack: Specs, Gates, Judges, and Escalation for AI Output That Has to Be Right
Vale, Ravi
Paperback
The Delegation Ladder: Engineering Human Oversight of Autonomous Work, from Ten Minutes to a Week
Vale, Ravi
Paperback
The Context Window Is a Budget: Context Engineering for Reliable AI Agents and Long-Horizon Work
Vale, Ravi
Paperback
The Second Opinion on AI: How to Catch the Confident-Wrong AI Answer in Medicine, Law, and Science
Vale, Ravi
Paperback
Done Is a Function You Write: Eval-Driven Development for LLMs You Can Actually Trust
Vale, Ravi
Paperback
Also in
Programming
Interactive Theorem Proving and Program Development: Coq'art: The Calculus of Inductive Constructions
Bertot, Yves
Castéran, Pierre
Hardcover
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Collector's Edition
Piggyback
Hardcover
Python Crash Course, 3rd Edition: A Hands-On, Project-Based Introduction to Programming
Matthes, Eric
Paperback
Crisis Engineering: Time-Tested Tools for Turning Chaos Into Clarity
Weaver, Matthew
Dickerson, Mikey
Nitze, Marina
Paperback
Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations
Humble, Jez
Kim, Gene
Forsgren Phd, Nicole
Paperback
Embedded Systems with ARM Cortex-M Microcontrollers in Assembly Language and C: Fourth Edition
Zhu, Yifeng
Paperback
Vibe Coding: Building Production-Grade Software with Genai, Chat, Agents, and Beyond
Yegge, Steve
Kim, Gene
Paperback
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Standard Edition
Piggyback
Paperback
Fundamentals of Software Architecture: A Modern Engineering Approach
Ford, Neal
Richards, Mark
Paperback
I Have an App Idea: The Essential Guide to Building an App Without Tech Skills
Spann, Amanda
Paperback
AI Projects with Raspberry Pi: High-Performance Artificial Intelligence for Robotics, Security, Home Automation, and Vision
Hattersley, Lucy
Jepson, Brian
Paperback
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
The Manager's Path: A Guide for Tech Leaders Navigating Growth and Change
Fournier, Camille
Paperback
The Devops Handbook, 2nd Edition: How to Create World-Class Agility, Reliability, & Security in Technology Organizations
Debois, Patrick
Kim, Gene
Humble, Jez
Paperback
Building Applications with AI Agents: Designing and Implementing Multiagent Systems
Albada, Michael
Paperback
The Developer's Guide to AI: A Field Guide for the Working Developer
Thompson, Danny
Orshalick, Jacob
Reghunadh, Jerry M.
Paperback
The Staff Engineer's Path: A Guide for Individual Contributors Navigating Growth and Change
Reilly, Tanya
Paperback
Learning Web Design: A Beginner's Guide to Html, Css, Javascript, and Web Images
Robbins, Jennifer
Paperback
Cracking the Coding Interview: 189 Programming Questions and Solutions
McDowell, Gayle Laakmann
Paperback
The New AI Cold War: Liberty vs. Tyranny in the Age of Machine Empires
Maginnis, Ltc Robert L.
Paperback
Software Architecture: The Hard Parts: Modern Trade-Off Analyses for Distributed Architectures
Ford, Neal
Richards, Mark
Sadalage, Pramod
Paperback
The Return on AI: From Promise to Profit in the Age of Intelligent Business
Mittal, Ashwin
Sawhney, Mohanbir
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Hardcover
Observability Engineering: Achieving Production Excellence
Miranda, George
Majors, Charity
Fong-Jones, Liz
Paperback
The Pragmatic Programmer: Your Journey to Mastery, 20th Anniversary Edition
Hunt, Andrew
Thomas, David
Hardcover
Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
The Official Raspberry Pi Handbook 2026: Astounding Projects with Raspberry Pi Computers
Makers of Raspberry Pi Official Magazine, The
Paperback
Forecasting: Principles and Practice, the Pythonic Way
Athanasopoulos, George
Hyndman, Rob J.
Paperback
Generative AI Design Patterns: Solutions to Common Challenges When Building Genai Agents and Applications
Lakshmanan, Valliappa
Hapke, Hannes
Paperback
Head First Design Patterns: Building Extensible and Maintainable Object-Oriented Software
Robson, Elisabeth
Freeman, Eric
Paperback
Frictionless: 7 Steps to Remove Barriers, Unlock Value, and Outpace Your Competition in the AI Era
Forsgren, Nicole
Noda, Abi
Paperback
Arduino Programming for Beginners: A Comprehensive Beginner's Guide to Learn the Realms of Arduino Programming from A-Z
Protosmith, Ada
Paperback
Concrete Mathematics: A Foundation for Computer Science
Knuth, Donald
Graham, Ronald
Patashnik, Oren
Hardcover
Building AI-Powered Products: The Essential Guide to AI and Genai Product Management
Nika, Marily
Paperback
Grokking Algorithms, Second Edition: An Illustrated Guide for Programmers and Other Curious People
Bhargava, Aditya Y.
Paperback
Debugging: The 9 Indispensable Rules for Finding Even the Most Elusive Software and Hardware Problems
Agans, David J.
Paperback
Learning Domain-Driven Design: Aligning Software Architecture and Business Strategy
Khononov, Vlad
Paperback
Learning Generative AI Tools for Excel: Speed Up Your Everyday Tasks with Microsoft Excel, Copilot, Chatgpt, and Beyond
Duca, Angelica Lo
Paperback
Site Reliability Engineering: How Google Runs Production Systems
Jones, Chris
Beyer, Betsy
Murphy, Niall Richard
Paperback
The Software Architect Elevator: Redefining the Architect's Role in the Digital Enterprise
Hohpe, Gregor
Paperback
Python Programming for Young Coders: A Hands-On, Project-Based Introduction to Coding for Beginners, Kids, and Teens
Pandey, Anand
Paperback
Computer Science from Scratch: Building Interpreters, Art, Emulators and ML in Python
Kopec, David
Paperback
Learning Php, MySQL & JavaScript: A Step-By-Step Guide to Creating Dynamic Websites
Nixon, Robin
Paperback
Building Safer Technology: A Field Guide to Failing Well
Coles, Neil
Kissner, Lea
Zunger, Yonatan
Paperback
Software Engineering at Google: Lessons Learned from Programming Over Time
Wright, Hyrum
Winters, Titus
Manshreck, Tom
Paperback
Prompt Engineering for Llms: The Art and Science of Building Large Language Model-Based Applications
Ziegler, Albert
Berryman, John
Paperback
Living a Jewish Life, Revised and Updated: Jewish Traditions, Customs, and Values for Today's Families
Diamant, Anita
Cooper, Howard
Paperback
Articulating Design Decisions: Communicate with Stakeholders, Keep Your Sanity, and Deliver the Best User Experience
Greever, Tom
Paperback
Pro C# 10 with .Net 6: Foundational Principles and Practices in Programming
Japikse, Phil
Troelsen, Andrew
Paperback
Adobe Photoshop, 2nd Edition: A Complete Course and Compendium of Features
Laskevitch, Stephen
Paperback
Spies, Lies, and Algorithms: The History and Future of American Intelligence
Zegart, Amy B.
Paperback
Build an AI Agent (from Scratch): Agents That Reason, Plan, and ACT Autonomously
Hur, Jungjun
Song, Younghee
Paperback
Kubernetes in Action, Second Edition: Deploying and Managing Containers and Cloud-Native Applications
Conner, Kevin
Luksa, Marko
Paperback
Electronic Music and Sound Design - Theory and Practice with Max 9 - Volume 1 (Fifth Edition)
Cipriani, Alessandro
Maurizio, Giri
Paperback