Sign-In
Cart
NVIDIA GPU Microarchitecture and Optimization: Mastering CUDA Kernels, Parallel Execution, Memory Hierarchy, Warp Scheduling, Profiling, and Workload
Paperback
Series: The Modern Engineer's Library
Publisher: Independently Published
Published: Sep 17 2026
Pages: 270
Weight: 1.39
Height: 0.57 Width: 8.50 Depth: 11.00
Language: English
Have you ever pushed a CUDA kernel into production, watched the profiler, and quietly wondered why it's only using a fraction of the GPU you paid for?
You're not alone. Most engineers learn just enough parallel programming to get something working, then hit a wall the moment they need it to actually perform. The gap between it runs and it's fast isn't a syntax problem. It's a hardware understanding problem. And that's exactly what this book is built to close.
This isn't another surface-level tutorial that shows you how to launch a kernel and calls it a day. This is a complete, ground-up education in how modern GPU hardware actually thinks, so that every optimization decision you make afterward is grounded in real understanding instead of guesswork and copy-pasted tricks from forum posts.
So let me ask you a few honest questions:
Do you actually know what a warp is doing when your threads diverge, or are you just hoping the compiler handles it? Can you look at a kernel's memory access pattern and predict, before you even run it, whether it'll hit the bandwidth ceiling? Do you know the difference between a kernel that's compute bound and one that's memory bound, and why that distinction should completely change how you optimize it? If any of those questions gave you pause, this book was written for you.
Inside, you'll build a real mental model of the hardware itself: streaming multiprocessors, the memory hierarchy from registers down to global memory, and the scheduling logic that determines whether your GPU is actually busy or just spinning its wheels. From there, the book walks you through the full programming model step by step, thread and block organization, warp-level execution, and the exact indexing patterns that separate a kernel that merely works from one that's genuinely efficient.
You'll spend real time inside the memory system, because that's where most performance is won or lost. Coalesced access, shared memory tiling, bank conflicts, register pressure, and the caching behavior that quietly shapes every kernel you write. You'll learn to read a profiler's output the way a mechanic reads an engine, spotting exactly where cycles are being wasted and why.
Then the book moves into territory a lot of guides skip entirely: concurrency and streams, multi-GPU scaling, tensor core programming, mixed precision training, and quantization for inference. If you're working anywhere near machine learning infrastructure, scientific computing, or large-scale data processing, these chapters alone are worth the price of admission.
And because knowing a technique isn't the same as knowing when to use it, the book closes with hands-on capstone projects, a custom convolution kernel, a scientific simulation, a full inference pipeline, and a multi-GPU scaling exercise, each one built the same way real optimization work actually happens: start naive, profile honestly, fix what the data tells you to fix, and measure again.
Here's what you won't find in this book: recycled documentation, filler chapters, or vague advice to just try different block sizes. Every technique is explained with the reasoning behind it, so that when the next generation of hardware ships, you're not starting over. You'll already know how to think about it.
Who is this actually for? Software engineers moving into performance-critical roles. Machine learning practitioners who want to understand what's happening beneath their framework of choice. Computer science students who want an edge going into systems or infrastructure roles. And working GPU programmers who know the basics but have never had the hardware explained to them properly, the way this book explains it.
If you're ready to stop guessing and start actually understanding the hardware you're programming for, this is where that starts. Scroll up, and let's get into it.
Also in
Programming
Interactive Theorem Proving and Program Development: Coq'art: The Calculus of Inductive Constructions
Castéran, Pierre
Bertot, Yves
Hardcover
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Collector's Edition
Piggyback
Hardcover
Python Crash Course, 3rd Edition: A Hands-On, Project-Based Introduction to Programming
Matthes, Eric
Paperback
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Standard Edition
Piggyback
Paperback
Crisis Engineering: Time-Tested Tools for Turning Chaos Into Clarity
Dickerson, Mikey
Nitze, Marina
Weaver, Matthew
Paperback
Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations
Humble, Jez
Kim, Gene
Forsgren Phd, Nicole
Paperback
Embedded Systems with ARM Cortex-M Microcontrollers in Assembly Language and C: Fourth Edition
Zhu, Yifeng
Paperback
Fundamentals of Software Architecture: A Modern Engineering Approach
Richards, Mark
Ford, Neal
Paperback
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
Vibe Coding: Building Production-Grade Software with Genai, Chat, Agents, and Beyond
Yegge, Steve
Kim, Gene
Paperback
AI Projects with Raspberry Pi: High-Performance Artificial Intelligence for Robotics, Security, Home Automation, and Vision
Jepson, Brian
Hattersley, Lucy
Paperback
The Manager's Path: A Guide for Tech Leaders Navigating Growth and Change
Fournier, Camille
Paperback
I Have an App Idea: The Essential Guide to Building an App Without Tech Skills
Spann, Amanda
Paperback
The Return on AI: From Promise to Profit in the Age of Intelligent Business
Sawhney, Mohanbir
Mittal, Ashwin
Paperback
The Devops Handbook, 2nd Edition: How to Create World-Class Agility, Reliability, & Security in Technology Organizations
Kim, Gene
Humble, Jez
Debois, Patrick
Paperback
The Staff Engineer's Path: A Guide for Individual Contributors Navigating Growth and Change
Reilly, Tanya
Paperback
The Developer's Guide to AI: A Field Guide for the Working Developer
Thompson, Danny
Orshalick, Jacob
Reghunadh, Jerry M.
Paperback
Building Applications with AI Agents: Designing and Implementing Multiagent Systems
Albada, Michael
Paperback
Software Architecture: The Hard Parts: Modern Trade-Off Analyses for Distributed Architectures
Richards, Mark
Sadalage, Pramod
Ford, Neal
Paperback
Cracking the Coding Interview: 189 Programming Questions and Solutions
McDowell, Gayle Laakmann
Paperback
Observability Engineering: Achieving Production Excellence
Fong-Jones, Liz
Miranda, George
Majors, Charity
Paperback
Forecasting: Principles and Practice, the Pythonic Way
Hyndman, Rob J.
Athanasopoulos, George
Paperback
Learning Web Design: A Beginner's Guide to Html, Css, Javascript, and Web Images
Robbins, Jennifer
Paperback
The New AI Cold War: Liberty vs. Tyranny in the Age of Machine Empires
Maginnis, Ltc Robert L.
Paperback
Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
The Pragmatic Programmer: Your Journey to Mastery, 20th Anniversary Edition
Thomas, David
Hunt, Andrew
Hardcover
Building Safer Technology: A Field Guide to Failing Well
Kissner, Lea
Zunger, Yonatan
Coles, Neil
Paperback
A Human's Guide to Machine Intelligence: How Algorithms Are Shaping Our Lives and How We Can Stay in Control
Hosanagar, Kartik
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Hardcover
Grokking Algorithms, Second Edition: An Illustrated Guide for Programmers and Other Curious People
Bhargava, Aditya Y.
Paperback
Generative AI Design Patterns: Solutions to Common Challenges When Building Genai Agents and Applications
Hapke, Hannes
Lakshmanan, Valliappa
Paperback
The Official Raspberry Pi Handbook 2026: Astounding Projects with Raspberry Pi Computers
Makers of Raspberry Pi Official Magazine, The
Paperback
Concrete Mathematics: A Foundation for Computer Science
Patashnik, Oren
Knuth, Donald
Graham, Ronald
Hardcover
Learning Domain-Driven Design: Aligning Software Architecture and Business Strategy
Khononov, Vlad
Paperback
Site Reliability Engineering: How Google Runs Production Systems
Beyer, Betsy
Jones, Chris
Leng, Christof
Paperback
Head First Design Patterns: Building Extensible and Maintainable Object-Oriented Software
Robson, Elisabeth
Freeman, Eric
Paperback
The Software Architect Elevator: Redefining the Architect's Role in the Digital Enterprise
Hohpe, Gregor
Paperback
Learning Generative AI Tools for Excel: Speed Up Your Everyday Tasks with Microsoft Excel, Copilot, Chatgpt, and Beyond
Duca, Angelica Lo
Paperback
Arduino Programming for Beginners: A Comprehensive Beginner's Guide to Learn the Realms of Arduino Programming from A-Z
Protosmith, Ada
Paperback
Building AI-Powered Products: The Essential Guide to AI and Genai Product Management
Nika, Marily
Paperback
Building Resilient Distributed Systems: Patterns and Practices for Stable Software
Newman, Sam
Paperback
Frictionless: 7 Steps to Remove Barriers, Unlock Value, and Outpace Your Competition in the AI Era
Noda, Abi
Forsgren, Nicole
Paperback
Debugging: The 9 Indispensable Rules for Finding Even the Most Elusive Software and Hardware Problems
Agans, David J.
Paperback
Build an AI Agent (from Scratch): Agents That Reason, Plan, and ACT Autonomously
Hur, Jungjun
Song, Younghee
Paperback
AI Agents with MCP: Model Context Protocol for Building Clients, Servers, and End-To-End Agents
Stratis, Kyle
Paperback
Signals & Levers: Systems Thinking Tools to Unblock Software Delivery
Tosi, Joel
Hendrickson, Elisabeth
Paperback
Software Engineering at Google: Lessons Learned from Programming Over Time
Winters, Titus
Manshreck, Tom
Wright, Hyrum
Paperback
Living a Jewish Life, Revised and Updated: Jewish Traditions, Customs, and Values for Today's Families
Cooper, Howard
Diamant, Anita
Paperback
Learning Php, MySQL & JavaScript: A Step-By-Step Guide to Creating Dynamic Websites
Nixon, Robin
Paperback
Python Programming for Young Coders: A Hands-On, Project-Based Introduction to Coding for Beginners, Kids, and Teens
Pandey, Anand
Paperback
Java in a Nutshell: A Desktop Quick Reference
Flanagan, David
Evans, Benjamin J.
Clark, Jason R.
Paperback
Programming Massively Parallel Processors: A Hands-On Approach
Hwu, Wen-Mei W.
Kirk, David B.
El Hajj, Izzat
Paperback
Computer Science from Scratch: Building Interpreters, Art, Emulators and ML in Python
Kopec, David
Paperback
Adobe Photoshop, 2nd Edition: A Complete Course and Compendium of Features
Laskevitch, Stephen
Paperback
Kubernetes in Action, Second Edition: Deploying and Managing Containers and Cloud-Native Applications
Conner, Kevin
Luksa, Marko
Paperback
Electronic Music and Sound Design - Theory and Practice with Max 9 - Volume 1 (Fifth Edition)
Maurizio, Giri
Cipriani, Alessandro
Paperback
Practical AI Security: A Hands-On Guide to Attacking, Defending, and Securing Modern AI Systems
Farlow, Harriet
Paperback