Sign-In
Cart
Advanced GPU Assembly Programming Third Edition: A Technical Reference for NVIDIA and AMD Architectures
Paperback
Series: Gpu Expert Engineering: Mastering Design, Programming, and Optimization
Publisher: Independently Published
Published: Jul 8 2026
Pages: 386
Weight: 1.97
Height: 0.80 Width: 8.50 Depth: 11.00
Language: English
Advanced GPU Assembly Programming
Most GPU performance problems are not source-code problems. They are machine-code problems.
A kernel can look clean in CUDA or HIP and still lose the war at the hardware level.
The compiler may choose an instruction sequence you did not expect. A branch may split a warp or wavefront into masked paths. A load pattern may explode into extra memory transactions. A tensor pipeline may sit underfed while the code looks mathematically right. Occupancy may look healthy while register pressure, wait states, barriers, cache behavior, or issue slots quietly cap throughput.
That is where this book begins.
Advanced GPU Assembly Programming is for advanced CUDA, HIP, AI-systems, HPC, and compiler engineers who need to read GPU machine code, understand NVIDIA and AMD execution behavior, and push kernels closer to the hardware performance ceiling.
This is not an introductory CUDA book.
It is not a beginner HIP guide.
It is not another surface-level explanation of parallel programming on GPUs.
This is a low-level technical reference for engineers who already understand kernels and now need to understand what those kernels become after compilation.
If you are optimizing AI inference, LLM kernels, GEMM, attention, scientific workloads, compiler output, CUDA-to-HIP portability, or architecture-specific performance, the question is no longer:
Does the kernel run?
The question is:
What is the machine actually doing, and how close is it to the real limit?
Inside, you will learn how to reason about:
- SIMT execution: warps, wavefronts, active masks, divergence, reconvergence, predication, and independent thread scheduling
- Machine code: PTX, SASS, AMD ISA, instruction encoding, disassembly, source correlation, and compiler idioms
- Execution resources: SMs, CUs, schedulers, issue slots, scoreboards, barriers, wait states, register files, and occupancy limits
- Memory behavior: coalescing, global memory, shared memory, LDS, cache policy, HBM bandwidth, alignment, sectors, and bank conflicts
- Tensor and matrix pipelines: tensor cores, MMA, MFMA, TMEM, FP8, FP6, FP4, block scaling, operand staging, and accumulator flow
- Asynchronous execution: cp.async, tensor-memory movement, producer/consumer roles, barriers, staged pipelines, and latency hiding
- Performance evidence: Nsight Compute, Nsight Systems, rocprof, Radeon GPU Profiler, Omniperf, roofline analysis, and microbenchmarking
- Real workloads: high-performance GEMM, attention, reductions, scans, sparse computation, atomics, scatter/gather, and irregular kernels
The value of this book is not that it tells you GPUs are fast.
You already know that.
The value is that it gives you the machinery to diagnose why a kernel is not fast enough.
Why did the compiler emit that instruction sequence?
Why did this memory access pattern create extra traffic?
Why are tensor units idle?
Why did a theoretically good tiling strategy lose throughput?
Why did NVIDIA and AMD behave differently?
Why did a change that looked harmless at source level move the bottleneck somewhere else?
This book helps you connect source code, compiler decisions, disassembly, profiler counters, memory transactions, lane masks, and architectural constraints into one coherent performance model.
Advanced GPU Assembly Programming was written for the engineer who wants the layer beneath CUDA, HIP, Triton, compiler output, and vendor libraries.
Also from
Thomas, Gareth
Electronic Warfare Systems: Volume II: Platforms, Integration and Future Trends
Thomas, Gareth
Paperback
Modern GPU Architecture Third Edition: Volume 1 - Foundations and the Graphics Pipeline
Thomas, Gareth
Paperback
Modern GPU Architecture Third Edition: Volume 2 - Acceleration, Integration, and Physical Design
Thomas, Gareth
Paperback
Robotics Algorithms: From Mathematical Foundations to Real-World Autonomous Systems
Thomas, Gareth
Paperback
Foundations of Cognitive Architectures: Interdisciplinary Models of Cognition for Artificial Intelligence
Thomas, Gareth
Paperback
Cognitive Architectures in the Age of Embodied Intelligence: From ACT-R and Soar to Vision-Language-Action Models
Thomas, Gareth
Paperback
C++ for Embedded Systems: With Exercises and Code Samples for Intermediate Developers
Thomas, Gareth
Paperback
C++ for Embedded Systems Second Edition: With Exercises and Code Samples for Intermediate Developers
Thomas, Gareth
Paperback
Rapid Iterative Development Second Edition: Applying Agile Principles to Hardware Engineering
Thomas, Gareth
Paperback
Bare Metal Computing ARM & RISC Edition: Cross Architecture Instruction Level Engineering
Thomas, Gareth
Paperback
Foundations of Modern EEG Engineering: Essential Principles, System Design, and Practical Applications
Thomas, Gareth
Paperback
Cutting-Edge Algorithms for Experts: Exploring High-Performance Computing, AI, and Cryptography
Thomas, Gareth
Paperback
Also in
Programming
Interactive Theorem Proving and Program Development: Coq'art: The Calculus of Inductive Constructions
Castéran, Pierre
Bertot, Yves
Hardcover
Seven Databases in Seven Weeks: A Guide to Modern Databases and the Nosql Movement
Redmond, Eric
Wilson, Jim
Perkins, Luc
Paperback
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Collector's Edition
Piggyback
Hardcover
Python Crash Course, 3rd Edition: A Hands-On, Project-Based Introduction to Programming
Matthes, Eric
Paperback
Crisis Engineering: Time-Tested Tools for Turning Chaos Into Clarity
Dickerson, Mikey
Nitze, Marina
Weaver, Matthew
Paperback
Vibe Coding: Building Production-Grade Software with Genai, Chat, Agents, and Beyond
Yegge, Steve
Kim, Gene
Paperback
Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations
Kim, Gene
Forsgren Phd, Nicole
Humble, Jez
Paperback
Embedded Systems with ARM Cortex-M Microcontrollers in Assembly Language and C: Fourth Edition
Zhu, Yifeng
Paperback
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Standard Edition
Piggyback
Paperback
I Have an App Idea: The Essential Guide to Building an App Without Tech Skills
Spann, Amanda
Paperback
Fundamentals of Software Architecture: A Modern Engineering Approach
Richards, Mark
Ford, Neal
Paperback
AI Projects with Raspberry Pi: High-Performance Artificial Intelligence for Robotics, Security, Home Automation, and Vision
Jepson, Brian
Hattersley, Lucy
Paperback
The Manager's Path: A Guide for Tech Leaders Navigating Growth and Change
Fournier, Camille
Paperback
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
The Devops Handbook, 2nd Edition: How to Create World-Class Agility, Reliability, & Security in Technology Organizations
Debois, Patrick
Kim, Gene
Humble, Jez
Paperback
Building Applications with AI Agents: Designing and Implementing Multiagent Systems
Albada, Michael
Paperback
The Developer's Guide to AI: A Field Guide for the Working Developer
Orshalick, Jacob
Reghunadh, Jerry M.
Thompson, Danny
Paperback
Cracking the Coding Interview: 189 Programming Questions and Solutions
McDowell, Gayle Laakmann
Paperback
The New AI Cold War: Liberty vs. Tyranny in the Age of Machine Empires
Maginnis, Ltc Robert L.
Paperback
Learning Web Design: A Beginner's Guide to Html, Css, Javascript, and Web Images
Robbins, Jennifer
Paperback
The Staff Engineer's Path: A Guide for Individual Contributors Navigating Growth and Change
Reilly, Tanya
Paperback
Software Architecture: The Hard Parts: Modern Trade-Off Analyses for Distributed Architectures
Ford, Neal
Richards, Mark
Sadalage, Pramod
Paperback
The Official Raspberry Pi Handbook 2026: Astounding Projects with Raspberry Pi Computers
Makers of Raspberry Pi Official Magazine, The
Paperback
Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Hardcover
The Pragmatic Programmer: Your Journey to Mastery, 20th Anniversary Edition
Hunt, Andrew
Thomas, David
Hardcover
Generative AI Design Patterns: Solutions to Common Challenges When Building Genai Agents and Applications
Lakshmanan, Valliappa
Hapke, Hannes
Paperback
Forecasting: Principles and Practice, the Pythonic Way
Athanasopoulos, George
Hyndman, Rob J.
Paperback
Observability Engineering: Achieving Production Excellence
Majors, Charity
Fong-Jones, Liz
Miranda, George
Paperback
Head First Design Patterns: Building Extensible and Maintainable Object-Oriented Software
Robson, Elisabeth
Freeman, Eric
Paperback
Frictionless: 7 Steps to Remove Barriers, Unlock Value, and Outpace Your Competition in the AI Era
Forsgren, Nicole
Noda, Abi
Paperback
The Return on AI: From Promise to Profit in the Age of Intelligent Business
Mittal, Ashwin
Sawhney, Mohanbir
Paperback
Arduino Programming for Beginners: A Comprehensive Beginner's Guide to Learn the Realms of Arduino Programming from A-Z
Protosmith, Ada
Paperback
Building AI-Powered Products: The Essential Guide to AI and Genai Product Management
Nika, Marily
Paperback
Grokking Algorithms, Second Edition: An Illustrated Guide for Programmers and Other Curious People
Bhargava, Aditya Y.
Paperback
Concrete Mathematics: A Foundation for Computer Science
Knuth, Donald
Graham, Ronald
Patashnik, Oren
Hardcover
Debugging: The 9 Indispensable Rules for Finding Even the Most Elusive Software and Hardware Problems
Agans, David J.
Paperback
Learning Generative AI Tools for Excel: Speed Up Your Everyday Tasks with Microsoft Excel, Copilot, Chatgpt, and Beyond
Duca, Angelica Lo
Paperback
Learning Domain-Driven Design: Aligning Software Architecture and Business Strategy
Khononov, Vlad
Paperback
This Is Service Design Doing: Applying Service Design Thinking in the Real World
Hormess, Markus Edgar
Stickdorn, Marc
Lawrence, Adam
Paperback
The Software Architect Elevator: Redefining the Architect's Role in the Digital Enterprise
Hohpe, Gregor
Paperback
Computer Science from Scratch: Building Interpreters, Art, Emulators and ML in Python
Kopec, David
Paperback
Python Programming for Young Coders: A Hands-On, Project-Based Introduction to Coding for Beginners, Kids, and Teens
Pandey, Anand
Paperback
Learning Php, MySQL & JavaScript: A Step-By-Step Guide to Creating Dynamic Websites
Nixon, Robin
Paperback
Software Engineering at Google: Lessons Learned from Programming Over Time
Wright, Hyrum
Winters, Titus
Manshreck, Tom
Paperback
Prompt Engineering for Llms: The Art and Science of Building Large Language Model-Based Applications
Berryman, John
Ziegler, Albert
Paperback
Living a Jewish Life, Revised and Updated: Jewish Traditions, Customs, and Values for Today's Families
Cooper, Howard
Diamant, Anita
Paperback
Articulating Design Decisions: Communicate with Stakeholders, Keep Your Sanity, and Deliver the Best User Experience
Greever, Tom
Paperback
Pro C# 10 with .Net 6: Foundational Principles and Practices in Programming
Troelsen, Andrew
Japikse, Phil
Paperback
Adobe Photoshop, 2nd Edition: A Complete Course and Compendium of Features
Laskevitch, Stephen
Paperback
Kubernetes in Action, Second Edition: Deploying and Managing Containers and Cloud-Native Applications
Luksa, Marko
Conner, Kevin
Paperback
Spies, Lies, and Algorithms: The History and Future of American Intelligence
Zegart, Amy B.
Paperback
Site Reliability Engineering: How Google Runs Production Systems
Jones, Chris
Beyer, Betsy
Murphy, Niall Richard
Paperback
Ruined by Design: How Designers Destroyed the World, and What We Can Do to Fix It
Monteiro, Mike
Paperback
Electronic Music and Sound Design - Theory and Practice with Max 9 - Volume 1 (Fifth Edition)
Maurizio, Giri
Cipriani, Alessandro
Paperback