Sign-In
Cart
Mastering PTX and SASS: Low-Level GPU Programming for NVIDIA Architectures
Paperback
Series: Gpu Expert Engineering: Mastering Design, Programming, and Optimization
Technology & EngineeringProgramming
Publisher: Independently Published
Published: Jul 6 2026
Pages: 514
Weight: 2.60
Height: 1.03 Width: 8.50 Depth: 11.00
Language: English
Most CUDA programmers never see the real program their GPU actually runs.
They write CUDA C++. They launch kernels. They profile. They tune block sizes, adjust memory access, stare at Nsight reports, and hope the compiler has done what they think it has done.
But the truth is lower down.
The truth is in PTX. The truth is in SASS.
Mastering PTX and SASS is for CUDA programmers, GPU performance engineers, ML systems developers, compiler-minded programmers, and high-performance computing specialists who want to understand NVIDIA GPU execution below the source level.
This is not a beginner CUDA book.
It is for readers who already understand the basic GPU programming model and now want to inspect the layer where performance is really exposed: instruction streams, register allocation, memory transactions, predicate logic, compiler output, synchronization, tensor pipelines, and architecture-specific machine code.
Inside, you will learn how to:
- Understand how CUDA source becomes PTX, and how PTX becomes SASS
- Use PTX as a portable low-level view of compiler intent
- Use SASS as evidence of what the GPU actually executes
- Interpret register pressure, spills, occupancy, instruction scheduling, and memory traffic
- Diagnose coalescing problems, bank conflicts, branch divergence, dependency stalls, and synchronization costs
- Work with tensor cores, MMA, WGMMA, TMA, low-precision formats, and modern NVIDIA architecture features
- Use nvcc, ptxas, cuobjdump, nvdisasm, Nsight Compute, Nsight Systems, and Compute Sanitizer as practical engineering tools
- Decide when CUDA C++, compiler flags, intrinsics, inline PTX, full PTX, or SASS inspection is the right level to touch
The goal is not assembly for its own sake.
The goal is diagnosis.
The goal is control.
The goal is to look at a slow kernel and know whether the limiting factor is memory movement, instruction throughput, register pressure, tensor-pipeline starvation, branch behavior, synchronization overhead, launch cost, or compiler transformation.
Modern GPU performance is not won by writing code that merely runs.
It is won by understanding how the machine schedules work, moves data, allocates registers, forms instructions, hides latency, feeds tensor units, and exposes bottlenecks through measurable evidence.
This book is for you if you already write CUDA code and want to understand what happens after compilation.
If you are still learning what a thread block is or how kernels launch, start with an introductory CUDA book first.
But if you want to read below the source level, connect profiler symptoms to architectural causes, and move closer to the real hardware ceiling, Mastering PTX and SASS was written for you.
Correctness is only the beginning.
The real question is: how close can you get to the hardware ceiling?
Also from
Thomas, Gareth
C++ for Embedded Systems Second Edition: With Exercises and Code Samples for Intermediate Developers
Thomas, Gareth
Paperback
Advanced GPU Assembly Programming Third Edition: A Technical Reference for NVIDIA and AMD Architectures
Thomas, Gareth
Paperback
Modern GPU Architecture Third Edition: Volume 1 - Foundations and the Graphics Pipeline
Thomas, Gareth
Paperback
Electronic Warfare Systems: Volume II: Platforms, Integration and Future Trends
Thomas, Gareth
Paperback
Foundations of Cognitive Architectures: Interdisciplinary Models of Cognition for Artificial Intelligence
Thomas, Gareth
Paperback
Cognitive Architectures in the Age of Embodied Intelligence: From ACT-R and Soar to Vision-Language-Action Models
Thomas, Gareth
Paperback
Robotics Algorithms: From Mathematical Foundations to Real-World Autonomous Systems
Thomas, Gareth
Paperback
C++ for Embedded Systems: With Exercises and Code Samples for Intermediate Developers
Thomas, Gareth
Paperback
Rapid Iterative Development Second Edition: Applying Agile Principles to Hardware Engineering
Thomas, Gareth
Paperback
The Physics of Quasiparticles: The Quantum Building Blocks of Emergent Matter
Thomas, Gareth
Paperback
Coprocessor Design for Robotics: Twelve Concept Designs for Offloading Sensing, Control, and Supervision
Thomas, Gareth
Paperback
Modern GPU Architecture Third Edition: Volume 2 - Acceleration, Integration, and Physical Design
Thomas, Gareth
Paperback
Architecting the Modern VLSI Chip: Semiconductor Devices, CMOS, RTL, Physical Design, and Tape-Out
Thomas, Gareth
Paperback
AI Physical Containment: How AI Communicates Secrets Through Heat, Light, Sound, and Vibration
Thomas, Gareth
Paperback
Bare Metal Computing ARM & RISC Edition: Cross Architecture Instruction Level Engineering
Thomas, Gareth
Paperback
Robotic Factory Design: Engineering Smart Manufacturing Systems Through Robotics, Automation, Digital Twins, and AI
Thomas, Gareth
Paperback
Active Electromagnetic Plasma Braking (AEPB): Electromagnetic Active Plasma Atmospheric Braking for Spacecraft
Thomas, Gareth
Paperback
Foundations of Electronic Design Automation Volume One: From Physics to Implementation
Thomas, Gareth
Paperback
Foundations of Modern EEG Engineering: Essential Principles, System Design, and Practical Applications
Thomas, Gareth
Paperback
Cutting-Edge Algorithms for Experts: Exploring High-Performance Computing, AI, and Cryptography
Thomas, Gareth
Paperback
Also in
Programming
Interactive Theorem Proving and Program Development: Coq'art: The Calculus of Inductive Constructions
Castéran, Pierre
Bertot, Yves
Hardcover
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Collector's Edition
Piggyback
Hardcover
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Standard Edition
Piggyback
Paperback
Python Crash Course, 3rd Edition: A Hands-On, Project-Based Introduction to Programming
Matthes, Eric
Paperback
Crisis Engineering: Time-Tested Tools for Turning Chaos Into Clarity
Weaver, Matthew
Dickerson, Mikey
Nitze, Marina
Paperback
Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations
Forsgren Phd, Nicole
Humble, Jez
Kim, Gene
Paperback
Embedded Systems with ARM Cortex-M Microcontrollers in Assembly Language and C: Fourth Edition
Zhu, Yifeng
Paperback
Fundamentals of Software Architecture: A Modern Engineering Approach
Ford, Neal
Richards, Mark
Paperback
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
Site Reliability Engineering: How Google Runs Production Systems
Beyer, Betsy
Jones, Chris
Leng, Christof
Paperback
The Manager's Path: A Guide for Tech Leaders Navigating Growth and Change
Fournier, Camille
Paperback
Vibe Coding: Building Production-Grade Software with Genai, Chat, Agents, and Beyond
Yegge, Steve
Kim, Gene
Paperback
AI Projects with Raspberry Pi: High-Performance Artificial Intelligence for Robotics, Security, Home Automation, and Vision
Hattersley, Lucy
Jepson, Brian
Paperback
I Have an App Idea: The Essential Guide to Building an App Without Tech Skills
Spann, Amanda
Paperback
The Devops Handbook, 2nd Edition: How to Create World-Class Agility, Reliability, & Security in Technology Organizations
Humble, Jez
Debois, Patrick
Kim, Gene
Paperback
The Return on AI: From Promise to Profit in the Age of Intelligent Business
Sawhney, Mohanbir
Mittal, Ashwin
Paperback
The Staff Engineer's Path: A Guide for Individual Contributors Navigating Growth and Change
Reilly, Tanya
Paperback
Evals for AI Engineers: Systematically Measuring and Improving AI Applications
Shankar, Shreya
Husain, Hamel
Paperback
The Developer's Guide to AI: A Field Guide for the Working Developer
Orshalick, Jacob
Reghunadh, Jerry M.
Thompson, Danny
Paperback
Building Applications with AI Agents: Designing and Implementing Multiagent Systems
Albada, Michael
Paperback
Software Architecture: The Hard Parts: Modern Trade-Off Analyses for Distributed Architectures
Ford, Neal
Richards, Mark
Sadalage, Pramod
Paperback
Forecasting: Principles and Practice, the Pythonic Way
Hyndman, Rob J.
Athanasopoulos, George
Paperback
Observability Engineering: Achieving Production Excellence
Miranda, George
Majors, Charity
Fong-Jones, Liz
Paperback
Cracking the Coding Interview: 189 Programming Questions and Solutions
McDowell, Gayle Laakmann
Paperback
Learning Web Design: A Beginner's Guide to Html, Css, Javascript, and Web Images
Robbins, Jennifer
Paperback
Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
The New AI Cold War: Liberty vs. Tyranny in the Age of Machine Empires
Maginnis, Ltc Robert L.
Paperback
Building Safer Technology: A Field Guide to Failing Well
Zunger, Yonatan
Coles, Neil
Kissner, Lea
Paperback
The Pragmatic Programmer: Your Journey to Mastery, 20th Anniversary Edition
Thomas, David
Hunt, Andrew
Hardcover
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Hardcover
A Human's Guide to Machine Intelligence: How Algorithms Are Shaping Our Lives and How We Can Stay in Control
Hosanagar, Kartik
Paperback
Grokking Algorithms, Second Edition: An Illustrated Guide for Programmers and Other Curious People
Bhargava, Aditya Y.
Paperback
Building Resilient Distributed Systems: Patterns and Practices for Stable Software
Newman, Sam
Paperback
Java in a Nutshell: A Desktop Quick Reference
Clark, Jason R.
Flanagan, David
Evans, Benjamin J.
Paperback
Generative AI Design Patterns: Solutions to Common Challenges When Building Genai Agents and Applications
Lakshmanan, Valliappa
Hapke, Hannes
Paperback
Learning Domain-Driven Design: Aligning Software Architecture and Business Strategy
Khononov, Vlad
Paperback
Concrete Mathematics: A Foundation for Computer Science
Patashnik, Oren
Knuth, Donald
Graham, Ronald
Hardcover
The Official Raspberry Pi Handbook 2026: Astounding Projects with Raspberry Pi Computers
Makers of Raspberry Pi Official Magazine, The
Paperback
Signals & Levers: Systems Thinking Tools to Unblock Software Delivery
Tosi, Joel
Hendrickson, Elisabeth
Paperback
The Software Architect Elevator: Redefining the Architect's Role in the Digital Enterprise
Hohpe, Gregor
Paperback
Head First Design Patterns: Building Extensible and Maintainable Object-Oriented Software
Robson, Elisabeth
Freeman, Eric
Paperback
Learning Generative AI Tools for Excel: Speed Up Your Everyday Tasks with Microsoft Excel, Copilot, Chatgpt, and Beyond
Duca, Angelica Lo
Paperback
AI Agents with MCP: Model Context Protocol for Building Clients, Servers, and End-To-End Agents
Stratis, Kyle
Paperback
Build an AI Agent (from Scratch): Agents That Reason, Plan, and ACT Autonomously
Hur, Jungjun
Song, Younghee
Paperback
Building AI-Powered Products: The Essential Guide to AI and Genai Product Management
Nika, Marily
Paperback
Inteligencia Artificial Con Python: Sistemas de aprendizaje, Machine Learning y Deep Learning explicados de forma clara y práctica.
Selles Rodenas, Juan Ignacio
Paperback
The Multiplier Mindset: How to Move from Senior Engineer to Tech Leader in the Age of AI
Ojstersek, Gregor
Paperback
Arduino Programming for Beginners: A Comprehensive Beginner's Guide to Learn the Realms of Arduino Programming from A-Z
Protosmith, Ada
Paperback
Debugging: The 9 Indispensable Rules for Finding Even the Most Elusive Software and Hardware Problems
Agans, David J.
Paperback
Living a Jewish Life, Revised and Updated: Jewish Traditions, Customs, and Values for Today's Families
Cooper, Howard
Diamant, Anita
Paperback
Software Engineering at Google: Lessons Learned from Programming Over Time
Wright, Hyrum
Winters, Titus
Manshreck, Tom
Paperback
The Book of Debugging: A Systematic Workflow for Finding and Fixing Bugs
Kuhlmann, Johannes
Paperback
Learning Php, MySQL & JavaScript: A Step-By-Step Guide to Creating Dynamic Websites
Nixon, Robin
Paperback
Frictionless: 7 Steps to Remove Barriers, Unlock Value, and Outpace Your Competition in the AI Era
Forsgren, Nicole
Noda, Abi
Paperback
Programming Massively Parallel Processors: A Hands-On Approach
Kirk, David B.
El Hajj, Izzat
Hwu, Wen-Mei W.
Paperback
Certified Associate in Project Management (Capm)(R) Exam Official Cert Guide
Thomas, Arthur
Lechler, Thomas
Kanabar, Vijay
Paperback
Python Programming for Young Coders: A Hands-On, Project-Based Introduction to Coding for Beginners, Kids, and Teens
Pandey, Anand
Paperback
Electronic Music and Sound Design - Theory and Practice with Max 9 - Volume 1 (Fifth Edition)
Cipriani, Alessandro
Maurizio, Giri
Paperback
Programming Rust: Fast, Safe Systems Development
Orendorff, Jason
Tindall, Leonora F. S.
Blandy, Jim
Paperback
Creación de Aplicaciones Con Agentes de Ia (Spanish Edition): Diseño E Implementación de Sistemas Multiagente
Albada, Michael
Paperback
Computer Science from Scratch: Building Interpreters, Art, Emulators and ML in Python
Kopec, David
Paperback
Head First Algorithms and Data Structures: A Learner's Guide to the Foundations of Computing
Freeman, Eric
Robson, Elisabeth
Paperback
Practical AI Security: A Hands-On Guide to Attacking, Defending, and Securing Modern AI Systems
Farlow, Harriet
Paperback