Sign-In
Cart
GPU-Accelerated Computing with Python 3 and CUDA: From low-level kernels to real-world applications in scientific computing and machine learning
Paperback
ISBN13: 9781803245423
Publisher: Packt Publishing
Published: Mar 31 2026
Pages: 534
Weight: 2.00
Height: 1.08 Width: 7.50 Depth: 9.25
Language: English
Accelerate your Python code on the GPU using CUDA, Numba, and modern libraries to solve real-world problems faster and more efficiently.
Key Features:
- Build a solid foundation in CUDA with Python, from kernel design to execution and debugging
- Optimize GPU performance with efficient memory access, CUDA streams, and multi-GPU scaling
- Use JAX, CuPy, RAPIDS, and Numba to accelerate numerical computing and machine learning
- Create practical GPU applications, from PDE solvers to image processing and transformers
Book Description:
Writing high-performance Python code doesn't have to mean switching to C]+. This book shows you how to accelerate Python applications using NVIDIA's CUDA platform and a modern ecosystem of Python tools and libraries. Aimed at researchers, engineers, and data scientists, it offers a practical yet deep understanding of GPU programming and how to fully exploit modern GPU hardware.
You'll begin with the fundamentals of CUDA programming in Python using Numba-CUDA, learning how GPUs work and how to write, execute, and debug custom GPU kernels. Building on this foundation, the book explores memory access optimization, asynchronous execution with CUDA streams, and multi-GPU scaling using Dask-CUDA. Performance analysis and tuning are emphasized throughout, using NVIDIA Nsight profilers.
You'll also learn to use high-level GPU libraries such as JAX, CuPy, and RAPIDS to accelerate numerical Python workflows with minimal code changes. These techniques are applied to real-world examples, including PDE solvers, image processing, physical simulations, and transformer models.
Written by experienced GPU practitioners, this hands-on guide emphasizes reproducible workflows using Python 3.10+, CUDA 12.3+, and tools like the Pixi package manager. By the end, you'll have future-ready skills for building scalable GPU applications in Python.
What You Will Learn:
- Understand GPU execution, parallelism, and the CUDA programming model
- Write, launch, and debug custom CUDA kernels in Python with CUDA
- Profile GPU code with NVIDIA Nsight and optimize memory access
- Use CUDA streams and async execution to overlap compute and transfers
- Apply JAX, CuPy, and RAPIDS to numerical computing and machine learning
- Scale GPU workloads across devices using Dask and multi-GPU strategies
- Accelerate PDE solvers, simulations, and image processing on the GPU
- Build, train, and run a transformer model from scratch on the GPU
Who this book is for:
Python developers, (data) scientists, engineers, and researchers looking to accelerate numerical computations without switching to low-level languages. This book is ideal for those with experience in scientific Python (NumPy, Pandas, SciPy) and a basic understanding of computing fundamentals who want deeper control over performance in GPU environments.
Table of Contents
- Why GPU programming with CUDA in Python 3?
- Setting up a GPU programming environment locally and in the cloud
- Writing and executing a CUDA kernel with numba
- Profiling and debugging CUDA code
- Optimize memory access patterns and other tricks
- Using CUDA Streams for Asynchronous Data Transfers
- Scaling to multiple GPUs
- Bringing NumPy and SciPy to the GPU with CuPy
- Bringing Pandas and Scikit-learn to the GPU with Rapids
- Solving Optimization Problems on the GPU with JAX
- Solving the heat equation on the GPU
- Image processing on the GPU
- Simulating Atomic Interactions on the GPU
- Implementing your own transformer based language model from scratch
- Expanding and Deepening your GPU Programming Knowledge
Also in
Programming
Interactive Theorem Proving and Program Development: Coq'art: The Calculus of Inductive Constructions
Castéran, Pierre
Bertot, Yves
Hardcover
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Collector's Edition
Piggyback
Hardcover
Python Crash Course, 3rd Edition: A Hands-On, Project-Based Introduction to Programming
Matthes, Eric
Paperback
Crisis Engineering: Time-Tested Tools for Turning Chaos Into Clarity
Nitze, Marina
Weaver, Matthew
Dickerson, Mikey
Paperback
Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations
Humble, Jez
Kim, Gene
Forsgren Phd, Nicole
Paperback
Embedded Systems with ARM Cortex-M Microcontrollers in Assembly Language and C: Fourth Edition
Zhu, Yifeng
Paperback
Vibe Coding: Building Production-Grade Software with Genai, Chat, Agents, and Beyond
Kim, Gene
Yegge, Steve
Paperback
The Legend of Zelda(tm) Tears of the Kingdom - The Complete Official Guide: Standard Edition
Piggyback
Paperback
Fundamentals of Software Architecture: A Modern Engineering Approach
Richards, Mark
Ford, Neal
Paperback
I Have an App Idea: The Essential Guide to Building an App Without Tech Skills
Spann, Amanda
Paperback
AI Projects with Raspberry Pi: High-Performance Artificial Intelligence for Robotics, Security, Home Automation, and Vision
Jepson, Brian
Hattersley, Lucy
Paperback
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
The Manager's Path: A Guide for Tech Leaders Navigating Growth and Change
Fournier, Camille
Paperback
The Devops Handbook, 2nd Edition: How to Create World-Class Agility, Reliability, & Security in Technology Organizations
Humble, Jez
Debois, Patrick
Kim, Gene
Paperback
Building Applications with AI Agents: Designing and Implementing Multiagent Systems
Albada, Michael
Paperback
The Staff Engineer's Path: A Guide for Individual Contributors Navigating Growth and Change
Reilly, Tanya
Paperback
The Developer's Guide to AI: A Field Guide for the Working Developer
Thompson, Danny
Orshalick, Jacob
Reghunadh, Jerry M.
Paperback
Learning Web Design: A Beginner's Guide to Html, Css, Javascript, and Web Images
Robbins, Jennifer
Paperback
Cracking the Coding Interview: 189 Programming Questions and Solutions
McDowell, Gayle Laakmann
Paperback
The New AI Cold War: Liberty vs. Tyranny in the Age of Machine Empires
Maginnis, Ltc Robert L.
Paperback
Software Architecture: The Hard Parts: Modern Trade-Off Analyses for Distributed Architectures
Richards, Mark
Sadalage, Pramod
Ford, Neal
Paperback
The Return on AI: From Promise to Profit in the Age of Intelligent Business
Sawhney, Mohanbir
Mittal, Ashwin
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Hardcover
Observability Engineering: Achieving Production Excellence
Fong-Jones, Liz
Miranda, George
Majors, Charity
Paperback
The Pragmatic Programmer: Your Journey to Mastery, 20th Anniversary Edition
Thomas, David
Hunt, Andrew
Hardcover
Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
The Official Raspberry Pi Handbook 2026: Astounding Projects with Raspberry Pi Computers
Makers of Raspberry Pi Official Magazine, The
Paperback
Forecasting: Principles and Practice, the Pythonic Way
Hyndman, Rob J.
Athanasopoulos, George
Paperback
Generative AI Design Patterns: Solutions to Common Challenges When Building Genai Agents and Applications
Lakshmanan, Valliappa
Hapke, Hannes
Paperback
Head First Design Patterns: Building Extensible and Maintainable Object-Oriented Software
Freeman, Eric
Robson, Elisabeth
Paperback
Frictionless: 7 Steps to Remove Barriers, Unlock Value, and Outpace Your Competition in the AI Era
Noda, Abi
Forsgren, Nicole
Paperback
Arduino Programming for Beginners: A Comprehensive Beginner's Guide to Learn the Realms of Arduino Programming from A-Z
Protosmith, Ada
Paperback
Concrete Mathematics: A Foundation for Computer Science
Graham, Ronald
Patashnik, Oren
Knuth, Donald
Hardcover
Building AI-Powered Products: The Essential Guide to AI and Genai Product Management
Nika, Marily
Paperback
Grokking Algorithms, Second Edition: An Illustrated Guide for Programmers and Other Curious People
Bhargava, Aditya Y.
Paperback
Debugging: The 9 Indispensable Rules for Finding Even the Most Elusive Software and Hardware Problems
Agans, David J.
Paperback
Learning Domain-Driven Design: Aligning Software Architecture and Business Strategy
Khononov, Vlad
Paperback
Learning Generative AI Tools for Excel: Speed Up Your Everyday Tasks with Microsoft Excel, Copilot, Chatgpt, and Beyond
Duca, Angelica Lo
Paperback
Site Reliability Engineering: How Google Runs Production Systems
Beyer, Betsy
Murphy, Niall Richard
Jones, Chris
Paperback
The Software Architect Elevator: Redefining the Architect's Role in the Digital Enterprise
Hohpe, Gregor
Paperback
Python Programming for Young Coders: A Hands-On, Project-Based Introduction to Coding for Beginners, Kids, and Teens
Pandey, Anand
Paperback
Computer Science from Scratch: Building Interpreters, Art, Emulators and ML in Python
Kopec, David
Paperback
Learning Php, MySQL & JavaScript: A Step-By-Step Guide to Creating Dynamic Websites
Nixon, Robin
Paperback
Building Safer Technology: A Field Guide to Failing Well
Zunger, Yonatan
Coles, Neil
Kissner, Lea
Paperback
Software Engineering at Google: Lessons Learned from Programming Over Time
Winters, Titus
Manshreck, Tom
Wright, Hyrum
Paperback
Prompt Engineering for Llms: The Art and Science of Building Large Language Model-Based Applications
Ziegler, Albert
Berryman, John
Paperback
Articulating Design Decisions: Communicate with Stakeholders, Keep Your Sanity, and Deliver the Best User Experience
Greever, Tom
Paperback
Living a Jewish Life, Revised and Updated: Jewish Traditions, Customs, and Values for Today's Families
Diamant, Anita
Cooper, Howard
Paperback
Pro C# 10 with .Net 6: Foundational Principles and Practices in Programming
Troelsen, Andrew
Japikse, Phil
Paperback
Adobe Photoshop, 2nd Edition: A Complete Course and Compendium of Features
Laskevitch, Stephen
Paperback
Spies, Lies, and Algorithms: The History and Future of American Intelligence
Zegart, Amy B.
Paperback
Electronic Music and Sound Design - Theory and Practice with Max 9 - Volume 1 (Fifth Edition)
Cipriani, Alessandro
Maurizio, Giri
Paperback
Kubernetes in Action, Second Edition: Deploying and Managing Containers and Cloud-Native Applications
Luksa, Marko
Conner, Kevin
Paperback