Sign-In
Cart
GPU Operating Systems and Parallel Computing: A Practical Guide to CUDA, GPU Architecture, Parallel Programming, and High Performance Systems
Paperback
Operating SystemsProgrammingSystem Administration
Currently unavailable to order
Please enter your email and a message will be sent to you when this product becomes available on our website.
Publisher: Independently Published
Pages: 176
Weight: 0.49
Height: 0.44 Width: 6.00 Depth: 9.00
Language: English
Stop Treating the GPU Like a Faster CPU. Learn to Engineer It as a Complete Computing System.
Modern GPU development is no longer just about writing a CUDA kernel and hoping it runs faster. Real performance depends on the entire path from application code to driver, memory system, scheduler, hardware, and production infrastructure.
GPU Operating Systems and Parallel Computing gives you a practical, systems-level framework for understanding that entire stack.
Starting with the GPU operating environment, this guide explains how host operating systems, drivers, runtimes, contexts, queues, memory mappings, firmware, and hardware schedulers work together. From there, it moves into GPU architecture, parallel decomposition, CUDA programming, memory optimization, asynchronous execution, profiling, debugging, multi-GPU computing, and production deployment.
Inside, you'll learn how to:
Understand the GPU software and hardware stack-and diagnose problems at the correct layer
Think in terms of warps, blocks, grids, streaming multiprocessors, memory hierarchies, and resource limits
Design parallel algorithms around independence, dependencies, locality, load balance, and scaling
Build and troubleshoot a CUDA development environment
Write correct CUDA kernels and reason about execution, synchronization, and launch configuration
Optimize memory access, data reuse, transfers, and shared-memory usage
Use streams, events, CUDA Graphs, and concurrency to build efficient pipelines
Profile workloads systematically instead of relying on optimization folklore
Debug memory errors, race conditions, synchronization failures, and numerical problems
Design multi-GPU workloads using topology awareness, collectives, MPS, and MIG
Build reliable GPU applications with observability, testing, reproducibility, security, and deployment practices
Evaluate CUDA, HIP, SYCL, and abstraction layers when portability matters
The book is designed for developers and engineers working in GPU programming, HPC, machine learning, scientific computing, simulation, rendering, backend infrastructure, and high-performance systems. It combines conceptual explanations with diagrams, tables, code examples, exercises, and practical engineering decision processes.
Most importantly, it teaches a repeatable approach to GPU performance: establish correctness, measure the complete workload, identify the real bottleneck, make a targeted change, and validate the result.
Whether you're learning CUDA, optimizing an existing GPU workload, building a multi-GPU service, or designing production accelerator infrastructure, this book helps you connect parallel programming concepts to the physical realities of modern GPU systems.
Build faster GPU software-but more importantly, learn why it is fast, when it will fail, and how to make it dependable.
Also from
Haagenrud, Thom
Home Assistant for Beginners: Build a private smart home without relying on the cloud
Haagenrud, Thom
Paperback
Python APIs for Beginners: Connect Apps, Automate Workflows, and Use Web Data with Simple Code
Haagenrud, Thom
Paperback
Computer Vision for Robotics: Enable robots to see, detect, and respond using OpenCV
Haagenrud, Thom
Paperback
MATLAB for Engineering Students: Solve Problems, Plot Data, and Build Simple Models
Haagenrud, Thom
Paperback
PX4 and MAVLink: Integrating Open-Source Flight Control with UAV Communication
Haagenrud, Thom
Paperback
PowerShell for Beginners: Automate Windows Tasks, Files, Reports, and Admin Work
Haagenrud, Thom
Paperback
Tasmota Firmware Flashing: Unlocking the full potential of Tuya and Sonoff smart plugs
Haagenrud, Thom
Paperback
SQL for Beginners: Query, Filter, Join, and Analyze Data for Real-World Work
Haagenrud, Thom
Paperback
REST API Security Protecting Data in Transit: Secure REST APIs with authentication and encryption
Haagenrud, Thom
Paperback
Python and MAVSDK: Connecting High-Level Code to Flight Controllers for Precise Control
Haagenrud, Thom
Paperback
APIs and Webhooks for Beginners: Connect Apps, Automate Tasks, and Build Useful Integrations
Haagenrud, Thom
Paperback
Python for Raspberry Pi Beginners: Build Useful Automation, Sensor, and Home Projects
Haagenrud, Thom
Paperback
Programming for Career Changers: Learn Coding Skills for Real Jobs, Portfolios, and Interviews
Haagenrud, Thom
Paperback
UAV Mission Planning: Strategies for Autonomous Mapping, Surveillance, and Inspection
Haagenrud, Thom
Paperback
UAV Programming with Python: A Developer's Guide to MAVLink Communication, PX4 Integration, and Onboard Scripting
Haagenrud, Thom
Paperback
ROS for Drone Development: A Practical Introduction to Building Autonomous UAVs with ROS, MAVLink, and Gazebo Simulation
Haagenrud, Thom
Paperback
OpenHAB Implementation: Integrating diverse smart devices into a single open-source interface
Haagenrud, Thom
Paperback
Zigbee Network Optimization: Designing robust mesh networks for reliable device communication
Haagenrud, Thom
Paperback
WLED Lighting Control: Creating synchronized LED effects and ambiance with ESP8266
Haagenrud, Thom
Paperback
JavaScript for Practical Web Projects: Build Interactive Pages Without Getting Lost
Haagenrud, Thom
Paperback
Linux Kernel Programming Essentials: A Practical Guide to Kernel Internals, Modules, Drivers, Memory, and System Development
Haagenrud, Thom
Paperback
Also in
Operating Systems
I Have an App Idea: The Essential Guide to Building an App Without Tech Skills
Spann, Amanda
Paperback
RHCSA Red Hat Enterprise Linux 10: Training and Exam Preparation Guide (EX200), Fourth Edition
Ghori, Asghar
Paperback
Microsoft Windows 11 - Tips & Tricks: Quickstudy Laminated Computer Reference Guide
Gatto, Katie
Other
Laptops for Seniors in Easy Steps, 9th Edition: Covers All Laptops with the Windows 11 2024 Update
Vandome, Nick
Paperback
Microsoft Copilot Studio Step by Step: Customizing Copilot and Creating Agents
Crosbie, Lisa
Paperback
Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
RHCSA Red Hat Enterprise Linux 9: Training and Exam Preparation Guide (EX200), Third Edition
Ghori, Asghar
Paperback
The Practice of System and Network Administration: Devops and Other Best Practices for Enterprise It, Volume 1
Chalup, Strata
Limoncelli, Thomas
Hogan, Christina
Paperback
Samsung Galaxy A17 5G User Guide: A Comprehensive, Step-by-Step Manual with Practical Tips for Beginners and Seniors
Gavriel, John
Paperback
The Wireless Cookbook: Build Real Projects and Master Wi-Fi, Bluetooth, and Lora
Zimmerman, Bill
Paperback
Comptia A+ Certification All-In-One Exam Guide, Eleventh Edition (Exams 220-1101 & 220-1102)
Hutz, Andrew
Everett, Travis A.
Hardcover
Exploring Windows 11 - 2025 Edition: The Illustrated, Practical Guide to Using Microsoft Windows
Wilson, Kevin
Paperback
Windows 11 Manual For Seniors: A Beginners Guide to Navigate Your Computer with Step-by-Step Instructions
Wells, Larry
Paperback
Microsoft 365 Copilot Adoption: A Practical Guide for Business Leaders and Consultants
Smith, Mark
Smith, Megan
Paperback
The Linux Programming Interface: A Linux and Unix System Programming Handbook
Kerrisk, Michael
Hardcover
Linux Mint Cinnamon Edition: A Complete Guide for Beginners and Advanced Users
Rodgers, David A., Jr.
Paperback
What On Earth is a Mainframe?: An Introduction to IBM Z Mainframes and z/OS Operating System for Total Beginners
Stephens, David
Paperback
Android Studio Panda Essentials - Java Edition: Developing Android Apps Using Android Studio Panda and Java
Smyth, Neil
Paperback
The Cathedral & the Bazaar: Musings on Linux and Open Source by an Accidental Revolutionary
Raymond, Eric S.
Paperback
Mac for Seniors - Sonoma Edition: The illustrated, Step-by-step guide on how to use MacOS (Large Print Edition)
Wilson, Kevin
Paperback
Linux Basics for Hackers: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
Mastering Linux Security and Hardening - Third Edition: A practical guide to protecting your Linux system from cyber attacks
Tevault, Donald a.
Paperback
The Accidental Administrator: Cisco Router Step-by-Step Configuration Guide
Crawley, Don R.
Paperback
Effective Shell: A Practical User's Guide to Working Smarter on the Command Line
Kerr, Dave
Paperback
Master Zorin OS 18: A Complete Hands-On Guide to Linux Mastery with Zorin OS 18
Mykel, Ross
Paperback
How to Build Android Applications with Kotlin - Third Edition: A hands-on guide to developing, testing, and publishing production-grade Android 16 app
Forrester, Alex
Boudjnah, Eran
Dumbravan, Alexandru
Paperback
Windows Internals: System Architecture, Processes, Threads, Memory Management, and More, Part 1
Yosifovich, Pavel
Russinovich, Mark
Solomon, David
Paperback
Comptia A+ Complete Study Guide: Core 1 Exam 220-1101 and Core 2 Exam 220-1102
Buhagiar, Jon
Docter, Quentin
Paperback
Windows 11 Tips, Tricks & Shortcuts in Easy Steps: 1000+ Tips, Tricks and Shortcuts
Vandome, Nick
Paperback
Chatgpt: A Guide to Making Money With Chatgpt (Creative Ways for Teens and Young Adults to Make Money With Chatgpt)
Trotter, Thomas
Paperback
Mastering Embedded Linux Development - Fourth Edition: Craft fast and reliable embedded solutions with Linux 6.6 and The Yocto Project 5.0 (Scarthgap)
Vasquez, Frank
Simmonds, Chris
Paperback
MacBook Neo User Guide: Seniors and Beginners Easy to follow Manual With ILLUSTRATIONS to Master Their Device Quickly [Tips and Trips included]
Klaywood Philip, Sans
Paperback
Linux Kernel Programming - Second Edition: A comprehensive and practical guide to kernel internals, writing modules, and kernel synchronization
Billimoria, Kaiwan N.
Paperback
Learning the VI and VIM Editors: Power and Agility Beyond Just Text Editing
Hannah, Elbert
Robbins, Arnold
Paperback
Head First Android Development: A Learner's Guide to Building Android Apps with Kotlin
Griffiths, David
Griffiths, Dawn
Paperback
Linux: The ultimate guide to Linux for beginners, Linux hacking, Linux command line, Linux operating system, and more!
Newport, Craig
Paperback
Data Science at the Command Line: Obtain, Scrub, Explore, and Model Data with UNIX Power Tools
Janssens, Jeroen
Paperback
Learn FileMaker Pro 2024: The Comprehensive Guide to Building Custom Databases
Munro, Mark Conway
Paperback
MacBook User Guide for Seniors: An Easy-to-Follow Manual for Using Your Laptop with Confidence
Reid, Nicholas L. a.
Paperback
The Ultimate Linux Shell Scripting Guide: Automate, Optimize, and Empower tasks with Linux Shell Scripting
Tevault, Donald a.
Paperback
Hotwire Native for Rails Developers: Build Native Mobile Apps Using Your Server
Masilotti, Joe
Paperback
A Handbook for Mainframe z/OS Enterprise Architects - Architecture and Design of Large-Scale Environments
Sahoo, Natabar
Paperback
Mastering Windows Server 2022 - Fourth Edition: Comprehensive administration of your Windows Server environment
Krause, Jordan
Paperback
Linux: A Complete Guide to Learn Linux Commands, Linux Operating System and Shell Scripting Step-by-Step
Ayden, Nicholas
Paperback
UNIX in a Nutshell: A Desktop Quick Reference - Covers Gnu/Linux, Mac OS X, and Solaris
Robbins, Arnold
Paperback
Comando de Linux: Una guía completa para principiantes para aprender los reinos del comando Linux desde A-Z
Vance, William
Paperback
Embedded Systems Architecture - Second Edition: Design and write software for embedded devices to build safe and connected systems
Lacamera, Daniele
Paperback
Android and IOS Mobile Forensics: Leveraging Blockchain, Machine Learning, and Deep Learning for Digital Investigations
Kaushik, Keshav
Sheth, Ravi
Parekha, Chandresh
Paperback
Mastering Microsoft Intune - Second Edition: Deploy Windows 11, Windows 365 via Microsoft Intune, Copilot and advance management via Intune Suite
Larsen, Per
Brinkhoff, Christiaan
Paperback
Moto G Stylus 5G 2025 User Guide: A Complete Step-by-Step Manual for Beginners and Seniors
Greg, Tova
Paperback
A Beginner's Guide to Mainframe z/OS RACF - Securing Mainframe Enterprise Operating System - Book 4
Sahoo, Natabar
Paperback
Practical Linux System Administration: A Guide to Installation, Configuration, and Management
Hess, Kenneth
Paperback
Debian 13.3 "Trixie" Desktop Handbook: A Practical Guide to Installing, Securing, and Mastering the Debian Linux Desktop - From Install to Advanced Ad
Rodgers, David A., Jr.
Paperback
Mastering Linux Security and Hardening - Third Edition: A practical guide to protecting your Linux system from cyber attacks
Tevault, Donald a.
Hardcover