Sign-In
Cart
GPU Operating Systems and Parallel Computing: A Practical Guide to CUDA, GPU Architecture, Parallel Programming, and High Performance Systems
Paperback
Operating SystemsProgrammingSystem Administration
Publisher: Independently Published
Published: Aug 29 2026
Pages: 176
Weight: 0.49
Height: 0.44 Width: 6.00 Depth: 9.00
Language: English
Stop Treating the GPU Like a Faster CPU. Learn to Engineer It as a Complete Computing System.
Modern GPU development is no longer just about writing a CUDA kernel and hoping it runs faster. Real performance depends on the entire path from application code to driver, memory system, scheduler, hardware, and production infrastructure.
GPU Operating Systems and Parallel Computing gives you a practical, systems-level framework for understanding that entire stack.
Starting with the GPU operating environment, this guide explains how host operating systems, drivers, runtimes, contexts, queues, memory mappings, firmware, and hardware schedulers work together. From there, it moves into GPU architecture, parallel decomposition, CUDA programming, memory optimization, asynchronous execution, profiling, debugging, multi-GPU computing, and production deployment.
Inside, you'll learn how to:
Understand the GPU software and hardware stack-and diagnose problems at the correct layer
Think in terms of warps, blocks, grids, streaming multiprocessors, memory hierarchies, and resource limits
Design parallel algorithms around independence, dependencies, locality, load balance, and scaling
Build and troubleshoot a CUDA development environment
Write correct CUDA kernels and reason about execution, synchronization, and launch configuration
Optimize memory access, data reuse, transfers, and shared-memory usage
Use streams, events, CUDA Graphs, and concurrency to build efficient pipelines
Profile workloads systematically instead of relying on optimization folklore
Debug memory errors, race conditions, synchronization failures, and numerical problems
Design multi-GPU workloads using topology awareness, collectives, MPS, and MIG
Build reliable GPU applications with observability, testing, reproducibility, security, and deployment practices
Evaluate CUDA, HIP, SYCL, and abstraction layers when portability matters
The book is designed for developers and engineers working in GPU programming, HPC, machine learning, scientific computing, simulation, rendering, backend infrastructure, and high-performance systems. It combines conceptual explanations with diagrams, tables, code examples, exercises, and practical engineering decision processes.
Most importantly, it teaches a repeatable approach to GPU performance: establish correctness, measure the complete workload, identify the real bottleneck, make a targeted change, and validate the result.
Whether you're learning CUDA, optimizing an existing GPU workload, building a multi-GPU service, or designing production accelerator infrastructure, this book helps you connect parallel programming concepts to the physical realities of modern GPU systems.
Build faster GPU software-but more importantly, learn why it is fast, when it will fail, and how to make it dependable.
Also from
Haagenrud, Thom
Home Assistant for Beginners: Build a private smart home without relying on the cloud
Haagenrud, Thom
Paperback
PowerShell for Beginners: Automate Windows Tasks, Files, Reports, and Admin Work
Haagenrud, Thom
Paperback
Python APIs for Beginners: Connect Apps, Automate Workflows, and Use Web Data with Simple Code
Haagenrud, Thom
Paperback
MATLAB for Engineering Students: Solve Problems, Plot Data, and Build Simple Models
Haagenrud, Thom
Paperback
Computer Vision for Robotics: Enable robots to see, detect, and respond using OpenCV
Haagenrud, Thom
Paperback
Python and MAVSDK: Connecting High-Level Code to Flight Controllers for Precise Control
Haagenrud, Thom
Paperback
Programming for Career Changers: Learn Coding Skills for Real Jobs, Portfolios, and Interviews
Haagenrud, Thom
Paperback
Python for Raspberry Pi Beginners: Build Useful Automation, Sensor, and Home Projects
Haagenrud, Thom
Paperback
PX4 and MAVLink: Integrating Open-Source Flight Control with UAV Communication
Haagenrud, Thom
Paperback
SQL for Beginners: Query, Filter, Join, and Analyze Data for Real-World Work
Haagenrud, Thom
Paperback
APIs and Webhooks for Beginners: Connect Apps, Automate Tasks, and Build Useful Integrations
Haagenrud, Thom
Paperback
Tasmota Firmware Flashing: Unlocking the full potential of Tuya and Sonoff smart plugs
Haagenrud, Thom
Paperback
REST API Security Protecting Data in Transit: Secure REST APIs with authentication and encryption
Haagenrud, Thom
Paperback
JavaScript for Practical Web Projects: Build Interactive Pages Without Getting Lost
Haagenrud, Thom
Paperback
UAV Programming with Python: A Developer's Guide to MAVLink Communication, PX4 Integration, and Onboard Scripting
Haagenrud, Thom
Paperback
Lua for Game Scripting Beginners: Create Simple Game Logic, Mods, and Automation Scripts
Haagenrud, Thom
Paperback
Java for Beginners Through Projects: Learn Coding by Building Practical Applications
Haagenrud, Thom
Paperback
Coding Projects for Absolute Beginners: 25 Simple Apps to Build Confidence in Any Language
Haagenrud, Thom
Paperback
Java for Android Beginners: Build Simple Mobile Apps with Real-World Features
Haagenrud, Thom
Paperback
Coding for Non-Programmers: Master Python Fundamentals in 14 Days Without Getting Overwhelmed by Technical Jargon
Haagenrud, Thom
Paperback
No-Fluff Coding Logic for Beginners: Learn Variables, Loops, Functions, and Problem Solving
Haagenrud, Thom
Paperback
Machine Learning Made Easy: A Plain-English Introduction to How Intelligent Algorithms Learn and Make Predictions
Haagenrud, Thom
Paperback
Artificial Intelligence for Absolute Beginners: Understand How AI Works and Start Building Your Own Basic Smart Applications
Haagenrud, Thom
Paperback
Git and GitHub for Beginner Programmers: Track Code, Fix Mistakes, and Publish Projects
Haagenrud, Thom
Paperback
OpenHAB Implementation: Integrating diverse smart devices into a single open-source interface
Haagenrud, Thom
Paperback
Data Structures for Beginners: Learn Arrays, Lists, Stacks, Queues, Trees, and Graphs Simply
Haagenrud, Thom
Paperback
Rust for Curious Beginners: Learn Memory-Safe Programming Through Practical Projects
Haagenrud, Thom
Paperback
JavaScript Automation for Beginners: Automate Browsers, Forms, Data Tasks, and Web Workflows
Haagenrud, Thom
Paperback
Python for Small Business: Automate Invoices, Customer Lists, Reports, and Admin Work
Haagenrud, Thom
Paperback
Python Dashboards for Beginners: Build Simple Data Apps with Streamlit and Plotly
Haagenrud, Thom
Paperback
PostgreSQL for Beginners: Learn Databases, Queries, Tables, and Practical Projects
Haagenrud, Thom
Paperback
MySQL for Beginners: Build, Query, and Manage Databases for Websites and Small Apps
Haagenrud, Thom
Paperback
Python Testing and Debugging for Beginners: Write Better Code and Fix Errors with Confidence
Haagenrud, Thom
Paperback
Python Automation for Beginners: Save Time with Scripts for Files, Folders, Emails, Reports, and Daily Tasks
Haagenrud, Thom
Paperback
Python Web Scraping for Beginners: Collect, Clean, and Organize Online Data with Practical Projects
Haagenrud, Thom
Paperback
Dart and Flutter for Beginners: Build Mobile Apps for Android and iOS from One Codebase
Haagenrud, Thom
Paperback
UAV Mission Planning: Strategies for Autonomous Mapping, Surveillance, and Inspection
Haagenrud, Thom
Paperback
ROS for Drone Development: A Practical Introduction to Building Autonomous UAVs with ROS, MAVLink, and Gazebo Simulation
Haagenrud, Thom
Paperback
Zigbee Network Optimization: Designing robust mesh networks for reliable device communication
Haagenrud, Thom
Paperback
WLED Lighting Control: Creating synchronized LED effects and ambiance with ESP8266
Haagenrud, Thom
Paperback
Linux Kernel Programming Essentials: A Practical Guide to Kernel Internals, Modules, Drivers, Memory, and System Development
Haagenrud, Thom
Paperback
Introduction to Vulnerability Assessment: Understanding Security Weaknesses, Risk Evaluation, Scanning, and Remediation
Haagenrud, Thom
Paperback
Working with Relational Data: An Introduction to Tables, Relationships, Queries, Data Integrity, and Database Applications
Haagenrud, Thom
Paperback
Also in
Operating Systems
RHCSA Red Hat Enterprise Linux 10: Training and Exam Preparation Guide (EX200), Fourth Edition
Ghori, Asghar
Paperback
I Have an App Idea: The Essential Guide to Building an App Without Tech Skills
Spann, Amanda
Paperback
Microsoft Windows 11 - Tips & Tricks: Quickstudy Laminated Computer Reference Guide
Gatto, Katie
Other
The Practice of System and Network Administration: Devops and Other Best Practices for Enterprise It, Volume 1
Limoncelli, Thomas
Hogan, Christina
Chalup, Strata
Paperback
Laptops for Seniors in Easy Steps, 9th Edition: Covers All Laptops with the Windows 11 2024 Update
Vandome, Nick
Paperback
Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali
Occupytheweb
Paperback
Microsoft Copilot Studio Step by Step: Customizing Copilot and Creating Agents
Crosbie, Lisa
Paperback
Samsung Galaxy A17 5G User Guide: A Comprehensive, Step-by-Step Manual with Practical Tips for Beginners and Seniors
Gavriel, John
Paperback
RHCSA Red Hat Enterprise Linux 9: Training and Exam Preparation Guide (EX200), Third Edition
Ghori, Asghar
Paperback
The Wireless Cookbook: Build Real Projects and Master Wi-Fi, Bluetooth, and Lora
Zimmerman, Bill
Paperback
Comptia A+ Certification All-In-One Exam Guide, Eleventh Edition (Exams 220-1101 & 220-1102)
Hutz, Andrew
Everett, Travis A.
Hardcover
Exploring Windows 11 - 2025 Edition: The Illustrated, Practical Guide to Using Microsoft Windows
Wilson, Kevin
Paperback
The Cathedral & the Bazaar: Musings on Linux and Open Source by an Accidental Revolutionary
Raymond, Eric S.
Paperback
Microsoft 365 Copilot Adoption: A Practical Guide for Business Leaders and Consultants
Smith, Mark
Smith, Megan
Paperback
The Linux Programming Interface: A Linux and Unix System Programming Handbook
Kerrisk, Michael
Hardcover
What On Earth is a Mainframe?: An Introduction to IBM Z Mainframes and z/OS Operating System for Total Beginners
Stephens, David
Paperback
Windows 11 Manual For Seniors: A Beginners Guide to Navigate Your Computer with Step-by-Step Instructions
Wells, Larry
Paperback
Linux Mint Cinnamon Edition: A Complete Guide for Beginners and Advanced Users
Rodgers, David A., Jr.
Paperback
Android Studio Panda Essentials - Java Edition: Developing Android Apps Using Android Studio Panda and Java
Smyth, Neil
Paperback
Mac for Seniors - Sonoma Edition: The illustrated, Step-by-step guide on how to use MacOS (Large Print Edition)
Wilson, Kevin
Paperback
Mastering Linux Security and Hardening - Third Edition: A practical guide to protecting your Linux system from cyber attacks
Tevault, Donald a.
Paperback
Master Zorin OS 18: A Complete Hands-On Guide to Linux Mastery with Zorin OS 18
Mykel, Ross
Paperback
Windows Internals: System Architecture, Processes, Threads, Memory Management, and More, Part 1
Russinovich, Mark
Solomon, David
Yosifovich, Pavel
Paperback
The Accidental Administrator: Cisco Router Step-by-Step Configuration Guide
Crawley, Don R.
Paperback
Cyberdeck Grimoire: A Beginner's Field Manual to Building Your Own Portable Computer: A Beginner's Field Manual to Building Your Own
Lane Publishing, Zinnia
Paperback
Windows 11 Tips, Tricks & Shortcuts in Easy Steps: 1000+ Tips, Tricks and Shortcuts
Vandome, Nick
Paperback
Effective Shell: A Practical User's Guide to Working Smarter on the Command Line
Kerr, Dave
Paperback
How to Build Android Applications with Kotlin - Third Edition: A hands-on guide to developing, testing, and publishing production-grade Android 16 app
Boudjnah, Eran
Dumbravan, Alexandru
Forrester, Alex
Paperback
Comptia A+ Complete Study Guide: Core 1 Exam 220-1101 and Core 2 Exam 220-1102
Docter, Quentin
Buhagiar, Jon
Paperback
MacBook Neo User Guide: Seniors and Beginners Easy to follow Manual With ILLUSTRATIONS to Master Their Device Quickly [Tips and Trips included]
Klaywood Philip, Sans
Paperback
Linux Kernel Programming - Second Edition: A comprehensive and practical guide to kernel internals, writing modules, and kernel synchronization
Billimoria, Kaiwan N.
Paperback
A Handbook for Mainframe z/OS Enterprise Architects - Architecture and Design of Large-Scale Environments
Sahoo, Natabar
Paperback
Don't Be Afraid of the Mainframe: The Missing Introduction for IT Leaders and Professionals
de Greef, Niek
Paperback
Android Phone User Guide for Seniors: A Beginner-Friendly Guide to Calling, Texting, Photos, Apps & Online Safety
Foster, Henry L.
Paperback
Linux: A Complete Guide to Learn Linux Commands, Linux Operating System and Shell Scripting Step-by-Step
Ayden, Nicholas
Paperback
Developing Inclusive Mobile Apps: Building Accessible Apps for IOS and Android
Whitaker, Rob
Paperback
Linux: The ultimate guide to Linux for beginners, Linux hacking, Linux command line, Linux operating system, and more!
Newport, Craig
Paperback
Mastering Windows Server 2022 - Fourth Edition: Comprehensive administration of your Windows Server environment
Krause, Jordan
Paperback
Learning the VI and VIM Editors: Power and Agility Beyond Just Text Editing
Robbins, Arnold
Hannah, Elbert
Paperback
Chatgpt: A Guide to Making Money With Chatgpt (Creative Ways for Teens and Young Adults to Make Money With Chatgpt)
Trotter, Thomas
Paperback
Understanding the Linux Kernel: From I/O Ports to Process Management
Cesati, Marco
Bovet, Daniel P.
Paperback
Learn FileMaker Pro 2024: The Comprehensive Guide to Building Custom Databases
Munro, Mark Conway
Paperback
Practical Linux System Administration: A Guide to Installation, Configuration, and Management
Hess, Kenneth
Paperback
Debian 13.3 "Trixie" Desktop Handbook: A Practical Guide to Installing, Securing, and Mastering the Debian Linux Desktop - From Install to Advanced Ad
Rodgers, David A., Jr.
Paperback
iPhone for Seniors - iOS 15 Edition: The illustrated, Step-by-step guide on how to use iPhone (Large Print Edition)
Wilson, Kevin
Paperback
Arduino Software Internals: A Complete Guide to How Your Arduino Language and Hardware Work Together
Dunbar, Norman
Paperback
Canva User Guide For Beginners: Design Stunning Graphics for Social Media, Business, and More
Caden, Clara
Paperback
Head First Android Development: A Learner's Guide to Building Android Apps with Kotlin
Griffiths, David
Griffiths, Dawn
Paperback
Hotwire Native for Rails Developers: Build Native Mobile Apps Using Your Server
Masilotti, Joe
Paperback
Mastering Embedded Linux Development - Fourth Edition: Craft fast and reliable embedded solutions with Linux 6.6 and The Yocto Project 5.0 (Scarthgap)
Simmonds, Chris
Vasquez, Frank
Paperback
The Ultimate Linux Shell Scripting Guide: Automate, Optimize, and Empower tasks with Linux Shell Scripting
Tevault, Donald a.
Paperback
Ubuntu 26.04 LTS: A Comprehensive Guide for Beginners and Advanced Users
Rodgers, David A., Jr.
Paperback
iPad for Seniors - iPadOS 16 Edition: The illustrated, Step-by-step guide on how to use iPad (Large Print Edition)
Wilson, Kevin
Paperback