Sign-In
Cart
Big Data on Kubernetes: A practical guide to building efficient and scalable data solutions
Paperback
DatabasesGeneral ComputersNetworking
ISBN13: 9781835462140
Publisher: Packt Publishing
Published: Jul 19 2024
Pages: 296
Weight: 1.13
Height: 0.62 Width: 7.50 Depth: 9.25
Language: English
Gain hands-on experience in building efficient and scalable big data architecture on Kubernetes, utilizing leading technologies such as Spark, Airflow, Kafka, and Trino
Key Features:
- Leverage Kubernetes in a cloud environment to integrate seamlessly with a variety of tools
- Explore best practices for optimizing the performance of big data pipelines
- Build end-to-end data pipelines and discover real-world use cases using popular tools like Spark, Airflow, and Kafka
- Purchase of the print or Kindle book includes a free PDF eBook
Book Description:
In today's data-driven world, organizations across different sectors need scalable and efficient solutions for processing large volumes of data. Kubernetes offers an open-source and cost-effective platform for deploying and managing big data tools and workloads, ensuring optimal resource utilization and minimizing operational overhead. If you want to master the art of building and deploying big data solutions using Kubernetes, then this book is for you.
Written by an experienced data specialist, Big Data on Kubernetes takes you through the entire process of developing scalable and resilient data pipelines, with a focus on practical implementation. Starting with the basics, you'll progress toward learning how to install Docker and run your first containerized applications. You'll then explore Kubernetes architecture and understand its core components. This knowledge will pave the way for exploring a variety of essential tools for big data processing such as Apache Spark and Apache Airflow. You'll also learn how to install and configure these tools on Kubernetes clusters. Throughout the book, you'll gain hands-on experience building a complete big data stack on Kubernetes.
By the end of this Kubernetes book, you'll be equipped with the skills and knowledge you need to tackle real-world big data challenges with confidence.
What You Will Learn:
- Install and use Docker to run containers and build concise images
- Gain a deep understanding of Kubernetes architecture and its components
- Deploy and manage Kubernetes clusters on different cloud platforms
- Implement and manage data pipelines using Apache Spark and Apache Airflow
- Deploy and configure Apache Kafka for real-time data ingestion and processing
- Build and orchestrate a complete big data pipeline using open-source tools
- Deploy Generative AI applications on a Kubernetes-based architecture
Who this book is for:
If you're a data engineer, BI analyst, data team leader, data architect, or tech manager with a basic understanding of big data technologies, then this big data book is for you. Familiarity with the basics of Python programming, SQL queries, and YAML is required to understand the topics discussed in this book.
Table of Contents
- Getting Started with Containers
- Kubernetes Architecture
- Kubernetes - Hands On
- The Modern Data Stack
- Big Data processing with Apache Spark
- Apache Airflow for building pipelines
- Apache Kafka for real time events and data ingestion
- Deploying the Big Data Stack on Kubernetes
- Data consumption layer
- Building a Big Data Pipeline on Kubernetes
- AI/ML Workloads on Kubernetes
- Where to go from here
Also in
Networking
CompTIA Network+ Certification All-in-One Exam Guide, Ninth Edition (Exam N10-009)
Weissman, Jonathan S.
Paperback
The Groundbreaker: Entrepreneurship, the American Dream, and the Rise of Modern India
Rekhi, Kanwal
Hardcover
The Practice of System and Network Administration: Devops and Other Best Practices for Enterprise It, Volume 1
Limoncelli, Thomas
Hogan, Christina
Chalup, Strata
Paperback
The Wireless Cookbook: Build Real Projects and Master Wi-Fi, Bluetooth, and Lora
Zimmerman, Bill
Paperback
Home Assistant for Beginners: Build a private smart home without relying on the cloud
Haagenrud, Thom
Paperback
Mobile Forensic Investigations: A Guide to Evidence Collection, Analysis, and Presentation, Second Edition
Reiber, Lee
Paperback
AI Data Center Network Design and Technologies
Subramaniam, Mahesh
Styszynski, Michal
Tambakuwala, Himanshu
Paperback
Computer Science Unleashed: Harness the Power of Computational Systems
Ferreira Filho, Wladston
Pictet, Raimondo
Paperback
Cilium: Up and Running: Cloud Native Networking, Security, and Observability
Laverack, James
Vibert, Nico
Nikolic, Filip
Paperback
Mastering the Togaf(r) Standard: A Practical Translation of the World's Leading Architecture Framework
Jager, Eric
Paperback
Root cause: Stories and Lessons from Two Decades of Backend Engineering Bugs
Nasser, Hussein
Paperback
CCNP and CCIE Data Center Core Dccor 350-601 Official Cert Guide
Ahmed, Firas
Nikolov, Iskren
Maloo, Somit
Paperback
Meshtastic: A Comprehensive Guide to Off-Grid Mesh Communication: Second Edition
Rodgers, David A., Jr.
Paperback
31 Days Before Your CCNA Exam: A Day-By-Day Review Guide for the CCNA 200-301 Certification Exam
Johnson, Allan
Paperback
CCNP and CCIE Enterprise Core & CCNP Enterprise Advanced Routing Portable Command Guide: All Encor (350-401) and Enarsi (300-410) Commands in One Comp
Empson, Scott
Gargano, Patrick
Paperback
Industrial Cybersecurity - Second Edition: Efficiently monitor the cybersecurity posture of your ICS environment
Ackerman, Pascal
Paperback
Red Team Engineering: The Art of Building Offensive Tools and Infrastructure
Erdmann, Casey
Paperback
High Performance Browser Networking: What Every Web Developer Should Know about Networking and Web Performance
Grigorik, Ilya
Paperback
Zero Trust Networks: Building Secure Systems in Untrusted Networks
Rais, Razi
Morillo, Christina
Gilman, Evan
Paperback
Learn Computer Forensics - Second Edition: Your one-stop guide to searching, analyzing, acquiring, and securing digital evidence
Oettinger, William
Paperback
Network Programmability and Automation: Skills for the Next-Generation Network Engineer
Oswalt, Matt
Adell, Christian
Lowe, Scott S.
Paperback
Hands-On Network Forensics: Investigate network attacks and find evidence using common network forensic tools
Jaswal, Nipun
Paperback
Mastering Linux Security and Hardening - Third Edition: A practical guide to protecting your Linux system from cyber attacks
Tevault, Donald a.
Paperback
The Accidental Administrator: Cisco Router Step-by-Step Configuration Guide
Crawley, Don R.
Paperback
IA desde cero: Inteligencia Artificial explicada de forma fácil
García García-Tuñón, Susana
Paperback
Cisco ASA for Accidental Administrators: An Illustrated Step-by-Step ASA Learning and Configuration Guide
Crawley, Don R.
Paperback
Cisco CCNA Command Guide: An Introductory Guide for CCNA & Computer Networking Beginners
Nastase, Ramon
Paperback
Welcome to the Cold Aisle: A Data Center Technicians No-Nonsense Survival Guide For Day One And On
Ortiz, Jason
Paperback
Learning API Styles: Understanding the Trade-Offs of Common APIs and Choosing the Correct Solutions
Dulak, Marcin
Dynowski, Lukasz
Paperback
The Fraud Fighter's AI Playbook: Strategies for the Genai Era
Zamir, Chen
Saporta, Gilit
Maraney, Shoshana
Paperback
Business Data Communications & IT Infrastructures
Agrawal, Manish
Daniel, Clinton
Connolly, Amy
Paperback
Delta Lake: The Definitive Guide: Modern Data Lakehouse Architectures with Data Lakes
Haines, Scott
Lee, Denny
Wentling, Tristen
Paperback
Gray Hat Hacking: The Ethical Hacker's Handbook, Sixth Edition
Sims, Stephen
Harper, Allen
Linn, Ryan
Paperback
The Home Network Manual: The Complete Guide to Setting Up, Upgrading, and Securing Your Home Network
Buchanan, Marlon
Paperback
Engineering Trustworthy Systems: Get Cybersecurity Design Right the First Time
Saydjari, O. Sami
Paperback
Crafting Great APIs with Domain-Driven Design: Collaborative Craftsmanship of Asynchronous and Synchronous APIs
Junker, Annegret
Lazzaretti, Fabrizio
Paperback
Autonomous Networks: Using AI to Advance Operations in Sp and Enterprise Domains
Manza, Stefan-Alexandru
Halley, Josh
Paperback
A Complete Guide to Agentforce: Plan, Design, Build and Run AI Agents with Salesforce
Kovala, Timo
Paperback
Mike Meyers' Comptia Network+ Guide to Managing and Troubleshooting Networks, Sixth Edition (Exam N10-008)
Jernigan, Scott
Paperback
A Beginner's Guide to Mainframe z/OS Networking - Connecting and Communicating in the Mainframe World - Book 5
Sahoo, Natabar
Paperback
Wireshark Certified Network Analyst Exam Prep Guide (Second Edition): WCNA Official Exam Prep Guide
Chappell, Laura
Paperback
ITIL(R) 4 Create, Deliver and Support (CDS): Your companion to the ITIL 4 Managing Professional CDS certification
Agutter, Claire
Paperback
Linux Kernel Programming - Second Edition: A comprehensive and practical guide to kernel internals, writing modules, and kernel synchronization
Billimoria, Kaiwan N.
Paperback
Tapo Tp-Link 1080p Indoor Security Camera User Guide: Unlock Powerful Tools for Safer Spaces and Smarter Control
Marcus, Alex
Paperback
Fatal Abstraction: Revolutionizing Strategy and Innovation for the Age of AI
Nichols, Michael
Paperback
Cisco CCNA Command Guide: An Introductory Guide for CCNA & Computer Networking Beginners
Nastase, Ramon
Paperback
CCNP Data Center Application Centric Infrastructure 300-620 Dcaci Official Cert Guide
Ahmadi, Ammar
Hardcover
Comptia(r) Network+ 1 Concepts & Implementation Study Guide: A Quickstudy Laminated Reference
Antoniou, George
Other
Security Operations Center: Building, Operating, and Maintaining Your Soc
Alfardan, Nadhem
Muniz, Joseph
McIntyre, Gary
Paperback
The Elements of Networking Style: And Other Essays & Animadversions on the Art of Intercomputer Networking
Padlipsky, M. a.
Paperback
The Practice of Network Security Monitoring: Understanding Incident Detection and Response
Bejtlich, Richard
Paperback
Linux for Makers: Understanding the Operating System That Runs Raspberry Pi and Other Maker Sbcs
Newcomb, Aaron
Paperback
Mastering Palo Alto Networks - Third Edition: The complete journey to firewall mastery from setup to advanced security
'Reaper', Tom Piens Aka
Paperback
IP Subnetting for Beginners: Your Complete Guide to Master IP Subnetting in 4 Simple Steps
Nastase, Ramon A.
Paperback
Electronics Projects with the Esp8266 and Esp32: Building Web Pages, Applications, and Wifi Enabled Devices
Cameron, Neil
Paperback
Mastering Windows Server 2022 - Fourth Edition: Comprehensive administration of your Windows Server environment
Krause, Jordan
Paperback
Development and Deployment of Multiplayer Online Games, Vol. II: DIY, (Re)Actors, Client Arch., Unity/UE4/ Lumberyard/Urho3D
Hare, 'No Bugs'
Hardcover
Mastering Linux Security and Hardening - Third Edition: A practical guide to protecting your Linux system from cyber attacks
Tevault, Donald a.
Hardcover
Enterprise Guide for Implementing Generative AI and Agentic AI: A Practical Guide to Developing, Deploying, and Operationalizing Ai-Driven Application
Edward, Shakuntala Gupta
Bhattacharya, Rahul
Sinha, Vikas
Paperback
Comando de Linux: Una guía completa para principiantes para aprender los reinos del comando Linux desde A-Z
Vance, William
Paperback
Ccde V3 Practice Labs: Preparing for the Cisco Certified Design Expert Lab Exam
Duggan, Martin
Paperback
Hacking Exposed Industrial Control Systems: ICS and Scada Security Secrets & Solutions
Singer, Bryan
Shbeeb, Aaron
Bodungen, Clint
Paperback
Silence on the Wire: A Field Guide to Passive Reconnaissance and Indirect Attacks
Zalewski, Michal
Paperback
Top 20 Essential Skills for ArcGIS Utility Network
Cremons, Christopher
Myers, Remi
Mayo, Melissa L.
Paperback
What We Talk About When We Talk About Systems: Essays on the Systems Approach
Davie, Bruce S.
Peterson, Larry L.
Paperback
Computer Networking: Beginner's guide for Mastering Computer Networking and the
Nastase, Ramon
Paperback
Intro to Bluetooth Low Energy: Learn Bluetooth Low Energy in a single weekend
Afaneh, Mohammad
Paperback
The Iot Hacker's Handbook: A Practical Guide to Hacking the Internet of Things
Gupta, Aditya
Paperback
UNIX in a Nutshell: A Desktop Quick Reference - Covers Gnu/Linux, Mac OS X, and Solaris
Robbins, Arnold
Paperback
Agentic AI in Enterprise: Harnessing Agentic AI for Business Transformation
Lobo, Lanwin
Ranjan, Sumit
Chembachere, Divya
Paperback
Asterisk: The Definitive Guide: Open Source Telephony for the Enterprise
Madsen, Leif
Meggelen, Jim Van
Bryant, Russell
Paperback
Time Management for System Administrators: Stop Working Late and Start Working Smart
Limoncelli, Thomas A.
Paperback
Hacking Exposed Wireless: Wireless Security Secrets & Solutions
Cache, Johnny
Wright, Joshua
Paperback
AWS for Solutions Architects - Third Edition: Design and scale secure AWS architectures with GenAI strategies and real-world patterns
Thakur, Dhiraj
Shrivastava, Saurabh
Srivastav, Neelanjali
Paperback
AI Networking Cookbook: Practical recipes for AI-assisted network automation and development
Chou, Eric
Paperback
Intelligent Iot Analytics: Concepts and Real-World Applications
Mahendra, Adhiguna
Rinaldi, Ekki
Paperback
Cwna Certified Wireless Network Administrator Study Guide: Exam Cwna-108
Westcott, David A.
Coleman, David D.
Paperback
Practical Lakehouse Architecture: Designing and Implementing Modern Data Platforms at Scale
Thalpati, Gaurav Ashok
Paperback
Business Data Communications and Networking
Durcikova, Alexandra
Fitzgerald, Jerry
Dennis, Alan
Paperback
Eco-Networking for Iot: Designing Energy-Efficient Models to Enhance Network Performance
Pandey, Bishwajeet
Sharma, Divya
Paperback
Migrating to SAP S/4hana: Operating Models, Migration Scenarios, Tools, and Implementation
Höft, Martina
Densborn, Frank
Finkbohner, Frank
Hardcover
Samsung Galaxy A16 5g User Guide for Beginners and Seniors: Samsung Galaxy A16 5g User Guide for Beginners and Seniors
Macvey, Elliot A. a.
Paperback
The Real Internet Architecture: Past, Present, and Future Evolution
Rexford, Jennifer
Zave, Pamela
Paperback
Development and Deployment of Multiplayer Online Games, Vol. I: GDD, Authoritative Servers, Communications
Hare, 'No Bugs'
Hardcover
iPhone 8: The User Guide For all iPhone 8, iPhone 8 Plus and older iPhone model Users
Binjeh, Jhale
Paperback
Perceptrons, Reissue of the 1988 Expanded Edition with a New Foreword by Léon Bottou: An Introduction to Computational Geometry
Minsky, Marvin
Papert, Seymour A.
Paperback
TCP/IP Illustrated, Volume 3: TCP for Transactions, Http, Nntp, and the UNIX Domain Protocols
Stevens, W.
Paperback
Beginning Lora Radio Networks with Arduino: Build Long Range, Low Power Wireless Iot Networks
Seneviratne, Pradeeka
Paperback