Sign-In
Cart
Azure Data Engineering Cookbook - Second Edition: Get well versed in various data engineering techniques in Azure using this recipe-based guide
Paperback
ISBN13: 9781803246789
Publisher: Packt Pub
Published: Sep 26 2022
Pages: 608
Weight: 2.27
Height: 1.23 Width: 7.50 Depth: 9.25
Language: English
Nearly 80 recipes to help you collect and transform data from multiple sources into a single data source, making it way easier to perform analytics on the data
Key Features:
- Build data pipelines from scratch and find solutions to common data engineering problems
- Learn how to work with Azure Data Factory, Data Lake, Databricks, and Synapse Analytics
- Monitor and maintain your data engineering pipelines using Log Analytics, Azure Monitor, and Azure Purview
Book Description:
The famous quote 'Data is the new oil' seems more true every day as the key to most organizations' long-term success lies in extracting insights from raw data. One of the major challenges organizations face in leveraging value out of data is building performant data engineering pipelines for data visualization, ingestion, storage, and processing. This second edition of the immensely successful book by Ahmad Osama brings to you several recent enhancements in Azure data engineering and shares approximately 80 useful recipes covering common scenarios in building data engineering pipelines in Microsoft Azure.
You'll explore recipes from Azure Synapse Analytics workspaces Gen 2 and get to grips with Synapse Spark pools, SQL Serverless pools, Synapse integration pipelines, and Synapse data flows. You'll also understand Synapse SQL Pool optimization techniques in this second edition. Besides Synapse enhancements, you'll discover helpful tips on managing Azure SQL Database and learn about security, high availability, and performance monitoring. Finally, the book takes you through overall data engineering pipeline management, focusing on monitoring using Log Analytics and tracking data lineage using Azure Purview.
By the end of this book, you'll be able to build superior data engineering pipelines along with having an invaluable go-to guide.
What You Will Learn:
- Process data using Azure Databricks and Azure Synapse Analytics
- Perform data transformation using Azure Synapse data flows
- Perform common administrative tasks in Azure SQL Database
- Build effective Synapse SQL pools which can be consumed by Power BI
- Monitor Synapse SQL and Spark pools using Log Analytics
- Track data lineage using Microsoft Purview integration with pipelines
Who this book is for:
This book is for data engineers, data architects, database administrators, and data professionals who want to get well versed with the Azure data services for building data pipelines. Basic understanding of cloud and data engineering concepts will help in getting the most out of this book.
Also from
Venkatesan, Nagaraj
Architecting Power BI Solutions in Microsoft Fabric: Design optimal solutions using Power BI to address common data problems
Venkatesan, Nagaraj
Paperback
Also in
Databases
Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems
Kleppmann, Martin
Paperback
The Definitive Guide to Dax: Business Intelligence for Microsoft Power Bi, SQL Server Analysis Services, and Excel
Russo, Marco
Ferrari, Alberto
Paperback
Fundamentals of Data Engineering: Plan and Build Robust Data Systems
Housley, Matt
Reis, Joe
Paperback
Practical Statistics for Data Scientists: 50+ Essential Concepts Using R and Python
Bruce, Andrew
Gedeck, Peter
Bruce, Peter
Paperback
The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling
Ross, Margy
Kimball, Ralph
Paperback
Introduction to Statistics: An Intuitive Guide for Analyzing Data and Unlocking Discoveries
Frost, Jim
Paperback
Product Operations: How successful companies build better products at scale
Tilles, Denise
Perri, Melissa
Paperback
Data Engineering for Cybersecurity: Build Secure Data Pipelines with Free and Open-Source Tools
Bonifield, James
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Hardcover
High Performance Python: Practical Performant Programming for Humans
Ozsvald, Ian
Gorelick, Micha
Paperback
PR Technology, Data and Insights: Igniting a Positive Return on Your Communications Investment
Weiner, Mark
Paperback
Fusion Strategy: How Real-Time Data and AI Will Power the Industrial Future
Govindarajan, Vijay
Venkatraman, Venkat
Hardcover
Data Engineering Design Patterns: Recipes for Solving the Most Common Data Engineering Problems
Konieczny, Bartosz
Paperback
SQL for Data Analysis: Advanced Techniques for Transforming Data Into Insights
Tanimura, Cathy
Paperback
How to Interpret Data: Using Data to Improve Your Influence and Decision-Making
Kelly, Nicholas
Paperback
Databricks Certified Data Engineer Associate Study Guide: In-Depth Guidance and Practice
Alhussein, Derar
Paperback
Football Analytics with Python & R: Learning Data Science Through the Lens of Sports
Eager, Eric A.
Erickson, Richard a.
Paperback
SQL Cookbook: Query Solutions and Techniques for All SQL Users
Molinaro, Anthony
Graaf, Robert de
Paperback
Kafka: The Definitive Guide: Real-Time Data and Stream Processing at Scale
Palino, Todd
Sivaram, Rajini
Shapira, Gwen
Paperback
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL
Shields, Walter
Paperback
The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition
Tibshirani, Robert
Hastie, Trevor
Friedman, Jerome
Hardcover
Mathletics: How Gamblers, Managers, and Fans Use Mathematics in Sports, Second Edition
Nestler, Scott
Pelechrinis, Konstantinos
Winston, Wayne L.
Paperback
Data Analytics & Visualization All-In-One for Dummies
Hyman, Jack A.
McFedries, Paul
Massaron, Luca
Paperback
Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World, 3rd Edition
Kent, William
Paperback
Non-Invasive Data Governance: The Path of Least Resistance and Greatest Success
Seiner, Robert
Paperback
PostgreSQL 16 Administration Cookbook: Solve real-world Database Administration challenges with 180+ practical recipes and best practices
Ciolli, Gianni
Mejías, Boriss
Angelakos, Jimmy
Paperback
Data Governance with Unity Catalog on Databricks: Implement Data and AI Governance with Databricks Data Intelligence Platform
Subbarao, Karthik
Sreekumar, Kiran
Paperback
Data Modeling with Microsoft Power BI: Self-Service and Enterprise Data Warehouse with Power BI
Ehrenmueller-Jensen, Markus
Paperback
Omnimics: An Executive Playbook for Artificial Intelligence and Analytics
Fetherling, J. Tod
Paperback
Data Literacy in Practice: A complete guide to data literacy and making smarter decisions with data through intelligent actions
Klidas, Angelika
Hanegan, Kevin
Paperback
Numerical Python: Scientific Computing and Data Science Applications with Numpy, Scipy and Matplotlib
Johansson, Robert
Paperback
Collect, Combine, and Transform Data Using Power Query in Power Bi and Excel
Maslyuk, Daniil
Raviv, Gil
Paperback
Observability Engineering: Achieving Production Excellence
Majors, Charity
Fong-Jones, Liz
Miranda, George
Paperback
SAP S/4hana Financial Accounting Certification Guide: Application Associate Exam
Pougkas, Stefanos
Paperback
Apache Iceberg: The Definitive Guide: Data Lakehouse Functionality, Performance, and Scalability on the Data Lake
Shiran, Tomer
Hughes, Jason
Merced, Alex
Paperback
A Friendly Guide to Data Science: Everything You Should Know about the Hottest Field in Tech
Vincent, Kelly P.
Paperback
Becoming a Data Head: How to Think, Speak, and Understand Data Science, Statistics, and Machine Learning
Gutman, Alex J.
Goldmeier, Jordan
Paperback
Data Analytics Made Easy: Analyze and present data to make informed decisions without writing any code
Mauro, Andrea de
Paperback
Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems
Kleppmann, Martin
Riccomini, Chris
Paperback
Learning Statistics with Jamovi: A Tutorial for Beginners in Statistical Analysis
Foxcroft, David
Navarro, Danielle
Paperback
Neo4j: The Definitive Guide: Hands-On Recipes for Production-Ready Graph Implementations
Willemsen, Christophe
Misquitta, Luanne
Paperback
Learning Tableau 2025 - Sixth Edition: Leverage Tableau's newest features to revolutionize your data storytelling with AI-enhanced insights
Milligan, Joshua N.
Paperback
Advanced Snowflake: Processing Data, Developing Applications, and Deploying ML Models at Scale
Ullah, Muhammad Fasih
Paperback
Agile Data Warehouse Design: Collaborative Dimensional Modeling, from Whiteboard to Star Schema
Corr, Lawrence
Stagnitto, Jim
Paperback
Data Science at the Command Line: Obtain, Scrub, Explore, and Model Data with UNIX Power Tools
Janssens, Jeroen
Paperback
Data Analytics with Hadoop: An Introduction for Data Scientists
Bengfort, Benjamin
Kim, Jenny
Paperback
SQL Server 2025 Unveiled: The Ai-Ready Enterprise Database with Microsoft Fabric Integration
Ward, Bob
Paperback
Turning Data into Wisdom: How We Can Collaborate with Data to Change Ourselves, Our Organizations, and Even the World
Hanegan, Kevin
Paperback
Databricks Data Intelligence Platform: Unlocking the Genai Revolution
Gupta, Nikhil
Yip, Jason
Paperback
Next-Level A/B Testing: Repeatable, Rapid, and Flexible Product Experimentation
Nassery, Leemay
Paperback
Data Governance: The Definitive Guide: People, Processes, and Tools to Operationalize Data Trustworthiness
Gilad, Uri
Lakshmanan, Valliappa
Eryurek, Evren
Paperback
Analytics Engineering with SQL and Dbt: Building Meaningful Data Models at Scale
Machado, Rui
Russa, Hélder
Paperback
PostgreSQL Query Optimization: The Ultimate Guide to Building Efficient Queries
Bailliekova, Anna
Database Expert
Dombrovskaya, Henrietta
Paperback
Practical Lakehouse Architecture: Designing and Implementing Modern Data Platforms at Scale
Thalpati, Gaurav Ashok
Paperback
Analytics the Right Way: A Business Leader's Guide to Putting Data to Productive Use
Wilson, Tim
Sutherland, Joe
Paperback
Everybody Lies: Big Data, New Data, and What the Internet Can Tell Us about Who We Really Are
Stephens-Davidowitz, Seth
Paperback
Practical Time Series Analysis: Prediction with Statistics and Machine Learning
Nielsen, Aileen
Paperback
First-Party Data Activation: Modernize Your Marketing Data Platform
Joosten, David H.
Magauova, Alina D.
Kennis, Oscar
Paperback
Kafka for Architects: Event-Driven Architecture, Logs, Microservices, Real-Time Event Processing
Gorshkova, Katya
Paperback
High Performance PostgreSQL for Rails: Reliable, Scalable, Maintainable Database Applications
Atkinson, Andrew
Paperback
Text as Data: A New Framework for Machine Learning and the Social Sciences
Grimmer, Justin
Roberts, Margaret E.
Stewart, Brandon M.
Paperback
Big Data in Der Mobilität: Akteure, Geschäftsmodelle Und Nutzenpotenziale Für Die Welt Von Morgen
Müller-Peters, Horst
Gatzert, Nadine
Knorre, Susanne
Paperback
Excel 2021: Everything you need to know about Excel to go from Beginner to Expert
Wright, Nora E.
Paperback
High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark
Warren, Rachel
Karau, Holden
Paperback
Practical Natural Language Processing: A Comprehensive Guide to Building Real-World Nlp Systems
Majumder, Bodhisattwa
Gupta, Anuj
Vajjala, Sowmya
Paperback
SQL Server 2022 Query Performance Tuning: Troubleshoot and Optimize Query Performance
Fritchey, Grant
Paperback
Data Science on the Google Cloud Platform: Implementing End-To-End Real-Time Data Pipelines: From Ingest to Machine Learning
Lakshmanan, Valliappa
Paperback
Microsoft Power Bi Visual Calculations: Simplifying Dax
Lelijveld, Marc
Ter Heerdt, Jeroen
Stikkelorum, Madzy
Paperback
SQL for Data Scientists: A Beginner's Guide for Building Datasets for Analysis
Teate, Renee M. P.
Paperback
Blockchain: The Comprehensive Guide to Blockchain Development, Ethereum, Solidity, and Smart Contracts
Schütz, Andreas
Fertig, Tobias
Paperback
Learn PostgreSQL - Second Edition: Use, manage and build secure and scalable databases with PostgreSQL 16
Ferrari, Luca
Pirozzi, Enrico
Paperback
Introduction to Statistics: An Intuitive Guide for Analyzing Data and Unlocking Discoveries
Frost, Jim
Hardcover
Cassandra: The Definitive Guide, (Revised) Third Edition: Distributed Data at Web Scale
Carpenter, Jeff
Hewitt, Eben
Paperback
Ciencia de Datos: Guía completa para principiantes para aprender los reinos de la ciencia de datos
Vance, William
Paperback
Social Media Exposed: Track Disinformation, Spot Bots, and Find Out What's Really Happening
Abrahams, Alexei Sisulu
Paperback
Stream Processing with Apache Flink: Fundamentals, Implementation, and Operation of Streaming Applications
Kalavri, Vasiliki
Hueske, Fabian
Paperback
Aprende SQL en un fin de semana: El curso definitivo para crear y consultar bases de datos
Padial Solier, Antonio
Paperback
Statistical Quantitative Methods in Finance: From Theory to Quantitative Portfolio Management
Ahlawat, Samit
Paperback
Apache Polaris: The Definitive Guide: Enriching Apache Iceberg Data Lakehouses with an Open Source Catalog
Shiran, Tomer
Madson, Andrew
Merced, Alex
Paperback
AWS Certified Data Engineer Study Guide: Associate (Dea-C01) Exam
Gumbo, Chenjerai
Gatt, Adam
Humair, Syed
Paperback
Streaming Databases: Unifying Batch and Stream Processing
Dulay, Hubert
Debusmann, Ralph Matthias
Paperback
The Data Storyteller's Handbook: How to create business impact using data storytelling
Greenbrook, Kat
Paperback
The Data Management Workbook: Practical Exercises for Better Organization, Storage and Use of Your Research Data
Briney, Kristin
Paperback
Implementing Data Mesh: Design, Build, and Implement Data Contracts, Data Products, and Data Mesh
Perrin, Jean-Georges
Broda, Eric
Paperback
Pro Oracle Database 23ai Administration: Manage and Safeguard Your Organization's Data
Malcher, Michelle
Kuhn, Darl
Paperback
Mastering Access 365: An Easy Guide to Building Efficient Databases for Managing Your Data
George, Nathan
Hardcover
Financial Data Science with Python: An Integrated Approach to Analysis, Modeling, and Machine Learning
Chen, Haojun
Paperback
Data Strategy: How to Use Data and Artificial Intelligence to Transform Your Business
Marr, Bernard
Paperback
How to Interpret Data: Using Data to Improve Your Influence and Decision-Making
Kelly, Nicholas
Hardcover
Managing Data as a Product: Design and build data-product-centered socio-technical architectures
Gioia, Andrea
Paperback
High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark
Polak, Adi
Warren, Rachel
Karau, Holden
Paperback
Dataproc Cookbook: Running Spark and Hadoop Workloads in Google Cloud
Sadineni, Narasimha
Venkataraman, Anuyogam
Paperback
Cracking the Data Science Interview: Unlock insider tips from industry experts to master the data science field
Gonzalez, Leondra R.
Stubberfield, Aaren
Paperback
Optimizing DAX: Improving DAX performance in Microsoft Power BI and Analysis Services
Russo, Marco
Ferrari, Alberto
Paperback