
Mapping Data Flows in Azure Data Factory: Building Scalable ETL Projects in the Microsoft Cloud
Mark Kromer
Résumé
The book begins with an introduction to Azure Data Factory followed by an introduction to its Mapping Data Flows feature set. Subsequent chapters show how to build your first pipeline and corresponding data flow, implement common design patterns, and operationalize your result. By the end of the book, you will be able to apply what you've learned to your complex data integration and ETL projects in Azure. These projects will enable cloud-scale big analytics and data loading and transformation best practices for data warehouses.
What You Will Learn
- Build scalable ETL jobs in Azure without writing code
- Transform big data for data quality and data modeling requirements
- Understand the different aspects of Azure Data Factory ETL pipelines from datasets and Linked Services to Mapping Data Flows
- Apply best practices for designing and managing complex ETL data pipelines in Azure Data Factory
- Add cloud-based ETL patterns to your set of data engineering skills
- Build repeatable code-free ETL design patterns
Who This Book Is For
Data engineers who are new to building complex data transformation pipelines in the cloud with Azure; and data engineers who need ETL solutions that scale to match swiftly growing volumes of data
Part I. Getting Started with Azure Data Factory and Mapping Data Flows 1. Introduction to Azure Data Factory2. Introduction to Mapping Data Flows
Part II. Designing Scalable ETL Jobs with ADF Mapping Data Flows 3. Build Your First Pipeline4. Common Pipeline Patterns5. Design Your First Mapping Data Flow6. Common Data Flow Patterns7. Debugging Mapping Data Flows8. Data Pipelines with Data Flows
Part III. Operationalize your ETL Data Pipelines 9. CI/CD and Scheduling10. Monitoring, Management, and Security
Part IV. Sample Project 11. Build a New ETL Project in ADF using Mapping Data Flows12. End-to-End Review of the ADF Project
Caractéristiques techniques
PAPIER | |
Éditeur(s) | Apress |
Auteur(s) | Mark Kromer |
Parution | 25/08/2022 |
Nb. de pages | 194 |
EAN13 | 9781484286111 |
Avantages Eyrolles.com
Consultez aussi
- Les meilleures ventes en Graphisme & Photo
- Les meilleures ventes en Informatique
- Les meilleures ventes en Construction
- Les meilleures ventes en Entreprise & Droit
- Les meilleures ventes en Sciences
- Les meilleures ventes en Littérature
- Les meilleures ventes en Arts & Loisirs
- Les meilleures ventes en Vie pratique
- Les meilleures ventes en Voyage et Tourisme
- Les meilleures ventes en BD et Jeunesse