Data Engineering Design Patterns
Recipes for Solving the Most Common Data Engineering Problems
Seiten
2025
O'Reilly Media (Verlag)
978-1-0981-6581-9 (ISBN)
O'Reilly Media (Verlag)
978-1-0981-6581-9 (ISBN)
- Noch nicht erschienen (ca. März 2025)
- Versandkostenfrei
- Auch auf Rechnung
- Artikel merken
This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, and idempotency. Bartosz Konieczny shows you how to of build reliable end-to-end data engineering projects, from data ingestion to data observability.
Data projects are an intrinsic part of an organization's technical ecosystem, but data engineers in many companies are still trying to solve problems that others have already solved. This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, idempotency, and more.
Author Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios.
Throughout this journey, you'll use open source data tools and public cloud services to see how to put each pattern into practice. You'll learn:
Challenges data engineers face and their impact on data systems
How these challenges relate to data system components
What data engineering patterns are for
How to identify and fix issues with your current data components
Technology-agnostic solutions to new and existing data projects
How to implement patterns with Apache Airflow, Apache Spark, Apache Flink, and Delta Lake
Bartosz Konieczny is a freelance data engineer who's been coding for more than 15 years. He's held various senior hands-on positions that helped him work on many data engineering problems in batch and stream processing.
Data projects are an intrinsic part of an organization's technical ecosystem, but data engineers in many companies are still trying to solve problems that others have already solved. This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, idempotency, and more.
Author Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios.
Throughout this journey, you'll use open source data tools and public cloud services to see how to put each pattern into practice. You'll learn:
Challenges data engineers face and their impact on data systems
How these challenges relate to data system components
What data engineering patterns are for
How to identify and fix issues with your current data components
Technology-agnostic solutions to new and existing data projects
How to implement patterns with Apache Airflow, Apache Spark, Apache Flink, and Delta Lake
Bartosz Konieczny is a freelance data engineer who's been coding for more than 15 years. He's held various senior hands-on positions that helped him work on many data engineering problems in batch and stream processing.
| Erscheint lt. Verlag | 31.3.2025 |
|---|---|
| Verlagsort | Sebastopol |
| Sprache | englisch |
| Maße | 178 x 232 mm |
| Themenwelt | Mathematik / Informatik ► Informatik ► Datenbanken |
| ISBN-10 | 1-0981-6581-0 / 1098165810 |
| ISBN-13 | 978-1-0981-6581-9 / 9781098165819 |
| Zustand | Neuware |
| Informationen gemäß Produktsicherheitsverordnung (GPSR) | |
| Haben Sie eine Frage zum Produkt? |
Mehr entdecken
aus dem Bereich
aus dem Bereich
Einführung in die Praxis der Datenbankentwicklung für Ausbildung, …
Buch | Softcover (2021)
Springer Fachmedien Wiesbaden GmbH (Verlag)
CHF 69,95
