SQL Server Data Automation Through Frameworks
Apress (Verlag)
978-1-4842-6212-2 (ISBN)
Frameworks not only reduce the time required to deliver enterprise functionality, but can also accelerate troubleshooting and problem resolution. You'll learn in this book how frameworks also improve code quality by using metadata to drive processes. Much of the work performed by data professionals can be classified as “drudge work”—tasks that are repetitive and template-based. The frameworks-based approach shown in this book helps you to avoid that drudgery by turning repetitive tasks into "one and done" operations. Frameworks as described in this book also support enterprise DevOps with built-in logging functionality.
What You Will Learn
Create a stored procedure framework to automate SQL process execution
Base your framework on a working system of stored procedures and execution logging
Create an SSIS framework to reduce the complexity of executing multiple SSIS packages
Deploy stored procedure and SSIS frameworks to Azure Data Factory environments in the cloud
Who This Book Is For
Database administrators and developers who are involved in enterprise data projects built around stored procedures and SQL Server Integration Services (SSIS). Readersshould have a background in programming along with a desire to optimize their data efforts by implementing repeatable processes that support enterprise DevOps.
Andy Leonard is Chief Data Engineer at Enterprise Data & Analytics, creator and Data Philosopher at DILM (Data Integration Lifecycle Management) Suite, an Azure Data Factory and SQL Server Integration Services trainer and consultant, and a BimlHero. He is a SQL Server database and data warehouse developer, community mentor, engineer, and farmer. Andy is co-author of SQL Server Integration Services Design Patterns, Data Integration Life Cycle Management with SSIS, and The Biml Book. Kent Bradshaw is the founder or Tudor Data Solutions, LLC. With over 40 years of IT experience, he is a SQL Server database/ETL developer and database architect with a background is in Medicaid claims, public schools, government, retail, and insurance systems. In 2011, Kent founded Tudor Data Solutions, LLC to pursue new development opportunities which led to his association with Andy Leonard and Enterprise Data & Analytics. In 2017, Kent received the MPP certification for Data Science.
Part I: Stored Procedure-Based Database Frameworks.- 1. Stored Procedures 101.- 2. Automation with Stored Procedures.- 3. Stored Procedure Orchestrators.- 4. A Stored Procedure-Base Metadata-Driven Framework.- Part II: SSIS Frameworks.- 5. A Simple Custom File-Based SSIS Framework.- 6. Framework Execution Engine.- 7. Framework Logging.- 8. Azure-SSIS Integration Runtime.- 9. Deploy A Simple Custom File-Based Azure-SSIS Framework.- 10. Framework Logging in ADF.- 11. Fault Tolerance in the ADF Framework.
| Erscheinungsdatum | 26.10.2020 |
|---|---|
| Zusatzinfo | 350 Illustrations, black and white; XX, 391 p. 350 illus. |
| Verlagsort | Berkley |
| Sprache | englisch |
| Maße | 178 x 254 mm |
| Themenwelt | Informatik ► Datenbanken ► Data Warehouse / Data Mining |
| Informatik ► Datenbanken ► SQL Server | |
| Mathematik / Informatik ► Informatik ► Software Entwicklung | |
| Schlagworte | Azure Data Factory • Azure SQL • Azure SSIS • Biml • Business Intelligence Markup Language • DevOps • ELT • ETL • SQL Server • SQL Server Integration Services • ssis • Transact-SQL • T-SQL • Visual Studio |
| ISBN-10 | 1-4842-6212-3 / 1484262123 |
| ISBN-13 | 978-1-4842-6212-2 / 9781484262122 |
| Zustand | Neuware |
| Haben Sie eine Frage zum Produkt? |
aus dem Bereich
