Fundamentals Of Data Engineering Plan And Build Robust Data Systems By Joe Reis And Matt Housley
Download Fundamentals Of Data Engineering Plan And Build Robust Data Systems By Joe Reis And Matt Housley PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Fundamentals Of Data Engineering Plan And Build Robust Data Systems By Joe Reis And Matt Housley book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages.
Fundamentals of Data Engineering
Data engineering has grown rapidly in the past decade, leaving many software engineers, data scientists, and analysts looking for a comprehensive view of this practice. With this practical book, you'll learn how to plan and build systems to serve the needs of your organization and customers by evaluating the best technologies available in the framework of the data engineering lifecycle. Authors Joe Reis and Matt Housley walk you through the data engineering lifecycle and show you how to stitch together a variety of cloud technologies to serve the needs of downstream data consumers. You'll understand how to apply the concepts of data generation, ingestion, orchestration, transformation, storage, governance, and deployment that are critical in any data environment regardless of the underlying technology. This book will help you: Assess data engineering problems using an end-to-end data framework of best practices Cut through marketing hype when choosing data technologies, architecture, and processes Use the data engineering lifecycle to design and build a robust architecture Incorporate data governance and security across the data engineering lifecycle
Fundamentals of Data Engineering
Data engineering has grown rapidly in the past decade, leaving many software engineers, data scientists, and analysts looking for a comprehensive view of this practice. With this practical book, you'll learn how to plan and build systems to serve the needs of your organization and customers by evaluating the best technologies available through the framework of the data engineering lifecycle. Authors Joe Reis and Matt Housley walk you through the data engineering lifecycle and show you how to stitch together a variety of cloud technologies to serve the needs of downstream data consumers. You'll understand how to apply the concepts of data generation, ingestion, orchestration, transformation, storage, and governance that are critical in any data environment regardless of the underlying technology. This book will help you: Get a concise overview of the entire data engineering landscape Assess data engineering problems using an end-to-end framework of best practices Cut through marketing hype when choosing data technologies, architecture, and processes Use the data engineering lifecycle to design and build a robust architecture Incorporate data governance and security across the data engineering lifecycle
The Enterprise Data Catalog
Author: Ole Olesen-Bagneux
language: en
Publisher: "O'Reilly Media, Inc."
Release Date: 2023-02-15
Chapter 2. Organize Data: Design a Robust Architecture for Search -- Organizing Domains in the Data Catalog -- Domain Architecture in a Data Catalog -- Understanding Domains -- Processes and Capabilities -- Data Sources -- Getting Assets into the Data Catalog -- Pull -- Push -- Organizing Assets in the Domains -- Asset Metadata -- Metadata Quality -- Classification -- Summary -- Chapter 3. Understand Search: Concepts, Features, and Mechanics -- Why Do You Search in a Data Catalog? -- Search Features in a Data Catalog -- Searching in Data Versus Searching for Data