GC Partner no outline H
8173  Reviews star_rate star_rate star_rate star_rate star_half

Managing a Data Mesh with Dataplex

Dataplex is an intelligent data fabric that enables organizations to centrally discover, manage, monitor, and govern their data across data lakes, data warehouses, and data marts. You can use...

Read More
$1,800 USD
Course Code GCP-DM-DPX
Duration 2 days
Available Formats Classroom, Virtual

Dataplex is an intelligent data fabric that enables organizations to centrally discover, manage, monitor, and govern their data across data lakes, data warehouses, and data marts. You can use Dataplex to build a data mesh architecture to decentralize data ownership among domain data owners.

In this course, you will learn how to discover, manage, monitor, and govern your data across data lakes, data warehouses, and data marts through guided lectures and independent exercises using sample data.

Skills Gained

  • Identify the importance of a modern data platform
  • Configure and set up Dataplex
  • Secure data lakes, zones, and assets
  • Implement tagging for resources and use tags to search for assets
  • Process data using Dataplex tasks
  • Design, execute and report on data quality processes

Who Can Benefit

Customers

Prerequisites

Completion of the "Modernizing Data Lakes and Data Warehouses with Google Cloud" and "Building Batch Data Pipelines on Google Cloud" courses in the "Data Engineer" learning path or equivalent experience using Google Cloud.

Course Details

Course Outline

Introduction to Dataplex

  • Modern Data Platforms and Data-Oriented Design
  • Pillars of Data Governance
  • What is Dataplex?
  • Dataplex Capabilities
  • Dataplex compared with other products on Google Cloud
  • Identify the importance of a modern data platform
  • Explain the role of Dataplex on Google Cloud

Creating a Data Mesh on Dataplex

  • What is a data mesh?
  • Dataplex concepts
  • Creating data lakes and zones
  • Assets in Dataplex
  • Define key Dataplex concepts
  • Configure and set up Dataplex
  • Lab: Provision a Data Mesh using Dataplex

Processing Data on Dataplex

  • Processing data on Dataplex
  • Data preparation tasks
  • Ingestion jobs
  • Dataflow and Spark tasks
  • Understand different data processing options in Dataplex
  • Configure and run data preparation tasks on Dataplex
  • Lab: Standardize Data using Dataplex Tasks

Managing Data Security through Dataplex

  • IAM permissions and roles
  • Securing your data lake
  • Policy management
  • Metadata security
  • Secure data lakes, zones, and assets in Dataplex
  • Lab: Manage Data Security using Dataplex

Data Tagging and Data Catalog

  • Introduction to Data Catalog
  • Technical metadata vs. business metadata
  • Tags and tag templates
  • Entries and entry groups
  • Data lineage
  • Implement tagging for resources and use tags to search for assets
  • Lab: Data Catalog and Data Lineage

Data Quality and Profiling

  • Data quality tasks and AutoDQ
  • Reporting on data quality
  • Data profiling
  • Design, execute and report on data quality processes
  • Lab: Data Quality and Profiling your Data in BigQuery

Dataplex Best Practices

  • Best practices
  • End-to-end demo
  • Implement best practices for Dataplex
  • Challenge Lab: Managing a Data Mesh with Dataplex
|
View Full Schedule