logo


your one source for IT & AV

Training Presentation Systems Services & Consulting Cloud Services Purchase Client Center Computer Museum
Arrow Course Schedule | Classroom Rentals | Student Information | Free Seminars | Client Feedback | Partners | Survey | Standby Discounts

Data Integration with Cloud Data Fusion

SS Course: 64551

Course Overview

TOP
This 2-day course introduces learners to Google Clouds data integration capability using Cloud Data Fusion. In this course, we discuss challenges with data integration and the need for a data integration platform (middleware). We then discuss how Cloud Data Fusion can help to effectively integrate data from a variety of sources and formats and generate insights. We take a look at Cloud Data Fusions main components and how they work, how to process batch data and real time streaming data with visual pipeline design, rich tracking of metadata and data lineage, and how to deploy data pipelines on various execution engines.                                                                  

Scheduled Classes

TOP
11/14/24 - TDV - Virtual-Instructor Led - Virtual-Instructor Led (click to enroll)
02/13/25 - TDV - Virtual-Instructor Led - Virtual-Instructor Led (click to enroll)
08/14/25 - TDV - Virtual-Instructor Led - Virtual-Instructor Led (click to enroll)

What You'll Learn

TOP
Identify the need of data integration,
  • Configure execution environment; Monitor and Troubleshoot pipeline execution,
  • Understand the relationship between metadata and data lineage
  • Understand the capabilities Cloud Data Fusion provides as a data integration platform,
  • Identify use cases for possible implementation with Cloud
  • Data Fusion,
  • List the core components of Cloud Data Fusion,
  • Design and execute batch and real time data
  • processing pipelines,
  • Work with Wrangler to build data transformations
  • Use connectors to integrate data from various sources and formats,

Outline

TOP
Viewing outline for:
Course Introduction
  • Data integration: what, why, challenges
  • Data integration tools used in industry
  • User personas
  • Introduction to Cloud Data Fusion
  • Data integration critical capabilities
  • Cloud Data Fusion UI components
  • Cloud Data Fusion architecture
  • Core concepts
  • Data pipelines and directed acyclic graphs (DAG)
  • Pipeline Lifecycle
  • Designing pipelines in Pipeline Studio
  • Branching, Merging and Joining
  • Actions and Notifications
  • Error handling and Macros
  • Pipeline Configurations, Scheduling, Import and Export
  • Schedules and triggers
  • Execution environment: Compute profile and provisioners
  • Monitoring pipelines
  • Wrangler
  • Directives
  • User-defined directives
  • Understand the data integration architecture.
  • List various connectors.
  • Use the Cloud Data Loss Prevention (DLP) API.
  • Understand the reference architecture of streaming pipelines.
  • Build and execute a streaming pipeline.
  • Metadata
  • Data lineage
  • Course Summary

Prerequisites

TOP
Completed Big Data and Machine Learning Fundamentals

      Who Should Attend

      TOP
      Data Engineer
      • Data Analysts

      Next Step Courses

      TOP