Google Cloud Dataflow Training in Exeter

Google Cloud Dataflow Training Course Outline

Module 1: Overview of Cloud Dataflow

• Introduction
• Run a Java Pipeline
• Run a Python Pipeline
• Run a Go Pipeline
• Run a Streaming Pipeline from a Template

Module 2: Build Pipelines

• Use Apache Beam
• Use Templates
• Use Notebooks
• Common Pipeline Patterns
• Use Dataflow SQL

Module 3: Run Pipeline

• Deploy Pipelines
• Configure Pipeline Options
• Use Dataflow GPUs
• Use Arm VMs
• Use Custom Containers
• Regional Endpoints

Module 4: Monitor

• Use the Monitoring UI
• Use the Command Line Interface
• Use Cloud Monitoring
• Use Cloud Profiler
• Sample Pipeline Data
• Work with Audit Logs
• Control Log Ingestion

Module 5: Optimise

• Use Flexible Resource Scheduling
• Horizontal Autoscaling
• Dynamic Thread Scaling
• Dynamic Work Rebalancing
• Dataflow Insights
• Use Streaming Engine for Streaming Jobs
• Use Dataflow Shuffle for Batch Jobs
• Use Dataflow Runner
• Use Dataflow Prime
• Use Computer Engine Reservations

Module 6: Manage

• Update an Existing Pipeline
• Stop a Running Pipeline
• Request Quotas
• Use Dataflow Snapshots
• Work with Data Pipelines
• Use Eventarc to Manage Dataflow

Module 7: Dataflow Development Guide

• Pipeline Lifecycle
• Design Considerations
• Plan Data Pipelines
• Develop and Test Pipelines
• Design Pipeline Workflows
• Data Representation in Streaming Pipeline

Who Should Attend this Google Cloud Dataflow Training?

The course is suitable for individuals who want to improve their skills in developing robust data processing pipelines while using Google Cloud Dataflow.  This course can benefit professionals such as:

• Data Engineers
• Data Scientists
• Software Developers
• Cloud Developers
• Data Architects
• Solution Architects
• ETL Developers

Prerequisites for the Google Cloud Dataflow Training

There are no formal prerequisites for this Google Cloud Dataflow Course.

Introduction to Google Cloud Dataflow Training

Google Cloud Dataflow Training provides an understanding of serverless data processing for batch and real-time analytics. It covers pipeline creation, Apache Beam, data transformation, and integration within Google Cloud Platform.

This training enables delegates to develop skills in building and managing scalable data pipelines efficiently. It supports improved data processing, enhances workflow automation, and strengthens data engineering capabilities.

This 1-Day course offered by The Knowledge Academy enables delegates to apply Dataflow concepts in real-world scenarios. It equips them with practical skills to design, deploy, and optimise data processing pipelines effectively.

Introduction to Google Cloud Dataflow Training Course Objectives

To enable delegates to understand the fundamentals of Cloud Dataflow and its role in transforming data in both batch and streaming modes

• To equip delegates with the skills to create, deploy, and manage data processing pipelines using Google Cloud Dataflow
• To provide hands-on experience in troubleshooting and updating existing data processing pipelines
• To instruct delegates on the use of Google-provided templates for efficient pipeline creation and execution
• To teach delegates how to configure internet access and firewall rules for secure and optimised data processing
• To empower delegates to utilise cloud pub/sub seek with Cloud Dataflow and create Cloud Dataflow SQL jobs for advanced data processing capabilities
• To understand monitoring and logging techniques for maintaining pipeline performance 

Upon completion of this Google Cloud Dataflow Course in the United Kingdom, delegates will be able to process data efficiently in batch and streaming modes. They will also enhance their career opportunities in data engineering, analytics, and cloud computing roles.

What’s Included in this Google Cloud Dataflow Training?

• World-Class Training Sessions from Experienced Instructors
• Google Cloud Dataflow Certificate
• Digital Delegate Pack