menu
arrow_back

Building Dynamic Pipelines in Cloud Data Fusion Using Macros

Building Dynamic Pipelines in Cloud Data Fusion Using Macros

1 个小时 30 分钟 7 个积分

GSP809

Google Cloud Self-Paced Labs

Overview

  • In Data Fusion, you can use Macros to introduce dynamic variables for plugin configurations so that you can specify the variable substitutions at runtime.

  • Macros are defined as variables wrapped inside of a **${ }**. Plugins that have macro enabled fields will contain a blue M icon.

10-01-overview.png

  • A typical use case for macros is to allow for variable substitution when the pipeline is run, so instead of using hard coded paths, you could use dynamic paths. This way you’re able to specify which particular file you want to process when the pipeline is invoked. In addition to macros you'll use wildcards as well.

加入 Qwiklabs 即可阅读本实验的剩余内容…以及更多精彩内容!

  • 获取对“Google Cloud Console”的临时访问权限。
  • 200 多项实验,从入门级实验到高级实验,应有尽有。
  • 内容短小精悍,便于您按照自己的节奏进行学习。
加入以开始此实验
分数

—/40

Create a bucket using gcp console

运行步骤

/ 10

Create cloud data fusion instance

运行步骤

/ 10

Test your pipeline

运行步骤

/ 10

Build and execute dynamic pipeline.

运行步骤

/ 10