Configuring data pipeline resources

After you deploy a data pipeline, you can configure the following:

• Compute config 

• Pipeline config

• Engine config

• Resources

• Pipeline alert

• Transformation pushdown

Compute config

You can change the compute profile you want to use to run this pipeline. For example, you want to run the pipeline against an existing Dataproc cluster rather than the default Dataproc cluster.

Open