ETL Processing on GCP Using Dataflow and BigQuery

Go to Lab

349 Reviews

Step - Data Ingestion, is not working. When I am running the code to set up spin up workers, I get this error in the cloud shell: "est --temp_location gs://qwiklabs-gcp-3ba1dae8bc3e9b27/test --input gs://qwiklabs-gcp-3ba1dae8bc3e9b27/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/", line 132, in <module> run() File "dataflow_python_examples/", line 98, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/home/google3429393_student/professional-services/examples/dataflow-python-examples/dataflow-env/local/lib/python2.7/site-packages/apache_beam/", line 155, in __init__ 'Pipeline has validations errors: \n' + '\n'.join(errors)) ValueError: Pipeline has validations errors: Invalid Project ID (). Please make sure you specified the Project ID, not project number. Invalid GCS path (gs:///test), given for the option: staging_location."

Feyzi B. · Reviewed 5 دقائق ago

Ike W. · Reviewed حوالي ساعة واحدة ago

Can't finish, too many time to execute dataflow :|

Ike W. · Reviewed حوالي ساعتان ago

Yap S. · Reviewed حوالي 6 ساعات ago

Mejor hacerlo en inglés.

Diego M. · Reviewed حوالي 7 ساعات ago

Francisco G. · Reviewed يوم واحد ago

buggy. i was logged out halfway and my progress was not saved.

Chris S. · Reviewed يوم واحد ago

Ludovic G. · Reviewed يوم واحد ago

Shu Hao L. · Reviewed يوم واحد ago

The description bullet points under each step need to be updated to reflect the real flow steps

Ahmed H. · Reviewed يومان ago

Lengthy activities...

David C. · Reviewed 3 أيام ago

Deepak M. · Reviewed 3 أيام ago

Achmad Gunar S. · Reviewed 4 أيام ago

Bing Yuan L. · Reviewed 4 أيام ago

Dhamotharan R. · Reviewed 4 أيام ago

Bin W. · Reviewed 4 أيام ago

Dhamotharan R. · Reviewed 4 أيام ago


Percy C. · Reviewed 4 أيام ago

hard to read through all the material in 1 hour

Sol H. · Reviewed 5 أيام ago

Ranjith R. · Reviewed 5 أيام ago

Muchammad A. · Reviewed 5 أيام ago

Dmytro V. · Reviewed 5 أيام ago

hendra r. · Reviewed 5 أيام ago

JiaMing Y. · Reviewed 6 أيام ago

Rafi Z. · Reviewed 6 أيام ago

الصفحة الرئيسية