menu

ETL Processing on Google Cloud Using Dataflow and BigQuery

Go to Lab

7813 评论

avatar image

Some steps are outdated (couldn´t find usa_names.csv). Also when I trid some "apache beam pipeline" steps, my machine never stopped processing, therefore I couldn´t finish the lab :c.

Dante -. · 评论30 分鐘之前

avatar image

data_transformation.py looks almost empty!!

KOJI I. · 评论大約 3 小時之前

avatar image

Antonio B. · 评论大約 8 小時之前

avatar image

Command provided not matching. No direction for troubleshooting

Mohammad Kamar U. · 评论大約 14 小時之前

avatar image

$ gsutil cp gs://spls/gsp290/data_files/usa_names.csv gs://$PROJECT/data_files/

미란 진. · 评论大約 16 小時之前

avatar image

the copy data files step for usa_names.csv and head_usa_names.csv is not working due to insufficient permission

Ilung P. · 评论大約 17 小時之前

avatar image

Yogita V. · 评论大約 23 小時之前

avatar image

Yogita V. · 评论大約 23 小時之前

avatar image

Some commands needed to add the "--region us-central1" parameter

Jimmy M. · 评论大約 24 小時之前

avatar image

There was some issue. I have been asked by chat support that this will be resolved later.

Siraj S. · 评论一天之前

avatar image

This lab is full of errors, cannot even be solved with the help of chatters. It is very annoying as it is not a free lab.

Oscar L. · 评论一天之前

avatar image

Errors encountered: (venv) student_04_2e873d239108@cloudshell:~ (qwiklabs-gcp-04-d9e92eb486d7)$ gsutil cp gs://spls/gsp290/usa_names.csv gs://$PROJECT/data_files/ CommandException: No URLs matched: gs://spls/gsp290/usa_names.csv (venv) student_04_2e873d239108@cloudshell:~ (qwiklabs-gcp-04-d9e92eb486d7)$ (venv) student_04_2e873d239108@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-04-d9e92eb486d7)$ python dataflow_python_examples/data_ingestion.py --project=$PROJECT --runner=DataflowRunner --staging_location=gs://$PROJECT/test --temp_location gs://$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/data_ingestion.py", line 134, in <module> run() File "dataflow_python_examples/data_ingestion.py", line 100, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/home/student_04_2e873d239108/professional-services/examples/dataflow-python-examples/venv/lib/python3.7/site-packages/apache_beam/pipeline.py", line 198, in __init__ 'Pipeline has validations errors: \n' + '\n'.join(errors)) ValueError: Pipeline has validations errors: Missing required option: region. (venv) student_04_2e873d239108@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-04-d9e92eb486d7)$

Paul R. · 评论一天之前

avatar image

俊樹 金. · 评论一天之前

avatar image

code is incomplete and doesn't run in latest version oF GCP

George T. · 评论2 天之前

avatar image

Ari W. · 评论2 天之前

avatar image

could not find the python files

irfan a. · 评论2 天之前

avatar image

Durgesh M. · 评论2 天之前

avatar image

Diptaparna B. · 评论2 天之前

avatar image

Durgesh M. · 评论2 天之前

avatar image

TATSUYA K. · 评论2 天之前

avatar image

instruction not clear and some path is wrong

Fajri R. · 评论2 天之前

avatar image

instruction not clear and some path is wrong

Fajri R. · 评论2 天之前

avatar image

TATSUYA K. · 评论2 天之前

avatar image

There was an error in the command below "python dataflow_python_examples/data_ingestion.py --project=$PROJECT --runner=DataflowRunner --staging_location=gs://$PROJECT/test --temp_location gs://$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session"

KOJI I. · 评论2 天之前

avatar image

Adarsh K. · 评论3 天之前