Dataflow: Qwik Start - Templates
GSP192
Overview
In this lab, you will learn how to create a streaming pipeline using one of Google's Cloud Dataflow templates. More specifically, you will use the Cloud Pub/Sub to BigQuery template, which reads messages written in JSON from a Pub/Sub topic and pushes them to a BigQuery table. You can find the documentation for this template here.
You'll be given the option to use the Cloud Shell command line or the GCP Console to create the BigQuery dataset and table. Pick one method to use, then continue with that method for the rest of the lab. If you want experience using both methods, run through this lab a second time.
Join Qwiklabs to read the rest of this lab...and more!
- Get temporary access to the Google Cloud Console.
- Over 200 labs from beginner to advanced levels.
- Bite-sized so you can learn at your own pace.
Score
—/20
Create a BigQuery Dataset (name: taxirides)
/ 5
Create a table in BigQuery Dataset
/ 5
Create a storage bucket
/ 5
Run the Pipeline
/ 5