Creating a Streaming Data Pipeline With Apache Kafka

search share Join Sign in

Creating a Streaming Data Pipeline With Apache Kafka

45 minutes 5 Credits

This lab was developed with our partner, Confluent. Your personal information may be shared with Confluent, the lab sponsor, if you have opted-in to receive product updates, announcements, and offers in your Account Profile.

GSP 730

Google Cloud Self-Paced Labs


In this lab, you create a streaming data pipeline with Kafka providing you a hands-on look at the Kafka Streams API. You will run a Java application that uses the Kafka Streams library by showcasing a simple end-to-end data pipeline powered by Apache Kafka®.


In this lab, you will:

  • Start a Kafka cluster on a Compute Engine single machine

  • Write example input data to a Kafka topic, using the console producer included in Kafka

  • Process the input data with a Java application called WordCount that uses the Kafka Streams library* Inspect the output data of the application, using the console consumer included in Kafka

Join Qwiklabs to read the rest of this lab...and more!

  • Get temporary access to the Google Cloud Console.
  • Over 200 labs from beginner to advanced levels.
  • Bite-sized so you can learn at your own pace.
Join to Start This Lab