Challenge 1: Getting started

Next Challenge

Introduction

Throughout this hack, you will be using a number of different tools and products within Google Cloud. Our focus in this first challenge will be setting up the pre-requisites. As part of the project setup, we’ve already created a VM that hosts a Oracle database for you, but there’s more to set up :)

Description

We’ll need to stage the Change Data Capture (CDC) stream from the Oracle database into a Google Cloud Storage bucket. Create a new bucket that minimizes egress costs.

In order to trigger Dataflow processing we’ll use Pub/Sub notifications for Cloud Storage, so go ahead and turn on Pub/Sub notifications for the newly created bucket. Once the topic is ready, add a subscription to it.

Finally create a BigQuery dataset in the same region, which will be used to store and analyze the data.

Success Criteria

  1. There’s a new Cloud Storage bucket
  2. The bucket is configured to send Pub/Sub notifications
  3. There’s a Pub/Sub subscription on the new notifications topic
  4. There’s a new BigQuery dataset

Tips

  • You can use the UI to configure some of the requirements (not everything possible through the UI) but Cloud Shell has all the tools you need to complete this challenge

Learning Resources

Next Challenge