Challenge 2: Federation

Previous Challenge Next Challenge

Introduction

Although you could run analytics queries also on Spanner, it’s mainly an OLTP database. We’ll export historical application data to BigQuery for advanced analytics and as a foundation for GenAI use cases. Tight integrations between BigQuery and the source databases can then be used for unified querying across analytics and transactional databases, and AI/ML integrations can then be leveraged to enhance customer insights

Description

Create a new BigQuery dataset cymbal_analytics in the multi-region US. Create a new external (federated) dataset spanner_external_dataset linked to the Spanner ecom database you’ve created in the previous challenge.

Copy each table from the Spanner database to the newly created BigQuery dataset.

Success Criteria

  • All the data from the Spanner database ecom is exported to the new BigQuery dataset.

  • Verify that the following tables with the corresponding row counts exist in the new BigQuery dataset:

    Table #Rows
    distribution_centers 10
    events 2438862
    inventory_items 494254
    order_items 182905
    orders 125905
    products 29120
    users 100000

Learning Resources

Previous Challenge Next Challenge