README

P8 (3% of grade): Google Cloud Services

Overview

Clarifications/Corrections

AI Usage

Part 1: Virtual Machine Setup

Educational Credits

Launch VM

Required VM Configuration

Steps to Launch

GitLab

Step 1: Set a GitLab Password

Step 2: Clone Using the HTTPS URL

GCP Authentication

Caution

Jupyter Setup

VM Questions

Q1: What is the OS release?

Q2: What CPUs does your VM have?

Part 2: GCS Bucket

Handling Bucket Names in a Team

Option A — Environment Variable for Bucket Name

Option B — Config File

Q3: What are the paths of all the files/directories in the top-level of your bucket?

Q4: What is the modification time of wi-schools-raw.parquet, in nanoseconds?

Part 3: Dataform

Dataform Setup

Pipeline Code

Q5: What are the dependencies between all the Dataform tables?

Part 4: BigQuery

Q6: How many counties are in Wisconsin?

Q7: How many public schools are there in Wisconsin?

Q8: Which counties have at least 2 cities that each contain 3 or more public high schools?

Q9: How many times can you run the query from Q8 before you exhaust the BigQuery free tier (1 TiB of processed data)?

Q10: Which MMSD elementary schools are named after people/places/etc?

Submission

Testing