Create Tables from Scraped APIs (Spark/GCP Pipeline Example)

Video Sections Show timestamps

Tutorial details

Today’s tutorial explores the art of API scraping and persistent storage of the results. Perfect for data enthusiasts and tech professionals, this video is your guide to extracting and utilizing valuable data efficiently.

Resources:

Demonstration Code and Diagram

Dec 7, 2023

Views

Moderate

Related Skills:

BigQuery
Cloud Storage
Cloud Scheduler
Cloud NAT
Cloud Dataproc
PySpark
Python

Related Video Tutorials

Gemini in Google Cloud (Hands-On with New Vertex AI LLMs)

Dive into the newest, bleeding-edge AI with us, in our latest video where we explore the cutting-edge Gemini Pro AI model, now available on Google Cloud’s Vertex AI platform.

NGINX with Redis Caching (Simple Serverless Setup)

Dive into the world of efficient caching and server management with our latest video tutorial on the integration of NGINX with Redis. Specifically, we use a Google-Cloud-Managed Redis instance via …

Hands-On Introduction to Ray with Vertex AI (Google Cloud)

In this video, we introduce the world of Managed Ray on Google Cloud, a component of the Vertex AI suite, to streamline your machine learning and data processing projects. This tutorial is your key to …