Getting Started with Serverless Spark (Dataproc) on GCP

Video Sections Show timestamps

Tutorial details

This video introduces Spark jobs and using the serverless capabilities of Google Cloud Platform’s Dataproc service.

This includes:

An introduction to Spark and its significance in large-scale data processing
A dive into Google Cloud Platform’s Dataproc service
A step-by-step walkthrough on setting up DataProc
Running a PySpark job in a serverless setup

Resources:

Demonstration Code

Jun 25, 2023

937

Views

Moderate

Related Skills:

Spark
Dataproc
Data processing
Big data
Data pipelines

Related Video Tutorials

Gemini in Google Cloud (Hands-On with New Vertex AI LLMs)

Dive into the newest, bleeding-edge AI with us, in our latest video where we explore the cutting-edge Gemini Pro AI model, now available on Google Cloud’s Vertex AI platform.

NGINX with Redis Caching (Simple Serverless Setup)

Dive into the world of efficient caching and server management with our latest video tutorial on the integration of NGINX with Redis. Specifically, we use a Google-Cloud-Managed Redis instance via …

Hands-On Introduction to Ray with Vertex AI (Google Cloud)

In this video, we introduce the world of Managed Ray on Google Cloud, a component of the Vertex AI suite, to streamline your machine learning and data processing projects. This tutorial is your key to …