Once you've mastered the essentials of Spark's framework in Part 1: Intro to Spark Fundamentals of Workshop Track 1: Spark Fundamentals and Beyond, the instructor, Austin Ouyang, will lead you through practical, hands-on examples & tutorials that are executed on distributed Spark clusters.
In this workshop, you will learn:
- Apache Spark hands-on tutorials
- Practical hands-on examples to better understand the fundamental concepts
Level:
Beginner - Intermediate
Prerequisites:
What you should know (or have pre-installed) to get the most value.
- A machine with a unix based OS or a virtual environment supporting one
- Familiarity with command line
- Some experience programming in Python
- All hands-on examples and projects will be executed on distributed Spark clusters on AWS and the environment will be pre-configured for everyone
Meet Your Instructor:
The workshop is lead by Austin Ouyang, Lead Platform Engineer at Insight Data Science. He is currently leading the efforts in building out a microservices architecture using Kubernetes on AWS for Insight’s internal tools and services. He has been a lead mentor for Apache Spark Workshops helping Data Scientists and Engineers learn the fundamentals of Spark and write performant Spark jobs. He joined Insight as a Data Engineering Fellow and then co-led the Data Engineering Fellows program for a year.
