Skip to content

Introduction to Apache Beam

Intro

Let's discover Apache Beam together with Stefano Bosisio to create data pipelines and orchestrate Data Engineering tasks.

Agenda for the meetup:

  • General introduction to Apache Beam
  • Creating a pipeline with Beam and running it locally
  • Introduction to Dataflow
  • Practical example of a pipeline with windowing to run on Dataflow
  • Flex templates on Dataflow
  • A practical example of scraping with Apache Beam

Material

Github

Medium

Meetup video