Introduction to Apache Beam
Intro¶
Let's discover Apache Beam together with Stefano Bosisio to create data pipelines and orchestrate Data Engineering tasks.
Agenda for the meetup:
- General introduction to Apache Beam
- Creating a pipeline with Beam and running it locally
- Introduction to Dataflow
- Practical example of a pipeline with windowing to run on Dataflow
- Flex templates on Dataflow
- A practical example of scraping with Apache Beam