# Apache Flink Streaming - Exploring Data Collection and Processing with Kafka in Flink (Day 2 Lecture)

> In this presentation, the focus is on elucidating how data is collected and processed utilizing Kafka. The step-by-step walkthrough covers the process of making a request and the seamless passage of data to a Kafka producer. Attention is given to a common challenge: data flowing into Kafka during d…

- Web page: https://www.dataexpert.io/lesson/infra-flink-streaming-day-2-lecture-v3
- Program: [Data Engineering Boot Camp V2 Combined Track](https://www.dataexpert.io/program/data-engineering-boot-camp-v2-combined-track)
- Module: Week 3: Streaming Pipelines with Apache Flink
- Access: Requires enrollment in Data Engineering Boot Camp V2 Combined Track
- Length: 47 min video
- Skills: ETL/ELT, Apache Spark, Cloud Platforms, Postgres, Kafka, Flink
- Academy: DataExpert.io Academy

## About this lesson

In this presentation, the focus is on elucidating how data is collected and processed utilizing Kafka. The step-by-step walkthrough covers the process of making a request and the seamless passage of data to a Kafka producer. Attention is given to a common challenge: data flowing into Kafka during development, including insights into a encountered bug and its resolution. Furthermore, we touch upon the advantages of leveraging the Kappa architecture and explore the functionality of emerging metastores such as Iceberg.[Recorded Nov 30, 2023]

## Navigation

- Previous lesson: [Apache Flink Streaming - Kafka, Postgres, Spark Integration, and Parallelism (Day 2 Lab)](https://www.dataexpert.io/lesson/infra-flink-streaming-day-2-lab-v3.md)
- Next lesson: [Advanced Data Pipeline Maintenance - Navigating the Complexities of Data Engineering (Day 1 Lecture) ](https://www.dataexpert.io/lesson/pipeline-maintenance-day-1-lecture-v3.md)