What you'll learn:
Learn Flink's basic and advanced concepts and architecture each followed by hands-on exercises in Scala 3
Learn how Flink handles stream processing, distributed and stateful computation
Learn to handle event time processing using Flink's watermarks mechanism and window operation
Learn to integrate Flink version 1.17 with Kafka and Kubernetes using Scala 3
Learn to write stateful applications using Flink's key concepts including checkpoint mechanism, map state, list state and value state
Learn Flink's deployment modes and deploy your own Flink application on Kubernetes
Requirements:
Basic understanding of functional programming languages such as Scala
Description:
As the latest Flink course released in December 2023, it covers Flink's basic and advanced concepts each followed by hands-on exercises. This course cuts through all the complexities of integrating the very recent Flink version 1.17 with Scala 3 and Kubernetes. Starting with version 1.15 of Flink, Scala support was removed to make it easier to integrate with multiple versions of Scala, including Scala 3. This course includes step by step video demonstrations on how to resolve the problem of classpath collision when deploying Flink applications in Scala 3 on Kubernetes.Concretely, here's what you will learn to either ace your next Flink interview or be ready to write your production level Flink application:1. Flink and Streaming FundamentalsYou'll understand how Flink handles stream processing, distributed and stateful computation; You'll learn Flink's architecture including Flink cluster's components; You'll know how to deploy and manage the lifecycle of a Flink application.2. Flink Data PipelineYou'll understand different levels of abstraction for developing streaming applications; You'll be able to process big data in real time any way you want to by mastering fundamental Flink concepts including: data ingestion, efficient data transformation, controlling your applications with lower level APIs, producing output streams to data sinks.3. Integration with Apache KafkaYou'll learn configuration of Kafka Source and Kafka Sink; You'll master how to set up Kafka dependencies in built.sbt and how to integrate Kafka with Flink as a data source or data sink.4. Time Handling, Watermarks and WindowsYou'll be able to handle event time processing using Flink's watermarks mechanism and window operation including tumbling window, sliding window and global window.5. Fault TolerantYou'll be able to write stateful applications using Flink's key concepts including checkpoint mechanism, map state, list state and value state.6. Integration with KubernetesYou'll learn Flink's deployment modes and deploy your own Flink application on Kubernetes by following along the video demonstration of every deployment step and deployment configurations.What you'll get from this course:You will get 30+ total Flink video lessons with slides and illustrative diagrams plus access to Github Repo with all the code in the course;You can practice by writing more than 20 Flink applications for common use cases and following along the hands-on video lessons;You will quickly master the configurations of all the dependencies and steps to deploy Flink 1.17 applications on Kubernetes by following the video demonstration;You will learn transferrable principles of big data streaming and distributed systems that you can apply on other streaming systems.
Who this course is for:
Developers who want write production ready Flink applications or want to learn about distributed real-time data streaming systems, or trying to troubleshoot Flink deployment on Kubernetes
Homepage