Written by 
I found that when flink application start，the number of slots request is SUM(Maximum parallelism of each task), but when the application is running, the number of slots request is JobManager(1) + Maximum parallelism of all task. For example if there are three tasks, the parallelism of task1(source/map) is 2, the parallelism of task2(keyby/window/apply) is 2, […]
I am using Flink sql client to commit a job by sql： Flink SQL> create table products ( > id int, > name string, > primary key(id) not enforced > ) with ( > ‘connector’=’oracle-cdc’, > ‘hostname’ = ‘myip’, > ‘port’ = ‘1521’, > ‘username’ = ‘****’, > ‘password’ = ‘*****’, > ‘database-name’ = ‘ORCLCDB’, […]
10 min read · Jul 31, 2024 Airbnb’s Use of A New Flink platform evolved from Apache Hadoop® Yarn At Airbnb, Apache Flink was introduced in 2018 as a supplementary solution for stream processing. It ran alongside Apache Spark™ Streaming for several years before transitioning to become the primary stream processing platform. In this blog […]