2. About me
• 2017.3 – present Alibaba Compute Platform
• 2012 – 2017.3 Microsoft China
• Spark as a Service, with a focus on streaming
• Skype for Business data
• 2000 – 2012 Microsoft US
• SQL Server engine
• Speech API & Speech Server
2
22. Examples of recent Blink runtime optimizations
• Credit-based network stack
• Dynamic load balancing
• Improved check-pointing for large scale jobs
• Some of these work has been contributed to Flink and will be released
in flink-1.5
23. Some New Flink Features
• Incremental Checkpoints
• Fine grained recovery
Flink 1.3
• Queryable states improvements
• Table API & SQL enhancements
Flink 1.4
• FLIP-6
• Network stack improvements
• State replication
• Eager State Declaration
• State evolution
Flink 1.5+