Backpressure Occurs During Flink Testing
Symptom
Flink uses windows to segment streaming data. In this test case, every 10s is a window. All data falling into the window is processed in this window. However, due to system instability, the data receiving rate of the system is higher than the data that can be processed in an instantaneous pulse. As a result, backpressure occurs, and the latency of subsequent data processing increases sharpy.
Key Process and Cause Analysis
None
Conclusion and Solution
Obtain the test data only when there is no backpressure in the test period to prevent backpressure on performance.
Parent topic: Troubleshooting