Pipeline Optimization

Primary pipeline optimization is an efficient and widely applicable technique that redistributes operator adaptation tasks to the secondary pipeline. This approach balances workloads across both pipeline stages while minimizing dequeue wake-up latency.

The usage is as follows:

export TASK_QUEUE_ENABLE=2