Application Scenarios

Learn about the application scenarios of Doris instruction optimization before using the feature.

Bitshuffle is a lossless data compression algorithm that can reduce storage space required by data while maintaining data precision. It is usually used to process large-scale scientific datasets, such as meteorological, seismic, and astronomical data. These datasets are often large in scale. Therefore, data compression can greatly save storage space and improve data transmission efficiency.

Bitshuffle applies to scenarios such as data storage, data transmission, data backup, and data processing.

• Data storage: Bitshuffle can compress various types of data to save storage space and improve data storage efficiency.
• Data transmission: Bitshuffle can effectively reduce the data transmission duration and bandwidth consumption, improving the data transmission efficiency.
• Data backup: Bitshuffle can compress data in an efficient way, decreasing the backup data size and improving backup efficiency.
• Data processing: Bitshuffle can compress data before data analysis to reduce the consumption of computing resources.