Multimodal Learning 相关度: 6/10

Efficient Learned Data Compression via Dual-Stream Feature Decoupling

Huidong Ma, Xinyan Shi, Hui Sun, Xiaofei Yue, Xiaoguang Liu, Gang Wang, Wentong Cai
arXiv: 2604.07239v1 发布: 2026-04-08 更新: 2026-04-08

AI 摘要

提出双流特征解耦的LDC方法,实现高压缩比、高吞吐量、低延迟和低内存占用。

主要贡献

  • 双流多尺度解耦器,分离局部和全局上下文
  • 分层门控精炼器,自适应特征精炼和精确概率建模
  • 并发流并行流水线,克服系统瓶颈实现全流水线并行

方法论

通过双流并行处理微观语法和宏观语义特征,并利用门控机制进行特征提炼,最终实现高效数据压缩。

原文摘要

While Learned Data Compression (LDC) has achieved superior compression ratios, balancing precise probability modeling with system efficiency remains challenging. Crucially, uniform single-stream architectures struggle to simultaneously capture micro-syntactic and macro-semantic features, necessitating deep serial stacking that exacerbates latency. Compounding this, heterogeneous systems are constrained by device speed mismatches, where throughput is capped by Amdahl's Law due to serial processing. To this end, we propose a Dual-Stream Multi-Scale Decoupler that disentangles local and global contexts to replace deep serial processing with shallow parallel streams, and incorporate a Hierarchical Gated Refiner for adaptive feature refinement and precise probability modeling. Furthermore, we design a Concurrent Stream-Parallel Pipeline, which overcomes systemic bottlenecks to achieve full-pipeline parallelism. Extensive experiments demonstrate that our method achieves state-of-the-art performance in both compression ratio and throughput, while maintaining the lowest latency and memory usage. The code is available at https://github.com/huidong-ma/FADE.

标签

数据压缩 学习型数据压缩 并行处理 特征解耦

arXiv 分类

cs.CL cs.IT cs.LG