Paper list of visual data compression for machines, including image/video coding for machines, feature compression, collaborative coding, point cloud compression for machines and image/video coding with large multimodal models.
Maintained by: Lingyu Zhu and Peilin Chen
- If you find papers relevant to this topic, please share them as a discussion post.
- Some papers may simultaneously belong to multiple subfields, and we categorize them accordingly to reflect these overlaps.
- Looking forward to your kind contributions and discussions! Many thanks!
Table of Contents
| Publish Date | Title | Authors | Code | |
|---|---|---|---|---|
| 2021.08 | Digital Retina: A Way to Make the City Brain More Efficient by Visual Coding | Wen Gao et.al. | TCSVT | null |
| 2024.11 | Compact Visual Data Representation for Green Multimedia - A Human Visual System Perspective | Peilin Chen et.al. | 2411.14135 | null |
| 2024.08 | Preprocessing Enhanced Image Compression for Machine Vision | Guo Lu et.al. | TCSVT | null |
| 2024.08 | A coding framework and benchmark towards low-bitrate video understanding | Yuan Tian et.al. | TPAMI | null |
| 2024.08 | Privacy-Preserving Autoencoder for Collaborative Object Detection | Bardia Azizian et.al. | TIP | null |
| 2024.07 | Task-Switchable Pre-Processor for Image Compression for Multiple Machine Vision Tasks | Mingyi Yang et.al. | TCSVT | null |
| 2024.07 | Region-of-Interest-Based Video Coding for Machines | Olgierd Stankiewicz et.al. | ICMEW | null |
| 2024.07 | Vnvc: A versatile neural video coding framework for efficient human-machine vision | Xihua Sheng et.al. | TPAMI | null |
| 2024.07 | Video Coding for Machines: Compact Visual Representation Compression for Intelligent Collaborative Analytics | Wenhan Yang et.al. | TPAMI | null |
| 2024.07 | Rate-Distortion-Cognition Controllable Versatile Neural Image Compression | Jinming Liu et.al. | 2407.11700 | null |
| 2024.06 | On Annotation-free Optimization of Video Coding for Machines | Marc Windsheimer et.al. | 2406.07938 | null |
| 2024.06 | SMC++: Masked Learning of Unsupervised Video Semantic Compression | Yuan Tian et.al. | 2406.04765 | null |
| 2024.06 | Machine Perception-Driven Facial Image Compression: A Layered Generative Approach | Yuefeng Zhang et.al. | TCSVT | null |
| 2024.06 | Human–Machine Collaborative Image Compression Method Based on Implicit Neural Representation | Huanyang Li et.al. | J EM SEL TOP C | null |
| 2024.05 | Privacy-preserving with Flexible Autoencoder for Video Coding for Machines | Aorui Gou et.al. | ISCAS | null |
| 2024.04 | Deep Video Codec Control for Vision Model | Christoph Reich et.al. | 2308.16215 | null |
| 2024.04 | A Perspective on Deep Vision Performance with Standard Image and Video Codecs | Christoph Reich et.al. | CVPRW | null |
| 2024.04 | Task-Aware Encoder Control for Deep Video Compression | Xingtong Ge et.al. | CVPR | null |
| 2023.12 | Image Coding for Machines based on Non-Uniform Importance Allocation | Yunpeng Qi et.al. | VCIP | null |
| 2023.12 | Scalable Face Image Coding via StyleGAN Prior: Towards Compression for Human-Machine Collaborative Vision | Qi Mao et.al. | TIP | null |
| 2023.12 | Pixel-level Texture Segmentation Based AV1 Video Compression | Zixiang Zhang et.al. | VCIP | null |
| 2023.10 | Sketch Assisted Face Image Coding for Human and Machine Vision: A Joint Training Approach | Xin Fang et.al. | TCSVT | null |
| 2023.10 | Deepsvc: Deep scalable video coding for both machine and human vision | Hongbin Lin et.al. | ACM MM | null |
| 2023.10 | ICMH-Net: Neural Image Compression Towards both Machine Vision and Human Vision | Lei Liu et.al. | ACM MM | null |
| 2023.10 | Video Object Detection From Compressed Formats for Modern Lightweight Consumer Electronics | Sangeeta Yadav et.al. | TCE | null |
| 2023.08 | Unified Architecture Adaptation for Compressed Domain Semantic Inference | Zhihao Duan et.al. | TCSVT | null |
| 2023.06 | Semantic Preprocessor for Image Compression for Machines | Mingyi Yang et.al. | ICASSP | null |
| 2023.05 | Rate-Distortion Theory in Coding for Machines and its Application | Alon Harell et.al. | 2305.17295 | null |
| 2023.05 | Prompt-icm: A unified framework towards image coding for machines with task-driven prompts | Ruoyu Feng et.al. | 2305.02578 | null |
| 2023.05 | Fast VVC Intra Encoding for Video Coding for Machines | Aorui Gou et.al. | ISCAS | null |
| 2022.12 | Semantic Segmentation In Learned Compressed Domain | Jinming Liu et.al. | PCS | null |
| 2022.08 | Improving Multiple Machine Vision Tasks in the Compressed Domain | Jinming Liu et.al. | ICPR | null |
| 2022.03 | Scalable Image Coding for Humans and Machines | Hyomin Choi et.al. | TIP | null |
| 2021.09 | Analysis Of Neural Image Compression Networks For Machine-To-Machine Communication | Kristian Fischer et.al. | ICIP | null |
| 2021.07 | Thousand to One: Semantic Prior Modeling for Conceptual Coding | Jianhui Chang et.al. | ICME | null |
| 2021.07 | Visual Analysis Motivated Rate-Distortion Model for Image Coding | Zhimeng Huang et.al. | ICME | null |
| 2021.07 | Learned Image Coding for Machines: A Content-Adaptive Approach | Nam Le et.al. | ICME | null |
| 2021.05 | Robust Deep Neural Object Detection and Segmentation for Automotive Driving Scenario with Compressed Image Data | Kristian Fischer et.al. | ISCAS | null |
| 2021.05 | End-to-end optimized image compression for machines, a study | Lahiru D. Chamain et.al. | DCC | null |
| 2021.05 | Collaborative Intelligence: Challenges and Opportunities | Ivan V. Bajić et.al. | ICASSP | null |
| 2021.05 | Recent Standard Development Activities on Video Coding for Machines | Wen Gao et.al. | 2105.12653 | null |
| 2021.05 | Image Coding For Machines: an End-To-End Learned Approach | Nam Le et.al. | ICASSP | null |
| 2021.05 | Saliency-Driven Versatile Video Coding for Neural Object Detection | Kristian Fischer et.al. | ICASSP | null |
| 2021.03 | Towards Coding for Human and Machine Vision: Scalable Face Image Coding | Shuai Yang et.al. | TMM | null |
| 2021.02 | Pareto-Optimal Bit Allocation for Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | TIP | null |
| 2020.11 | Task-Aware Quantization Network for JPEG Image Compression | Jinyoung Choi et.al. | ECCV | null |
| 2020.10 | Semantic-Preserving Image Compression | Neel Patwa et.al. | ICIP | null |
| 2020.10 | On Intra Video Coding And In-Loop Filtering For Neural Object Detection Networks | Kristian Fischer et.al. | ICIP | null |
| 2020.08 | Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analytics | Lingyu Duan et.al. | TIP | null |
| 2020.07 | Towards Coding For Human And Machine Vision: A Scalable Image Coding Approach | Yueyu Hu et.al. | ICME | null |
| 2020.06 | Image Compression With Encoder-Decoder Matched Semantic Segmentation | Trinh Man Hoang et.al. | CVPRW | null |
| 2020.05 | Back-And-Forth Prediction for Deep Tensor Compression | Hyomin Choi et.al. | ICASSP | null |
| 2020.05 | Binary Probability Model for Learning Based Image Compression | Théo LADUNE et.al. | ICASSP | null |
| 2020.05 | Bit Allocation for Multi-Task Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | ICASSP | null |
| 2020.01 | Towards Efficient Front-End Visual Sensing for Digital Retina: A Model-Centric Paradigm | Yihang Lou et.al. | TMM | null |
| 2019.10 | AdaCompress: Adaptive Compression for Online Computer Vision Services | Hongshan Li et.al. | ACM MM | null |
| 2019.08 | Multi-Task Learning with Compressible Features for Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | ICIP | null |
| 2019.08 | Image Pre-Transformation for Recognition-Aware Image Compression | Satoshi Suzuki et.al. | ICIP | null |
| 2019.08 | Layered conceptual image compression via deep semantic synthesis | Jianhui Chang et.al. | ICIP | null |
| 2019.05 | DSSLIC: Deep Semantic Segmentation-based Layered Image Compression | Mohammad Akbari et.al. | ICASSP | null |
| 2019.05 | Pixel-level Texture Segmentation Based AV1 Video Compression | Di Chen et.al. | ICASSP | null |
| Publish Date | Title | Authors | Code | |
|---|---|---|---|---|
| 2024.05 | Split Computing With Scalable Feature Compression for Visual Analytics on the Edge | Zhongzheng Yuan et.al. | TMM | null |
| 2024.04 | Hierarchical Image Feature Compression for Machines via Feature Sparsity Learning | Ding Ding et.al. | SPL | null |
| 2023.07 | Residual based hierarchical feature compression for multi-task machine vision | Chaoran Chen et.al. | ICME | null |
| 2023.06 | Learnt mutual feature compression for machine vision | Tie Liu et.al. | ICASSP | null |
| 2021.07 | Rate-Distortion Optimized Hierarchical Deep Feature Compression | Ademola Ikusan et.al. | ICME | null |
| 2021.06 | MSFC: Deep Feature Compression in Multi-Task Network | Zhicong Zhang et.al. | ICME | null |
| 2021.06 | Semantics-to-Signal Scalable Image Compression with Learned Revertible Representations | Kang Liu et.al. | IJCV | null |
| 2021.02 | Pareto-Optimal Bit Allocation for Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | TIP | null |
| 2020.12 | Sensitivity-Aware Bit Allocation for Intermediate Deep Feature Compression | Yuzhang Hu et.al. | VCIP) | null |
| 2020.10 | End-to-End Learning of Compressible Features | Saurabh Singh et.al. | ICIP | null |
| 2020.10 | Data Representation in Hybrid Coding Framework for Feature Maps Compression | Zhuo Chen et.al. | ICIP | null |
| 2020.10 | Deep Feature Compression With Spatio-Temporal Arranging for Collaborative Intelligence | Satoshi Suzuki et.al. | ICIP | null |
| 2020.07 | Bottlenet++: An end-to-end approach for feature compression in device-edge co-inference systems | Jiawei Shao et.al. | ICCW | null |
| 2020.07 | Object-Based Image Coding: A Learning-Driven Revisit | Qi Xia et.al. | ICME | null |
| 2020.07 | An Emerging Coding Paradigm Vcm: A Scalable Coding Approach Beyond Feature And Signal | Sifeng Xia et.al. | ICME | null |
| 2020.05 | Deriving Compact Feature Representations Via Annealed Contraction | Muhammad A. Shah et.al. | ICASSP | null |
| 2020.05 | Bit Allocation for Multi-Task Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | ICASSP | null |
| 2020.03 | Binary Representation and High Efficient Compression of 3D CNN Features for Action Recognition | Peiyin Xing et.al. | DCC | null |
| 2019.10 | Lossy Intermediate Deep Learning Feature Compression and Evaluation | Zhuo Chen et.al. | ACM MM | null |
| 2019.09 | Toward Intelligent Sensing: Intermediate Deep Feature Compression | Zhuo Chen et.al. | TIP | null |
| 2019.09 | Semantically Scalable Image Coding With Compression of Feature Maps | Ning Yan et.al. | ICIP | null |
| 2019.08 | Multi-Task Learning with Compressible Features for Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | ICIP | null |
| 2019.05 | Pixel-level Texture Segmentation Based AV1 Video Compression | Di Chen et.al. | ICASSP | null |
| 2018.09 | Deep Feature Compression for Collaborative Object Detection | Hyomin Choi et.al. | ICIP | null |
| Publish Date | Title | Authors | Code | |
|---|---|---|---|---|
| 2024.07 | Vnvc: A versatile neural video coding framework for efficient human-machine vision | Xihua Sheng et.al. | TPAMI | null |
| 2024.06 | Human–Machine Collaborative Image Compression Method Based on Implicit Neural Representation | Huanyang Li et.al. | J EM SEL TOP C | null |
| 2024.02 | Scalable Human-Machine Point Cloud Compression | Mateen Ulhaq et.al. | PCS | null |
| 2023.12 | Scalable Face Image Coding via StyleGAN Prior: Towards Compression for Human-Machine Collaborative Vision | Qi Mao et.al. | TIP | null |
| 2023.10 | Sketch Assisted Face Image Coding for Human and Machine Vision: A Joint Training Approach | Xin Fang et.al. | TCSVT | null |
| 2023.10 | Deepsvc: Deep scalable video coding for both machine and human vision | Hongbin Lin et.al. | ACM MM | null |
| 2023.10 | ICMH-Net: Neural Image Compression Towards both Machine Vision and Human Vision | Lei Liu et.al. | ACM MM | null |
| 2021.06 | Semantics-to-Signal Scalable Image Compression with Learned Revertible Representations | Kang Liu et.al. | IJCV | null |
| 2021.06 | Towards Analysis-Friendly Face Representation With Scalable Feature and Texture Compression | Shurun Wang et.al. | TCSVT | null |
| 2021.05 | Teacher-Student Learning With Multi-Granularity Constraint Towards Compact Facial Feature Representation | Shurun Wang et.al. | ICASSP | null |
| 2021.03 | Towards Coding for Human and Machine Vision: Scalable Face Image Coding | Shuai Yang et.al. | TMM | null |
| 2021.02 | Pareto-Optimal Bit Allocation for Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | TIP | null |
| 2020.07 | Towards Coding For Human And Machine Vision: A Scalable Image Coding Approach | Yueyu Hu et.al. | ICME | null |
| 2020.07 | An Emerging Coding Paradigm Vcm: A Scalable Coding Approach Beyond Feature And Signal | Sifeng Xia et.al. | ICME | null |
| 2020.05 | Bit Allocation for Multi-Task Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | ICASSP | null |
| 2019.08 | Multi-Task Learning with Compressible Features for Collaborative Intelligence | Saeed Ranjbar Alvar et.al. | ICIP | null |
| 2019.08 | Scalable Facial Image Compression with Deep Feature Reconstruction | Shurun Wang et.al. | ICIP | null |
| 2019.05 | Pixel-level Texture Segmentation Based AV1 Video Compression | Di Chen et.al. | ICASSP | null |
| Publish Date | Title | Authors | Code | |
|---|---|---|---|---|
| 2024.07 | Towards Point Cloud Compression for Machine Perception: A Simple and Strong Baseline by Learning the Octree Depth Level Predictor | Lei Liu et.al. | IJCAI | null |
| 2024.02 | Scalable Human-Machine Point Cloud Compression | Mateen Ulhaq et.al. | PCS | null |
| 2023.10 | Deep learning-based compressed domain point cloud classification | Abdelrahman Seleem et.al. | ICIP | null |
| Publish Date | Title | Authors | Code | |
|---|---|---|---|---|
| 2024.11 | Large Language Models for Lossless Image Compression: Next-Pixel Prediction in Language Space is All You Need | Kecheng Chen et.al. | 2411.12448 | null |
| 2024.10 | High Efficiency Image Compression for Large Visual-Language Models | Binzhe Li et.al. | TCSVT | null |
| 2024.08 | Tell Codec What Worth Compressing: Semantically Disentangled Image Coding for Machine with LMMs | Jinming Liu et.al. | 2408.08575 | null |
| 2024.08 | When Video Coding Meets Multimodal Large Language Models: A Unified Paradigm for Video Coding | Pingping Zhang et.al. | 2408.08093 | null |
| 2024.07 | ComNeck: Bridging Compressed Image Latents and Multimodal LLMs via Universal Transform-Neck | Chia-Hao Kao et.al. | 2407.19651 | null |