Workshop
Neural Compression: From Information Theory to Applications
Berivan Isik · Yibo Yang · Daniel Severo · Karen Ullrich · Robert Bamler · Stephan Mandt
Meeting Room 317 A
Sat 29 Jul, noon PDT
This workshop aims to address fundamental problems in the young but potentially highly-impactful field of machine-learning-based methods for data compression and communication. We invite participates to exchange ideas on fundamental issues in neural compression such as the role of quantization and stochasticity in communication, characterization and estimation of information measures, and more resource-efficient models/methods. We aim to address these fundamental issues by bringing together researchers from various fields including machine learning, information theory, statistics, and computer vision.
Chat is not available.
Timezone: America/Los_Angeles
Schedule
Sat 12:00 p.m. - 12:05 p.m.
|
Daniel Severo
(
Intro & Welcome
)
>
SlidesLive Video |
🔗 |
Sat 12:05 p.m. - 12:35 p.m.
|
Johannes Ballé
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 12:35 p.m. - 1:05 p.m.
|
Tsachy Weissman
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 1:05 p.m. - 1:20 p.m.
|
Coffee Break
|
🔗 |
Sat 1:20 p.m. - 1:50 p.m.
|
José Miguel Hernández-Lobato
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 1:50 p.m. - 2:10 p.m.
|
Contributed Talk 1 - Neural Distributed Compressor Does Binning
(
Contributed Talk
)
>
SlidesLive Video |
🔗 |
Sat 2:10 p.m. - 2:55 p.m.
|
Ashish Khisti, Ties van Rozendaal, George Toderici, Rashmi Vinayak
(
Panel
)
>
SlidesLive Video |
🔗 |
Sat 2:55 p.m. - 3:55 p.m.
|
Lunch Break
|
🔗 |
Sat 3:55 p.m. - 4:25 p.m.
|
Hyeji Kim
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 4:25 p.m. - 4:45 p.m.
|
Contributed Talk 2 - Entropy Coding of Unordered Data Structures
(
Contributed Talk
)
>
SlidesLive Video |
🔗 |
Sat 4:45 p.m. - 5:15 p.m.
|
Yan Lu
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 5:15 p.m. - 6:45 p.m.
|
Poster Session
(
Poster Session
)
>
|
🔗 |
Sat 6:45 p.m. - 7:15 p.m.
|
Aaron Wagner
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 7:15 p.m. - 7:35 p.m.
|
Contributed Talk 3 - Neural Image Compression: Generalization, Robustness, and Spectral Bias
(
Contributed Talk
)
>
SlidesLive Video |
🔗 |
Sat 7:35 p.m. - 7:55 p.m.
|
Contributed Talk 4 - Slicing Mutual Information Generalization Bounds for Neural Networks
(
Contributed Talk
)
>
SlidesLive Video |
🔗 |
Sat 7:55 p.m. - 8:00 p.m.
|
Berivan Isik
(
Concluding Remarks
)
>
SlidesLive Video |
🔗 |
-
|
Why Quantization Improves Generalization: NTK of Binary Weight Neural Network ( Poster ) > link | Kaiqi Zhang · Ming Yin · Yu-Xiang Wang 🔗 |
-
|
Diagnostically Lossless Compression of Medical Images ( Poster ) > link | Rogier Van der Sluijs · Maya Varma · Jip Prince · Curtis Langlotz · Akshay Chaudhari 🔗 |
-
|
Reconstruction Distortion of Learned Image Compression with Imperceptible Perturbations ( Poster ) > link | Yang Sui · Zhuohang Li · Ding Ding · Xiang Pan · Xiaozhong Xu · Shan Liu · Zhenzhong Chen 🔗 |
-
|
Transformers are Universal Predictors ( Poster ) > link | Sourya Basu · Moulik Choraria · Lav Varshney 🔗 |
-
|
Low Complexity Neural Network-Based In-loop Filtering with Decomposed Split Luma-Chroma Model for Video Compression ( Poster ) > link | Tong Shao · Jay Shingala · Ajay Shyam · Peng Yin · Arjun Arora · Sean McCarthy 🔗 |
-
|
Lossy Image Compression with Conditional Diffusion Model ( Poster ) > link | Ruihan Yang · Stephan Mandt 🔗 |
-
|
FusionToken: Enhancing Compression and Efficiency in Language Model Tokenization ( Poster ) > link | Robert Kwiatkowski · Zijian Wang · Robert Giaquinto · Varun Kumar · Xiaofei Ma · Anoop Deoras · Bing Xiang · Ben Athiwaratkun 🔗 |
-
|
Estimating the Rate-Distortion Function by Wasserstein Gradient Descent ( Poster ) > link | Yibo Yang · Stephan Eckstein · Marcel Nutz · Stephan Mandt 🔗 |
-
|
NNCodec: An Open Source Software Implementation of the Neural Network Coding ISO/IEC Standard ( Poster ) > link | Daniel Becking · Paul Haase · Heiner Kirchhoffer · Karsten Müller · Wojciech Samek 🔗 |
-
|
Practical Random Tree Generation using Spanning Trees: Entropy and Compression ( Poster ) > link | Amirmohammad Farzaneh 🔗 |
-
|
Minimal Random Code Learning with Mean-KL Parameterization ( Poster ) > link | Jihao Andreas Lin · Gergely Flamich · Jose Miguel Hernandez-Lobato 🔗 |
-
|
Slicing Mutual Information Generalization Bounds for Neural Networks ( Poster ) > link | Kimia Nadjahi · Kristjan Greenewald · Rickard Gabrielsson · Justin Solomon 🔗 |
-
|
Task-aware Distributed Source Coding under Dynamic Bandwidth ( Poster ) > link | Po-han Li · Sravan Kumar Ankireddy · Ruihan Zhao · Hossein Nourkhiz Mahjoub · Ehsan Moradi Pari · Ufuk Topcu · Sandeep Chinchali · Hyeji Kim 🔗 |
-
|
Text + Sketch: Image Compression at Ultra Low Rates ( Poster ) > link | Eric Lei · Yigit Berkay Uslu · Hamed Hassani · Shirin Bidokhti 🔗 |
-
|
On the Choice of Perception Loss Function for Learned Video Compression ( Poster ) > link | Buu Phan · Sadaf Salehkalaibar · Jun Chen · Wei Yu · Ashish Khisti 🔗 |
-
|
Designing Discontinuities ( Poster ) > link | Ibtihal Ferwana · Suyong Park · Ting-Yi Wu · Lav Varshney 🔗 |
-
|
Neural Image Compression: Generalization, Robustness, and Spectral Biases ( Poster ) > link | Kelsey Lieberman · James Diffenderfer · Charles Godfrey · Bhavya Kailkhura 🔗 |
-
|
Siamese SIREN: Audio Compression with Implicit Neural Representations ( Poster ) > link | Luca Lanzendörfer · Roger Wattenhofer 🔗 |
-
|
ICE-Pick: Iterative Cost-Efficient Pruning for DNNs ( Poster ) > link | Wenhao Hu · Perry Gibson · José Cano 🔗 |
-
|
Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation ( Poster ) > link | Khouloud Saadi · Jelena Mitrović · Michael Granitzer 🔗 |
-
|
Entropy Coding of Unordered Data Structures ( Poster ) > link | Julius Kunze · Daniel Severo · Giulio Zani · Jan-Willem van de Meent · James Townsend 🔗 |
-
|
Autoencoding Implicit Neural Representations for Image Compression ( Poster ) > link | Tuan Pham · Yibo Yang · Stephan Mandt 🔗 |
-
|
Neural Network Optimization with Weight Evolution ( Poster ) > link | Samir Belhaouari · Ashhadul Islam 🔗 |
-
|
EntropyRank: Unsupervised Keyphrase Extraction via Side-Information Optimization for Language Model-based Text Compression ( Poster ) > link | Alexander Tsvetkov · Alon Kipnis 🔗 |
-
|
Revisiting Associative Compression: I Can't Believe It's Not Better ( Poster ) > link | Winnie Xu · Matthew Muckley · Yann Dubois · Karen Ullrich 🔗 |
-
|
Neural Image Compression with Quantization Rectifier ( Poster ) > link | Wei Luo · Bo Chen 🔗 |
-
|
Fast Autoregressive Bit Sequence Modeling for Lossless Compression ( Poster ) > link | Hiroaki Akutsu · Ko Arai 🔗 |
-
|
Lightweighted Sparse Autoencoder based on Explanable Contribution ( Poster ) > link | Joohong Rheey · Hyunggon Park 🔗 |
-
|
On the Maximum Mutual Information Capacity of Neural Architectures ( Poster ) > link | Brandon J Foggo · Nanpeng Yu 🔗 |
-
|
Neural Distributed Compressor Does Binning ( Poster ) > link | Ezgi Ozyilkan · Johannes Ballé · Elza Erkip 🔗 |
-
|
Less-Energy-Usage Network with Batch Power Iteration ( Poster ) > link | Hao Huang · Tapan Shah · Shinjae Yoo · Scott Evans 🔗 |
-
|
MLIC$^{++}$: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compression ( Poster ) > link | Wei Jiang · Ronggang Wang 🔗 |
-
|
Making Text-Image Connection Formal and Practical ( Poster ) > link | Carlos-Gustavo Salas-Flores · Dongmian Zou · Luyao Zhang 🔗 |
-
|
Are Visual Recognition Models Robust to Image Compression? ( Poster ) > link | João Maria Janeiro · Stanislav Frolov · Alaaeldin El-Nouby · Jakob Verbeek 🔗 |