Skip to yearly menu bar Skip to main content


Algorithms for the Communication of Samples

Lucas Theis · Nour Ahmed

Hall E #707

Keywords: [ T: Probabilistic Methods ] [ PM: Monte Carlo and Sampling Methods ]


The efficient communication of noisy data has applications in several areas of machine learning, such as neural compression or differential privacy, and is also known as reverse channel coding or the channel simulation problem. Here we propose two new coding schemes with practical advantages over existing approaches. First, we introduce ordered random coding (ORC) which uses a simple trick to reduce the coding cost of previous approaches. This scheme further illuminates a connection between schemes based on importance sampling and the so-called Poisson functional representation. Second, we describe a hybrid coding scheme which uses dithered quantization to more efficiently communicate samples from distributions with bounded support.

Chat is not available.