3 years ago

Wyner's Common Information under R\'enyi Divergence Measures.

Lei Yu, Vincent Y. F. Tan

We study a generalized version of Wyner's common information problem (also coined the distributed sources simulation problem). The original common information problem consists in understanding the minimum rate of the common input to independent processors to generate an approximation of a joint distribution when the distance measure used to quantify the discrepancy between the synthesized and target distributions is the normalized relative entropy. Our generalization involves changing the distance measure to the unnormalized and normalized R\'enyi divergences of order $\alpha=1+s\in[0,2]$. We show that the minimum rate needed to ensure the R\'enyi divergences between the distribution induced by a code and the target distribution vanishes remains the same as the one in Wyner's setting, except when the order $\alpha=1+s=0$. This implies that Wyner's common information is rather robust to the choice of distance measure employed. As a by product of the proofs used to the establish the above results, the exponential strong converse for the common information problem under the total variation distance measure is established.

Publisher URL: http://arxiv.org/abs/1709.02168

DOI: arXiv:1709.02168v2

You might also like
Discover & Discuss Important Research

Keeping up-to-date with research can feel impossible, with papers being published faster than you'll ever be able to read them. That's where Researcher comes in: we're simplifying discovery and making important discussions happen. With over 19,000 sources, including peer-reviewed journals, preprints, blogs, universities, podcasts and Live events across 10 research areas, you'll never miss what's important to you. It's like social media, but better. Oh, and we should mention - it's free.

  • Download from Google Play
  • Download from App Store
  • Download from AppInChina

Researcher displays publicly available abstracts and doesn’t host any full article content. If the content is open access, we will direct clicks from the abstracts to the publisher website and display the PDF copy on our platform. Clicks to view the full text will be directed to the publisher website, where only users with subscriptions or access through their institution are able to view the full article.