More Ruzsa distance estimates

Let \(G\) be an additive group.

LemmaFlipping a sign#

If \(X,Y\) are \(G\)-valued, then

\[ d[X ; -Y] \leq 3 d[X;Y]. \]
Proof

Without loss of generality (using Copy preserves Ruzsa distance and Existence of independent copies) we may take \(X,Y\) to be independent. By \((X_1,Y_1)\), \((X_2,Y_2)\) be copies of \((X,Y)\) that are conditionally independent over \(X_1-Y_1=X_2-Y_2\) (this exists thanks to Existence of conditional independent trials). By Existence of independent copies, we can also find another copy \((X_3,Y_3)\) of \((X,Y)\) that is independent of \(X_1,Y_1,X_2,Y_2\). From Alternate form of submodularity, one has

\[ \mathbb{H}[X_3-Y_2, X_1-Y_3, X_2, Y_1, X_3, Y_3, X_3+Y_3] + \mathbb{H}[X_3+Y_3] \leq \mathbb{H}[X_3-Y_2, X_1-Y_3, X_2, Y_1, X_3+Y_3] + \mathbb{H}[X_3, Y_3, X_3+Y_3]. \]

From Ruzsa distance in independent case, Negation preserves entropy, Copy preserves Ruzsa distance we have

\[ \mathbb{H}[X_3+Y_3] = \frac{1}{2} \mathbb{H}[X_3] + \frac{1}{2} \mathbb{H}[-Y_3] + d[X_3;-Y_3] = \frac{1}{2} \mathbb{H}[X] + \frac{1}{2} \mathbb{H}[Y] + d[X;-Y]. \]

Since \(X_3+Y_3\) is a function of \(X_3,Y_3\), we see from Entropy and relabeling and Additivity of entropy that

\[ \mathbb{H}[X_3,Y_3,X_3+Y_3] = \mathbb{H}[X_3,Y_3] = \mathbb{H}[X,Y] = \mathbb{H}[X]+\mathbb{H}[Y]. \]

Because \(X_1-Y_1=X_2-Y_2\), we have

\[ X_3+Y_3 = (X_3-Y_2) - (X_1-Y_3) + (X_2+Y_1) \]

and thus by Entropy and relabeling

\[ \mathbb{H}[X_3-Y_2, X_1-Y_3, X_2, Y_1, X_3+Y_3] = \mathbb{H}[X_3-Y_2, X_1-Y_3, X_2, Y_1] \]

and hence by Subadditivity

\[ \mathbb{H}[X_3-Y_2, X_1-Y_3, X_2, Y_1, X_3+Y_3] \leq \mathbb{H}[X_3-Y_2] + \mathbb{H}[X_1-Y_3] + \mathbb{H}[X_2] + \mathbb{H}[Y_1]. \]

Since \(X_3,Y_2\) are independent, we see from Ruzsa distance in independent case, Copy preserves Ruzsa distance that

\[ \mathbb{H}[X_3-Y_2] = \frac{1}{2} \mathbb{H}[X] + \frac{1}{2} \mathbb{H}[Y] + d[X; Y]. \]

Similarly

\[ \mathbb{H}[X_1-Y_3] = \frac{1}{2} \mathbb{H}[X] + \frac{1}{2} \mathbb{H}[Y] + d[X; Y]. \]

We conclude that

\[ \mathbb{H}[X_3-Y_2, X_1-Y_3, X_2, Y_1, X_3+Y_3] \leq 2\mathbb{H}[X] + 2\mathbb{H}[Y] + 2d[X; Y]. \]

Finally, from Data processing for a single variable we have

\[ \mathbb{H}[X_1,Y_1,X_2,Y_2,X_3,Y_3] \leq \mathbb{H}[X_3-Y_2, X_1-Y_3, X_2, Y_1, X_3, Y_3, X_3+Y_3]. \]

From Additivity of entropy followed by Entropy of conditionally independent variables, we have

\[ \mathbb{H}[X_1,Y_1,X_2,Y_2,X_3,Y_3] = \mathbb{H}[X_1,Y_1,X_1-Y_1] + \mathbb{H}[X_2,Y_2,X_2-Y_2] - \mathbb{H}[X_1-Y_1] + \mathbb{H}[X_3,Y_3] \]

and thus by Ruzsa distance in independent case, Copy preserves Ruzsa distance, Entropy and relabeling, Additivity of entropy

\[ \mathbb{H}[X_1,Y_1,X_2,Y_2,X_3,Y_3] = \mathbb{H}[X] + \mathbb{H}[Y] + \mathbb{H}[X] + \mathbb{H}[Y] -\left(\frac{1}{2}\mathbb{H}[X] + \frac{1}{2}\mathbb{H}[Y] + d[X; Y]\right) + \mathbb{H}[X] + \mathbb{H}[Y]. \]

Applying all of these estimates, the claim now follows from linear arithmetic.

Lean

Formalized as rdist_of_neg_le.

Sources
Uses 10 · Used by 1

LemmaKaimonovich–Vershik–Madiman inequality#

If \(n \geq 0\) and \(X, Y_1, \dots, Y_n\) are jointly independent \(G\)-valued random variables, then

\[ \mathbb{H}\left[X + \sum_{i=1}^n Y_i\right] - \mathbb{H}[X] \leq \sum_{i=1}^n \left(\mathbb{H}[X+Y_i] - \mathbb{H}[X]\right). \]
Proof

This is trivial for \(n=0,1\), while the \(n=2\) case is Kaimanovich-Vershik-Madiman inequality. Now suppose inductively that \(n > 2\), and the claim was already proven for \(n-1\). By a further application of Kaimanovich-Vershik-Madiman inequality one has

\[ \mathbb{H}\left[X + \sum_{i=1}^n Y_i\right] - \mathbb{H}\left[X + \sum_{i=1}^{n-1} Y_i\right] \leq \mathbb{H}[X+Y_n] - \mathbb{H}[X]. \]

By induction hypothesis one has

\[ \mathbb{H}\left[X + \sum_{i=1}^{n-1} Y_i\right] - \mathbb{H}[X] \leq \sum_{i=1}^{n-1} \mathbb{H}[X+Y_i] - \mathbb{H}[X]. \]

Summing the two inequalities, we obtain the claim.

Lean

Formalized as kvm_ineq_I.

Sources
Uses 1 · Used by 5

LemmaKaimonovich–Vershik–Madiman inequality, II#

If \(n \geq 1\) and \(X, Y_1, \dots, Y_n\) are jointly independent \(G\)-valued random variables, then

\[ d[X; \sum_{i=1}^n Y_i] \leq 2 \sum_{i=1}^n d[X; Y_i]. \]
Proof

Applying Kaimonovich–Vershik–Madiman inequality with all the \(Y_i\) replaced by \(-Y_i\), and using Negation preserves entropy and Ruzsa distance in independent case, we obtain after some rearranging

\[ d[X; \sum_{i=1}^n Y_i] + \frac{1}{2} (\mathbb{H}[\sum_{i=1}^n Y_i] - \mathbb{H}[X]) \leq \sum_{i=1}^n \left(d[X;Y_i] + \frac{1}{2} (\mathbb{H}[Y_i] - \mathbb{H}[X])\right). \]

From Independent lower bound on sumset we have

\[ \mathbb{H}[\sum_{i=1}^n Y_i] \geq \mathbb{H}[Y_i] \]

for all \(i\); subtracting \(\mathbb{H}[X]\) and averaging, we conclude that

\[ \mathbb{H}[\sum_{i=1}^n Y_i] - \mathbb{H}[X] \geq \frac{1}{n} \sum_{i=1}^n \mathbb{H}[Y_i] - \mathbb{H}[X] \]

and thus

\[ d[X; \sum_{i=1}^n Y_i] \leq \sum_{i=1}^n d[X;Y_i] + \frac{n-1}{2n} (\mathbb{H}[Y_i] - \mathbb{H}[X]). \]

From Distance controls entropy difference we have

\[ \mathbb{H}[Y_i] - \mathbb{H}[X] \leq 2 d[X;Y_i]. \]

Since \(0 \leq \frac{n-1}{2n} \leq \frac{1}{2}\), the claim follows.

Lean

Formalized as kvm_ineq_II.

Sources
Uses 5

LemmaKaimonovich–Vershik–Madiman inequality, III#

If \(n \geq 1\) and \(X, Y_1, \dots, Y_n\) are jointly independent \(G\)-valued random variables, then

\[ d\left[X; \sum_{i=1}^n Y_i\right] \leq d\left[X; Y_1\right] + \frac{1}{2}\left(\mathbb{H}\left[ \sum_{i=1}^n Y_i\right] - \mathbb{H}[Y_1]\right). \]
Proof

From Kaimanovich-Vershik-Madiman inequality one has

\[ \mathbb{H}\left[-X + \sum_{i=1}^n Y_i\right] \leq \mathbb{H}[ - X + Y_1 ] + \mathbb{H}\left[ \sum_{i=1}^n Y_i \right] - \mathbb{H}[Y_1]. \]

The claim then follows from Ruzsa distance in independent case and some elementary algebra.

Lean

Formalized as kvm_ineq_III.

Sources
Uses 2 · Used by 2

LemmaComparing sums#

Let \((X_i)_{1 \leq i \leq m}\) and \((Y_j)_{1 \leq j \leq l}\) be tuples of jointly independent random variables (so the \(X\)'s and \(Y\)'s are also independent of each other), and let \(f: \{1,\dots,l\} \to \{1,\dots,m\}\) be a function, then

\[ \mathbb{H}[\sum_{j=1}^l Y_j] \leq \mathbb{H}[ \sum_{i=1}^m X_i ] + \sum_{j=1}^l (\mathbb{H}[ Y_j - X_{f(j)}] - \mathbb{H}[X_{f(j)}]). \]
Proof

Write \(W := \sum_{i=1}^m X_i\). From Independent lower bound on sumset we have

\[ \mathbb{H}[\sum_{j=1}^l Y_j] \leq \mathbb{H}[-W + \sum_{j=1}^l Y_j] \]

while from Kaimonovich–Vershik–Madiman inequality one has

\[ \mathbb{H}[-W + \sum_{j=1}^l Y_j] \leq \mathbb{H}[-W] + \sum_{j=1}^l \mathbb{H}[-W + Y_j] - \mathbb{H}[-W]. \]

From Kaimanovich-Vershik-Madiman inequality one has

\[ \mathbb{H}[-W + Y_j] - \mathbb{H}[-W] \leq \mathbb{H}[-X_{f(j)} + Y_j] - \mathbb{H}[-X_{f(j)}]. \]

The claim now follows from Negation preserves entropy and some elementary algebra.

Lean

Formalized as ent_of_sum_le_ent_of_sum.

Sources
Uses 4 · Used by 1

LemmaSums of dilates I#

Let \(X,Y,X'\) be independent \(G\)-valued random variables, with \(X'\) a copy of \(X\), and let \(a\) be an integer. Then

\[ \mathbb{H}[X-(a+1)Y] \leq \mathbb{H}[X-aY] + \mathbb{H}[X-Y-X'] - \mathbb{H}[X] \]

and

\[ \mathbb{H}[X-(a-1)Y] \leq \mathbb{H}[X-aY] + \mathbb{H}[X-Y-X'] - \mathbb{H}[X]. \]
Proof

From Improved Ruzsa triangle inequality we have

\[ \mathbb{H}[(X-Y)-aY] \leq \mathbb{H}[(X-Y) - X'] + \mathbb{H}[X'-aY] - \mathbb{H}[X'] \]

which gives the first inequality. Similarly from Improved Ruzsa triangle inequality we have

\[ \mathbb{H}[(X+Y)-aY] \leq \mathbb{H}[(X+Y) - X'] + \mathbb{H}[X'-aY] - \mathbb{H}[X'] \]

which (when combined with Negation preserves entropy) gives the second inequality.

Lean

Formalized as ent_sub_nsmul_le, ent_of_sub_smul'.

Sources
Uses 2 · Used by 1

LemmaSums of dilates II#

Let \(X,Y\) be independent \(G\)-valued random variables, and let \(a\) be an integer. Then

\[ \mathbb{H}[X-aY] - \mathbb{H}[X] \leq 4 |a| d[X;Y]. \]
Proof

From Kaimanovich-Vershik-Madiman inequality one has

\[ \mathbb{H}[Y-X+X'] - \mathbb{H}[Y-X] \leq \mathbb{H}[Y+X'] - \mathbb{H}[Y] = \mathbb{H}[Y+X] - \mathbb{H}[Y] \]

which by Ruzsa distance in independent case gives

\[ \mathbb{H}[X-Y-X'] -\mathbb{H}[X] \leq d[X;Y] + d[X;-Y] \]

and hence by Flipping a sign

\[ \mathbb{H}[X-Y-X'] - \mathbb{H}[X] \leq 4d[X;Y]. \]

From Sums of dilates I we then have

\[ \mathbb{H}[X-(a\pm 1)Y] \leq \mathbb{H}[X-aY] + 4 d[X;Y] \]

and the claim now follows by an induction on \(|a|\).

Lean

Formalized as ent_sub_zsmul_sub_ent_le.

Sources
Uses 4 · Used by 1

We remark that in the paper [GGMT2024] the variant estimate

\[ \mathbb{H}[X-aY] - \mathbb{H}[X] \leq (4 + 10 \lfloor \log_2 |a| \rfloor) d[X;Y] \]

is also proven by a similar method. This variant is superior for \(|a| \geq 9\) (or \(|a|=7\)); but we will not need this estimate here.

The dependency explorer needs JavaScript and its graph data.

Download the complete graph data.