Endgame

Now let \(m \geq 2\), let \(G\) be an \(m\)-torsion abelian group, and let \((X_i)_{1 \leq i \leq m}\) be a \(\tau\)-minimizer.

LemmaZero-sum#

We have

\[ Z_1+Z_2+Z_3= 0\qquad\text{(1)} \]
Proof

Clear from definition.

Lean

Formalized as sum_of_z_eq_zero.

Sources
Used by 1

PropositionMutual information bound#

We have

\[ \mathbb{I}[Z_1 : Z_2\, |\, W],\ \mathbb{I}[Z_2 : Z_3\, |\, W],\ \mathbb{I}[Z_1 : Z_3\, |\, W] \leq t \]

where

\[ t := m(4m+1) \eta k.\qquad\text{(2)} \]
Proof

We analyze these variables by Bounding mutual information in several different ways. In the first application, take \(X_{i,j}=Y_{i,j}\). Note that each column \((X_{i,j})_{i=1}^m\) is indeed a permutation of \(X_1,\dots,X_m\); in fact, the trivial permutation. Note also that for each \(i \in \mathbb{Z}/m\mathbb{Z}\), the row sum is

\[ \sum_{j=1}^m X_{i,j} = \sum_{j \in \mathbb{Z}/m\mathbb{Z}} Y_{i,j} = P_i \]

and for each \(j \in \mathbb{Z}/m\mathbb{Z}\), the column sum is

\[ \sum_{i=1}^m X_{i,j} = \sum_{i \in \mathbb{Z}/m\mathbb{Z}} Y_{i,j} = Q_j. \]

Finally note that \(\sum_{i,j=1}^m X_{i,j} = W\). From Bounding mutual information we then have

\[ \mathbb{I}[ (P_i)_{i \in \mathbb{Z}/m\mathbb{Z}} : (Q_j)_{j \in \mathbb{Z}/m\mathbb{Z} } \,\big|\, W ] \leq t, \]

with \(t\) as in (2). Since \(Z_1\) is a function of \((P_i)_{i \in \mathbb{Z}/m\mathbb{Z}}\) by Additional random variables, and similarly \(Z_2\) is a function of \((Q_j)_{j \in \mathbb{Z}/m\mathbb{Z}}\), it follows immediately from Data processing inequality that

\[ \mathbb{I}[ Z_1 : Z_2 \,|\, W ] \leq t. \]

In the second application of Bounding mutual information, we instead consider \(X'_{i,j} = Y_{i-j,j}\). Again, for each fixed \(j\), the tuple \((X'_{i,j})_{i=1}^m\) is a permutation of \(X_1,\dots,X_m\). This time the row sums for \(i \in \{1,\dots, m\}\) are

\[ \sum_{j=1}^m X'_{i,j} = \sum_{j \in \mathbb{Z}/m\mathbb{Z}} Y_{i-j,j} = R_{-i}. \]

Similarly, the column sums for \(j \in \{1,\dots, m\}\) are

\[ \sum_{i=1}^m X'_{i,j} = \sum_{i \in \mathbb{Z}/m\mathbb{Z}} Y_{i-j,j} = Q_j. \]

As before, \(\sum_{i,j=1}^m X'_{i,j} = W\). Hence, using Additional random variables and Data processing inequality again, Bounding mutual information tells us

\[ \mathbb{I}[ Z_3 : Z_2 \,|\, W] \leq \mathbb{I}[ (R_i)_{i \in \mathbb{Z}/m\mathbb{Z}} : (Q_j)_{j \in \mathbb{Z}/m\mathbb{Z} } \,\big|\, W ] \leq t. \]

In the third application (In fact, by permuting the variables \((Y_{i,j})_{i,j \in \mathbb{Z}/m\mathbb{Z}}\), one can see that the random variables \((W, Z_1, Z_2)\) and \((W, Z_1, Z_3)\) have the same distribution, so this is in some sense identical to – and can be deduced from – the first application.) of Bounding mutual information, take \(X''_{i,j} = Y_{i,j-i}\). The column and row sums are respectively

\[ \sum_{j=1}^m X''_{i,j} = \sum_{j \in \mathbb{Z}/m\mathbb{Z}} Y_{i,j-i} = P_i \]

and

\[ \sum_{i=1}^m X''_{i,j} = \sum_{i \in \mathbb{Z}/m\mathbb{Z}} Y_{i,j-i} = R_{-j}. \]

Hence, Bounding mutual information and Data processing inequality give

\[ \mathbb{I}[ Z_1 : Z_3 \,|\, W] \leq \mathbb{I}[ (P_i)_{i \in \mathbb{Z}/m\mathbb{Z}} : (R_j)_{j \in \mathbb{Z}/m\mathbb{Z} } \,\big|\, W ] \leq t, \]

which completes the proof.

Lean

Formalized as mutual_information_le_t_12, mutual_information_le_t_13, mutual_information_le_t_23.

Sources
Uses 2 · Used by 1

LemmaEntropy of \(W\)#

We have \(\mathbb{H}[W] \leq (2m-1)k + \frac1m \sum_{i=1}^m \mathbb{H}[X_i]\).

Proof

Without loss of generality, we may take \(X_1,\dots,X_m\) to be independent. Write \(S = \sum_{i=1}^m X_i\). Note that for each \(j \in \mathbb{Z}/m\mathbb{Z}\), the sum \(Q_j\) from Additional random variables above has the same distribution as \(S\). By Kaimonovich–Vershik–Madiman inequality we have

\[ \begin{aligned} \mathbb{H}[W] = \mathbb{H}[\sum_{j \in \mathbb{Z}/m\mathbb{Z}} Q_j] & \leq \mathbb{H}[S] + \sum_{j=2}^m (\mathbb{H}[Q_1+Q_j] - \mathbb{H}[S]) \\ & = \mathbb{H}[S] + (m-1) d[S;-S]. \end{aligned} \]

By Multidistance and Ruzsa distance, IV, we have

\[ d[S; -S] \leq 2 k\qquad\text{(3)} \]

and hence

\[ \mathbb{H}[W] \leq 2 k (m-1) + \mathbb{H}[S]. \]

From Multidistance we have

\[ \mathbb{H}[S] = k + \frac1m \sum_{i=1}^m \mathbb{H}[X_i],\qquad\text{(4)} \]

and the claim follows.

Lean

Formalized as entropy_of_W_le.

Sources
Uses 3 · Used by 1

LemmaEntropy of \(Z_2\)#

We have \(\mathbb{H}[Z_2] \leq (8m^2-16m+1) k + \frac{1}{m} \sum_{i=1}^m \mathbb{H}[X_i]\).

Proof

We observe

\[ \mathbb{H}[Z_2] = \mathbb{H}[\sum_{j \in \mathbb{Z}/m\mathbb{Z}} j Q_j]. \]

Applying Kaimonovich–Vershik–Madiman inequality one has

\[ \begin{aligned} \mathbb{H}[Z_2] &\leq \sum_{i=2}^{m-1} \mathbb{H}[Q_1 + i Q_i] - (m-2) \mathbb{H}[S]. \end{aligned} \]

Using Sums of dilates II and (3) we get

\[ \begin{aligned} \mathbb{H}[Z_2] &\leq \mathbb{H}[S] + 4m (m-2) d[S;-S] \\ &\leq \mathbb{H}[S] + 8m (m-2) k. \end{aligned} \]

Applying (4) gives the claim.

Lean

Formalized as entropy_of_Z_two_le.

Sources
Uses 2 · Used by 1

LemmaMutual information bound#

We have \(\mathbb{I}[W : Z_2] \leq 2 (m-1) k\).

Proof

From Alternative formulae for mutual information we have \(\mathbb{I}[W : Z_2] = \mathbb{H}[W] - \mathbb{H}[W | Z_2]\), and since \(Z_2 = \sum_{j=1}^{m-1} j Q_j\) and \(W = \sum_{j=1}^m Q_j\),

\[ \mathbb{H}[W | Z_2] \geq \mathbb{H}[W \,|\, Q_1,\dots,Q_{m-1}] = \mathbb{H}[Q_m] = \mathbb{H}[S]. \]

Hence, by Entropy of \(W\),

\[ \mathbb{I}[W : Z_2] \leq \mathbb{H}[W] - \mathbb{H}[S] \leq 2 (m-1) k, \]

as claimed.

Lean

Formalized as mutual_of_W_Z_two_le.

Sources
Uses 2 · Used by 1

LemmaDistance bound#

We have \(\sum_{i=1}^m d[X_i;Z_2|W] \leq 4(m^3-m^2) k\).

Proof

For each \(i \in \{1,\dots, m\}\), using Kaimonovich–Vershik–Madiman inequality, III (noting the sum \(Z_2\) contains \(X_i\) as a summand) we have

\[ d[X_i;Z_2] \leq d[X_i;X_i] + \tfrac12 (\mathbb{H}[Z_2] - \mathbb{H}[X_i])\qquad\text{(5)} \]

and using Upper bound on conditioned Ruzsa distance we have

\[ d[X_i;Z_2 | W] \leq d[X_i;Z_2] + \tfrac12 \mathbb{I}[W : Z_2]. \]

Combining with (5) and Mutual information bound gives

\[ d[X_i;Z_2 | W] \leq d[X_i;X_i] + \tfrac12 (\mathbb{H}[Z_2] - \mathbb{H}[X_i]) + (m-1)k. \]

Summing over \(i\) and applying Entropy of \(Z_2\) gives

\[ \sum_{i = 1}^m d[X_i;Z_2 | W] \leq \sum_{i = 1}^m d[X_i;X_i] + m(8m^2-16m+1) k/2 + m(m-1) k. \]

Finally, applying Multidistance and Ruzsa distance, II (and dropping some lower order terms) gives the claim.

Lean

Formalized as sum_of_conditional_distance_le.

Sources
Uses 5 · Used by 1

LemmaApplication of BSG#

Let \(G\) be an abelian group, let \((T_1,T_2,T_3)\) be a \(G^3\)-valued random variable such that \(T_1+T_2+T_3=0\) holds identically, and write

\[ \delta := \mathbb{I}[T_1 : T_2] + \mathbb{I}[T_1 : T_3] + \mathbb{I}[T_2 : T_3]. \]

Let \(Y_1,\dots,Y_n\) be some further \(G\)-valued random variables and let \(\alpha>0\) be a constant. Then there exists a random variable \(U\) such that

\[ d[U;U] + \alpha \sum_{i=1}^n d[Y_i;U] \leq \Bigl(2 + \frac{\alpha n}{2} \Bigr) \delta + \alpha \sum_{i=1}^n d[Y_i;T_2].\qquad\text{(6)} \]
Proof

We apply Balog-Szemerédi-Gowers with \(X=T_1\) and \(Y=T_2\). Since \(T_1+T_2=-T_3\), we find that

\[ \begin{split} \sum_{z} p_{T_3}(z) & d[T_1 \,|\, T_3 \mathop{=} z;T_2 \,|\, T_3 \mathop{=} z] \\ &\leq 3 \mathbb{I}[T_1 : T_2] + 2 \mathbb{H}[T_3] - \mathbb{H}[T_1] - \mathbb{H}[T_2] \\ &\ = \mathbb{I}[T_1 : T_2] + \mathbb{I}[T_1 : T_3] + \mathbb{I}[T_2 : T_3] = \delta, \end{split}\qquad\text{(7)} \]

where the last line follows from Entropy and relabeling by observing

\[ \mathbb{H}[T_1,T_2] = \mathbb{H}[T_1,T_3] = \mathbb{H}[T_2,T_3] = \mathbb{H}[T_1,T_2,T_3] \]

since any two of \(T_1,T_2,T_3\) determine the third.

By (7) and the triangle inequality,

\[ \sum_z p_{T_3}(z) d[T_2 \,|\, T_3 \mathop{=} z; T_2 \,|\, T_3\mathop{=}z] \leq 2 \delta \]

and by Comparison of Ruzsa distances, I, for each \(Y_i\),

\[ \begin{aligned} &\sum_z p_{T_3}(z) d[Y_i; T_2 \,|\, T_3 \mathop{=} z] \\ &\qquad= d[Y_i; T_2 \,|\, T_3] \leq d[Y_i;T_2] + \frac12 \mathbb{I}[T_2 : T_3] \leq d[Y_i;T_2] + \frac{\delta}{2}. \end{aligned} \]

Hence,

\[ \begin{aligned} &\sum_z p_{T_3}(z) \bigg( d[T_2 \,|\, T_3 \mathop{=} z; T_2 \,|\, T_3 \mathop{=} z] + \alpha \sum_{i=1}^n d[Y_i;T_2 \,|\, T_3 \mathop{=} z] \bigg) \\ &\qquad \leq \Bigl(2 + \frac{\alpha n}{2} \Bigr) \delta + \alpha \sum_{i=1}^n d[Y_i; T_2], \end{aligned} \]

and the result follows by setting \(U=(T_2 \,|\, T_3 \mathop{=} z)\) for some \(z\) such that the quantity in parentheses on the left-hand side is at most the weighted average value.

Lean

Formalized as dist_of_U_add_le.

Sources
Uses 3 · Used by 1

PropositionVanishing entropy#

We have \(k = 0\).

Proof

For each value \(W=w\), apply Application of BSG (and Zero-sum) to

\[ T_1 = (Z_1 \,|\, W \mathop{=} w),\ T_2 = (Z_2 \,|\, W \mathop{=} w),\ T_3 = (Z_3 \,|\, W \mathop{=} w) \]

with \(Y_i=X_i\) and \(\alpha=\eta/m\). Write

\[ \delta_w := \mathbb{I}[T_1 : T_2] + \mathbb{I}[T_1 : T_3] + \mathbb{I}[T_2 : T_3] \]

for this choice, and note that

\[ \begin{aligned} \delta_\ast := \sum_w p_W(w) \delta_w &= \mathbb{I}[Z_1 : Z_2 \,|\, W] + \mathbb{I}[Z_1 : Z_3 \,|\, W] + \mathbb{I}[Z_2 : Z_3 \,|\, W]\qquad\text{(8)}\\ & \leq 3 m (4m+1) \eta k \end{aligned} \]

by Mutual information bound. Write \(U_w\) for the random variable guaranteed to exist by Application of BSG, so that (6) gives

\[ d[U_w; U_w] \leq \Bigl( 2 + \frac{\alpha m}{2} \Bigr) \delta_w + \alpha \sum_{i=1}^m \bigl( d[X_i; T_2] - d[X_i; U_w] \bigr).\qquad\text{(9)} \]

Let \((U_w)_I\) denote the tuple consisting of the same variable \(U_w\) repeated \(m\) times. By Multidistance and Ruzsa distance, III

\[ D[(U_w)_I] \leq m d[U_w; U_w].\qquad\text{(10)} \]

On the other hand, from Lower bound on multidistance one has

\[ D[(U_w)_I] \geq k - \eta \sum_{i=1}^m d[X_i;U_w].\qquad\text{(11)} \]

Combining (9), (10) and (11) and averaging over \(w\) (with weight \(p_W(w)\)), and recalling the value \(\alpha=\eta/m\), gives

\[ m \Bigl( 2 + \frac{\eta}{2} \Bigr) \delta_\ast + \eta \sum_{i=1}^m d[X_i; Z_2 | W] \geq k \]

since the terms \(d[X_i; U_w]\) cancel by our choice of \(\alpha\). Substituting in Distance bound and (8), and using the fact that \(2 + \frac{\eta}{2} < 3\), we have

\[ 3 m^2 (4m+1) (2+\frac{\eta}{2}) \eta k + \eta 8(m^3-m^2) k \geq k. \]

From \(\eta\) we have we have

\[ 3 m^2 (4m+1) (2+\frac{\eta}{2}) \eta + \eta 8(m^3-m^2) < 1 \]

and hence \(k \leq 0\). The claim now follows from Nonnegativity.

Lean

Formalized as k_eq_zero.

Sources
Uses 8 · Used by 1

The dependency explorer needs JavaScript and its graph data.

Download the complete graph data.