Typical subspace

In quantum information theory, the idea of a typical subspace plays an important role in the proofs of many coding theorems (the most prominent example being Schumacher compression). Its role is analogous to that of the typical set in classical information theory.

Unconditional Quantum Typicality

Consider a density operator $\rho$ with the following spectral decomposition:

$\rho=\sum_{x}p_{X}\left( x\right) \left\vert x\right\rangle \left\langle x\right\vert .$

The weakly typical subspace is defined as the span of all vectors such that the sample entropy $\overline{H}\left( x^{n}\right)$ of their classical label is close to the true entropy $H\left( X\right)$ of the distribution $p_{X}\left( x\right)$:

$T_{\delta}^{X^{n}}\equiv\text{span}\left\{ \left\vert x^{n}\right\rangle :\left\vert \overline{H}\left( x^{n}\right) -H\left( X\right) \right\vert \leq\delta\right\} ,$

where

$\overline{H}\left( x^{n}\right) \equiv-\frac{1}{n}\log\left( p_{X^{n} }\left( x^{n}\right) \right) ,$

$H\left( X\right) \equiv-\sum_{x}p_{X}\left( x\right) \log p_{X}\left( x\right) .$

The projector $\Pi_{\rho,\delta}^{n}$ onto the typical subspace of $\rho$ is defined as

$\Pi_{\rho,\delta}^{n}\equiv\sum_{x^{n}\in T_{\delta}^{X^{n}}}\left\vert x^{n}\right\rangle \left\langle x^{n}\right\vert ,$

where we have "overloaded" the symbol $T_{\delta}^{X^{n}}$ to refer also to the set of $\delta$-typical sequences:

$T_{\delta}^{X^{n}}\equiv\left\{ x^{n}:\left\vert \overline{H}\left( x^{n}\right) -H\left( X\right) \right\vert \leq\delta\right\} .$

The three important properties of the typical projector are as follows:

$\text{Tr}\left\{ \Pi_{\rho,\delta}^{n}\rho^{\otimes n}\right\} \geq1-\epsilon,$

$\text{Tr}\left\{ \Pi_{\rho,\delta}^{n}\right\} \leq2^{n\left[ H\left( X\right) +\delta\right] },$

$2^{-n\left[ H\left( X\right) +\delta\right] }\Pi_{\rho,\delta}^{n} \leq\Pi_{\rho,\delta}^{n}\rho^{\otimes n}\Pi_{\rho,\delta}^{n}\leq2^{-n\left[ H\left( X\right) -\delta\right] }\Pi_{\rho,\delta}^{n},$

where the first property holds for arbitrary $\epsilon,\delta>0$ and sufficiently large $n$.

Conditional Quantum Typicality

Consider an ensemble $\left\{ p_{X}\left( x\right) ,\rho_{x}\right\} _{x\in\mathcal{X}}$ of states. Suppose that each state $\rho_{x}$ has the following spectral decomposition:

$\rho_{x}=\sum_{y}p_{Y|X}\left( y|x\right) \left\vert y_{x}\right\rangle \left\langle y_{x}\right\vert .$

Consider a density operator $\rho_{x^{n}}$ which is conditional on a classical sequence $x^{n}\equiv x_{1}\cdots x_{n}$:

$\rho_{x^{n}}\equiv\rho_{x_{1}}\otimes\cdots\otimes\rho_{x_{n}}.$

We define the weak conditionally typical subspace as the span of vectors (conditional on the sequence $x^{n}$) such that the sample conditional entropy $\overline{H}\left( y^{n}|x^{n}\right)$ of their classical labels is close to the true conditional entropy $H\left( Y|X\right)$ of the distribution $p_{Y|X}\left( y|x\right) p_{X}\left( x\right)$:

$T_{\delta}^{Y^{n}|x^{n}}\equiv\text{span}\left\{ \left\vert y_{x^{n}} ^{n}\right\rangle :\left\vert \overline{H}\left( y^{n}|x^{n}\right) -H\left( Y|X\right) \right\vert \leq\delta\right\} ,$

where

$\overline{H}\left( y^{n}|x^{n}\right) \equiv-\frac{1}{n}\log\left( p_{Y^{n}|X^{n}}\left( y^{n}|x^{n}\right) \right) ,$

$H\left( Y|X\right) \equiv-\sum_{x}p_{X}\left( x\right) \sum_{y} p_{Y|X}\left( y|x\right) \log p_{Y|X}\left( y|x\right) .$

The projector $\Pi_{\rho_{x^{n}},\delta}$ onto the weak conditionally typical subspace of $\rho_{x^{n}}$ is as follows:

$\Pi_{\rho_{x^{n}},\delta}\equiv\sum_{y^{n}\in T_{\delta}^{Y^{n}|x^{n}} }\left\vert y_{x^{n}}^{n}\right\rangle \left\langle y_{x^{n}}^{n}\right\vert ,$

where we have again overloaded the symbol $T_{\delta}^{Y^{n}|x^{n}}$ to refer to the set of weak conditionally typical sequences:

$T_{\delta}^{Y^{n}|x^{n}}\equiv\left\{ y^{n}:\left\vert \overline{H}\left( y^{n}|x^{n}\right) -H\left( Y|X\right) \right\vert \leq\delta\right\} .$

The three important properties of the weak conditionally typical projector are as follows:

$\mathbb{E}_{X^{n}}\left\{ \text{Tr}\left\{ \Pi_{\rho_{X^{n}},\delta} \rho_{X^{n}}\right\} \right\} \geq1-\epsilon,$

$\text{Tr}\left\{ \Pi_{\rho_{x^{n}},\delta}\right\} \leq2^{n\left[ H\left( Y|X\right) +\delta\right] },$

$2^{-n\left[ H\left( Y|X\right) +\delta\right] }\ \Pi_{\rho_{x^{n}} ,\delta} \leq\Pi_{\rho_{x^{n}},\delta}\ \rho_{x^{n}}\ \Pi_{\rho_{x^{n} },\delta} \leq2^{-n\left[ H\left( Y|X\right) -\delta\right] }\ \Pi _{\rho_{x^{n}},\delta},$

where the first property holds for arbitrary $\epsilon,\delta>0$ and sufficiently large $n$, and the expectation is with respect to the distribution $p_{X^{n}}\left( x^{n}\right)$.

See also

• Classical capacity
• Quantum information theory

References

• Mark M. Wilde, "From Classical to Quantum Shannon Theory", arXiv:1106.1445.