# arrow_back State Bennett's inequality

20 views
State Bennett's inequality

Theorem:(Bennett inequality, 1962):

Let $\left\{X_{i}\right\}_{i=1}^{n}$ be a collection of independent random variables satisfying the conditions:
a) $E\left[X_{i}^{2}\right]<\infty \forall i$, so that one can write $\sum_{i=1}^{n} E\left[X_{i}^{2}\right]=v^{2}$
b) $\operatorname{Pr}\left\{\left|X_{i}\right| \leq M\right\}=1 \quad \forall i$
Then, for any $\varepsilon \geq 0$
$\operatorname{Pr}\left\{\sum_{i=1}^{n}\left(X_{i}-E\left[X_{i}\right]\right)>\varepsilon\right\} \leq \exp \left[-\frac{v^{2}}{M^{2}} \theta\left(\frac{\varepsilon M}{v^{2}}\right)\right] \leq \exp \left[-\frac{\varepsilon}{2 M} \ln \left(1+\frac{\varepsilon M}{v^{2}}\right)\right]$
where
$\theta(x)=(1+x) \ln (1+x)-x$
Remark: Observing that $(1+x) \ln (1+x)-x \geq 9\left(1+\frac{x}{3}-\sqrt{1+\frac{2}{3} x}\right) \geq$ $\frac{3 x^{2}}{2(x+3)} \quad \forall x \geq 0$, and plugging these expressions into the bound, one obtains immediately the Bernstein inequality under the hypotheses of boundness of random variables, as one might expect. However, Bernstein inequalities, although weaker, hold under far more general hypotheses than Bennett one.

by Platinum
(106,844 points)

## Related questions

Notice: Undefined index: avatar in /home/customer/www/mathsgee.com/public_html/qa-theme/AVEN/qa-theme.php on line 993
State the Schwartz inequality or Cauchy-Schwartz inequality
State the Schwartz inequality or Cauchy-Schwartz inequalityState the Schwartz inequality or Cauchy-Schwartz inequality ...
close

Notice: Undefined index: avatar in /home/customer/www/mathsgee.com/public_html/qa-theme/AVEN/qa-theme.php on line 993
Prove Markov’s inequality.
Prove Markov’s inequality.Prove (Markov's inequality). Suppose $X$ is a nonnegative random variable and $a \in$ is a positive constant. Then \ P(X \geq a) \leq \frac{E X} ...
close

Notice: Undefined index: avatar in /home/customer/www/mathsgee.com/public_html/qa-theme/AVEN/qa-theme.php on line 993
Prove the Prohorov inequality
Prove the Prohorov inequalityProve the Prohorov inequality ...
close

Notice: Undefined index: avatar in /home/customer/www/mathsgee.com/public_html/qa-theme/AVEN/qa-theme.php on line 993
What is the Schwartz theorem?
What is the Schwartz theorem?What is the Schwartz theorem? ...
close

Notice: Undefined index: avatar in /home/customer/www/mathsgee.com/public_html/qa-theme/AVEN/qa-theme.php on line 993
What is the Cauchy-Schwartz inequality useful for in mathematics?
What is the Cauchy-Schwartz inequality useful for in mathematics?What is the Cauchy-Schwartz inequality useful for in mathematics? ...
close

Notice: Undefined index: avatar in /home/customer/www/mathsgee.com/public_html/qa-theme/AVEN/qa-theme.php on line 993
State the Prohorov inequality