Skip to content

Beta distribution

The beta distribution models bounded proportions or uncertainty about a probability. Read its shapes, endpoint behaviour and beta–binomial update through an order-fill example.

The beta distribution is a family of continuous probability distributions on the interval from zero to one, controlled by two positive shape parameters. It can describe a bounded proportion, such as a recovery fraction, or uncertainty about an unknown probability, such as an order's chance of filling before a deadline. Those are different modelling uses: a realised fraction is an observation; an unknown probability is a parameter.
Here, write Θ∼Beta(α,β)\Theta\sim\text{Beta}(\alpha,\beta) with α>0\alpha>0 and β>0\beta>0. Both parameters describe shape. Neither is a rate, a scale, or the market beta of a security.

A density over probabilities

fΘ(θ)=θα−1(1−θ)β−1B(α,β),0<θ<1,f_\Theta(\theta)=\frac{\theta^{\alpha-1}(1-\theta)^{\beta-1}}{B(\alpha,\beta)},\qquad 0<\theta<1,

where the beta function normalises the area:

B(α,β)=∫01tα−1(1−t)β−1 dt.B(\alpha,\beta)=\int_0^1 t^{\alpha-1}(1-t)^{\beta-1}\,dt.

The density is zero outside the interval. There are no probability atoms at zero or one: the beta law has support [0,1][0,1], but P(Θ=0)=P(Θ=1)=0\mathbb P(\Theta=0)=\mathbb P(\Theta=1)=0. Even an infinite endpoint density is an integrable limit, not a positive chance of landing exactly there.

The mean and variance are
E[Θ]=αα+β,Var(Θ)=αβ(α+β)2(α+β+1).\mathbb E[\Theta]=\frac{\alpha}{\alpha+\beta},\qquad \text{Var}(\Theta)=\frac{\alpha\beta}{(\alpha+\beta)^2(\alpha+\beta+1)}.

A useful alternative is the mean m=α/(α+β)m=\alpha/(\alpha+\beta) and concentration κ=α+β\kappa=\alpha+\beta. Then α=mκ\alpha=m\kappa, β=(1−m)κ\beta=(1-m)\kappa, and Var(Θ)=m(1−m)/(κ+1)\text{Var}(\Theta)=m(1-m)/(\kappa+1). Holding the mean fixed while increasing concentration reduces dispersion. The mean alone does not specify how uncertain the model is.

Updating a fill-probability estimate

Consider a synthetic execution study. Define success as an order filling in full within one second, under a fixed order policy and comparable conditions. Let θ\theta be the common success probability. Before collecting this sample, suppose the desk chooses a prior
Θ∼Beta(2,8).\Theta\sim\text{Beta}(2,8).

This is an explicit modelling judgement, with prior mean 2/10=0.202/10=0.20, variance 4/275≈0.01454554/275\approx0.0145455, and mode 1/8=0.1251/8=0.125. A mean of 20% is a summary of the distribution over possible success probabilities; it does not assert that the probability is known to equal 20%.

The next ten orders produce three successes and seven failures. Assume their binary outcomes are conditionally independent, with the same probability θ\theta given Θ=θ\Theta=\theta. The success count then has a binomial distribution, and its likelihood is proportional to θ3(1−θ)7\theta^3(1-\theta)^7. Multiplying by the prior gives
π(θ∣data)∝θ2−1(1−θ)8−1θ3(1−θ)7=θ5−1(1−θ)15−1.\begin{aligned} \pi(\theta\mid\text{data}) &\propto \theta^{2-1}(1-\theta)^{8-1}\theta^3(1-\theta)^7\\ &=\theta^{5-1}(1-\theta)^{15-1}. \end{aligned}
The posterior distribution is therefore Beta(5,15)\text{Beta}(5,15). In general, ss successes and ff failures update the shapes to (α+s,β+f)(\alpha+s,\beta+f): this is beta–binomial conjugacy. The calculation follows the parameter-update rule in Orloff and Bloom's MIT notes.
Summary of uncertainty about θ\thetaBefore dataAfter data
DistributionBeta(2,8)\text{Beta}(2,8)Beta(5,15)\text{Beta}(5,15)
Mean0.200.200.250.25
Mode0.1250.1252/9≈0.22222/9\approx0.2222
Variance4/275≈0.01454554/275\approx0.01454551/112≈0.00892861/112\approx0.0089286

The posterior mean lies between the prior mean and the observed success fraction:

520=1020×0.20+1020×310=0.25.\frac{5}{20}=\frac{10}{20}\times0.20+\frac{10}{20}\times\frac{3}{10}=0.25.

Here α+β\alpha+\beta supplies the prior's weight in this mean calculation. Calling it a pseudo-count is useful; it need not represent literal earlier orders. Prior data must not be counted again in the new likelihood.

Dashed Beta(2,8) prior and solid Beta(5,15) posterior for an unknown order-fill probability. Mean markers move from 0.20 to 0.25. Prior area below 0.20 is 0.563792384.
Dashed Beta(2,8) prior and solid Beta(5,15) posterior for an unknown order-fill probability. Mean markers move from 0.20 to 0.25. Prior area below 0.20 is 0.563792384.
Original synthetic model. Three full fills and seven non-fills within the deadline revise the distribution over the shared probability. The shaded area belongs to the prior.
A single future order still has a Bernoulli outcome: success or failure, coded one or zero. Under this model its posterior predictive success probability is E[Θ∣data]=0.25\mathbb E[\Theta\mid\text{data}]=0.25. The beta variance 1/1121/112 measures uncertainty about θ\theta; it is not that order's predictive variance, which is 0.25(1−0.25)=0.18750.25(1-0.25)=0.1875. Several future orders also share parameter uncertainty, so integrating out Θ\Theta does not make their outcomes independent.
The simple update relies on a common, stable probability and the stated likelihood. Changes in liquidity, order size, queue position or routing policy can invalidate that assumption. Conjugacy makes a chosen model easy to update; it does not establish that the model fits execution data. Bayesian Reasoning develops the same update with default probabilities and discusses prior strength. Its public page is a preview; the full lesson requires membership.

Shape and endpoint traps

Beta does not mean bell-shaped. For α,β>1\alpha,\beta>1, the density has one interior mode,

θmode=α−1α+β−2.\theta_{\text{mode}}=\frac{\alpha-1}{\alpha+\beta-2}.
This formula is conditional on both shapes exceeding one. Differentiating the log density gives (α−1)/θ−(β−1)/(1−θ)(\alpha-1)/\theta-(\beta-1)/(1-\theta); outside those conditions, its zero can be a minimum or fail to identify a maximum.
Shape parametersDensity behaviour
α=β=1\alpha=\beta=1Uniform: every point has the same density.
α<1\alpha<1, β<1\beta<1U-shaped, with divergent limits at both endpoints and an interior minimum.
α≤1\alpha\le1, β≥1\beta\ge1, excluding (1,1)(1,1)Decreasing; boundary peak toward zero.
α≥1\alpha\ge1, β≤1\beta\le1, excluding (1,1)(1,1)Increasing; boundary peak toward one.
α>1\alpha>1, β>1\beta>1One interior maximum at the formula above.

More precisely, the limit near zero is infinite if α<1\alpha<1, finite and equal to β\beta if α=1\alpha=1, and zero if α>1\alpha>1. Swap the parameters to obtain the corresponding limit near one. Boundary peaks describe density limits; they do not create endpoint atoms or probabilities of one.

Four beta densities on the interval zero to one: Beta(1,1) is uniform; Beta(0.5,0.5) is U-shaped with divergent endpoint limits; Beta(2,8) favours small values; Beta(8,2) favours large values.
Four beta densities on the interval zero to one: Beta(1,1) is uniform; Beta(0.5,0.5) is U-shaped with divergent endpoint limits; Beta(2,8) favours small values; Beta(8,2) favours large values.
Original analytic densities. The U-shaped curve is shown only from 0.01 to 0.99; the omitted endpoint limits are infinite, not finite maxima.
Density heights can exceed one. The Beta(2,8)\text{Beta}(2,8) peak is approximately 3.53433.5343, yet its total area remains one. An interval probability comes from integration. For example, its CDF gives
P(Θ≤0.20)=∫00.2072t(1−t)7 dt=0.563792384.\mathbb P(\Theta\le0.20)=\int_0^{0.20}72t(1-t)^7\,dt =0.563792384.
If a bounded recovery model needs positive probabilities of exactly zero or exactly full recovery, an ordinary beta density alone cannot supply them. Endpoint masses require a mixture or another explicitly specified model. A beta distribution is also unsuitable for an unbounded variable merely because its observed sample happened to lie between zero and one.

Sources

Last updated
  • probability
  • continuous distributions
  • bayesian inference
  • beta binomial
  • bounded proportions
← Back to the glossaryBack to top ↑