Hermite distribution
In probability theory and statistics, the Hermite distribution, named after Charles Hermite, is a discrete probability distribution used to model count data with more than one parameter. This distribution is flexible in terms of its ability to allow a moderate over-dispersion in the data.
The authors Kemp and Kemp have called it "Hermite distribution" from the fact its probability function and the moment generating function can be expressed in terms of the coefficients of Hermite polynomials.
History
The distribution first appeared in the paper Applications of Mathematics to Medical Problems, by Anderson Gray McKendrick in 1926. In this work the author explains several mathematical methods that can be applied to medical research. In one of this methods he considered the bivariate Poisson distribution and showed that the distribution of the sum of two correlated Poisson variables follow a distribution that later would be known as Hermite distribution.As a practical application, McKendrick considered the distribution of counts of bacteria in leucocytes. Using the method of moments he fitted the data with the Hermite distribution and found the model more satisfactory than fitting it with a Poisson distribution.
The distribution was formally introduced and published by C. D. Kemp and Adrienne W. Kemp in 1965 in their work Some Properties of ‘Hermite’ Distribution. The work is focused on the properties of this distribution for instance a necessary condition on the parameters and their maximum likelihood estimators, the analysis of the probability generating function and how it can be expressed in terms of the coefficients of Hermite polynomials. An example they have used in this publication is the distribution of counts of bacteria in leucocytes that used McKendrick but Kemp and Kemp estimate the model using the maximum likelihood method.
Hermite distribution is a special case of discrete compound Poisson distribution with only two parameters.
The same authors published in 1966 the paper An alternative Derivation of the Hermite Distribution. In this work established that the Hermite distribution can be obtained formally by combining a Poisson distribution with a normal distribution.
In 1971, Y. C. Patel did a comparative study of various estimation procedures for the Hermite distribution in his doctoral thesis. It included maximum likelihood, moment estimators, mean and zero frequency estimators and the method of even points.
In 1974, Gupta and Jain did a research on a generalized form of Hermite distribution.
Definition
Probability mass function
Let X1 and X2 be two independent Poisson variables with parameters a1 and a2. The probability distribution of the random variable Y = X1 + 2X2 is the Hermite distribution with parameters a1 and a2 and probability mass function is given bywhere
- n = 0, 1, 2,...
- a1, a2 ≥ 0.
- ! and j! are the factorials of and j, respectively.
- is the integer part of n/2.
Notation
When a random variable Y = X1 + 2X2 is distributed by an Hermite distribution, where X1 and X2 are two independent Poisson variables with parameters a1 and a2, we writeProperties
Moment and cumulant generating functions
The moment generating function of a random variable X is defined as the expected value of et, as a function of the real parameter t. For an Hermite distribution with parameters X1 and X2, the moment generating function exists and is equal toThe cumulant generating function is the logarithm of the moment generating function and is equal to
If we consider the coefficient of rr
Hence the mean and the succeeding three moments about it are
Order | Moment | Cumulant |
1 | ||
2 | ||
3 | ||
4 |
Skewness
The skewness is the third moment centered around the mean divided by the 3/2 power of the standard deviation, and for the hermite distribution is,- Always, so the mass of the distribution is concentrated on the left.
Kurtosis
The excess kurtosis is just a correction to make the kurtosis of the normal distribution equal to zero, and it is the following,
- Always, or the distribution has a high acute peak around the mean and fatter tails.
Characteristic function
This function is related to the moment-generating function via. Hence for this distribution the characteristic function is,
Cumulative distribution function
The cumulative distribution function is,Other properties
- This distribution can have any number of modes. As an example, the fitted distribution for McKendrick’s data has an estimated parameters of,. Therefore, the first five estimated probabilities are 0.899, 0.012, 0.084, 0.001, 0.004.
- This distribution is closed under addition or closed under convolutions. Like the Poisson distribution, the Hermite distribution has this property. Given two Hermite-distributed random variables and, then Y = X1 + X2 follows an Hermite distribution,.
- This distribution allows a moderate overdispersion, so it can be used when data has this property. A random variable has overdispersion, or it is overdispersed with respect the Poisson distribution, when its variance is greater than its expected value. The Hermite distribution allows a moderate overdispersion because the coefficient of dispersion is always between 1 and 2,
Parameter estimation
Method of moments
The mean and the variance of the Hermite distribution are and, respectively. So we have these two equation,Solving these two equation we get the moment estimators and of a1 and a2.
Since a1 and a2 both are positive, the estimator and are admissible only if, .
Maximum likelihood
Given a sample X1,..., Xm are independent random variables each having an Hermite distribution we wish to estimate the value of the parameters and. We know that the mean and the variance of the distribution are and, respectively. Using these two equation,We can parameterize the probability function by μ and d
Hence the log-likelihood function is,
where
Straightforward calculations show that,
- And d can be found by solving,
- It can be shown that the log-likelihood function is strictly concave in the domain of the parameters. Consequently, the MLE is unique.
Proposition: Let X1,..., Xm come from a generalized Hermite distribution with fixed n. Then the MLEs of the parameters are and if only if, where indicates the empirical factorial momement of order 2.
- Remark 1: The condition is equivalent to where is the empirical dispersion index
- Remark 2: If the condition is not satisfied, then the MLEs of the parameters are and, that is, the data are fitted using the Poisson distribution.
Zero frequency and the mean estimators
We obtain the zero frequency and the mean estimator a1 of and a2 of,
where, is the zero relative frequency, n > 0
It can be seen that for distributions with a high probability at 0, the efficiency is high.
- For admissible values of and, we must have
Testing Poisson assumption
Likelihood-ratio test
The likelihood-ratio test statistic for hermite distribution is,Where is the log-likelihood function. As d = 1 belongs to the boundary of the domain of parameters, under the null hypothesis, W does not have an asymptotic distribution as expected. It can be established that the asymptotic distribution of W is a 50:50 mixture of the constant 0 and the. The α upper-tail percentage points for this mixture are the same as the 2α upper-tail percentage points for a ; for instance, for α = 0.01, 0.05, and 0.10 they are 5.41189, 2.70554 and 1.64237.
The "score" or Lagrange multiplier test
The score statistic is,where m is the number of observations.
The asymptotic distribution of the score test statistic under the null hypothesis is a distribution. It may be convenient to use a signed version of the score test, that is,, following asymptotically a standard normal.