Template:Weibull-bayesian analysis

Weibull-Bayesian Analysis
In this section, the Bayesian methods are presented for the two-parameter Weibull distribution. Bayesian concepts were introduced in Chapter 3. This model considers prior knowledge on the shape ( β ) parameter of the Weibull distribution when it is chosen to be fitted to a given set of data. There are many practical applications for this model, particularly when dealing with small sample sizes and some prior knowledge for the shape parameter is available. For example, when a test is performed, there is often a good understanding about the behavior of the failure mode under investigation, primarily through historical data. At the same time, most reliability tests are performed on a limited number of samples. Under these conditions, it would be very useful to use this prior knowledge with the goal of making more accurate predictions. A common approach for such scenarios is to use the one-parameter Weibull distribution, but this approach is too deterministic, too absolute you may say (and you would be right). The Weibull-Bayesian model in Weibull++ (which is actually a true "WeiBayes" model, unlike the one-parameter Weibull that is commonly referred to as such) offers an alternative to the one-parameter Weibull, by including the variation and uncertainty that might have been observed in the past on the shape parameter. Applying Bayes's rule on the two-parameter Weibull distribution and assuming the prior distributions of β and η are independent, we obtain the following posterior :


 * $$ f(\beta ,\eta |Data)=\dfrac{L(\beta ,\eta )\varphi (\beta )\varphi (\eta )}{ \int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta } $$ EQNREF WeibBayes

In this model, η is assumed to follow a noninformative prior distribution with the density function $$ \varphi (\eta )=\dfrac{1}{\eta } $$. This is called Jeffrey's prior, and is obtained by performing a logarithmic transformation on η. Specifically, since η is always positive, we can assume that ln( η) follows a uniform distribution, U( − ∞, + ∞). Applying Jeffrey's rule [9] which says "in general, an approximate non-informative prior is taken proportional to the square root of Fisher's information", yields $$ \varphi (\eta )=\dfrac{1}{\eta }. $$

The prior distribution of β, denoted as $$ \varphi (\beta ) $$, can be selected from the following distributions: normal, lognormal, exponential and uniform. The procedure of performing a Weibull-Bayesian analysis is as follows:


 * Collect the times-to-failure data.
 * Specify a prior distribution for β (the prior for η is assumed to be 1/ η).
 * Obtain the posterior from Eqn. (EQNREF WeibBayes ).

In other words, a distribution (the posterior ) is obtained, rather than a point estimate as in classical statistics (i.e., as in the parameter estimation methods described previously in this chapter). Therefore, if a point estimate needs to be reported, a point of the posterior needs to be calculated. Typical points of the posterior distribution used are the mean (expected value) or median. In Weibull++, both options are available and can be chosen from the Analysis page, under the Results As area, as shown next.



The expected value of β is obtained by:
 * $$ E(\beta )=\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }\beta \cdot f(\beta ,\eta |Data)d\beta d\eta $$

Similarly, the expected value of η is obtained by:
 * $$ E(\eta )=\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }\eta \cdot f(\beta ,\eta |Data)d\beta d\eta $$

The median points are obtained by solving the following equations for $$ \breve{\beta} $$ and $$ \breve{\eta} $$ respectively:


 * $$ \int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\breve{\beta}}f(\beta ,\eta |Data)d\beta d\eta =0.5 $$


 * and


 * $$ \int\nolimits_{0}^{\breve{\eta}}\int\nolimits_{0}^{\infty }f(\beta ,\eta |Data)d\beta d\eta =0.5 $$

Of course, other points of the posterior distribution can be calculated as well. For example, one may want to calculate the 10th percentile of the joint posterior distribution (w.r.t. one of the parameters). The procedure for obtaining other points of the posterior distribution is similar to the one for obtaining the median values, where instead of 0.5 the percentage of interest is given. This procedure actually provides the confidence bounds on the parameters, which in the Bayesian framework are called ‘‘Credible Bounds‘‘. However, since the engineering interpretation is the same, and to avoid confusion, we refer to them as confidence bounds in this reference and in Weibull++.

Posterior Distributions for Functions of Parameters
As explained in Chapter 3, in Bayesian analysis, all the functions of the parameters are distributed. In other words, a posterior distribution is obtained for functions such as reliability and failure rate, instead of point estimate as in classical statistics. Therefore, in order to obtain a point estimate for these functions, a point on the posterior distributions needs to be calculated. Again, the expected value (mean) or median value are used.

$$pdf$$ of the Times-to-Failure
The posterior distribution of the failure time is given by:


 * $$ f(T|Data)=\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }f(T,\beta ,\eta )f(\beta ,\eta |Data)d\eta d\beta $$ EQNREF WeibBayesPDF


 * where:


 * $$ f(T,\beta ,\eta )=\dfrac{\beta }{\eta }\left( \dfrac{T}{\eta }\right) ^{\beta -1}e^{-\left( \dfrac{T}{\eta }\right) ^{\beta }} $$

For the $$pdf$$ of the times-to-failure, only the expected value is calculated and reported in Weibull++.

Reliability
In order to calculate the median value of the reliability function, we first need to obtain posterior of the reliability. Since R(T) is a function of β, the density functions of β and R(T) have the following relationship:


 * $$ \begin{align} f(R|Data,T)dR = & f(\beta |Data)d\beta)\\

= & (\int\nolimits_{0}^{\infty }f(\beta ,\eta |Data)d{\eta}) d{\beta} \\ =& \dfrac{\int\nolimits_{0}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta }{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }d\beta \end{align} $$ EQNREF Rpdf

The median value of the reliability is obtained by solving the following equation w.r.t. $$ \breve{R}: $$


 * $$ \int\nolimits_{0}^{\breve{R}}f(R|Data,T)dR=0.5 $$ EQNREF MedRel

The expected value of the reliability at time is given by:


 * $$ R(T|Data)=\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }R(T,\beta ,\eta )f(\beta ,\eta |Data)d\eta d\beta $$ where:


 * $$ R(T,\beta ,\eta )=e^{-\left( \dfrac{T}{\eta }\right) ^{^{\beta }}} $$

Failure Rate
The failure rate at time is given by:


 * $$ \lambda (T|Data)=\dfrac{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }\lambda (T,\beta ,\eta )L(\beta ,\eta )\varphi (\eta )\varphi (\beta )d\eta d\beta }{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }L(\beta ,\eta )\varphi (\eta )\varphi (\beta )d\eta d\beta } $$


 * where:


 * $$ \lambda (T,\beta ,\eta )=\dfrac{\beta }{\eta }\left( \dfrac{T}{\eta }\right) ^{\beta -1} $$

Note on Calculated Results
As mentioned above, in order to obtain point estimates for the parameters of functions of the parameters in Bayesian analysis, the Median or Mean values of the different posterior $$pdf$$s are calculated. It is important to note that the Median value is preferable and is the default in Weibull++. This is because the Median value always corresponds to the 50th percentile of the distribution. On the other hand, the Mean is not a fixed point on the distribution, which could cause issues, especially when comparing results across different data sets.

Confidence Bounds on R(T)
The confidence bounds calculation under the Weibull-Bayesian analysis is very similar to the Bayesian Confidence Bounds method described in the previous section, with the exception that in the case of the Weibull-Bayesian Analysis the specified prior of β is considered instead of an non-informative prior. The Bayesian one-sided upper bound estimate for R(T) is given by:


 * $$ \int\nolimits_{0}^{R_{U}(T)}f(R|Data,T)dR=CL $$

Using Eqns. (EQNREF WeibBayes ) and (EQNREF Rpdf ) the following is obtained:


 * $$ \dfrac{\int\nolimits_{0}^{\infty }\int\nolimits_{T\exp (-\dfrac{\ln (-\ln R_{U})}{\beta })}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }=CL $$ EQNREF 1CLRU

Eqn. (EQNREF 1CLRU ) can be solved for RU(T). The Bayesian one-sided lower bound estimate for $$ \ R(T) $$ is given by:


 * $$ \int\nolimits_{0}^{R_{L}(T)}f(R|Data,T)dR=1-CL $$

Using Eqns. (EQNREF WeibBayes ) and (EQNREF Rpdf ) the following is obtained:


 * $$ \dfrac{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{T\exp (-\dfrac{\ln (-\ln R_{L})}{\beta })}L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }=1-CL $$ EQNREF 1CLRL

Eqn. (EQNREF 1CLRL ) can be solved for RL(T). The Bayesian two-sided bounds estimate for R(T) is given by:


 * $$ \int\nolimits_{R_{L}(T)}^{R_{U}(T)}f(R|Data,T)dR=CL $$ which is equivalent to:


 * $$ \int\nolimits_{0}^{R_{U}(T)}f(R|Data,T)dR=(1+CL)/2 $$


 * and


 * $$ \int\nolimits_{0}^{R_{L}(T)}f(R|Data,T)dR=(1-CL)/2 $$

Using the same method for one-sided bounds, RU(T) and RL(T) can be computed.

Confidence Bounds on Time $$T$$
Following the same procedure described for bounds on Reliability, the bounds of time can be calculated, given. The Bayesian one-sided upper bound estimate for T(R) is given by:


 * $$ \int\nolimits_{0}^{T_{U}(R)}f(T|Data,R)dT=CL $$

Using Eqns. (EQNREF WeibBayes ) and. (EQNREF WeibBayesPDF ), we obtain:


 * $$ \dfrac{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{T_{U}\exp (-\dfrac{\ln (-\ln R)}{\beta })}L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }=CL $$ EQNREF 1CLTU

Eqn. (EQNREF 1CLTU ) can be solved for TU(R). The Bayesian one-sided lower bound estimate for T(R) is given by:


 * $$ \int\nolimits_{0}^{T_{L}(R)}f(T|Data,R)dT=1-CL $$


 * or:


 * $$ \dfrac{\int\nolimits_{0}^{\infty }\int\nolimits_{T_{L}\exp (\dfrac{-\ln (-\ln R)}{\beta })}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }{\int\nolimits_{0}^{\infty }\int\nolimits_{0}^{\infty }L(\beta ,\eta )\varphi (\beta )\varphi (\eta )d\eta d\beta }=CL $$ EQNREF 1CLTL

Eqn. (EQNREF 1CLTL ) can be solved for TL(R). The Bayesian two-sided lower bounds estimate for T(R) is:


 * $$ \int\nolimits_{T_{L}(R)}^{T_{U}(R)}f(T|Data,R)dT=CL $$

which is equivalent to:


 * $$ \int\nolimits_{0}^{T_{U}(R)}f(T|Data,R)dT=(1+CL)/2 $$


 * and:


 * $$ \int\nolimits_{0}^{T_{L}(R)}f(T|Data,R)dT=(1-CL)/2 $$