The Exponential Distribution

=The Exponential Distribution= The exponential distribution is a commonly used distribution in reliability engineering. Mathematically, it is a fairly simple distribution, which many times leads to its use in inappropriate situations. It is, in fact, a special case of the Weibull distribution where $$\beta =1$$. The exponential distribution is used to model the behavior of units that have a constant failure rate (or units that do not degrade with time or wear out).

Rank Regression on Y
Performing a rank regression on Y requires that a straight line be fitted to the set of available data points such that the sum of the squares of the vertical deviations from the points to the line is minimized. The least squares parameter estimation method (regression analysis) was discussed in Chapter 3, and the following equations for rank regression on Y (RRY) were derived:


 * $$\hat{a}=\bar{y}-\hat{b}\bar{x}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}-\hat{b}\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}}{N}$$


 * and:


 * $$\hat{b}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}{{y}_{i}}-\tfrac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}}{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,x_{i}^{2}-\tfrac{N}}$$

In our case, the equations for $${{y}_{i}}$$ and $${{x}_{i}}$$ are:


 * $${{y}_{i}}=\ln [1-F({{T}_{i}})]$$


 * and:


 * $${{x}_{i}}={{T}_{i}}$$

and the $$F({{T}_{i}})$$ is estimated from the median ranks. Once $$\hat{a}$$ and $$\hat{b}$$ are obtained, then $$\hat{\lambda }$$ and $$\hat{\gamma }$$ can easily be obtained from Eqns. (ae) and (be). For the one-parameter exponential, Eqns. (aae) and (bbe) become:


 * $$\begin{align}

\hat{a}= & 0, \\ \hat{b}= & \frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}{{y}_{i}}}{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,x_{i}^{2}} \end{align}$$

The Correlation Coefficient
The estimator of $$\rho $$ is the sample correlation coefficient, $$\hat{\rho }$$, given by:


 * $$\hat{\rho }=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,({{x}_{i}}-\overline{x})({{y}_{i}}-\overline{y})}{\sqrt{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{({{x}_{i}}-\overline{x})}^{2}}\cdot \underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{({{y}_{i}}-\overline{y})}^{2}}}}$$

Example 2
Fourteen units were being reliability tested and the following life test data were obtained (Table 7.1):

Assuming that the data follow a two-parameter exponential distribution, estimate the parameters and determine the correlation coefficient, $$\rho $$, using rank regression on Y.

Solution to Example 2
Construct Table 7.2, as shown next.

$$\overset – {\mathop{\text{Table 7}\text{.2 - Least Squares Analysis}}}\,$$

$$\begin{matrix} N & T_{i} & F(T_{i}) & y_{i} & T_{i}^{2} & y_{i}^{2} & T_{i} y_{i} \\ \text{1} & \text{5} & \text{0}\text{.0483} & \text{-0}\text{.0495} & \text{25} & \text{0}\text{.0025} & \text{-0}\text{.2475} \\ \text{2} & \text{10} & \text{0}\text{.1170} & \text{-0}\text{.1244} & \text{100} & \text{0}\text{.0155} & \text{-1}\text{.2443} \\ \text{3} & \text{15} & \text{0}\text{.1865} & \text{-0}\text{.2064} & \text{225} & \text{0}\text{.0426} & \text{-3}\text{.0961} \\ \text{4} & \text{20} & \text{0}\text{.2561} & \text{-0}\text{.2958} & \text{400} & \text{0}\text{.0875} & \text{-5}\text{.9170} \\ \text{5} & \text{25} & \text{0}\text{.3258} & \text{-0}\text{.3942} & \text{625} & \text{0}\text{.1554} & \text{-9}\text{.8557} \\ \text{6} & \text{30} & \text{0}\text{.3954} & \text{-0}\text{.5032} & \text{900} & \text{0}\text{.2532} & \text{-15}\text{.0956} \\ \text{7} & \text{35} & \text{0}\text{.4651} & \text{-0}\text{.6257} & \text{1225} & \text{0}\text{.3915} & \text{-21}\text{.8986} \\ \text{8} & \text{40} & \text{0}\text{.5349} & \text{-0}\text{.7655} & \text{1600} & \text{0}\text{.5860} & \text{-30}\text{.6201} \\ \text{9} & \text{50} & \text{0}\text{.6046} & \text{-0}\text{.9279} & \text{2500} & \text{0}\text{.8609} & \text{-46}\text{.3929} \\ \text{10} & \text{60} & \text{0}\text{.6742} & \text{-1}\text{.1215} & \text{3600} & \text{1}\text{.2577} & \text{-67}\text{.2883} \\ \text{11} & \text{70} & \text{0}\text{.7439} & \text{-1}\text{.3622} & \text{4900} & \text{1}\text{.8456} & \text{-95}\text{.3531} \\ \text{12} & \text{80} & \text{0}\text{.8135} & \text{-1}\text{.6793} & \text{6400} & \text{2}\text{.8201} & \text{-134}\text{.3459} \\ \text{13} & \text{90} & \text{0}\text{.8830} & \text{-2}\text{.1456} & \text{8100} & \text{4}\text{.6035} & \text{-193}\text{.1023} \\ \text{14} & \text{100} & \text{0}\text{.9517} & \text{-3}\text{.0303} & \text{10000} & \text{9}\text{.1829} & \text{-303}\text{.0324} \\ \sum_{}^{} & \text{630} & {} & \text{-13}\text{.2315} & \text{40600} & \text{22}\text{.1148} & \text{-927}\text{.4899} \\ \end{matrix}$$

The median rank values ( $$F({{T}_{i}})$$ ) can be found in rank tables or they can be estimated using the Quick Statistical Reference in Weibull++. Given the values in the table above, calculate $$\hat{a}$$ and $$\hat{b}$$ using Eqns. (aae) and (bbe):


 * $$\begin{align}

\hat{b}= & \frac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}}{{y}_{i}}-(\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}})(\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{y}_{i}})/14}{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,T_{i}^{2}-{{(\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}})}^{2}}/14} \\ \\  \hat{b}= & \frac{-927.4899-(630)(-13.2315)/14}{40,600-{{(630)}^{2}}/14} \end{align}$$


 * or:


 * $$\hat{b}=-0.02711$$


 * and:


 * $$\hat{a}=\overline{y}-\hat{b}\overline{T}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}-\hat{b}\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{T}_{i}}}{N}$$


 * or:


 * $$\hat{a}=\frac{-13.2315}{14}-(-0.02711)\frac{630}{14}=0.2748$$

Therefore, from Eqn. (be):


 * $$\hat{\lambda }=-\hat{b}=-(-0.02711)=0.02711\text{ failures/hour}$$


 * and from Eqn. (ae):


 * $$\hat{\gamma }=\frac{\hat{a}}{\hat{\lambda }}=\frac{0.2748}{0.02711}$$


 * or:


 * $$\hat{\gamma }=10.1365\text{ hours}$$


 * Then:


 * $$f(T)=(0.02711)\cdot {{e}^{-0.02711(T-10.136)}}$$

The correlation coefficient can be estimated using Eqn. (RHOe):


 * $$\hat{\rho }=-0.9679$$

This example can be repeated using Weibull++, choosing two-parameter exponential and rank regression on Y (RRY), as shown in the figure on the following page.

The estimated parameters and the correlation coefficient using Weibull++ were found to be:


 * $$\hat{\lambda }=0.0271\text{ fr/hr },\hat{\gamma }=10.1348\text{ hr },\hat{\rho }=-0.9679$$



The probability plot can be obtained simply by clicking the Plot icon.



Rank Regression on X
Similar to rank regression on Y, performing a rank regression on X requires that a straight line be fitted to a set of data points such that the sum of the squares of the horizontal deviations from the points to the line is minimized.

Again the first task is to bring our exponential $$cdf$$ function, Eqn. (Fe), into a linear form. This step is exactly the same as in regression on Y analysis and Eqns. (loge), (ye), (ae), and (be) again apply in this case. The deviation from the previous analysis begins on the least squares fit step, since in this case we treat $$x$$ as the dependent variable and $$y$$ as the independent variable. The best-fitting straight line to the data, for regression on X (see Chapter 3), is the straight line:


 * $$x=\hat{a}+\hat{b}y$$

The corresponding equations for $$\hat{a}$$ and $$\hat{b}$$ are:


 * $$\hat{a}=\overline{x}-\hat{b}\overline{y}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}}{N}-\hat{b}\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}$$


 * and:


 * $$\hat{b}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}{{y}_{i}}-\tfrac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}}{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,y_{i}^{2}-\tfrac{N}}$$


 * where:


 * $${{y}_{i}}=\ln [1-F({{T}_{i}})]$$


 * and:


 * $${{x}_{i}}={{T}_{i}}$$

The values of $$F({{T}_{i}})$$ are estimated from the median ranks. Once $$\hat{a}$$ and $$\hat{b}$$ are obtained, solve Eqn. (xline) for the unknown $$y$$ value, which corresponds to:


 * $$y=-\frac{\hat{a}}{\hat{b}}+\frac{1}{\hat{b}}x$$

Solving for the parameters from Eqns. (ae) and (be) we get:


 * $$a=-\frac{\hat{a}}{\hat{b}}=\lambda \gamma \Rightarrow \gamma =\hat{a}$$


 * and:


 * $$b=\frac{1}{\hat{b}}=-\lambda \Rightarrow \lambda =-\frac{1}{\hat{b}}$$

For the one-parameter exponential case, Eqns. (aaexz) and (bbexz) become,


 * $$\begin{align}

\hat{a}= & 0 \\ \hat{b}= & \frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{x}_{i}}{{y}_{i}}}{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,y_{i}^{2}} \end{align}$$

The correlation coefficient is evaluated as before using Eqn. (RHOe).

Example 3
Using the data of Example 2 and assuming a two-parameter exponential distribution, estimate the parameters and determine the correlation coefficient estimate, $$\hat{\rho }$$, using rank regression on X.

Solution to Example 3
Table 7.2 constructed in Example 2 applies to this example also. Using the values from this table, we get:


 * $$\begin{align}

\hat{b}= & \frac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}}{{y}_{i}}-\tfrac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}}\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{y}_{i}}}{14}}{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,y_{i}^{2}-\tfrac{14}} \\ \\  \hat{b}= & \frac{-927.4899-(630)(-13.2315)/14}{22.1148-{{(-13.2315)}^{2}}/14} \end{align}$$


 * or:


 * $$\hat{b}=-34.5563$$


 * and:


 * $$\hat{a}=\overline{x}-\hat{b}\overline{y}=\frac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{T}_{i}}}{14}-\hat{b}\frac{\underset{i=1}{\overset{14}{\mathop{\sum }}}\,{{y}_{i}}}{14}$$


 * or:


 * $$\hat{a}=\frac{630}{14}-(-34.5563)\frac{(-13.2315)}{14}=12.3406$$


 * Therefore, from Eqn. (bex):


 * $$\hat{\lambda }=-\frac{1}{\hat{b}}=-\frac{1}{(-34.5563)}=0.0289\text{ failures/hour}$$


 * and from Eqn. (aex):


 * $$\hat{\gamma }=\hat{a}=12.3406$$


 * The correlation coefficient is found using Eqn. (RHOe):


 * $$\hat{\rho }=-0.9679$$

Note that the equation for regression on Y is not necessarily the same as that for the regression on X. The only time when the two regression methods yield identical results is when the data lie perfectly on a line. If this were the case, the correlation coefficient would be $$-1$$. The negative value of the correlation coefficient is due to the fact that the slope of the exponential probability plot is negative.

This example can be repeated using Weibull++, choosing two-parameter exponential and rank regression on X (RRX) methods for analysis, as shown below. The estimated parameters and the correlation coefficient using Weibull++ were found to be:


 * $$\begin{array}{*{35}{l}}

\hat{\lambda }= &0.0289 \text{failures/hour} \\ \hat{\gamma}= & 12.3395 \text{hours} \\ \hat{\rho} = &-0.9679 \\ \end{array}$$



The probability plot can be obtained simply by clicking the Plot icon.



Maximum Likelihood Estimation
As outlined in Chapter 3, maximum likelihood estimation works by developing a likelihood function based on the available data and finding the values of the parameter estimates that maximize the likelihood function. This can be achieved by using iterative methods to determine the parameter estimate values that maximize the likelihood function. This can be rather difficult and time-consuming, particularly when dealing with the three-parameter distribution. Another method of finding the parameter estimates involves taking the partial derivatives of the likelihood equation with respect to the parameters, setting the resulting equations equal to zero, and solving simultaneously to determine the values of the parameter estimates. The log-likelihood functions and associated partial derivatives used to determine maximum likelihood estimates for the exponential distribution are covered in Appendix C.

Example 4
Using the data of Example 2 and assuming a two-parameter exponential distribution, estimate the parameters using the MLE method.

Solution to Example 4
In this example we have complete data only. The partial derivative of the log-likelihood function, $$\Lambda ,$$ is given by:


 * $$\frac{\partial \Lambda }{\partial \lambda }=\underset{i=1}{\overset{\mathop \sum }}\,\left[ \frac{1}{\lambda }-\left( {{T}_{i}}-\gamma \right) \right]=\underset{i=1}{\overset{14}{\mathop \sum }}\,\left[ \frac{1}{\lambda }-\left( {{T}_{i}}-\gamma  \right) \right]=0$$

Complete descriptions of the partial derivatives can be found in Appendix C. Recall that when using the MLE method for the exponential distribution, the value of $$\gamma $$ is equal to that of the first failure time. The first failure occurred at 5 hours, thus $$\gamma =5$$ hours$$.$$ Substituting the values for $$T$$ and $$\gamma $$ we get:


 * $$\frac{14}{\hat{\lambda }}=560$$


 * or:


 * $$\hat{\lambda }=0.025\text{ failures/hour}.$$


 * Using Weibull++:




 * The probability plot is:



Confidence Bounds
In this section, we present the methods used in the application to estimate the different types of confidence bounds for exponentially distributed data. The complete derivations were presented in detail (for a general function) in Chapter 5. At this time we should point out that exact confidence bounds for the exponential distribution have been derived, and exist in a closed form, utilizing the $${{\chi }^{2}}$$ distribution. These are described in detail in Kececioglu [20], and are covered in the section on test design in Chapter 11. For most exponential data analyses, Weibull++ will use the approximate confidence bounds, provided from the Fisher information matrix or the likelihood ratio, in order to stay consistent with all of the other available distributions in the application. The $${{\chi }^{2}}$$ confidence bounds for the exponential distribution are discussed in more detail in Chapter 11.

Bounds on the Parameters
For the failure rate $$\hat{\lambda }$$ the upper ($${{\lambda }_{U}}$$) and lower ($${{\lambda }_{L}}$$) bounds are estimated by [30]:


 * $$\begin{align}

& {{\lambda }_{U}}= & \hat{\lambda }\cdot {{e}^{\left[ \tfrac{{{K}_{\alpha }}\sqrt{Var(\hat{\lambda })}}{\hat{\lambda }} \right]}} \\ & &  \\  & {{\lambda }_{L}}= & \frac{\hat{\lambda }} \end{align}$$

where $${{K}_{\alpha }}$$ is defined by:


 * $$\alpha =\frac{1}{\sqrt{2\pi }}\int_^{\infty }{{e}^{-\tfrac{2}}}dt=1-\Phi ({{K}_{\alpha }})$$

If $$\delta $$ is the confidence level, then $$\alpha =\tfrac{1-\delta }{2}$$ for the two-sided bounds, and $$\alpha =1-\delta $$ for the one-sided bounds. The variance of $$\hat{\lambda },$$ $$Var(\hat{\lambda }),$$ is estimated from the Fisher matrix, as follows:


 * $$Var(\hat{\lambda })={{\left( -\frac{{{\partial }^{2}}\Lambda }{\partial {{\lambda }^{2}}} \right)}^{-1}}$$

where $$\Lambda $$ is the log-likelihood function of the exponential distribution, described in Appendix C.

Note that no true MLE solution exists for the case of the two-parameter exponential distribution. The mathematics simply break down while trying to simultaneously solve the partial derivative equations for both the $$\gamma $$ and $$\lambda $$ parameters, resulting in unrealistic conditions. The way around this conundrum involves setting $$\gamma ={{T}_{1}},$$ or the first time-to-failure, and calculating $$\lambda $$ in the regular fashion for this methodology. Weibull++ treats $$\gamma $$ as a constant when computing bounds, i.e. $$Var(\hat{\gamma })=0.$$ (See the discussion in Appendix C for more information.)

Bounds on Reliability
The reliability of the two-parameter exponential distribution is:


 * $$\hat{R}(T;\hat{\lambda })={{e}^{-\hat{\lambda }(T-\hat{\gamma })}}$$

The corresponding confidence bounds are estimated from:


 * $$\begin{align}

& {{R}_{L}}= & {{e}^{-{{\lambda }_{U}}(T-\hat{\gamma })}} \\ & {{R}_{U}}= & {{e}^{-{{\lambda }_{L}}(T-\hat{\gamma })}} \end{align}$$

These equations hold true for the one-parameter exponential distribution, with $$\gamma =0$$.

Bounds on Time
The bounds around time for a given exponential percentile, or reliability value, are estimated by first solving the reliability equation with respect to time, or reliable life:


 * $$\hat{T}=-\frac{1}\cdot \ln (R)+\hat{\gamma }$$

The corresponding confidence bounds are estimated from:


 * $$\begin{align}

& {{T}_{U}}= & -\frac{1}\cdot \ln (R)+\hat{\gamma } \\ & {{T}_{L}}= & -\frac{1}\cdot \ln (R)+\hat{\gamma } \end{align}$$

The same equations apply for the one-parameter exponential with $$\gamma =0.$$

Bounds on Parameters
For one-parameter distributions such as the exponential, the likelihood confidence bounds are calculated by finding values for $$\theta $$ that satisfy:


 * $$-2\cdot \text{ln}\left( \frac{L(\theta )}{L(\hat{\theta })} \right)=\chi _{\alpha ;1}^{2}$$

This equation can be rewritten as:


 * $$L(\theta )=L(\hat{\theta })\cdot {{e}^{\tfrac{-\chi _{\alpha ;1}^{2}}{2}}}$$

For complete data, the likelihood function for the exponential distribution is given by:


 * $$L(\lambda )=\underset{i=1}{\overset{N}{\mathop \prod }}\,f({{x}_{i}};\lambda )=\underset{i=1}{\overset{N}{\mathop \prod }}\,\lambda \cdot {{e}^{-\lambda \cdot {{x}_{i}}}}$$

where the $${{x}_{i}}$$ values represent the original time-to-failure data. For a given value of $$\alpha $$, values for $$\lambda $$ can be found which represent the maximum and minimum values that satisfy Eqn. (lratio3). These represent the confidence bounds for the parameters at a confidence level $$\delta ,$$ where $$\alpha =\delta $$ for two-sided bounds and $$\alpha =2\delta -1$$ for one-sided.

Example 5
Five units are put on a reliability test and experience failures at 20, 40, 60, 100, and 150 hours. Assuming an exponential distribution, the MLE parameter estimate is calculated to be $$\hat{\lambda }=0.013514.$$  Calculate the 85% two-sided confidence bounds on these parameters using the likelihood ratio method.

Solution to Example 5
The first step is to calculate the likelihood function for the parameter estimates:


 * $$\begin{align}

L(\hat{\lambda })= & \underset{i=1}{\overset{N}{\mathop \prod }}\,f({{x}_{i}};\hat{\lambda })=\underset{i=1}{\overset{N}{\mathop \prod }}\,\hat{\lambda }\cdot {{e}^{-\hat{\lambda }\cdot {{x}_{i}}}} \\ L(\hat{\lambda })= & \underset{i=1}{\overset{5}{\mathop \prod }}\,0.013514\cdot {{e}^{-0.013514\cdot {{x}_{i}}}} \\ L(\hat{\lambda })= & 3.03647\times {{10}^{-12}} \end{align}$$

where $${{x}_{i}}$$ are the original time-to-failure data points. We can now rearrange Eqn. (lratio3) to the form:


 * $$L(\lambda )-L(\hat{\lambda })\cdot {{e}^{\tfrac{-\chi _{\alpha ;1}^{2}}{2}}}=0$$

Since our specified confidence level, $$\delta $$, is 85%, we can calculate the value of the chi-squared statistic, $$\chi _{0.85;1}^{2}=2.072251.$$ We can now substitute this information into the equation:


 * $$\begin{align}

L(\lambda )-L(\hat{\lambda })\cdot {{e}^{\tfrac{-\chi _{\alpha ;1}^{2}}{2}}}= & 0, \\ L(\lambda )-3.03647\times {{10}^{-12}}\cdot {{e}^{\tfrac{-2.072251}{2}}}= & 0, \\ L(\lambda )-1.07742\times {{10}^{-12}}= & 0. \end{align}$$

It now remains to find the values of $$\lambda $$ which satisfy this equation. Since there is only one parameter, there are only two values of $$\lambda $$ that will satisfy the equation. These values represent the $$\delta =85%$$ two-sided confidence limits of the parameter estimate $$\hat{\lambda }$$. For our problem, the confidence limits are:


 * $${{\lambda }_{0.85}}=(0.006572,0.024172)$$

Bounds on Time and Reliability
In order to calculate the bounds on a time estimate for a given reliability, or on a reliability estimate for a given time, the likelihood function needs to be rewritten in terms of one parameter and time/reliability, so that the maximum and minimum values of the time can be observed as the parameter is varied. This can be accomplished by substituting a form of the exponential reliability equation into the likelihood function. The exponential reliability equation can be written as:


 * $$R={{e}^{-\lambda \cdot t}}$$

This can be rearranged to the form:


 * $$\lambda =\frac{-\text{ln}(R)}{t}$$

This equation can now be substituted into Eqn. (explikelihood) to produce a likelihood equation in terms of $$t$$ and $$R\ \ :$$


 * $$L(t/R)=\underset{i=1}{\overset{N}{\mathop \prod }}\,\left( \frac{-\text{ln}(R)}{t} \right)\cdot {{e}^{\left( \tfrac{\text{ln}(R)}{t} \right)\cdot {{x}_{i}}}}$$

The unknown parameter $$t/R$$ depends on what type of bounds are being determined. If one is trying to determine the bounds on time for a given reliability, then $$R$$ is a known constant and $$t$$ is the unknown parameter. Conversely, if one is trying to determine the bounds on reliability for a given time, then $$t$$ is a known constant and $$R$$ is the unknown parameter. Either way, Eqn. (expliketr) can be used to solve Eqn. (lratio3) for the values of interest.

Example 6
For the data given in Example 5, determine the 85% two-sided confidence bounds on the time estimate for a reliability of 90%. The ML estimate for the time at $$R(t)=90%$$ is $$\hat{t}=7.797$$.

Solution to Example 6
In this example, we are trying to determine the 85% two-sided confidence bounds on the time estimate of 7.797. This is accomplished by substituting $$R=0.90$$ and $$\alpha =0.85$$ into Eqn. (expliketr). It now remains to find the values of $$t$$ which satisfy this equation. Since there is only one parameter, there are only two values of $$t$$ that will satisfy the equation. These values represent the $$\delta =85%$$ two-sided confidence limits of the time estimate $$\hat{t}$$. For our problem, the confidence limits are:


 * $${{\hat{t}}_{R=0.9}}=(4.359,16.033).$$

Example 7
For the data given in Example 5, determine the 85% two-sided confidence bounds on the reliability estimate for a $$t=50$$. The ML estimate for the time at $$t=50$$ is $$\hat{R}=50.881%$$.

Solution to Example 7
In this example, we are trying to determine the 85% two-sided confidence bounds on the reliability estimate of 50.881%. This is accomplished by substituting $$t=50$$ and $$\alpha =0.85$$ into Eqn. (expliketr). It now remains to find the values of $$R$$ which satisfy this equation. Since there is only one parameter, there are only two values of $$t$$ that will satisfy the equation. These values represent the $$\delta =85%$$ two-sided confidence limits of the reliability estimate $$\hat{R}$$. For our problem, the confidence limits are:


 * $${{\hat{R}}_{t=50}}=(29.861%,71.794%)$$

Bounds on Parameters
From Chapter 5, we know that the posterior distribution of $$\lambda $$ can be written as:


 * $$f(\lambda |Data)=\frac{L(Data|\lambda )\varphi (\lambda )}{\int_{0}^{\infty }L(Data|\lambda )\varphi (\lambda )d\lambda }$$

where $$\varphi (\lambda )=\tfrac{1}{\lambda }$$, is the non-informative prior of $$\lambda $$.

With the above prior distribution, $$f(\lambda |Data)$$ can be rewritten as:


 * $$f(\lambda |Data)=\frac{L(Data|\lambda )\tfrac{1}{\lambda }}{\int_{0}^{\infty }L(Data|\lambda )\tfrac{1}{\lambda }d\lambda }$$

The one-sided upper bound of $$\lambda $$ is:


 * $$CL=P(\lambda \le {{\lambda }_{U}})=\int_{0}^f(\lambda |Data)d\lambda $$

The one-sided lower bound of $$\lambda $$ is:


 * $$1-CL=P(\lambda \le {{\lambda }_{L}})=\int_{0}^f(\lambda |Data)d\lambda $$

The two-sided bounds of $$\lambda $$ are:


 * $$CL=P({{\lambda }_{L}}\le \lambda \le {{\lambda }_{U}})=\int_^f(\lambda |Data)d\lambda $$

Bounds on Time (Type 1)
The reliable life equation is:


 * $$T=\frac{-\ln R}{\lambda }$$

For the one-sided upper bound on time we have:


 * $$CL=\underset{}{\overset{}{\mathop{\Pr }}}\,(T\le {{T}_{U}})=\underset{}{\overset{}{\mathop{\Pr }}}\,(\frac{-\ln R}{\lambda }\le {{T}_{U}})$$

Eqn. (1SBT) can be rewritten in terms of $$\lambda $$ as:


 * $$CL=\underset{}{\overset{}{\mathop{\Pr }}}\,(\frac{-\ln R}\le \lambda )$$

From Eqn (postL), we have:


 * $$CL=\frac{\int_{\tfrac{-\ln R}}^{\infty }L(Data|\lambda )\tfrac{1}{\lambda }d\lambda }{\int_{0}^{\infty }L(Data|\lambda )\tfrac{1}{\lambda }d\lambda }$$

Eqn. (1CBT) is solved w.r.t. $${{T}_{U}}.$$ The same method is applied for one-sided lower and two-sided bounds on time.

Bounds on Reliability (Type 2)
The one-sided upper bound on reliability is given by:


 * $$CL=\underset{}{\overset{}{\mathop{\Pr }}}\,(R\le {{R}_{U}})=\underset{}{\overset{}{\mathop{\Pr }}}\,(\exp (-\lambda T)\le {{R}_{U}})$$

Eqn. (1SBR) can be rewritten in terms of $$\lambda $$ as:


 * $$CL=\underset{}{\overset{}{\mathop{\Pr }}}\,(\frac{-\ln {{R}_{U}}}{T}\le \lambda )$$

From Eqn (postL), we have:


 * $$CL=\frac{\int_{\tfrac{-\ln {{R}_{U}}}{T}}^{\infty }L(Data|\lambda )\tfrac{1}{\lambda }d\lambda }{\int_{0}^{\infty }L(Data|\lambda )\tfrac{1}{\lambda }d\lambda }$$

Eqn. (1CBR) is solved w.r.t. $${{R}_{U}}.$$ The same method can be used to calculate one-sided lower and two sided bounds on reliability.

Example 8
Twenty units were reliability tested with the following results:

8-1. Assuming a two-parameter exponential distribution, estimate the parameters analytically using the MLE method.

8-2. Repeat part 8-1 using Weibull++ (enter the data as grouped data to duplicate the results of 8-1).

8-3. Plot the exponential probability vs. time-to-failure using Weibull++.

8-4. Plot $$R(t)$$ vs. time using Weibull++.

8-5. Plot the $$pdf$$ using Weibull++.

8-6. Plot the failure rate vs. time using Weibull++.

8-7. Estimate the parameters analytically using the RRY method (using grouped ranks).

Solution To Example 8
8-1. For the two-parameter exponential distribution and for $$\hat{\gamma }=100$$ hours (first failure), the partial of the log-likelihood function, $$\Lambda $$, becomes:


 * $$ \begin{align}

\frac{\partial \Lambda }{\partial \lambda }= &\underset{i=1}{\overset{6}{\mathop \sum }}\,{N_i} \left[ \frac{1}{\lambda }-\left( {{T}_{i}}-100 \right) \right]=0\\

\Rightarrow & 7[\frac{1}{\lambda }-(100-100)]+5[\frac{1}{\lambda}-(200-100)] + \ldots +2[\frac{1}{\lambda}-(600-100)]\\ = & 0\\ \Rightarrow & \hat{\lambda}=\frac{20}{3100}=0.0065 \text{fr/hr}

\end{align} $$

8-2. The data as entered in Weibull++ along with results are shown next.





Select Reliability vs. Time.



The exponential $$pdf$$ plot is shown next.



The exponential failure rate plot is shown next.



Note that, as described at the beginning of this chapter, the failure rate for the exponential distribution is constant. Also note that the failure rate plot does not exist for times before the location parameter, $$\gamma $$, at 100 hours.

8-7. In the case of grouped data, one must be cautious when estimating the parameters using a rank regression method. That is because the median rank values are determined from the total number of failures observed by time $${{T}_{i}}$$ where $$i$$ indicates the group number. In this example the total number of groups is $$N=6$$ and the total number of units is $${{N}_{T}}=20$$. Thus, the median rank values will be estimated for twenty units and for the total failed units ($${{N}_}$$) up to the $${{i}^{th}}$$ group, for the $${{i}^{th}}$$ rank value. The median ranks values can be found from rank tables or they can be estimated using ReliaSoft's Quick Statistical Reference.

For example, the median rank value of the fourth group will be the $${{17}^{th}}$$ rank out of a sample size of twenty units (or 81.945%).

The following table is then constructed (as in Example 2).

$$\begin{matrix} N & {{N}_{F}} & {{N}_} & {{T}_{i}} & F({{T}_{i}}) & {{y}_{i}} & T_{i}^{2} & y_{i}^{2} & {{T}_{i}}{{y}_{i}} \\ \text{1} & \text{7} & \text{7} & \text{100} & \text{0}\text{.32795} & \text{-0}\text{.3974} & \text{10000} & \text{0}\text{.1579} & \text{-39}\text{.7426} \\ \text{2} & \text{5} & \text{12} & \text{200} & \text{0}\text{.57374} & \text{-0}\text{.8527} & \text{40000} & \text{0}\text{.7271} & \text{-170}\text{.5402} \\ \text{3} & \text{3} & \text{15} & \text{300} & \text{0}\text{.72120} & \text{-1}\text{.2772} & \text{90000} & \text{1}\text{.6313} & \text{-383}\text{.1728} \\ \text{4} & \text{2} & \text{17} & \text{400} & \text{0}\text{.81945} & \text{-1}\text{.7117} & \text{160000} & \text{2}\text{.9301} & \text{-684}\text{.6990} \\ \text{5} & \text{1} & \text{18} & \text{500} & \text{0}\text{.86853} & \text{-2}\text{.0289} & \text{250000} & \text{4}\text{.1166} & \text{-1014}\text{.4731} \\ \text{6} & \text{2} & \text{20} & \text{600} & \text{0}\text{.96594} & \text{-3}\text{.3795} & \text{360000} & \text{11}\text{.4211} & \text{-2027}\text{.7085} \\ \sum_{}^{} & {} & {} & \text{2100} & {} & \text{-9}\text{.6476} & \text{910000} & \text{20}\text{.9842} & \text{-4320}\text{.3362} \\ \end{matrix}$$

Given the values in the table above, calculate $$\hat{a}$$ and $$\hat{b}$$ using Eqns. (aae) and (bbe):


 * $$\begin{align}

& \hat{b}= & \frac{\underset{i=1}{\overset{6}{\mathop{\sum }}}\,{{T}_{i}}{{y}_{i}}-(\underset{i=1}{\overset{6}{\mathop{\sum }}}\,{{T}_{i}})(\underset{i=1}{\overset{6}{\mathop{\sum }}}\,{{y}_{i}})/6}{\underset{i=1}{\overset{6}{\mathop{\sum }}}\,T_{i}^{2}-{{(\underset{i=1}{\overset{6}{\mathop{\sum }}}\,{{T}_{i}})}^{2}}/6} \\ & &  \\  & \hat{b}= & \frac{-4320.3362-(2100)(-9.6476)/6}{910,000-{{(2100)}^{2}}/6} \end{align}$$


 * or:


 * $$\hat{b}=-0.005392$$


 * and:


 * $$\hat{a}=\overline{y}-\hat{b}\overline{T}=\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{y}_{i}}}{N}-\hat{b}\frac{\underset{i=1}{\overset{N}{\mathop{\sum }}}\,{{T}_{i}}}{N}$$


 * or:


 * $$\hat{a}=\frac{-9.6476}{6}-(-0.005392)\frac{2100}{6}=0.2793$$


 * Therefore, from Eqn. (be):


 * $$\hat{\lambda }=-\hat{b}=-(-0.005392)=0.05392\text{ failures/hour}$$


 * and from Eqn. (ae):


 * $$\hat{\gamma }=\frac{\hat{a}}{\hat{\lambda }}=\frac{0.2793}{0.005392}$$


 * or:


 * $$\hat{\gamma }\simeq 51.8\text{ hours}$$


 * Then:


 * $$f(T)=(0.005392){{e}^{-0.005392(T-51.8)}}$$

Using Weibull++, the estimated parameters are:


 * $$\begin{align}

\hat{\lambda }= & 0.0054\text{ failures/hour} \\ \hat{\gamma }= & 51.82\text{ hours} \end{align}$$

The small difference in the values from Weibull++ is due to rounding. In Weibull++ the calculations and the rank values are carried out up to the $${{15}^{th}}$$ decimal point.

Example 9
A number of leukemia patients were treated with either drug 6 MP or a placebo, and the times in weeks until cancer symptoms returned were recorded. Analyze each treatment separately. [21, p.175]

Solution to Example 9
Enter the data into Weibull++, by selecting Times to Failure, with Right Censored Data (Suspensions) and 'with Grouped Observations. In the first column enter the number of patients. Whenever there are uncompleted tests, enter the number of patients who completed the test separately from the number of patients who did not. In the second column enter F for completed tests and S for uncompleted. In the third column enter the time. In the fourth column (Subset ID) enter the name of the treatment. The title of each column can be changed by double-clicking it and typing the desired name.



Now click the Batch Auto Run icon




 * or:



and click Select All Available> > to separate the 6 MP drug from the placebo as shown next.



Click OK and you will get a new Data Sheet for each treatment with the corresponding results, as shown next.

Make sure both data sheets are calculated, then from the Life Data tab, click on Insert Additional Plot. Click on the Select Data Sheets button.





and check the two data sheets under the Folio1 project.

The plot is shown next,