Parametric Recurrent Events Data Analysis
Parametric Recurrence Data Analysis
Weibull++'s Parametric RDA Specialized Folio is a tool to model recurrent event data. It can capture the trend, estimate the rate and predict the total number of recurrences. The failure and repair data of a repairable system can be treated as one type of recurrence data. Past and current repairs may affect the future failure process. For most recurrence events, time (distance, cycles, etc.) is a key factor. With the time, the recurrence rate may keep constant, increase or decrease. For other recurrence events, not only the time, but also the number of events can affect the recurrence process, e.g. the debugging process in software development. The parametric analysis approach utilizes the General Renewal Process (GRP) model [28]. In this model, the repair time is assumed to be negligible so that the processes can be viewed as point processes. This model provides a way to describe the rate of occurrence of events over time such as in the case of data obtained from a repairable system. This model is particularly useful in modeling the failure behavior of a specific system and understanding the effects of the repairs on the age of that system. For example, consider a system that is repaired after a failure, where the repair does not bring the system to an as-good-as-new or an as-bad-as-old condition. In other words, the system is partially rejuvenated after the repair. Traditionally in as-bad-as-old repairs, also known as minimal repairs, the failure data from such a system would have been modeled using a homogeneous or non-homogeneous Poisson process (NHPP). On rare occasions, a Weibull distribution has been used as well, in cases where the system is almost as-good-as-new after the repair, also known as perfect renewal process (PRP). However, for the intermediate states after the repair, there has not been a commercially available model, even though many models have been proposed in literature. In Weibull++, the GRP model provides the capability of modeling such systems with partial renewal (general repair or imperfect repair/maintenance) and allows for a variety of predictions such as reliability, expected failures, etc.
The GRP Model
In this model, the concept of virtual age is introduced. Denote by [math]\displaystyle{ {{t}_{1}},{{t}_{2}},\cdots ,{{t}_{n}} }[/math] the successive failure times and let [math]\displaystyle{ {{x}_{1}},{{x}_{2}},\cdots ,{{x}_{n}} }[/math] represent the time between failures ( [math]\displaystyle{ {{t}_{i}}=\sum_{j=1}^{i}{{x}_{j}}) }[/math] . Assume that after each event, actions are taken to improve the system performance. Let [math]\displaystyle{ q }[/math] be the action effectiveness factor. There are two GRP models.
Type I:
- [math]\displaystyle{ {{v}_{i}}={{v}_{i-1}}+q{{x}_{i}}=q{{t}_{i}} }[/math]
Type II:
- [math]\displaystyle{ {{v}_{i}}=q({{v}_{i-1}}+{{x}_{i}})={{q}^{i}}{{x}_{1}}+{{q}^{i-1}}{{x}_{2}}+\cdots +{{x}_{i}} }[/math]
where [math]\displaystyle{ {{v}_{i}} }[/math] is the virtual age of the system right after [math]\displaystyle{ i }[/math] th repair. The Type I model assumes that the [math]\displaystyle{ i }[/math] th repair cannot remove the damage incurred before the ith failure. It can only reduce the additional age [math]\displaystyle{ {{x}_{i}} }[/math] to [math]\displaystyle{ q{{x}_{i}} }[/math] . The Type II model assumes that at the [math]\displaystyle{ i }[/math] th repair, the virtual age has been accumulated to [math]\displaystyle{ {{v}_{i-1}}+{{x}_{i}} }[/math] . The [math]\displaystyle{ i }[/math] th repair will remove the cumulative damage from both current and previous failures by reducing the virtual age to [math]\displaystyle{ q({{v}_{i-1}}+{{x}_{i}}) }[/math] .
The power law function is used to model the rate of recurrence, which is:
- [math]\displaystyle{ \lambda (t)=\lambda \beta {{t}^{\beta -1}} }[/math]
The conditional [math]\displaystyle{ pdf }[/math] is:
- [math]\displaystyle{ f({{t}_{i}}|{{t}_{i-1}})=\lambda \beta {{({{x}_{i}}+{{v}_{i-1}})}^{\beta -1}}{{e}^{-\lambda \left[ {{\left( {{x}_{i}}+{{v}_{i-1}} \right)}^{\beta }}-v_{i-1}^{\beta } \right]}} }[/math]
MLE method is used to estimate model parameters. The log likelihood function is [28]:
- [math]\displaystyle{ \begin{align} & \ln (L)= & n(\ln \lambda +\ln \beta )-\lambda \left[ {{\left( T-{{t}_{n}}+{{v}_{n}} \right)}^{\beta }}-v_{n}^{\beta } \right] \\ & & -\lambda \underset{i=1}{\overset{n}{\mathop \sum }}\,\left[ {{\left( {{x}_{i}}+{{v}_{i-1}} \right)}^{\beta }}-v_{i}^{\beta } \right]+(\beta -1)\underset{i=1}{\overset{n}{\mathop \sum }}\,\ln ({{x}_{i}}+{{v}_{i-1}}) \end{align} }[/math]
where [math]\displaystyle{ n }[/math] is the total number of events during the entire observation period. [math]\displaystyle{ T }[/math] is the stop time of the observation. [math]\displaystyle{ T={{t}_{n}} }[/math] if the observation stops right after the last event.
Confidence Bounds
In general, in order to obtain the virtual age, the exact occurrence time of each event (failure) should be available, see Eqns.(Type I) and (Type 2). However, the times are unknown until the corresponding events occur. For this reason, there are no closed-form expressions for total failure number and failure intensity, which are functions of failure times and virtual age. Therefore, in Weibull++, Monte Carlo simulation is used to predict values of virtual time, failure number, MTBF and failure rate. The approximate confidence bounds obtained from simulation are provided. The uncertainty of model parameters is also considered in the bounds.
Bounds of Cumulative Failure (Event) Numbers
The variance of the cumulative failure number [math]\displaystyle{ N(t) }[/math] is:
- [math]\displaystyle{ Var[N(t)]=Var\left[ E(N(t)|\lambda ,\beta ,q) \right]+E\left[ Var(N(t)|\lambda ,\beta ,q) \right] }[/math]
The first term accounts for the uncertainty of the parameter estimation. The second term considers the uncertainty caused by the renewal process even when model parameters are fixed. However, unless [math]\displaystyle{ q=1 }[/math] , [math]\displaystyle{ Var\left[ E(N(t)|\lambda ,\beta ,q) \right] }[/math] cannot be calculated because [math]\displaystyle{ E(N(t)) }[/math] cannot be expressed as a closed-form function of [math]\displaystyle{ \lambda ,\beta , }[/math] and [math]\displaystyle{ q }[/math] . In order to consider the uncertainty of the parameter estimation, [math]\displaystyle{ Var\left[ E(N(t)|\lambda ,\beta ,q) \right] }[/math] is approximated by:
- [math]\displaystyle{ Var\left[ E(N(t)|\lambda ,\beta ,q) \right]=Var[E(N({{v}_{t}})|\lambda ,\beta )]=Var[\lambda v_{t}^{\beta }] }[/math]
where [math]\displaystyle{ {{v}_{t}} }[/math] is the expected virtual age at time [math]\displaystyle{ t }[/math] and [math]\displaystyle{ Var[\lambda v_{t}^{\beta }] }[/math] is::
- [math]\displaystyle{ \begin{align} & Var[\lambda v_{t}^{\beta }]= & {{\left( \frac{\partial (\lambda v_{t}^{\beta })}{\partial \beta } \right)}^{2}}Var(\hat{\beta })+{{\left( \frac{\partial (\lambda v_{t}^{\beta })}{\partial \lambda } \right)}^{2}}Var(\hat{\lambda }) \\ & & +2\frac{\partial (\lambda v_{t}^{\beta })}{\partial \beta }\frac{\partial (\lambda v_{t}^{\beta })}{\partial \lambda }Cov(\hat{\beta },\hat{\lambda }) \end{align} }[/math]
By conducting this approximation, the uncertainty of [math]\displaystyle{ \lambda }[/math] and [math]\displaystyle{ \beta }[/math] are considered. The value of [math]\displaystyle{ {{v}_{t}} }[/math] and the value of the second term in Eqn.(VarN) are obtained through the Monte Carlo simulation using parameters [math]\displaystyle{ \hat{\lambda },\hat{\beta },\hat{q}, }[/math] which are the ML estimators. The same simulation is used to estimate the cumulative number of failures [math]\displaystyle{ \hat{N}(t)=E(N(t)|\hat{\lambda },\hat{\beta },\hat{q}) }[/math] .
Once the variance and the expected value of [math]\displaystyle{ N(t) }[/math] have been obtained, the bounds can be calculated by assuming [math]\displaystyle{ N(t) }[/math] is lognormally distributed as:
- [math]\displaystyle{ \frac{\ln N(t)-\ln \hat{N}(t)}{\sqrt{Var(\ln N(t))}}\tilde{\ }N(0,1) }[/math]
The upper and lower bounds for a given confidence level [math]\displaystyle{ \alpha }[/math] can be calculated by:
- [math]\displaystyle{ N{{(t)}_{U,L}}=\hat{N}(t){{e}^{\pm {{z}_{a}}\sqrt{Var(N(t))}/\hat{N}(t)}} }[/math]
where [math]\displaystyle{ {{z}_{a}} }[/math] is the standard normal distribution.
If [math]\displaystyle{ N(t) }[/math] is assumed to be normally distributed, the bounds can be calculated by:
- [math]\displaystyle{ N{{(t)}_{U}}=\hat{N}(t)+{{z}_{a}}\sqrt{Var(N(t))} }[/math]
- [math]\displaystyle{ N{{(t)}_{L}}=\hat{N}(t)-{{z}_{a}}\sqrt{Var(N(t))} }[/math]
In Weibull++, the [math]\displaystyle{ N{{(t)}_{U}} }[/math] is the smaller of the upper bounds obtained from Eqns. (LogNorm) and (Norm). The [math]\displaystyle{ N{{(t)}_{L}} }[/math] is set to the largest of the lower bounds obtained from Eqns. (LogNorm) and (Norm). This combined method can prevent the out-of-range values of bounds for some small [math]\displaystyle{ t }[/math] values.
Bounds of Cumulative Failure Intensity and MTBF
For a given time [math]\displaystyle{ t }[/math] , the expected value of cumulative MTBF [math]\displaystyle{ {{m}_{c}}(t) }[/math] and cumulative failure intensity [math]\displaystyle{ {{\lambda }_{c}}(t) }[/math] can be calculated using the following equations:
- [math]\displaystyle{ {{\hat{\lambda }}_{c}}(t)=\frac{\hat{N}(t)}{t};{{\hat{m}}_{c}}(t)=\frac{t}{\hat{N}(t)} }[/math]
The bounds can be easily obtained from the corresponding bounds of [math]\displaystyle{ N(t). }[/math]
- [math]\displaystyle{ \begin{align} & {{{\hat{\lambda }}}_{c}}{{(t)}_{L}}= & \frac{\hat{N}{{(t)}_{L}}}{t};\text{ }{{{\hat{\lambda }}}_{c}}{{(t)}_{L}}=\frac{\hat{N}{{(t)}_{L}}}{t};\text{ } \\ & {{{\hat{m}}}_{c}}{{(t)}_{L}}= & \frac{t}{\hat{N}{{(t)}_{U}}};\text{ }{{{\hat{m}}}_{c}}{{(t)}_{U}}=\frac{t}{\hat{N}{{(t)}_{L}}} \end{align} }[/math]
Bounds of Instantaneous Failure Intensity and MTBF
The instantaneous failure intensity is given by:
- [math]\displaystyle{ {{\lambda }_{i}}(t)=\lambda \beta v_{t}^{\beta -1} }[/math]
where [math]\displaystyle{ {{v}_{t}} }[/math] is the virtual age at time [math]\displaystyle{ t. }[/math] When [math]\displaystyle{ q\ne 1, }[/math] it is obtained from simulation. When [math]\displaystyle{ q=1 }[/math] , [math]\displaystyle{ {{v}_{t}}=t }[/math] from Eqns. #(Type I) and (Type 2).
The variance of instantaneous failure intensity can be calculated by:
- [math]\displaystyle{ \begin{align} & Var({{\lambda }_{i}}(t))= & {{\left( \frac{\partial {{\lambda }_{i}}(t)}{\partial \beta } \right)}^{2}}Var(\hat{\beta })+{{\left( \frac{\partial {{\lambda }_{i}}(t)}{\partial \lambda } \right)}^{2}}Var(\hat{\lambda }) \\ & & +2\frac{\partial {{\lambda }_{i}}(t)}{\partial \beta }\frac{\partial {{\lambda }_{i}}(t)}{\partial \lambda }Cov(\hat{\beta },\hat{\lambda })+{{\left( \frac{\partial {{\lambda }_{i}}(t)}{\partial v(t)} \right)}^{2}}Var({{{\hat{v}}}_{t}}) \end{align} }[/math]
The expected value and variance of [math]\displaystyle{ {{v}_{t}} }[/math] are obtained from the Monte Carlo simulation with parameters [math]\displaystyle{ \hat{\lambda },\hat{\beta },\hat{q}. }[/math] Because of the simulation accuracy and the convergence problem in calculation of [math]\displaystyle{ Var(\hat{\beta }),Var(\hat{\lambda }) }[/math] and [math]\displaystyle{ Cov(\hat{\beta },\hat{\lambda }), }[/math] [math]\displaystyle{ Var({{\lambda }_{i}}(t)) }[/math] can be a negative value at some time points. When this case happens, the bounds of instantaneous failure intensity are not provided.
Once the variance and the expected value of [math]\displaystyle{ {{\lambda }_{i}}(t) }[/math] are obtained, the bounds have been calculated by assuming [math]\displaystyle{ {{\lambda }_{i}}(t) }[/math] is lognormally distributed as:
- [math]\displaystyle{ \frac{\ln {{\lambda }_{i}}(t)-\ln {{{\hat{\lambda }}}_{i}}(t)}{\sqrt{Var(\ln {{\lambda }_{i}}(t))}}\tilde{\ }N(0,1) }[/math]
The upper and lower bounds for a given confidence level [math]\displaystyle{ \alpha }[/math] can be calculated by:
- [math]\displaystyle{ {{\lambda }_{i}}(t)={{\hat{\lambda }}_{i}}(t){{e}^{\pm {{z}_{a}}\sqrt{Var({{\lambda }_{i}}(t))}/{{{\hat{\lambda }}}_{i}}(t)}} }[/math]
where [math]\displaystyle{ {{z}_{a}} }[/math] is the standard normal distribution.
If [math]\displaystyle{ {{\lambda }_{i}}(t) }[/math] is assumed to be normally distributed, the bounds can be calculated by:
- [math]\displaystyle{ {{\lambda }_{i}}{{(t)}_{U}}={{\hat{\lambda }}_{i}}(t)+{{z}_{a}}\sqrt{Var(N(t))} }[/math]
- [math]\displaystyle{ {{\lambda }_{i}}{{(t)}_{L}}={{\hat{\lambda }}_{i}}(t)-{{z}_{a}}\sqrt{Var(N(t))} }[/math]
In Weibull++, [math]\displaystyle{ {{\lambda }_{i}}{{(t)}_{U}} }[/math] is set to the smaller of the two upper bounds obtained from Eqns.#(LognorIF)and (normIF). [math]\displaystyle{ {{\lambda }_{i}}{{(t)}_{L}} }[/math] is set to the largest of the two lower bounds obtained from Eqns.#(LognorIF) and (normIF). This combination method can prevent the out of range values of bounds when [math]\displaystyle{ t }[/math] values are small.
For a given time [math]\displaystyle{ t }[/math] , the expected value of cumulative MTBF [math]\displaystyle{ {{m}_{i}}(t) }[/math] is:
- [math]\displaystyle{ {{\hat{m}}_{i}}(t)=\frac{1}{{{{\hat{\lambda }}}_{i}}(t)}\text{ } }[/math]
The upper and lower bounds can be easily obtained from the corresponding bounds of [math]\displaystyle{ {{\lambda }_{i}}(t): }[/math]
- [math]\displaystyle{ {{\hat{m}}_{i}}{{(t)}_{U}}=\frac{1}{{{{\hat{\lambda }}}_{i}}{{(t)}_{L}}} }[/math]
- [math]\displaystyle{ {{\hat{m}}_{i}}{{(t)}_{L}}=\frac{1}{{{{\hat{\lambda }}}_{i}}{{(t)}_{U}}} }[/math]
Bounds of Conditional Reliability
Given mission start time [math]\displaystyle{ {{t}_{0}} }[/math] and mission time [math]\displaystyle{ T }[/math] , the conditional reliability can be calculated by:
- [math]\displaystyle{ R(T|{{t}_{0}})=\frac{R(T+{{v}_{0}})}{R({{v}_{0}})}={{e}^{-\lambda [{{({{v}_{0}}+T)}^{\beta }}-{{v}_{0}}]}} }[/math]
[math]\displaystyle{ {{v}_{0}} }[/math] is the virtual age corresponding to time [math]\displaystyle{ {{t}_{0}} }[/math] . The expected value and the variance of [math]\displaystyle{ {{v}_{0}} }[/math] are obtained from Monte Carlo simulation. The variance of the conditional reliability [math]\displaystyle{ R(T|{{t}_{0}}) }[/math] is:
- [math]\displaystyle{ \begin{align} & Var(R)= & {{\left( \frac{\partial R}{\partial \beta } \right)}^{2}}Var(\hat{\beta })+{{\left( \frac{\partial R}{\partial \lambda } \right)}^{2}}Var(\hat{\lambda }) \\ & & +2\frac{\partial R}{\partial \beta }\frac{\partial R}{\partial \lambda }Cov(\hat{\beta },\hat{\lambda })+{{\left( \frac{\partial R}{\partial {{v}_{0}}} \right)}^{2}}Var({{{\hat{v}}}_{0}}) \end{align} }[/math]
Because of the simulation accuracy and the convergence problem in calculation of [math]\displaystyle{ Var(\hat{\beta }),Var(\hat{\lambda }) }[/math] and [math]\displaystyle{ Cov(\hat{\beta },\hat{\lambda }), }[/math] [math]\displaystyle{ Var(R) }[/math] can be a negative value at some time points. When this case happens, the bounds are not provided.
The bounds are based on:
- [math]\displaystyle{ \log \text{it}(\hat{R}(T))\tilde{\ }N(0,1) }[/math]
- [math]\displaystyle{ \log \text{it}(\hat{R}(T))=\ln \left\{ \frac{\hat{R}(T)}{1-\hat{R}(T)} \right\} }[/math]
The confidence bounds on reliability are given by:
- [math]\displaystyle{ R=\frac{{\hat{R}}}{\hat{R}+(1-\hat{R}){{e}^{\pm \sqrt{Var(R)}/[\hat{R}(1-\hat{R})]}}} }[/math]
It will be compared with the bounds obtained from:
- [math]\displaystyle{ R=\hat{R}{{e}^{\pm {{z}_{a}}\sqrt{Var(R)}/\hat{R}}} }[/math]
The smaller of the two upper bounds will be the final upper bound and the larger of the two lower bounds will be the final lower bound.
Example 4
The following table gives the failure times of the air-condition unit of an aircraft. The observation is ended by the time of the last failure [3].
1. Estimate the GRP model parameters using the Type I virtual age option.
2. Plot the failure number and instantaneous failure intensity vs. time with 90% two-sided confidence bounds.
3. Plot the conditional reliability vs. time with 90% two-sided confidence bounds. The mission start time is 40 and mission time is varying.
4. Using the QCP, calculate the expected failure number and expected instantaneous failure intensity by time 1800.
Solution to Example 4
Enter the data into a Parametric RDA Specialized Folio in Weibull++. Choose 3 under Parameters and Type I under Settings. Keep the default simulation settings.
1. The estimated parameters are [math]\displaystyle{ \hat{\beta }=1.1976, }[/math] [math]\displaystyle{ \hat{\lambda }=4.94E-03, }[/math] [math]\displaystyle{ \hat{q}=0.1344 }[/math] .
2. The failure number and instantaneous failure intensity are given in the following plots.
3. The conditional reliability is plotted below.
4. Using QCP, the failure number and instantaneous failure intensity are:
