Non-Parametric Recurrent Event Data Analysis: Difference between revisions
No edit summary |
|||
| Line 16: | Line 16: | ||
[[Image:Lda11.1.png|center|400px]] | [[Image:Lda11.1.png|center|400px]] | ||
The non-parametric model for a population of units is described as the population of cumulative history functions (curves). It is the population of all staircase functions of every unit in the population. At age t, the units have a distribution of their cumulative number of events. That is, a fraction of the population has accumulated 0 recurrences, another fraction has accumulated 1 recurrence, another fraction has accumulated 2 recurrences, etc. This distribution differs at different ages < | The non-parametric model for a population of units is described as the population of cumulative history functions (curves). It is the population of all staircase functions of every unit in the population. At age t, the units have a distribution of their cumulative number of events. That is, a fraction of the population has accumulated 0 recurrences, another fraction has accumulated 1 recurrence, another fraction has accumulated 2 recurrences, etc. This distribution differs at different ages <math>t\,\!</math>, and has a mean <math>M(t)\,\!</math> called the mean cumulative function (MCF). The <math>M(t)\,\!</math> is the point-wise average of all population cumulative history functions (see figure below). | ||
[[Image:Lda11.2.png|center|400px]] | [[Image:Lda11.2.png|center|400px]] | ||
For the case of uncensored data, the mean cumulative function <math>M{{(t)}_{i}}\ \,\!</math> values at different recurrence ages < | For the case of uncensored data, the mean cumulative function <math>M{{(t)}_{i}}\ \,\!</math> values at different recurrence ages <math>{{t}_{i}}\,\!</math> are estimated by calculating the average of the cumulative number of recurrences of events for each unit in the population at <math>{{t}_{i}}\,\!</math>. When the histories are censored, the following steps are applied. | ||
'''1st Step - Order all ages:''' | '''1st Step - Order all ages:''' | ||
| Line 26: | Line 26: | ||
Order all recurrence and censoring ages from smallest to largest. If a recurrence age for a unit is the same as its censoring (suspension) age, then the recurrence age goes first. If multiple units have a common recurrence or censoring age, then these units could be put in a certain order or be sorted randomly. | Order all recurrence and censoring ages from smallest to largest. If a recurrence age for a unit is the same as its censoring (suspension) age, then the recurrence age goes first. If multiple units have a common recurrence or censoring age, then these units could be put in a certain order or be sorted randomly. | ||
'''2nd Step - Calculate the number, < | '''2nd Step - Calculate the number, <math>{{r}_{i}}\,\!</math>, of units that passed through age <math>{{t}_{i}}\,\!</math> :''' | ||
::<math>\begin{align} | ::<math>\begin{align} | ||
| Line 33: | Line 33: | ||
\end{align}\,\!</math> | \end{align}\,\!</math> | ||
< | <math>N\,\!</math> is the total number of units and <math>{{r}_{1}} = N\,\!</math> at the first observed age which could be a recurrence or suspension. | ||
'''3rd Step - Calculate the MCF estimate, M*(t):''' | '''3rd Step - Calculate the MCF estimate, M*(t):''' | ||
For each sample recurrence age < | For each sample recurrence age <math>{{t}_{i}}\,\!</math>, calculate the mean cumulative function estimate as follows | ||
::<math>{{M}^{*}}({{t}_{i}})=\frac{1}{{{r}_{i}}}+{{M}^{*}}({{t}_{i-1}})\,\!</math> | ::<math>{{M}^{*}}({{t}_{i}})=\frac{1}{{{r}_{i}}}+{{M}^{*}}({{t}_{i-1}})\,\!</math> | ||
where <math>{{M}^{*}}(t)=\tfrac{1}{{{r}_{1}}}\,\!</math> at the earliest observed recurrence age, < | where <math>{{M}^{*}}(t)=\tfrac{1}{{{r}_{1}}}\,\!</math> at the earliest observed recurrence age, <math>{{t}_{1}}\,\!</math>. | ||
===Confidence Limits for the MCF=== | ===Confidence Limits for the MCF=== | ||
| Line 55: | Line 55: | ||
::<math>Var[{{M}^{*}}({{t}_{i}})]=Var[{{M}^{*}}({{t}_{i-1}})]+\frac{1}{r_{i}^{2}}\left[ \underset{j\in {{R}_{i}}}{\overset{}{\mathop \sum }}\,{{\left( {{d}_{ji}}-\frac{1}{{{r}_{i}}} \right)}^{2}} \right]\,\!</math> | ::<math>Var[{{M}^{*}}({{t}_{i}})]=Var[{{M}^{*}}({{t}_{i-1}})]+\frac{1}{r_{i}^{2}}\left[ \underset{j\in {{R}_{i}}}{\overset{}{\mathop \sum }}\,{{\left( {{d}_{ji}}-\frac{1}{{{r}_{i}}} \right)}^{2}} \right]\,\!</math> | ||
where <math>{r}_{i}\,\!</math> is defined in the equation of the survivals, <math>{{R}_{i}}\,\!</math> | where <math>{r}_{i}\,\!</math> is defined in the equation of the survivals, <math>{{R}_{i}}\,\!</math> is the set of the units that have not been suspended by <math>i\,\!</math> and <math>{{d}_{ji}}\,\!</math> is defined as follows: | ||
::<math>\begin{align} | ::<math>\begin{align} | ||
Revision as of 21:43, 26 September 2012
 |
This article appears in the Life Data Analysis Reference book.
Non-parametric RDA provides a non-parametric graphical estimate of the mean cumulative number or cost of recurrence per unit versus age. As discussed in Nelson [31], in the reliability field, the Mean Cumulative Function (MCF) can be used to:
- Evaluate whether the population repair (or cost) rate increases or decreases with age (this is useful for product retirement and burn-in decisions).
- Estimate the average number or cost of repairs per unit during warranty or some time period.
- Compare two or more sets of data from different designs, production periods, maintenance policies, environments, operating conditions, etc.
- Predict future numbers and costs of repairs, such as the expected number of failures next month, quarter, or year.
- Reveal unexpected information and insight.
The Mean Cumulative Function (MCF)
In a non-parametric analysis of recurrent event data, each population unit can be described by a cumulative history function for the cumulative number of recurrences. It is a staircase function that depicts the cumulative number of recurrences of a particular event, such as repairs over time. The figure below depicts a unit's cumulative history function.
The non-parametric model for a population of units is described as the population of cumulative history functions (curves). It is the population of all staircase functions of every unit in the population. At age t, the units have a distribution of their cumulative number of events. That is, a fraction of the population has accumulated 0 recurrences, another fraction has accumulated 1 recurrence, another fraction has accumulated 2 recurrences, etc. This distribution differs at different ages [math]\displaystyle{ t\,\! }[/math], and has a mean [math]\displaystyle{ M(t)\,\! }[/math] called the mean cumulative function (MCF). The [math]\displaystyle{ M(t)\,\! }[/math] is the point-wise average of all population cumulative history functions (see figure below).
For the case of uncensored data, the mean cumulative function [math]\displaystyle{ M{{(t)}_{i}}\ \,\! }[/math] values at different recurrence ages [math]\displaystyle{ {{t}_{i}}\,\! }[/math] are estimated by calculating the average of the cumulative number of recurrences of events for each unit in the population at [math]\displaystyle{ {{t}_{i}}\,\! }[/math]. When the histories are censored, the following steps are applied.
1st Step - Order all ages:
Order all recurrence and censoring ages from smallest to largest. If a recurrence age for a unit is the same as its censoring (suspension) age, then the recurrence age goes first. If multiple units have a common recurrence or censoring age, then these units could be put in a certain order or be sorted randomly.
2nd Step - Calculate the number, [math]\displaystyle{ {{r}_{i}}\,\! }[/math], of units that passed through age [math]\displaystyle{ {{t}_{i}}\,\! }[/math] :
- [math]\displaystyle{ \begin{align} & {{r}_{i}}= & {{r}_{i-1}}\quad \quad \text{if }{{t}_{i}}\text{ is a recurrence age} \\ & {{r}_{i}}= & {{r}_{i-1}}-1\text{ if }{{t}_{i}}\text{ is a censoring age} \end{align}\,\! }[/math]
[math]\displaystyle{ N\,\! }[/math] is the total number of units and [math]\displaystyle{ {{r}_{1}} = N\,\! }[/math] at the first observed age which could be a recurrence or suspension.
3rd Step - Calculate the MCF estimate, M*(t):
For each sample recurrence age [math]\displaystyle{ {{t}_{i}}\,\! }[/math], calculate the mean cumulative function estimate as follows
- [math]\displaystyle{ {{M}^{*}}({{t}_{i}})=\frac{1}{{{r}_{i}}}+{{M}^{*}}({{t}_{i-1}})\,\! }[/math]
where [math]\displaystyle{ {{M}^{*}}(t)=\tfrac{1}{{{r}_{1}}}\,\! }[/math] at the earliest observed recurrence age, [math]\displaystyle{ {{t}_{1}}\,\! }[/math].
Confidence Limits for the MCF
Upper and lower confidence limits for [math]\displaystyle{ M({{t}_{i}})\,\! }[/math] are:
- [math]\displaystyle{ \begin{align} & {{M}_{U}}({{t}_{i}})= {{M}^{*}}({{t}_{i}}).{{e}^{\tfrac{{{K}_{\alpha }}.\sqrt{Var[{{M}^{*}}({{t}_{i}})]}}{{{M}^{*}}({{t}_{i}})}}} \\ & {{M}_{L}}({{t}_{i}})= \frac{{{M}^{*}}({{t}_{i}})}{{{e}^{\tfrac{{{K}_{\alpha }}.\sqrt{Var[{{M}^{*}}({{t}_{i}})]}}{{{M}^{*}}({{t}_{i}})}}}} \end{align}\,\! }[/math]
where [math]\displaystyle{ \alpha \,\! }[/math] ( [math]\displaystyle{ 50%\lt \alpha \lt 100%\,\! }[/math] ) is confidence level, [math]\displaystyle{ {{K}_{\alpha }}\,\! }[/math] is the [math]\displaystyle{ \alpha \,\! }[/math] standard normal percentile and [math]\displaystyle{ Var[{{M}^{*}}({{t}_{i}})]\,\! }[/math] is the variance of the MCF estimate at recurrence age [math]\displaystyle{ {{t}_{i}}\,\! }[/math]. The variance is calculated as follows:
- [math]\displaystyle{ Var[{{M}^{*}}({{t}_{i}})]=Var[{{M}^{*}}({{t}_{i-1}})]+\frac{1}{r_{i}^{2}}\left[ \underset{j\in {{R}_{i}}}{\overset{}{\mathop \sum }}\,{{\left( {{d}_{ji}}-\frac{1}{{{r}_{i}}} \right)}^{2}} \right]\,\! }[/math]
where [math]\displaystyle{ {r}_{i}\,\! }[/math] is defined in the equation of the survivals, [math]\displaystyle{ {{R}_{i}}\,\! }[/math] is the set of the units that have not been suspended by [math]\displaystyle{ i\,\! }[/math] and [math]\displaystyle{ {{d}_{ji}}\,\! }[/math] is defined as follows:
- [math]\displaystyle{ \begin{align} & {{d}_{ji}}= 1\text{ if the }{{j}^{\text{th }}}\text{unit had an event recurrence at age }{{t}_{i}} \\ & {{d}_{ji}}= 0\text{ if the }{{j}^{\text{th }}}\text{unit did not have an event reoccur at age }{{t}_{i}} \end{align}\,\! }[/math]
Example: Mean Cumulative Function
A health care company maintains five identical pieces of equipment used by a hospital. When a piece of equipment fails, the company sends a crew to repair it. The following table gives the failure and censoring ages for each machine, where the + sign indicates a censoring age.
Estimate the MCF values, with 95% confidence bounds.
Solution
The MCF estimates are obtained as follows:
Using the MCF variance equation, the following table of variance values can be obtained:
| ID | Months | State | [math]\displaystyle{ {{r}_{i}}\,\! }[/math] | [math]\displaystyle{ Va{{r}_{i}}\,\! }[/math] |
|---|---|---|---|---|
| 1 | 5 | F | 5 | [math]\displaystyle{ (\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.032\,\! }[/math] |
| 2 | 6 | F | 5 | [math]\displaystyle{ 0.032+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.064\,\! }[/math] |
| 1 | 10 | F | 5 | [math]\displaystyle{ 0.064+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.096\,\! }[/math] |
| 3 | 12 | F | 5 | [math]\displaystyle{ 0.096+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.128\,\! }[/math] |
| 2 | 13 | F | 5 | [math]\displaystyle{ 0.128+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.160\,\! }[/math] |
| 4 | 13 | F | 5 | [math]\displaystyle{ 0.160+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.192\,\! }[/math] |
| 1 | 15 | F | 5 | [math]\displaystyle{ 0.192+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.224\,\! }[/math] |
| 4 | 15 | F | 5 | [math]\displaystyle{ 0.224+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.256\,\! }[/math] |
| 5 | 16 | F | 5 | [math]\displaystyle{ 0.256+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.288\,\! }[/math] |
| 2 | 17 | F | 5 | [math]\displaystyle{ 0.288+(\tfrac{1}{5})^2[(1-\tfrac{1}{5})^2+4(0-\tfrac{1}{5})^2]=0.320\,\! }[/math] |
| 1 | 17 | S | 4 | |
| 2 | 19 | S | 3 | |
| 3 | 20 | F | 3 | [math]\displaystyle{ 0.320+(\tfrac{1}{3})^2[(1-\tfrac{1}{3})^2+2(0-\tfrac{1}{3})^2]=0.394\,\! }[/math] |
| 5 | 22 | F | 3 | [math]\displaystyle{ 0.394+(\tfrac{1}{3})^2[(1-\tfrac{1}{3})^2+2(0-\tfrac{1}{3})^2]=0.468\,\! }[/math] |
| 4 | 24 | S | 2 | |
| 3 | 25 | F | 2 | [math]\displaystyle{ 0.468+(\tfrac{1}{2})^2[(1-\tfrac{1}{2})^2+(0-\tfrac{1}{2})^2]=0.593\,\! }[/math] |
| 5 | 25 | F | 2 | [math]\displaystyle{ 0.593+(\tfrac{1}{2})^2[(1-\tfrac{1}{2})^2+(0-\tfrac{1}{2})^2]=0.718\,\! }[/math] |
| 3 | 26 | S | 1 | |
| 5 | 28 | S | 0 |
Using the equation for the MCF bounds and [math]\displaystyle{ {{K}_{5}} = 1.644\,\! }[/math] for a 95% confidence level, the confidence bounds can be obtained as follows:
The analysis presented in this example can be performed automatically in Weibull++'s non-parametric RDA folio, as shown next.
Note: In the folio above, the [math]\displaystyle{ F\,\! }[/math] refers to failures and [math]\displaystyle{ E\,\! }[/math] refers to suspensions (or censoring ages). The results, with calculated MCF values and upper and lower 95% confidence limits, are shown next along with the graphical plot.
