Simulation Based Bounds Example

This example appears in the Introduction to Confidence Bounds article.

Comparing Parameter Estimation Methods Using Simulation Based Bounds

The purpose of this example is to determine the best parameter estimation method for a sample of ten units with complete time-to-failure data for each unit (i.e., no censoring). The data set follows a Weibull distribution with $$\beta =2\,\!$$ and $$\eta =100\,\!$$ hours.

The confidence bounds for the data set could be obtained by using Weibull++'s SimuMatic utility. To obtain the results, use the following settings in SimuMatic.


 * On the Main tab, choose the 2P-Weibull distribution and enter the given parameters (i.e., $$\beta =2\,\!$$ and $$\eta =100\,\!$$ hours)
 * On the Censoring tab, select the No censoring option.
 * On the Settings tab, set the number of data sets to 1,000 and the number of data points to 10.
 * On the Analysis tab, choose the RRX analysis method and set the confidence bounds to 90.

The following plot shows the simulation-based confidence bounds for the RRX parameter estimation method, as well as the expected variation due to sampling error.



Create another SimuMatic folio and generate a second data using the same settings, but this time, select the RRY analysis method on the Analysis tab. The following plot shows the result.



The following plot shows the results using the MLE analysis method.



The results clearly demonstrate that the median RRX estimate provides the least deviation from the truth for this sample size and data type. However, the MLE outputs are grouped more closely together, as evidenced by the bounds.

This experiment can be repeated in SimuMatic using multiple censoring schemes (including Type I and Type II right censoring as well as random censoring) with various distributions. Multiple experiments can be performed with this utility to evaluate assumptions about the appropriate parameter estimation method to use for data sets.