Multivariable Relationships: General Log-Linear and Proportional Hazards

So far in this reference the life-stress relationships presented have been either single stress relationships or two stress relationships. In most practical applications, however, life is a function of more than one or two variables (stress types). In addition, there are many applications where the life of a product as a function of stress and of some engineering variable other than stress is sought. In this chapter, the general log-linear relationship and the proportional hazards model are presented for the analysis of such cases where more than two accelerated stresses (or variables) need to be considered.

=General Log-Linear Relationship=

=Proportional Hazards Model= Introduced by D. R. Cox, the Proportional Hazards (PH) model was developed in order to estimate the effects of different covariates influencing the times-to-failure of a system. The model has been widely used in the biomedical field, as discussed in Leemis [22], and recently there has been an increasing interest in its application in reliability engineering. In its original form, the model is non-parametric, (i.e., no assumptions are made about the nature or shape of the underlying failure distribution). In this reference, the original non-parametric formulation as well as a parametric form of the model will be considered utilizing a Weibull life distribution. In ALTA, the proportional hazards model is included in its parametric form and can be used to analyze data with up to eight variables. The GLL-Weibull and GLL-exponential models are actually special cases of the proportional hazards model. However, when using the proportional hazards in ALTA, no transformation on the covariates (or stresses) can be performed.

Non-Parametric Model Formulation
According to the PH model, the failure rate of a system is affected not only by its operation time, but also by the covariates under which it operates. For example, a unit may have been tested under a combination of different accelerated stresses such as humidity, temperature, voltage, etc. It is clear then that such factors affect the failure rate of a unit.

The instantaneous failure rate (or hazard rate) of a unit is given by:


 * $$\lambda (t)=\frac{f(t)}{R(t)}\,\!$$

where:


 * $$f(t)\,\!$$ is the probability density function.


 * $$R(t)\,\!$$ is the reliability function.

Note that for the case of the failure rate of a unit being dependent not only on time but also on other covariates, the above equation must be modified in order to be a function of time and of the covariates. The proportional hazards model assumes that the failure rate (hazard rate) of a unit is the product of:


 * an arbitrary and unspecified baseline failure rate, $${{\lambda }_{0}}(t),\,\!$$ which is a function of time only.


 * a positive function $$g(x,\underline{A})\,\!$$, independent of time, which incorporates the effects of a number of covariates such as humidity, temperature, pressure, voltage, etc.

The failure rate of a unit is then given by:


 * $$\lambda (t,\underline{X})={{\lambda }_{0}}(t)\cdot g(\underline{X},\underline{A})\,\!$$

where:


 * $$\underline{X}\,\!$$ is a row vector consisting of the covariates:


 * $$\underline{X}=({{x}_{1}},{{x}_{2}},...,{{x}_{m}})\,\!$$


 * $$\underline{A}\,\!$$ is a column vector consisting of the unknown parameters (also called regression parameters) of the model:
 * $$\underline{A}={{({{a}_{1}},{{a}_{2}},...{{a}_{m}})}^{T}}\,\!$$


 * where:


 * $$\quad \quad m\,\!$$ = number of stress related variates (time-independent).

It can be assumed that the form of $$g(\underline{X},\underline{A})\,\!$$ is known and $${{\lambda }_{0}}(t)\,\!$$ is unspecified. Different forms of $$g(\underline{X},\underline{A})\,\!$$ can be used.

However, the exponential form is mostly used due to its simplicity and is given by:


 * $$g(\underline{X},\underline{A})={{e}^}={{e}^{\mathop{}_{j=1}^{m}{{a}_{j}}{{x}_{j}}}}\,\!$$

The failure rate can then be written as:


 * $$\lambda (t,\underline{X})={{\lambda }_{0}}(t)\cdot {{e}^{\mathop{}_{j=1}^{m}{{a}_{j}}{{x}_{j}}}}\,\!$$

Parametric Model Formulation
A parametric form of the proportional hazards model can be obtained by assuming an underlying distribution. In ALTA, the Weibull and exponential distributions are available. In this section we will consider the Weibull distribution to formulate the parametric proportional hazards model. In other words, it is assumed that the baseline failure rate is parametric and given by the Weibull distribution. In this case, the baseline failure rate is given by:


 * $${{\lambda }_{0}}(t)=\frac{\beta }{\eta }{{\left( \frac{t}{\eta } \right)}^{\beta -1}}\,\!$$

The PH failure rate then becomes:


 * $$\lambda (t,\underline{X})=\frac{\beta }{\eta }{{\left( \frac{t}{\eta } \right)}^{\beta -1}}\cdot {{e}^{\mathop{\sum}_{j=1}^{m}{{a}_{j}}{{x}_{j}}}}\,\!$$

It is often more convenient to define an additional covariate, $${{x}_{0}} = 1\,\!$$, in order to allow the Weibull scale parameter raised to the beta (shape parameter) to be included in the vector of regression coefficients. The PH failure rate can then be written as:


 * $$\lambda (t,\underline{X})=\beta \cdot {{t}^{\beta -1}}\cdot {{e}^{\mathop{\sum}_{j=0}^{m}{{a}_{j}}{{x}_{j}}}}\,\!$$

The PH reliability function is given by:


 * $$\begin{align}

R(t,\underline{X})=\ {{e}^{-\int_{0}^{t}\lambda (u)du}} =\ {{e}^{-\int_{0}^{t}\lambda (u,\underline{X})du}} =\  {{e}^{-{{t}^{\beta }}\cdot {{e}^{\mathop{\sum}_{j=0}^{m}{{a}_{j}}{{x}_{j}}}}}} \end{align}\,\!$$

The pdf can be obtained by taking the partial derivative of the reliability function with respect to time. The PH pdf is:


 * $$\begin{align}

f(t,\underline{X})= & \lambda (t,\underline{X})\cdot R(t,\underline{X}) =\ \beta \cdot {{t}^{\beta -1}}{{e}^{\left[ \mathop{\sum}_{j=0}^{m}{{a}_{j}}{{x}_{j}}-{{t}^{\beta }}\cdot {{e}^{\mathop{\sum}_{j=0}^{m}{{a}_{j}}{{x}_{j}}}} \right]}} \end{align}\,\!$$

The total number of unknowns to solve for in this model is $$m+2\,\!$$ (i.e., $$\beta ,\eta ,{{a}_{0}},{{a}_{1}},...{{a}_{m}}\,\!$$).

The maximum likelihood estimation method can be used to determine these parameters. The log-likelihood function for this case is given by:


 * $$\begin{align}

\ln (L)= & \Lambda =\underset{i=1}{\overset{\mathop \sum }}\,{{N}_{i}}\ln \left( \beta \cdot T_{i}^{\beta -1}{{e}^{-T_{i}^{\beta }\cdot {{e}^{\mathop{\sum}_{j=0}^{m}{{a}_{j}}{{x}_{i,j}}}}}}{{e}^{\mathop{\sum}_{j=0}^{m}{{a}_{j}}{{x}_{i,j}}}} \right) -\underset{i=1}{\overset{S}{\mathop \sum }}\,N_{i}^{\prime }{{\left( T_{i}^{\prime } \right)}^{\beta }}{{e}^{\mathop{\sum}_{j=0}^{m}{{a}_{j}}{{x}_{i,j}}}}+\overset{FI}{\mathop{\underset{i=1}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{\prime \prime }\ln [R_{Li}^{\prime \prime }-R_{Ri}^{\prime \prime }] \end{align}\,\!$$

where:


 * $$\begin{align}

& R_{Li}^{\prime \prime }= & {{e}^{-T_{Li}^{\prime \prime \beta }{{e}^{\underset{j=0}{\mathop{\overset{n}{\mathop{\mathop{\sum}_{}^{}}}\,}}\,{{\alpha }_{j}}{{x}_{j}}}}}} \\ & R_{Ri}^{\prime \prime }= & {{e}^{-T_{Ri}^{\prime \prime \beta }{{e}^{\underset{j=0}{\mathop{\overset{n}{\mathop{\mathop{\sum}_{}^{}}}\,}}\,{{\alpha }_{j}}{{x}_{j}}}}}} \end{align}\,\!$$

Solving for the parameters that maximize the log-likelihood function will yield the parameters for the PH-Weibull model. Note that for $$\beta =1 \,\!$$, the log-likelihood function becomes the log-likelihood function for the PH-exponential model, which is similar to the original form of the proportional hazards model proposed by Cox and Oakes [39].

Note that the likelihood function of the GLL model is very similar to the likelihood function for the proportional hazards-Weibull model. In particular, the shape parameter of the Weibull distribution can be included in the regression coefficients as follows:


 * $${{a}_{i,PH}}=-\beta \cdot {{a}_{i,GLL}}\,\!$$

where:


 * $${{a}_{i,PH}}\,\!$$ are the parameters of the PH model.


 * $${{a}_{i,GLL}}\,\!$$ are the parameters of the general log-linear model.

In this case, the likelihood functions are identical. Therefore, if no transformation on the covariates is performed, the parameter values that maximize the likelihood function of the GLL model also maximize the likelihood function for the proportional hazards-Weibull (PHW) model. Note that for $$\beta = 1\,\!$$ (exponential life distribution), the two likelihood functions are identical, and $${{a}_{i,PH}}=-{{a}_{i,GLL}}.\,\!$$

=Indicator Variables= Another advantage with both the General Log-Linear and Proportional Hazards models is that they allow for simultaneous analysis of continuous and categorical variables. Categorical variables are variables that take on discrete values such as the lot designation for products from different manufacturing lots. In this example, lot is a categorical variable, and it can be expressed in terms of indicator variables. Indicator variables only take a value of 1 or 0. For example, consider a sample of test units. A number of these units were obtained from Lot 1, others from Lot 2, and the rest from Lot 3. These three lots can be represented with the use of indicator variables, as follows:


 * Define two indicator variables, $${{X}_{1}}\,\!$$ and $${{X}_{2}}.\,\!$$


 * For the units from Lot 1, $${{X}_{1}}=1,\,\!$$ and $${{X}_{2}}=0.\,\!$$


 * For the units from Lot 2, $${{X}_{1}}=0,\,\!$$ and $${{X}_{2}}=1.\,\!$$


 * For the units from Lot 3, $${{X}_{1}}=0,\,\!$$ and $${{X}_{2}}=0.\,\!$$

Assume that an accelerated test was performed with these units, and temperature was the accelerated stress. In this case, the GLL relationship can be used to analyze the data. From the GLL relationship we get:


 * $$L(\underline{X})={{e}^{{{\alpha }_{0}}+{{\alpha }_{1}}{{X}_{1}}+{{\alpha }_{2}}{{X}_{2}}+{{\alpha }_{3}}{{X}_{3}}}}\,\!$$

where:


 * $${{X}_{1}}\,\!$$ and $${{X}_{2}}\,\!$$ are the indicator variables, as defined above.


 * $${{X}_{3}}=\tfrac{1}{T},\,\!$$ where $$T\,\!$$ is the temperature.

The data can now be entered in ALTA and, with the assumption of an underlying life distribution and using MLE, the parameters of this model can be obtained.