The Gamma Log-Likelihood Functions and their Partials - Revision history

Lisa Hacker: Redirected page to Appendix: Log-Likelihood Equations

2015-06-25T19:26:42Z

Redirected page to Appendix: Log-Likelihood Equations

← Older revision		Revision as of 19:26, 25 June 2015
Line 1:		Line 1:
			#REDIRECT [[Appendix:_Log-Likelihood_Equations]]



	~~=== The Gamma Log-Likelihood Functions and their Partials===~~
	~~This log-likelihood function is composed of three summation portions:~~

	~~::<math>\begin{align}~~
	\ln (L)= & \Lambda =\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}\ln \left( \frac{{{e}^{k(\ln ({{T}_{i}})-\mu )-{{e}^{{{e}^{\ln ({{T}_{i}})-\mu }}}}}}}{{{T}_{i}}\Gamma (k)} \right) \\
	& +\underset{i=1}{\mathop{\overset{S}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime }}\ln \left( 1-\Gamma \left( _{1}k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu )}} \right) \right) \\
	& +\underset{i=1}{\mathop{\overset{{{F}_{I}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime \prime }}\ln \left( {{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }} \right) \right)
	~~\end{align}</math>~~

	~~:or:~~

	~~::<math>\begin{align}~~
	\Lambda = & \underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{-\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}\ln ({{T}_{i}})\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{-\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}\ln (\Gamma (k))+k\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}(\ln ({{T}_{i}})-\mu ) \\
	~~& \underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{-\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}{{e}^{\ln ({{T}_{i}})-\mu }} \\~~
	& +\underset{i=1}{\mathop{\overset{S}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime }}\ln \left( 1-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu }} \right) \right) \\
	& +\underset{i=1}{\mathop{\overset{{{F}_{I}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime \prime }}\ln \left( {{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu )}} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu )}} \right) \right)
	~~\end{align}</math>~~


	~~:where:~~
	~~::• <math>{{F}_{e}}</math> is the number of groups of times-to-failure data points~~
	~~::• <math>{{N}_{i}}</math> is the number of times-to-failure in the <math>{{i}^{th}}</math> time-to-failure data group~~
	~~::• <math>\mu </math> is the gamma shape parameter (unknown a priori, the first of two parameters to be found)~~
	~~::• <math>k</math> is the gamma scale parameter (unknown a priori, the second of two parameters to be found)~~
	~~::• <math>{{T}_{i}}</math> is the time of the <math>{{i}^{th}}</math> group of time-to-failure data~~
	~~::• <math>S</math> is the number of groups of suspension data points~~
	~~::• .. is the number of suspensions in <math>{{i}^{th}}</math> group of suspension data points~~
	~~::• <math>T_{i}^{\prime }</math> is the time of the <math>{{i}^{th}}</math> suspension data group~~
	~~::• <math>FI</math> is the number of interval failure data groups~~
	~~::• <math>N_{i}^{\prime \prime }</math> is the number of intervals in <math>{{i}^{th}}</math> group of data intervals~~
	~~::• <math>T_{Li}^{\prime \prime }</math> is the beginning of the <math>{{i}^{th}}</math> interval~~
	~~::• and <math>T_{Ri}^{\prime \prime }</math> is the ending of the <math>{{i}^{th}}</math> interval~~

	~~For the purposes of MLE, left censored data will be considered to be intervals with <math>T_{Li}^{\prime \prime }=0.</math>~~

	The solution of the maximum log-likelihood function is found by solving for (<math>\widehat{\mu },\widehat{\sigma })</math> so that <math>\tfrac{\partial \Lambda }{\partial \mu }=0,\tfrac{\partial \Lambda }{\partial k}=0.</math>

	~~::<math>\begin{align}~~
	\frac{\partial \Lambda }{\partial \mu }= & -k\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}+\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}{{e}^{\ln ({{T}_{i}})-\mu }} \\
	& +\frac{1}{\Gamma (k)}\underset{i=1}{\mathop{\overset{S}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime }}\frac{{{e}^{k\left( \ln (T_{i}^{^{\prime }})-\mu )-{{e}^{\ln (T_{i}^{^{\prime }})-\mu )}} \right)}}}{1-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu }} \right)} \\
	& +\frac{1}{\Gamma (k)}\underset{i=1}{\mathop{\overset{{{F}_{I}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime \prime }}\{\frac{{{e}^{k{{e}^{{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }}}}-{{e}^{{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }}}}}}}{{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }} \right)} \\
	& -\frac{{{e}^{k{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }}-{{e}^{{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }}}}}}}{{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }} \right)}\}
	~~\end{align}</math>~~

	::~~<math>\begin{align}~~
	\frac{\partial \Lambda }{\partial k}= & \underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}(\ln ({{T}_{i}})-\mu )-\frac{{{\Gamma }^{^{\prime }}}(k)\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\mathop{}_{}^{}}}\,}}\,{{N}_{i}}}{\Gamma (k)} \\
	& -\underset{i=1}{\mathop{\overset{S}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime }}\frac{\tfrac{\partial {{\Gamma }_{1}}(k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu }})}{\partial k}}{1-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu }} \right)} \\
	& +\underset{i=1}{\mathop{\overset{{{F}_{I}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime \prime }}\left( \frac{\tfrac{\partial {{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }} \right)}{\partial k}-\tfrac{\partial {{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)}{\partial k}}{{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-~~\mu }}) \right)} \right)~~
	~~\end{align}</math>~~
	~~<br>~~

Pantelis: Created page with ' === The Gamma Log-Likelihood Functions and their Partials=== This log-likelihood function is composed of three summation portions: :: $\begin{align} \ln (L)= & \Lamb…'$

2011-10-29T13:22:04Z

Created page with ' === The Gamma Log-Likelihood Functions and their Partials=== This log-likelihood function is composed of three summation portions: ::<math>\begin{align} \ln (L)= & \Lamb…'

New page

=== The Gamma Log-Likelihood Functions and their Partials===
This log-likelihood function is composed of three summation portions:

::<math>\begin{align}
\ln (L)= & \Lambda =\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}\ln \left( \frac{{{e}^{k(\ln ({{T}_{i}})-\mu )-{{e}^{{{e}^{\ln ({{T}_{i}})-\mu }}}}}}}{{{T}_{i}}\Gamma (k)} \right) \\
& +\underset{i=1}{\mathop{\overset{S}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime }}\ln \left( 1-\Gamma \left( _{1}k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu )}} \right) \right) \\
& +\underset{i=1}{\mathop{\overset{{{F}_{I}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime \prime }}\ln \left( {{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }} \right) \right)
\end{align}</math>

:or:

::<math>\begin{align}
\Lambda = & \underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{-\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}\ln ({{T}_{i}})\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{-\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}\ln (\Gamma (k))+k\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}(\ln ({{T}_{i}})-\mu ) \\
& \underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{-\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}{{e}^{\ln ({{T}_{i}})-\mu }} \\
& +\underset{i=1}{\mathop{\overset{S}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime }}\ln \left( 1-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu }} \right) \right) \\
& +\underset{i=1}{\mathop{\overset{{{F}_{I}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime \prime }}\ln \left( {{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu )}} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu )}} \right) \right)
\end{align}</math>

:where:
::• <math>{{F}_{e}}</math> is the number of groups of times-to-failure data points
::• <math>{{N}_{i}}</math> is the number of times-to-failure in the <math>{{i}^{th}}</math> time-to-failure data group
::• <math>\mu </math> is the gamma shape parameter (unknown a priori, the first of two parameters to be found)
::• <math>k</math> is the gamma scale parameter (unknown a priori, the second of two parameters to be found)
::• <math>{{T}_{i}}</math> is the time of the <math>{{i}^{th}}</math> group of time-to-failure data
::• <math>S</math> is the number of groups of suspension data points
::• .. is the number of suspensions in <math>{{i}^{th}}</math> group of suspension data points
::• <math>T_{i}^{\prime }</math> is the time of the <math>{{i}^{th}}</math> suspension data group
::• <math>FI</math> is the number of interval failure data groups
::• <math>N_{i}^{\prime \prime }</math> is the number of intervals in <math>{{i}^{th}}</math> group of data intervals
::• <math>T_{Li}^{\prime \prime }</math> is the beginning of the <math>{{i}^{th}}</math> interval
::• and <math>T_{Ri}^{\prime \prime }</math> is the ending of the <math>{{i}^{th}}</math> interval

For the purposes of MLE, left censored data will be considered to be intervals with <math>T_{Li}^{\prime \prime }=0.</math>

The solution of the maximum log-likelihood function is found by solving for (<math>\widehat{\mu },\widehat{\sigma })</math> so that <math>\tfrac{\partial \Lambda }{\partial \mu }=0,\tfrac{\partial \Lambda }{\partial k}=0.</math>

::<math>\begin{align}
\frac{\partial \Lambda }{\partial \mu }= & -k\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}+\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}{{e}^{\ln ({{T}_{i}})-\mu }} \\
& +\frac{1}{\Gamma (k)}\underset{i=1}{\mathop{\overset{S}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime }}\frac{{{e}^{k\left( \ln (T_{i}^{^{\prime }})-\mu )-{{e}^{\ln (T_{i}^{^{\prime }})-\mu )}} \right)}}}{1-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu }} \right)} \\
& +\frac{1}{\Gamma (k)}\underset{i=1}{\mathop{\overset{{{F}_{I}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime \prime }}\{\frac{{{e}^{k{{e}^{{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }}}}-{{e}^{{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }}}}}}}{{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }} \right)} \\
& -\frac{{{e}^{k{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }}-{{e}^{{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }}}}}}}{{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }} \right)}\}
\end{align}</math>

::<math>\begin{align}
\frac{\partial \Lambda }{\partial k}= & \underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,{{N}_{i}}(\ln ({{T}_{i}})-\mu )-\frac{{{\Gamma }^{^{\prime }}}(k)\underset{i=1}{\mathop{\overset{{{F}_{e}}}{\mathop{\mathop{}_{}^{}}}\,}}\,{{N}_{i}}}{\Gamma (k)} \\
& -\underset{i=1}{\mathop{\overset{S}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime }}\frac{\tfrac{\partial {{\Gamma }_{1}}(k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu }})}{\partial k}}{1-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{i}^{^{\prime }})-\mu }} \right)} \\
& +\underset{i=1}{\mathop{\overset{{{F}_{I}}}{\mathop{\underset{}{\overset{}{\mathop \sum }}\,}}\,}}\,N_{i}^{^{\prime \prime }}\left( \frac{\tfrac{\partial {{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }} \right)}{\partial k}-\tfrac{\partial {{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)}{\partial k}}{{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{R}_{i}}}^{^{\prime \prime }})-\mu }} \right)-{{\Gamma }_{1}}\left( k;{{e}^{\ln (T_{{{L}_{i}}}^{^{\prime \prime }})-\mu }}) \right)} \right)
\end{align}</math>
<br>

The Gamma Log-Likelihood Functions and their Partials - Revision history

Lisa Hacker: Redirected page to Appendix: Log-Likelihood Equations

Pantelis: Created page with ' === The Gamma Log-Likelihood Functions and their Partials=== This log-likelihood function is composed of three summation portions: ::\begin{align} \ln (L)= & \Lamb…'

Pantelis: Created page with ' === The Gamma Log-Likelihood Functions and their Partials=== This log-likelihood function is composed of three summation portions: :: $\begin{align} \ln (L)= & \Lamb…'$