Prior Elicitation and Evaluation of Imprecise Judgements for Bayesian Analysis of System Reliability

Alireza Daneshkhah, Amin Hosseinian-Far, Tabassom Sedighi, Maryam Farsi

Research output: Contribution to Book/Report typesChapterResearchpeer-review

1 Downloads (Pure)

Abstract

System reliability assessment is a critical task for design engineers. Identifying the least reliable components within a to-be system would immensely assist the engineers to improve designs. This represents a pertinent example of data-informed decision-making (DIDM). In this chapter, we have looked into the theoretical frameworks and the underlying structure of system reliability assessment using prior elicitation and analysis of imprecise judgements. We consider the issue of imprecision in the expert’s probability assessments. We particularly examine how imprecise assessments would lead to uncertainty. It is crucial to investigate and assess this uncertainty. Such an assessment would lead to a more realistic representation of the expert’s beliefs, and would avoid artificially precise inferences. In other words, in many of the existing elicitation methods, it cannot be claimed that the resulting distribution perfectly describes the expert’s beliefs. In this paper, we examine suitable ways of modelling the imprecision in the expert’s probability assessments. We would also discuss the level of uncertainty that we might have about an expert’s density function following an elicitation. Our method to elicit an expert’s density function is nonparametric (using Gaussian Process emulators), as introduced by Oakley and O’Hagan [1]. We will modify this method by including the imprecision in any elicited probability judgement. It should be noticed that modelling imprecision does not have any impact on the expert’s true density function, and it only affects the analyst’s uncertainty about the unknown quantity of interest. We will compare our method with the method proposed in [2] using the ‘roulette method’. We quantify the uncertainty of their density function, given the fact that the expert has only specified a limited number of probability judgements, and that these judgements are forced to be rounded. We will investigate the advantages of these methods against each other. Finally, we employ the proposed methods in this paper to examine the uncertainty about the prior density functions of the power law model’s parameters elicited based on the imprecise judgements and how this uncertainty might affect our final inference.
Original languageEnglish
Title of host publicationEngineering for Cloud Computing and Big Data Analytics
PublisherSpringer Verlag
Pages63-79
ISBN (Electronic)978-3-319-52491-7
ISBN (Print)978-3-319-52490-0
DOIs
Publication statusPublished - 15 Feb 2017

Fingerprint

Probability density function
Engineers
Uncertainty
Decision making

Cite this

Daneshkhah, A., Hosseinian-Far, A., Sedighi, T., & Farsi, M. (2017). Prior Elicitation and Evaluation of Imprecise Judgements for Bayesian Analysis of System Reliability. In Engineering for Cloud Computing and Big Data Analytics (pp. 63-79). Springer Verlag. https://doi.org/10.1007/978-3-319-52491-7_4
Daneshkhah, Alireza ; Hosseinian-Far, Amin ; Sedighi, Tabassom ; Farsi, Maryam. / Prior Elicitation and Evaluation of Imprecise Judgements for Bayesian Analysis of System Reliability. Engineering for Cloud Computing and Big Data Analytics. Springer Verlag, 2017. pp. 63-79
@inbook{1dbab302838848b3a1bfafd8262a62a6,
title = "Prior Elicitation and Evaluation of Imprecise Judgements for Bayesian Analysis of System Reliability",
abstract = "System reliability assessment is a critical task for design engineers. Identifying the least reliable components within a to-be system would immensely assist the engineers to improve designs. This represents a pertinent example of data-informed decision-making (DIDM). In this chapter, we have looked into the theoretical frameworks and the underlying structure of system reliability assessment using prior elicitation and analysis of imprecise judgements. We consider the issue of imprecision in the expert’s probability assessments. We particularly examine how imprecise assessments would lead to uncertainty. It is crucial to investigate and assess this uncertainty. Such an assessment would lead to a more realistic representation of the expert’s beliefs, and would avoid artificially precise inferences. In other words, in many of the existing elicitation methods, it cannot be claimed that the resulting distribution perfectly describes the expert’s beliefs. In this paper, we examine suitable ways of modelling the imprecision in the expert’s probability assessments. We would also discuss the level of uncertainty that we might have about an expert’s density function following an elicitation. Our method to elicit an expert’s density function is nonparametric (using Gaussian Process emulators), as introduced by Oakley and O’Hagan [1]. We will modify this method by including the imprecision in any elicited probability judgement. It should be noticed that modelling imprecision does not have any impact on the expert’s true density function, and it only affects the analyst’s uncertainty about the unknown quantity of interest. We will compare our method with the method proposed in [2] using the ‘roulette method’. We quantify the uncertainty of their density function, given the fact that the expert has only specified a limited number of probability judgements, and that these judgements are forced to be rounded. We will investigate the advantages of these methods against each other. Finally, we employ the proposed methods in this paper to examine the uncertainty about the prior density functions of the power law model’s parameters elicited based on the imprecise judgements and how this uncertainty might affect our final inference.",
author = "Alireza Daneshkhah and Amin Hosseinian-Far and Tabassom Sedighi and Maryam Farsi",
year = "2017",
month = "2",
day = "15",
doi = "10.1007/978-3-319-52491-7_4",
language = "English",
isbn = "978-3-319-52490-0",
pages = "63--79",
booktitle = "Engineering for Cloud Computing and Big Data Analytics",
publisher = "Springer Verlag",
address = "Germany",

}

Daneshkhah, A, Hosseinian-Far, A, Sedighi, T & Farsi, M 2017, Prior Elicitation and Evaluation of Imprecise Judgements for Bayesian Analysis of System Reliability. in Engineering for Cloud Computing and Big Data Analytics. Springer Verlag, pp. 63-79. https://doi.org/10.1007/978-3-319-52491-7_4

Prior Elicitation and Evaluation of Imprecise Judgements for Bayesian Analysis of System Reliability. / Daneshkhah, Alireza; Hosseinian-Far, Amin; Sedighi, Tabassom; Farsi, Maryam.

Engineering for Cloud Computing and Big Data Analytics. Springer Verlag, 2017. p. 63-79.

Research output: Contribution to Book/Report typesChapterResearchpeer-review

TY - CHAP

T1 - Prior Elicitation and Evaluation of Imprecise Judgements for Bayesian Analysis of System Reliability

AU - Daneshkhah, Alireza

AU - Hosseinian-Far, Amin

AU - Sedighi, Tabassom

AU - Farsi, Maryam

PY - 2017/2/15

Y1 - 2017/2/15

N2 - System reliability assessment is a critical task for design engineers. Identifying the least reliable components within a to-be system would immensely assist the engineers to improve designs. This represents a pertinent example of data-informed decision-making (DIDM). In this chapter, we have looked into the theoretical frameworks and the underlying structure of system reliability assessment using prior elicitation and analysis of imprecise judgements. We consider the issue of imprecision in the expert’s probability assessments. We particularly examine how imprecise assessments would lead to uncertainty. It is crucial to investigate and assess this uncertainty. Such an assessment would lead to a more realistic representation of the expert’s beliefs, and would avoid artificially precise inferences. In other words, in many of the existing elicitation methods, it cannot be claimed that the resulting distribution perfectly describes the expert’s beliefs. In this paper, we examine suitable ways of modelling the imprecision in the expert’s probability assessments. We would also discuss the level of uncertainty that we might have about an expert’s density function following an elicitation. Our method to elicit an expert’s density function is nonparametric (using Gaussian Process emulators), as introduced by Oakley and O’Hagan [1]. We will modify this method by including the imprecision in any elicited probability judgement. It should be noticed that modelling imprecision does not have any impact on the expert’s true density function, and it only affects the analyst’s uncertainty about the unknown quantity of interest. We will compare our method with the method proposed in [2] using the ‘roulette method’. We quantify the uncertainty of their density function, given the fact that the expert has only specified a limited number of probability judgements, and that these judgements are forced to be rounded. We will investigate the advantages of these methods against each other. Finally, we employ the proposed methods in this paper to examine the uncertainty about the prior density functions of the power law model’s parameters elicited based on the imprecise judgements and how this uncertainty might affect our final inference.

AB - System reliability assessment is a critical task for design engineers. Identifying the least reliable components within a to-be system would immensely assist the engineers to improve designs. This represents a pertinent example of data-informed decision-making (DIDM). In this chapter, we have looked into the theoretical frameworks and the underlying structure of system reliability assessment using prior elicitation and analysis of imprecise judgements. We consider the issue of imprecision in the expert’s probability assessments. We particularly examine how imprecise assessments would lead to uncertainty. It is crucial to investigate and assess this uncertainty. Such an assessment would lead to a more realistic representation of the expert’s beliefs, and would avoid artificially precise inferences. In other words, in many of the existing elicitation methods, it cannot be claimed that the resulting distribution perfectly describes the expert’s beliefs. In this paper, we examine suitable ways of modelling the imprecision in the expert’s probability assessments. We would also discuss the level of uncertainty that we might have about an expert’s density function following an elicitation. Our method to elicit an expert’s density function is nonparametric (using Gaussian Process emulators), as introduced by Oakley and O’Hagan [1]. We will modify this method by including the imprecision in any elicited probability judgement. It should be noticed that modelling imprecision does not have any impact on the expert’s true density function, and it only affects the analyst’s uncertainty about the unknown quantity of interest. We will compare our method with the method proposed in [2] using the ‘roulette method’. We quantify the uncertainty of their density function, given the fact that the expert has only specified a limited number of probability judgements, and that these judgements are forced to be rounded. We will investigate the advantages of these methods against each other. Finally, we employ the proposed methods in this paper to examine the uncertainty about the prior density functions of the power law model’s parameters elicited based on the imprecise judgements and how this uncertainty might affect our final inference.

U2 - 10.1007/978-3-319-52491-7_4

DO - 10.1007/978-3-319-52491-7_4

M3 - Chapter

SN - 978-3-319-52490-0

SP - 63

EP - 79

BT - Engineering for Cloud Computing and Big Data Analytics

PB - Springer Verlag

ER -

Daneshkhah A, Hosseinian-Far A, Sedighi T, Farsi M. Prior Elicitation and Evaluation of Imprecise Judgements for Bayesian Analysis of System Reliability. In Engineering for Cloud Computing and Big Data Analytics. Springer Verlag. 2017. p. 63-79 https://doi.org/10.1007/978-3-319-52491-7_4