Point-based pomdp solvers for life-cycle cost minimization of deteriorating structures

K. G. Papakonstantinou, C. Andriotis, M. Shinozuka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

Optimized maintenance of operating aging infrastructures is of paramount importance to ensure safe and cost effective operation during their original design lifetime and even beyond that. Modern answers to the problem should focus on automated planning and decision making techniques taking advantage of informative but uncertain data that become available during the structural life-cycle. In this paper such a solution framework is presented, based on partially observable Markov decision processes (POMDPs). In a POMDP framework, the evolution of the system is described by stochastic processes, real-time observation data update the system state estimations, and all possible future actions, about where, when and what type of inspection and repair should be performed, are taken into account in order to optimize the long-term life-cycle objectives. As a consequence of their advanced mathematical attributes, POMDP models are unfortunately hard to solve. In recent years, however, significant breakthroughs have been achieved, mainly due to the introduction of point-based value iteration algorithms. In this work, several POMDP point-based methods are examined, with various characteristics in the selection of the belief space points/subset and the value function update procedures. To investigate the strengths and limitations of the various solution methods for structural maintenance problems of deteriorating infrastructure and to draw conclusions regarding their efficiency and applicability to problems of this kind, a realistic nonstationary example is selected, concerning corrosion of reinforcing bars of concrete structures in a spatial stochastic context.

Original languageEnglish (US)
Title of host publicationLife-Cycle of Engineering Systems
Subtitle of host publicationEmphasis on Sustainable Civil Infrastructure - 5th International Symposium on Life-Cycle Engineering, IALCCE 2016
EditorsJaap Bakker, Dan M. Frangopol, Klaas van Breugel
PublisherCRC Press/Balkema
Pages427-434
Number of pages8
ISBN (Print)9781138028470
StatePublished - 2017
Event5th International Symposium on Life-Cycle Engineering, IALCCE 2016 - Delft, Netherlands
Duration: Oct 16 2016Oct 20 2016

Publication series

NameLife-Cycle of Engineering Systems: Emphasis on Sustainable Civil Infrastructure - 5th International Symposium on Life-Cycle Engineering, IALCCE 2016

Other

Other5th International Symposium on Life-Cycle Engineering, IALCCE 2016
Country/TerritoryNetherlands
CityDelft
Period10/16/1610/20/16

All Science Journal Classification (ASJC) codes

  • Civil and Structural Engineering
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Point-based pomdp solvers for life-cycle cost minimization of deteriorating structures'. Together they form a unique fingerprint.

Cite this