Milad Memarzadeh, Matteo Pozzi (PI), Zico Kolter
This project is focusing on the interaction between learning and planning in sequential decision making, with application in the management of wind turbines. Reasoning at a network level is crucial for effective management of wind farms, because of the dependency in the epistemic uncertainty modeling the performance of the turbines. We use Partially Observable Markov Decision Processes (POMDP) as basic modeling tool.
By modeling this dependency, observations collected on one turbine are relevant for the entire farm.
We are working with EverPower Wind Holdings, a company owning and operating many wind farms inside and outside Pennsylvania, who provide us data and feedback.
The idea of the project: each turbine is modeled by a POMDP, and similarity is captured by relating turbines to a common parent.
A representation of the algorithm used for learning and planning with POMDP, when the underling model is uncertain.
Source of Funding
Start-up funds and Pennsylvania Infrastructure Technology Alliance (PITA) via grant PITA YR16 315188.8.131.522204
Memarzadeh, M., Pozzi, M., Kolter, J.Z. “Hierarchical Modeling of Systems with Similar Components: A Framework for Adaptive Monitoring and Control," Reliability Engineering & System Safety 153:159-169. (Elsevier) doi:10.1016/j.ress.2016.04.016 (2016).
Memarzadeh, M., Pozzi, M. "Integrated inspection scheduling and maintenance planning for infrastructure systems," Computer-Aided Civil and Infrastructure Engineering 31(6):403-415. (Wiley) doi: 10.1111/mice.12178 (2016).
Memarzadeh, M., Pozzi, M. “Integrated adaptive planning and inspection scheduling for maintenance of infrastructure systems,” 10th International Workshop on Structural Health Monitoring (IWSHM 2015), September 1-3, 2015, Stanford University, CA.
Memarzadeh, M., Pozzi, M., Kolter, Z.J. "Hierarchical modeling of systems with similar components,” 12th International Conference on Applied Statistics and Probability in Civil Engineering, ICASP12, Vancouver, Canada, July 12-15, 2015.
Memarzadeh, M., Pozzi, M., Kolter, J.Z. “Optimal planning and learning in uncertain environments for the management of wind farm,”. ASCE Journal of Computing in Civil Engineering, 29(5), 04014076 (2015).
Memarzadeh, M., Pozzi, M., Kolter, J.Z. “Multiple POMDP formulations for systems of degrading components,” The Sixth World Conference on Structural Control and Monitoring, Barcelona, 15-17 July 2014.
Memarzadeh, M., Pozzi, M., Kolter, J.Z. “Probabilistic learning and planning for optimal management of wind farms,” Structural Health Monitoring 2013, proceedings of the 9th International Workshop on Structural Health Monitoring, Stanford University, CA. 10-12 September 2013.