Japan Geoscience Union Meeting 2019

Presentation information

Print

[E] Poster

P (Space and Planetary Sciences ) » P-EM Solar-Terrestrial Sciences, Space Electromagnetism & Space Environment

[P-EM12] Space Weather and Space Climate

Tue. May 28, 2019 5:15 PM - 6:30 PM Poster Hall (International Exhibition Hall8, Makuhari Messe)

convener:Ryuho Kataoka(National Institute of Polar Research), Antti A Pulkkinen(NASA Goddard Space Flight Center), Kanya Kusano(Institute for Space-Earth Environmental Research, Nagoya University), Kaori Sakaguchi(National Institute of Information and Communications Technology)

[PEM12-P24] Why do some probabilistic forecasts lack reliability?

*Yuki Kubo1 (1.National Institute of Information and Communications Technology)

Keywords:Probabilistic forecast, Reliability

One of the important attributes to be satisfied for the probabilistic forecast system is reliability. However, some probabilistic forecast systems lack reliability. Why do some probabilistic forecasts lack reliability? We investigate a condition for a probabilistic binary forecast to be reliable in this work. We mathematically prove that a necessary, but not sufficient, condition for achieving a reliable probabilistic forecast is maximizing the Peirce skill score (PSS) at the threshold probability of the climatological base rate. The condition is confirmed by using artificially synthesized forecast-outcome pair data and previously published probabilistic solar flare forecast models. The condition gives a partial answer as to why some probabilistic forecast systems lack reliability, because the system, which does not satisfy the proved condition, can never be reliable. The result implies that those who want to develop a reliable probabilistic forecast system must adjust or train the system so as to maximize PSS near the threshold probability of the climatological base rate.