11:00 AM - 1:00 PM
[ACG38-P03] Improvements of cloud detection algorithm of GCOM-C with neural network method
Keywords:cloud detection, GCOM-C, deep neural network
The known issues of Ver.2 CLFG are misclassification between snow/ice from clear sky in day time (e.g. low reflectance snow covered region), misclassification between heavy aerosols and clouds in day time( e.g. extreme wildfires), and misclassification between cloud and clear sky at night time (e.g. at high latitude region).
To improve the accuracy of classification above, we newly developed a deep neural network (DNN) method. This DNN method is processed at the same time as Ver.2 CLFG method (CLAUDIA) processing. Comparing the results obtained from two different methods for each pixel, the more plausible result is chosen to output the final cloud flag. The cloud flag for the areas that do not need any improvements would be the same as the Ver.2 method because the algorithm of Ver.3 basically developed to focus on the weak points of Ver.2.
We made the training input dataset and the ground truth data at the various regions in various days of year. We labeled the category for each pixel considering the RGB true color image and QA flag of SIPR (Snow Ice PRoperties) prooduct with eyes. Defined categories are ”land”, ”ocean”, ”cloudy”, ”heavy aerosol”, and ”ice/snow”. The total pixels of the training dataset is more than 500,000.
We used a 3-layer DNN architecture in this method and the trained results show a high accuracy of ~99% for all categories except for 88% for night-time aerosol. The pixels used for verification were in the same tile as the area containing the training pixels (exactly the same pixels were not used to validate).
As a result, the main achieved improvements of the Ver.3 cloud flag algorithm are as below:
1. Reduced misclassification between snow/ice and clear-sky pixels.
2. Day-time heavy aerosols can be detected (not as cloud).
3. Reduced misclassification between cloud and clear sky at night time (clear-sky pixels increased). The valid pixels for the other SGLI products such as LST (Land Surface Temperature) are also expected to increase due to its improvements of cloud flag at night. However, the accuracy of clear-sky detection at night in high latitudes still needs to be addressed (future work).