1. Snow Depth Extraction From Time‐Lapse Imagery Using a Keypoint Deep Learning Model.
- Author
-
Breen, C. M., Currier, W. R., Vuyovich, C., Miao, Z., and Prugh, L. R.
- Subjects
SNOW accumulation ,DEEP learning ,CHRONOPHOTOGRAPHY ,COMPUTER vision ,ALGORITHMS ,CAMERAS - Abstract
Snow pole time‐lapse photography, in which a snow pole of a known height is installed in front of a camera and photographed repeatedly over the course of a snow season, allows a large network of sites to be established relatively quickly and affordably. However, current approaches for extracting snow depth from snow poles typically relies on time intensive manual photo processing. By integrating computer vision algorithms with snow pole photography, we present a method that uses a keypoint detection model to automatically observe snow height across a network of sites. At 20 snow pole locations from Grand Mesa, CO (n = 9,722 images), our model successfully predicts the top and bottom of the pole with a mean absolute error (MAE) of 1.30 cm. To assess model generalizability, we tested the model on 12 sites in Washington State (n = 1,770 images). When the Colorado trained model was fine‐tuned using a subset of Washington images, the model predicted snow depth with a MAE of 4.0 cm. Best performance was achieved when both data sets were included during training, with a MAE of 2.05 cm for Colorado images and a MAE of 1.14 cm for Washington images. We demonstrate that, especially when trained using a subset of site‐specific data, a keypoint detection model can accelerate snow pole automation. This algorithm brings the hydrology community one step closer to a generalized snow pole detection model, and we call for a future model that integrates across time‐lapse images from additional locations. Plain Language Summary: Snow scientists depend on accurate snow depth measurements for water planning and snow modeling. Time‐lapse cameras are inexpensive, can be installed for months at a time in remote regions when winter access may be difficult, and can be programmed to take multiple images a day throughout the winter. However, these cameras often generate thousands of images that require processing to extract snow depth. Here, we develop a keypoint detection model to facilitate automating the process of snow depth extraction from snow poles installed in front of time‐lapse cameras. We expand upon previous approaches to predict the length in pixels, then use pixel to centimeter conversions to extract the snow depth in centimeters. We provide a framework for future analysis of snow depth from time‐lapse imagery, helping to improve snow depth monitoring and forecasting. Key Points: A keypoint detection model to automate snow depth measurements with a mean absolute error equal to 1.14 cm is introducedMethod shows accuracy for snow depth both in and out of canopy locations and throughout the winter seasonWhen "fine‐tuned" using 10 images per camera, the model achieves accuracy within 4 cm on a novel network comprising 12 cameras [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF