Timeseries

Deep Learning Predictions for Hydrology Data

Here is the our research abstract: This research strives to approve that one can study several sets of sequences or time series of an underlying evolution operator using a deep learning network. The language of geospatial time series is used as a common application type, whereas the series can be any sequence, and the sequences can be in any collection (bag)-not just Euclidean space-time-as we need sequences labeled in some way, and having properties consequent of this label (position in abstract space). This problem has been successfully tackled by deep learning in many ways and within numerous research fields. The most advanced work is estimated to be Natural Language processing and transportation (ride-hailing). The second case, with traffic and the number of people needing rides, is a geospatial problem with significant constraints from the spatial locality. As in many problems, the data here is typically space-time-stamped events. However, these can be converted into spatial time series by binning in space and time. Comparing deep learning for such time series with coupled ordinary differential equations used to describe multi-particle systems motivates the introduction of an evolution operator that describes the time dependence of complex systems. With an appropriate training process, our research interprets deep learning applied to spatial time series as a particular approach to finding the time evolution operator for the complex system giving rise to the spatial time series. Whimsically we view this training process as determining hidden variables that represent the theory (as in Newton’s laws) of the complex system. This problem is formulated in general and presents an open-source package FFFFWNPF as a Jupyter notebook for training and inference using either recurrent neural networks or a variant of the transformer (multi-headed attention) approach. This assumes an outside data engineering step that can prepare data to ingest into FFFFWNPF. The approach, a comparison of transformer and LSTM networks are presented for time series of Hydrology streamflow, temperature, and precipitation data collected on 671 catchments from each nation: the US, the UK, and Chile. This research is intended to explore how complex systems of different types (different membership linkages) are described by different types of deep learning operators. Geometric structure in space and multi-scale behavior in both time and space will be important. We predict that the current forecasting formulation will be easily extended to sequence-to-sequence problems.

Participants

• Eric He fay5du@virginia.edu

Deliverables

1. GitHub repo: TBD
2. Paper: TBD

References

1. Newman, A. & Clark, M. & Sampson, Kevin & Wood, A. & Hay, Lauren & Bock, Andy & Viger, Roland & Blodgett, David & Brekke, Levi & Arnold, Jeffrey & Hopson, Thomas & Duan, Qingyun. (2015). Development of a large-sample watershed-scale hydrometeorological data set for the contiguous USA: Data set characteristics and assessment of regional variability in hydrologic model performance. Hydrology and Earth System Sciences. 19. 209-223. 10.5194/hess-19-209-2015.
2. Alvarez-Garreton, Camila & Mendoza, Pablo & Boisier, Juan P. & Addor, Nans & Galleguillos, Mauricio & Zambrano-Bigiarini, Mauricio & Lara, Antonio & Puelma, Cristobal & Cortés, Gonzalo & Garreaud, Rene & Mcphee, James & Ayala, Álvaro. (2018). The CAMELS-CL dataset: Catchment attributes and meteorology for large sample studies-Chile dataset. Hydrology and Earth System Sciences. 22. 5817-5846. 10.5194/hess-22-5817-2018.
3. Coxon, G. & Addor, Nans & Bloomfield, John & Freer, Jim & Fry, Matt & Hannaford, Jamie & Howden, Nicholas & Lane, Rosanna & Lewis, Melinda & Robinson, Emma & Wagener, Thorsten & Woods, Ross. (2020). CAMELS-GB: hydrometeorological time series and landscape attributes for 671 catchments in Great Britain. Earth System Science Data. 12. 2459-2483. 10.5194/essd-12-2459-2020.
4. Sit, Muhammed & Demiray, Bekir & Xiang, Zhongrun & Ewing, Gregory & Sermet, Yusuf & Demir, Ibrahim. (2020). A comprehensive review of deep learning applications in hydrology and water resources. Water Science and Technology. 82. 10.2166/wst.2020.369.
5. Fox, Geoffrey & Rundle, John & Donnellan, Andrea & Feng, Bo. (2021). Earthquake Nowcasting with Deep Learning. 10.13140/RG.2.2.27588.14722.
6. Vaswani, Ashish & Shazeer, Noam & Parmar, Niki & Uszkoreit, Jakob & Jones, Llion & Gomez, Aidan & Kaiser, Lukasz & Polosukhin, Illia. (2017). Attention Is All You Need.
7. Huang, Xinyuan & Fox, Geoffrey & Serebryakov, Sergey & Mohan, Ankur & Morkisz, Pawel & Dutta, Debojyoti. (2019). Benchmarking Deep Learning for Time Series: Challenges and Directions. 5679-5682. 10.1109/BigData47090.2019.9005496.