Abstract
Accurate estimation of surface soil moisture (SM) in terrestrial ecosystems is essential for understanding hydroclimate dynamics. The L-band Soil Moisture Active Passive (SMAP) mission provides 9-km global daily surface SM by using a microwave radiative transfer model (RTM)-based algorithm. However, the accuracy of SMAP SM is limited in regions with dense vegetation cover and complex surface conditions, due to the empirical parameterization and oversimplified radiative transfer processes. To overcome the limitations, we developed a Process-Guided Machine Learning (PGML) framework to integrate RTM theories and deep learning to predict global daily surface 9-km SM from April 2015 to June 2025. Informed by domain knowledge, we developed the PGML model structure using RTM and hydrological theories, designed a Kling-Gupta efficiency-based cost function, pretrained it with RTM simulations, and fine-tuned it with in-situ measurements. The independent validation shows that PGML SM has strong agreement with in-situ measurements (R = 0.868 and unbiased RMSE = 0.054 m3/m3). This study highlights the potential of PGML to enhance the accuracy of satellite SM, thereby supporting improved water resources and ecosystem management.
Similar content being viewed by others
Data availability
The global soil moisture dataset72 published in this study is available from Zenodo at https://doi.org/10.5281/zenodo.15826989. All external input datasets used in this research (e.g., SMAP brightness temperatures, ERA5-Land meteorological variables, MODIS NDVI) are publicly available from their original repositories, as cited in the manuscript.
Code availability
Data processing and analysis were conducted using Python version 3.13. The code is available on GitHub at https://github.com/SkyeFengg/PGML-SM.
References
Oki, T. & Kanae, S. Global Hydrological Cycles and World Water Resources. Science 313, 1068–1072 (2006).
Jung, M. et al. Recent decline in the global land evapotranspiration trend due to limited moisture supply. Nature 467, 951–954 (2010).
Calvet, J.-C. et al. Sensitivity of Passive Microwave Observations to Soil Moisture and Vegetation Water Content: L-Band to W-Band. IEEE Trans. Geosci. Remote Sensing 49, 1190–1199 (2011).
Fu, Z. et al. Global critical soil moisture thresholds of plant water stress. Nature Communications 15, 4826 (2024).
Liu, L. et al. Soil moisture dominates dryness stress on ecosystem production globally. Nat Commun 11, 4892 (2020).
Saeedi, M., Sharafati, A., Brocca, L. & Tavakol, A. Estimating rainfall depth from satellite-based soil moisture data: A new algorithm by integrating SM2RAIN and the analytical net water flux models. Journal of Hydrology 610, 127868 (2022).
Entekhabi, D. et al. The Soil Moisture Active Passive (SMAP) Mission. Proc. IEEE 98, 704–716 (2010).
Kerr, Y. H. et al. The SMOS Mission: New Tool for Monitoring Key Elements ofthe Global Water Cycle. Proc. IEEE 98, 666–687 (2010).
Ulaby, F. T. & Wilson, E. A. Microwave Attenuation Properties of Vegetation Canopies. IEEE Transactions on Geoscience and Remote Sensing GE-23, 746–753 (1985).
Mo, T., Choudhury, B. J., Schmugge, T. J., Wang, J. R. & Jackson, T. J. A model for microwave emission from vegetation-covered fields. Journal of Geophysical Research: Oceans 87, 11229–11237 (1982).
Konings, A. G. et al. Vegetation optical depth and scattering albedo retrieval using time series of dual-polarized L-band radiometer observations. Remote Sensing of Environment 172, 178–189 (2016).
Zhao, T. et al. Retrievals of soil moisture and vegetation optical depth using a multi-channel collaborative algorithm. Remote Sensing of Environment 257, 112321 (2021).
Li, X. et al. A new SMAP soil moisture and vegetation optical depth product (SMAP-IB): Algorithm, assessment and inter-comparison. Remote Sensing of Environment 271, 112921 (2022).
Colliander, A. et al. Comparison of high-resolution airborne soil moisture retrievals to SMAP soil moisture during the SMAP validation experiment 2016 (SMAPVEX16). Remote Sensing of Environment 227, 137–150 (2019).
Colliander, A. et al. Validation of Soil Moisture Data Products from the NASA SMAP Mission. IEEE J. Sel. Top. Appl. Earth Observations Remote Sensing 15, 364–392 (2022).
Walker, V. A. et al. From field observations to temporally dynamic soil surface roughness retrievals in the U.S. Corn Belt. Remote Sensing of Environment 287, 113458 (2023).
Gao, L., Sadeghi, M., Ebtehaj, A. & Wigneron, J.-P. A temporal polarization ratio algorithm for calibration-free retrieval of soil moisture at L-band. Remote Sensing of Environment 249, 112019 (2020).
Feng, S. et al. Improved estimation of vegetation water content and its impact on L-band soil moisture retrieval over cropland. Journal of Hydrology 617, 129015 (2023).
Feng, S. et al. Can real-time NDVI observations better constrain SMAP soil moisture retrievals? Remote Sensing of Environment 318, 114569 (2025).
Walker, V. A., Hornbuckle, B. K., Cosh, M. H. & Prueger, J. H. Seasonal Evaluation of SMAP Soil Moisture in the U.S. Corn Belt. Remote Sensing 11, 2488 (2019).
Chaubell, M. J. et al. Improved SMAP Dual-Channel Algorithm for the Retrieval of Soil Moisture. IEEE Trans. Geosci. Remote Sensing 58, 3894–3905 (2020).
Zeng, J., Chen, K.-S., Cui, C. & Bai, X. A Physically Based Soil Moisture Index From Passive Microwave Brightness Temperatures for Soil Moisture Variation Monitoring. IEEE Trans. Geosci. Remote Sensing 58, 2782–2795 (2020).
Gao, L. et al. A deep neural network based SMAP soil moisture product. Remote Sensing of Environment 277, 113059 (2022).
Lei, F. et al. Quasi-global machine learning-based soil moisture estimates at high spatio-temporal scales using CYGNSS and SMAP observations. Remote Sensing of Environment 276, 113041 (2022).
Yao, P. et al. A global daily soil moisture dataset derived from Chinese FengYun Microwave Radiation Imager (MWRI)(2010–2019). Sci Data 10, 133 (2023).
Ma, H. et al. Surface soil moisture from combined active and passive microwave observations: Integrating ASCAT and SMAP observations based on machine learning approaches. Remote Sensing of Environment 308, 114197, https://doi.org/10.1016/j.rse.2024.114197 (2024).
Han, Q. et al. Global long term daily 1 km surface soil moisture dataset with physics informed machine learning. Sci Data 10, 101 (2023).
Wang, S. et al. Airborne hyperspectral imaging of cover crops through radiative transfer process-guided machine learning. Remote Sensing of Environment 285, 113386 (2023).
Liu, L. et al. Knowledge-guided machine learning can improve carbon cycle quantification in agroecosystems. Nat Commun 15, 357 (2024).
Karniadakis, G. E. et al. Physics-informed machine learning. Nat Rev Phys 3, 422–440 (2021).
Willard, J., Jia, X., Xu, S., Steinbach, M. & Kumar, V. Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems. ACM Comput. Surv. 55, 1–37 (2023).
Karpatne, A. et al. Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data. IEEE Trans. Knowl. Data Eng. 29, 2318–2331 (2017).
Wang, S. et al. Airborne hyperspectral imaging of nitrogen deficiency on crop traits and yield of maize by machine learning and radiative transfer modeling. International Journal of Applied Earth Observation and Geoinformation 105, 102617 (2021).
Wang, Y. et al. A Deep Learning Approach Based on Physical Constraints for Predicting Soil Moisture in Unsaturated Zones. Water Resources Research 59, e2023WR035194 (2023).
Bagheri, A., Patrignani, A., Ghanbarian, B. & Pourkargar, D. B. A physics-informed machine learning approach to predict soil water content for agricultural decision-making. 2024 American Control Conference (ACC) 2–7 (2024).
Li, Z. et al. Global multi-scale surface soil moisture retrieval coupling physical mechanisms and machine learning in the cloud environment. Remote Sensing of Environment 329, 114928 (2025).
Zhang, T. et al. Multi-layer grid-scale soil moisture estimation using spatiotemporal deep learning methods with physical constraints. Journal of Hydrology 657, 133086 (2025).
O’Neill, P. et al. SMAP Enhanced L3 Radiometer Global and Polar Grid Daily 9 km EASE-Grid Soil Moisture, Version 6. NASA National Snow and Ice Data Center Distributed Active Archive Center https://doi.org/10.5067/M20OXIZHY3RJ (2023).
Lv, S., Wen, J., Zeng, Y., Tian, H. & Su, Z. An improved two-layer algorithm for estimating effective soil temperature in microwave radiometry using in situ temperature and soil moisture measurements. Remote Sensing of Environment 152, 356–363 (2014).
Chan, S., Bindlish, R., Hunt, R., Jackson, T. & Kimball, J. Ancillary Data Report Vegetation Water Content. Report No. JPL D-53061 (Jet Propulsion Laboratory California Institute of Technology, 2013).
O’Neill, P. et al. Algorithm Theoretical Basis Document Level 2 & 3 Soil Moisture (Passive) Data Products. Report No. JPL D-66480 (Jet Propulsion Laboratory California Institute of Technology, 2021).
Didan, K. MODIS/Terra Vegetation Indices 16-Day L3 Global 0.05Deg CMG V061. NASA Land Processes Distributed Active Archive Center https://doi.org/10.5067/MODIS/MOD13C1.061 (2021).
Savitzky, A. & Golay, M. J. E. Smoothing and Differentiation of Data by Simplified Least Squares Procedures. Anal. Chem. 36, 1627–1639 (1964).
Chen, J. et al. A simple method for reconstructing a high-quality NDVI time-series data set based on the Savitzky–Golay filter. Remote Sensing of Environment 91, 332–344 (2004).
Copernicus Climate Change Service. ERA5-Land hourly data from 1950 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), https://doi.org/10.24381/CDS.E2161BAC (2019).
Friedl, M. & Sulla-Menashe, D. MODIS/Terra+Aqua Land Cover Type Yearly L3 Global 0.05Deg CMG V061. NASA Land Processes Distributed Active Archive Center, https://doi.org/10.5067/MODIS/MCD12C1.061 (2022).
Hengl, T. et al. SoilGrids250m: Global gridded soil information based on machine learning. PLoS ONE 12, e0169748 https://www.soilgrids.org/ (2017).
Beck, H. E. et al. High-resolution (1 km) Köppen-Geiger maps for 1901–2099 based on constrained CMIP6 projections. figshare https://doi.org/10.6084/m9.figshare.c.6395666.v1 (2023).
Dorigo, W. et al. The International Soil Moisture Network: serving Earth system science for over a decade. Hydrol. Earth Syst. Sci. 25, 5749–5804 (2021).
Novick, K. A. et al. The AmeriFlux network: A coalition of the willing. Agricultural and Forest Meteorology 249, 444–456 (2018).
Drought 2018 Team, ICOS Ecosystem Thematic Centre, ICOS Ecosystem Thematic Centre & Trotta, C. Drought-2018 ecosystem eddy covariance flux product for 52 stations in FLUXNET-Archive format. ICOS Ecosystem Thematic Centre, https://doi.org/10.18160/YVR0-4898 (2020).
ICOS RI et al. Ecosystem final quality (L2) product in ETC-Archive format - release 2025-1. ICOS Ecosystem Thematic Centre, https://doi.org/10.18160/S6HM-CP8Q (2025).
Warm Winter 2020 Team, ICOS Ecosystem Thematic Centre, ICOS Ecosystem Thematic Centre & Trotta, C. Warm Winter 2020 ecosystem eddy covariance flux product for 73 stations in FLUXNET-Archive format—release 2022-1. ICOS Ecosystem Thematic Centre, https://doi.org/10.18160/2G60-ZHAK (2022).
Ueyama, M. et al. The JapanFlux2024 dataset for eddy covariance observations covering Japan and East Asia from 1990 to 2023. Arctic Data archive System https://ads.nipr.ac.jp/japan-flux2024/ (2024).
Zhang, P. et al. A 10 year (2009–2019) surface soil moisture dataset produced based on in situ measurements collected from the Tibet-Obs. 4TU.ResearchData, https://doi.org/10.4121/12763700.v7 (2020).
Cho, K. et al. Calibration of the SMAP Soil Moisture Retrieval Algorithm to Reduce Bias Over the Amazon Rainforest. IEEE J. Sel. Top. Appl. Earth Observations Remote Sensing 17, 8724–8736 (2024).
Spennemann, P. C., Fernández-Long, M. E., Gattinoni, N. N., Cammalleri, C. & Naumann, G. Soil moisture evaluation over the Argentine Pampas using models, satellite estimations and in-situ measurements. Journal of Hydrology: Regional Studies 31, 100723 (2020).
Yang, K. et al. Network of soil temperature and moisture on the Pali (2015-2021). National Tibetan Plateau Data Center https://doi.org/10.11888/Terre.tpdc.301088 (2022).
Domine, F., Sarrazin, D., Nadeau, D., Lackner, G. & Belke-Brea, M. Hydrometeorological, snow and soil data from a low-Arctic valley in the forest-tundra ecotone in Northern Quebec. PANGAEA https://doi.org/10.1594/PANGAEA.964743 (2024).
Singh, G., Panda, R. K. & Mohanty, B. P. Spatiotemporal Analysis of Soil Moisture and Optimal Sampling Design for Regional‐Scale Soil Moisture Estimation in a Tropical Watershed of India. Water Resources Research https://agupubs.onlinelibrary.wiley.com/doi/full/10.1029/2018WR024044#support-information-section (2019).
Cosh, M., Kelly, V. & Colliander, A. SMAPVEX19-22 Millbrook Temporary Soil Moisture Network, Version 1. NASA National Snow and Ice Data Center Distributed Active Archive Center https://doi.org/10.5067/NXNJWN9933UI (2020).
Cosh, M., Kraatz, S. & Colliander, A. SMAPVEX19-22 Massachusetts Temporary Soil Moisture Network, Version 1. NASA National Snow and Ice Data Center Distributed Active Archive Center https://doi.org/10.5067/3LXL78PSKVXQ (2020).
Wang, C. et al. Chinese Soil Moisture Observation Network and Time Series Data Set. figshare https://doi.org/10.6084/m9.figshare.21302955.v2 (2022).
Boike, J. et al. Measurements in soil and air at Samoylov Station (2002-2018). PANGAEA https://doi.org/10.1594/PANGAEA.891142 (2018).
Boike, J., Miesner, F., Bornemann, N., Cable, W. L. & Grünberg, I. Trail Valley Creek, NWT, Canada Soil Moisture and Temperature 2016. PANGAEA https://doi.org/10.1594/PANGAEA.962726 (2023).
Gupta, H. V. & Kling, H. On typical range, sensitivity, and normalization of Mean Squared Error and Nash‐Sutcliffe Efficiency type metrics. Water Resources Research 47, 2011WR010962 (2011).
Liao, D., Niu, J., Du, T. & Kang, S. Improving Subsurface Soil Moisture Estimation Using a 2‐Dimensional Data Assimilation Framework Incorporated With a Dual State‐Parameter Scheme. Water Resources Research 60, e2023WR035771 (2024).
Fatima, E. et al. Improved representation of soil moisture processes through incorporation of cosmic-ray neutron count measurements in a large-scale hydrologic model. Hydrol. Earth Syst. Sci. 28, 5419–5441 (2024).
Al Bitar, A. et al. The global SMOS Level 3 daily soil moisture and brightness temperature maps. Earth Syst. Sci. 9, 293–315 (2017).
Dorigo, W. et al. ESA CCI Soil Moisture for improved Earth system understanding: State-of-the art and future directions. Remote Sensing of Environment 203, 185–215 (2017).
Wigneron, J.-P. et al. SMOS-IC data record of soil moisture and L-VOD: Historical development, applications and perspectives. Remote Sensing of Environment 254, 112238 (2021).
Feng, S. et al. Global daily 9 km remotely sensed soil moisture (2015–2025) with microwave radiative transfer-guided learning. Zenodo https://doi.org/10.5281/ZENODO.15826988 (2025).
Colliander, A. et al. Seasonal Dependence of SMAP Radiometer-Based Soil Moisture Performance as Observed Over Core Validation Sites. IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium 5320–5323 (2019).
Ambadan, J. T. et al. Evaluation of SMAP Soil Moisture Retrieval Accuracy Over a Boreal Forest Region. IEEE Transactions on Geoscience and Remote Sensing 60, 1–11 (2022).
Bakke, S. J., Ionita, M. & Tallaksen, L. M. The 2018 northern European hydrological drought and its drivers in a historical perspective. Hydrol. Earth Syst. Sci. 24, 5621–5653 (2020).
Rakovec, O. et al. The 2018–2020 Multi‐Year Drought Sets a New Benchmark in Europe. Earth’s Future 10, e2021EF002394 (2022).
Peters, W., Bastos, A., Ciais, P. & Vermeulen, A. A historical, geographical and ecological perspective on the 2018 European summer drought. Phil. Trans. R. Soc. B 375, 20190505 (2020).
Hovmöller, E. The Trough-and-Ridge diagram. Tellus 1, 62–66 (1949).
Acknowledgements
This work was supported by the Danish Data Science Academy, which is funded by the Novo Nordisk Foundation (NNF21SA0069429) and VILLUM FONDEN (40516). This work was also supported by the VILLUM Young Investigator 2024 project (00072051), the Novo Nordisk Starting Grant (NNF23OC0087612), the SCALE project (AgriFoodTure, Innovation Fund Denmark), NASA ECOSTRESS Science and Applications Program (80NSSC23K0308), NASA Early Career Investigator Program in Earth Science (80NSSC24K1057), and the Global Wetland Center (NNF23OC0081089, Novo Nordisk Foundation). Additional funding was provided by the Pioneer Center for Research in Sustainable Agricultural Futures (Land-CRAFT), DNRF grant number P2, and Aarhus University. The author acknowledge NASA, ESA, INRAE and ECMWF for providing global SM products and land surface features, and thank ISMN, AmeriFlux, JapanFlux, ICOS and previous studies for providing available in-situ SM measurements.
Author information
Authors and Affiliations
Contributions
S.F. and S.W. conceived this research and drafted the manuscript; S.F. and A.L. performed the experiments and data processing; S.W. provided supervision and guidance throughout the experiment and analysis; and all the authors reviewed and revised the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Feng, S., Li, A., Zhou, R. et al. Global daily 9 km remotely sensed soil moisture (2015–2025) with microwave radiative transfer-guided learning. Sci Data (2026). https://doi.org/10.1038/s41597-026-06721-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41597-026-06721-6


