Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Advertisement

Scientific Reports
  • View all journals
  • Search
  • My Account Login
  • Content Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • RSS feed
  1. nature
  2. scientific reports
  3. articles
  4. article
Multi-agent coordination and uncertainty adaptation in deep learning–assisted hierarchical optimization for renewable-dominated distribution networks
Download PDF
Download PDF
  • Article
  • Open access
  • Published: 13 January 2026

Multi-agent coordination and uncertainty adaptation in deep learning–assisted hierarchical optimization for renewable-dominated distribution networks

  • Yongle Zheng1,
  • Huixuan Li1,
  • Shiqian Wang1,
  • Zhongfu Tan2,
  • Xiaoliang Jiang1,
  • Peng Li1,
  • Yijun Jiang2 &
  • …
  • Hongkai Zhang1 

Scientific Reports , Article number:  (2026) Cite this article

  • 689 Accesses

  • 1 Altmetric

  • Metrics details

We are providing an unedited version of this manuscript to give early access to its findings. Before final publication, the manuscript will undergo further editing. Please note there may be errors present which affect the content, and all legal disclaimers apply.

Subjects

  • Energy science and technology
  • Engineering
  • Mathematics and computing

Abstract

The rapid proliferation of renewable energy sources has introduced multi-layered uncertainty into modern power system operation, challenging conventional deterministic and stochastic optimization frameworks. To address this complexity, this study proposes a deep learning–assisted distributionally robust optimization (Deep-DRO) framework designed to enhance both economic efficiency and operational reliability under uncertainty. The model integrates a hierarchical coordination architecture, wherein deep learning modules infer the probabilistic structure of uncertain variables–such as solar irradiance, wind availability, and load fluctuation–while the DRO layer enforces system-wide robustness through an adaptively reshaped ambiguity set. The learning-assisted ambiguity reconstruction enables the optimization to dynamically adjust conservativeness, improving the tradeoff between cost, reliability, and renewable utilization. Methodologically, the proposed framework employs a multi-agent dispatch structure consisting of three decision layers–county, feeder, and distributed energy resource (DER)–each learning distinct policy mappings through reinforcement-guided coordination. Deep networks trained on high-resolution meteorological and operational data estimate scenario distributions, while the robust optimization core minimizes expected cost and reliability penalties under distributional ambiguity. The resulting hybrid system seamlessly couples data-driven forecasting and model-based optimization, bridging the gap between predictive intelligence and operational robustness. To ensure scalability and interpretability, convergence diagnostics, sensitivity analyses, and cost decomposition studies are performed across multiple test systems and uncertainty scenarios. Simulation results on a benchmark multi-region distribution network demonstrate substantial performance gains. Compared to conventional DRO, the Deep-DRO model reduces total operational cost by 11.0–13.5%, improves reliability indices from 0.864 to 0.911, and raises renewable utilization from 85.6% to 89.7%. The integrated deep learning mechanism effectively captures latent correlations among stochastic parameters, enabling the system to maintain resilience even under 30% higher uncertainty variance. Furthermore, carbon emissions decline by 28.6% relative to baseline, confirming that the proposed method achieves an intrinsic balance between economic optimization and environmental sustainability. The analysis reveals that hierarchical learning fosters adaptive coordination among agents, while the robust layer guarantees performance consistency across uncertain conditions. The study thus advances a generalizable paradigm for intelligent, risk-aware energy management, offering theoretical and practical implications for future power system restoration, smart grid autonomy, and sustainable dispatch design.

Similar content being viewed by others

Hierarchical deep Q-network-based optimization of resilient grids under multi-dimensional uncertainties from extreme weather

Article Open access 10 July 2025

Multi-label machine learning for power forecasting of a grid-connected photovoltaic solar plant over multiple time horizons

Article Open access 23 September 2025

Adaptive distributed stochastic deep reinforcement learning control for voltage and frequency restoration in islanded AC microgrids with communication noise and delay

Article Open access 27 July 2025

Data availability

The datasets generated during and/or analysed during the current study are not publicly available due to conflict of interest but are available from the corresponding author on reasonable request.

References

  1. Holmes, H. E., Realff, M. J. & Lively, R. P. Water management and heat integration in direct air capture systems. Nat. Chem. Eng. 1(3), 208–215 (2024).

    Google Scholar 

  2. Cheng, Q., Zhang, Z., Wang, Y. & Zhang, L. A review of distributed energy systems: technologies, classification, and applications. Sustainability 17(4), 1346 (2025).

    Google Scholar 

  3. Wang, Y. & Zhen, J. Evaluating the economic and environmental impacts of distributed photovoltaic policy: Insights from county-level data in China. Energy Policy 198, 114509 (2025).

    Google Scholar 

  4. Tong, L., Geng, Y., Zhang, Y., Zhang, Y. & Wang, H. Testing the effectiveness of deploying distributed photovoltaic power systems in residential buildings: evidence from rural China. Environ. Impact Assess. Rev. 104, 107300 (2024).

    Google Scholar 

  5. Li, T. T., Zhao, A. P., Wang, Y. & Alhazmi, M. Hybrid energy storage for dairy farms: enhancing energy efficiency and operational resilience. J. Energy Storage 114, 115811 (2025).

    Google Scholar 

  6. Zhao, A. P. et al. Hydrogen as the nexus of future sustainable transport and energy systems. Nat. Rev. Electr. Eng. 2025, 1–20 (2025).

    Google Scholar 

  7. Liang, H., Zhang, Z., Hu, C., Gong, Y. & Cheng, D. A survey on spatio-temporal big data analytics ecosystem: resource management, processing platform, and applications. IEEE Trans. Big Data 10(2), 174–193 (2023).

    Google Scholar 

  8. Hady, M. A., Hu, S., Pratama, M., Cao, Z. & Kowalczyk, R. Multi-agent reinforcement learning for resources allocation optimization: a survey. Artif. Intell. Rev. 58(11), 354 (2025).

    Google Scholar 

  9. Choppara, P. & Mangalampalli, S. S. Resource adaptive automated task scheduling using deep deterministic policy gradient in fog computing. IEEE Access 2025, 256 (2025).

    Google Scholar 

  10. Li, T. T. et al. Integrating solar-powered electric vehicles into sustainable energy systems. Nat. Rev. Electr. Eng. 2025, 256. https://doi.org/10.1038/s44287-025-00181-7 (2025).

    Google Scholar 

  11. Zhao, A. P. et al. AI for science: covert cyberattacks on energy storage systems. J. Energy Storage 99, 112835. https://doi.org/10.1016/j.est.2024.112835 (2024).

    Google Scholar 

  12. El Maghraoui, A. et al. Revolutionizing smart grid-ready management systems: a holistic framework for optimal grid reliability. Sustain. Energy Grids Netw. 39, 101452 (2024).

    Google Scholar 

  13. Mohammadi, M. & Mohammadi, A. Empowering distributed solutions in renewable energy systems and grid optimization. In Distributed Machine Learning and Computing: Theory and Applications 141–155 (Springer, 2024).

  14. Michailidis, P., Michailidis, I. & Kosmatopoulos, E. Reinforcement learning for optimizing renewable energy utilization in buildings: a review on applications and innovations. Energies 18(7), 1724 (2025).

    Google Scholar 

  15. Li, P., Gu, C., Cheng, X., Li, J. & Alhazmi, M. Integrated energy-water systems for community-level flexibility: a hybrid deep Q-network and multi-objective optimization framework. Energy Rep. 13, 4813–4826. https://doi.org/10.1016/j.egyr.2025.03.059 (2025).

    Google Scholar 

  16. Gurbuz, F. B., Karaki, A., Karaki, A., Demirbas, S. & Bayhan, S. Model-free reinforcement learning in microgrid control: a review. IEEE Access 2025, 256 (2025).

    Google Scholar 

  17. Fose, N., Singh, A. R., Krishnamurthy, S., Ratshitanga, M. & Moodley, P. Empowering distribution system operators: a review of distributed energy resource forecasting techniques. Heliyon 10, 15 (2024).

    Google Scholar 

  18. Mannan, M. et al. Recent development of grid-connected microgrid scheduling controllers for sustainable energy: a bibliometric analysis and future directions. IEEE Access 12, 90606–90628 (2024).

    Google Scholar 

  19. Juma, S. A., Ayeng’o, S. P. & Kimambo, C. Z. A review of control strategies for optimized microgrid operations. IET Renew. Power Gener. 18(14), 2785–2818 (2024).

    Google Scholar 

  20. Jia, X., Dong, X., Wang, C., Yang, M. & Lu, T. Decentralized power transfer limit calculation method considering spatial and seasonal differences of ambient factors. J. Modern Power Syst. Clean Energy 13(6), 1955–1965 (2025).

    Google Scholar 

  21. Manogna, R., Dharmaji, V. & Sarang, S. Enhancing agricultural commodity price forecasting with deep learning. Sci. Rep. 15(1), 20903 (2025).

    Google Scholar 

  22. Haq, I. U., Kumar, A. & Rathore, P. S. Machine learning approaches for wind power forecasting: a comprehensive review. Discover Appl. Sci. 7(10), 1139 (2025).

    Google Scholar 

  23. Li, P., Shen, Y., Shang, Y. & Alhazmi, M. Innovative distribution network design using GAN-based distributionally robust optimization for DG planning. IET Gener. Transm. Distrib. 19(1), e13350 (2025).

    Google Scholar 

  24. Liu, M. et al. Enhancing cyber-resiliency of der-based smart grid: a survey. IEEE Trans. Smart Grid 15(5), 4998–5030 (2024).

    Google Scholar 

  25. Thallapally, P. & Panda, D. An aggregator-based market modelling with an impact of risk under uncertainty. IEEE Lat. Am. Trans. 23(5), 415–426 (2025).

    Google Scholar 

  26. Yan, J., Shi, X., Guo, L., Wan, Y. & Wen, G. Distributed proximal alternating direction method of multipliers for constrained composite optimization over directed networks. IEEE Trans. Signal Inf. Process. Netw. 10, 539–551 (2024).

    Google Scholar 

  27. Jia, X. et al. Coordinated operation of multi-energy microgrids considering green hydrogen and congestion management via a safe policy learning approach. Appl. Energy 401, 126611 (2025).

    Google Scholar 

Download references

Funding

This work was supported by the 2025 Science and Technology Project of State Grid Henan Electric Power Company (5217L0250006).

Author information

Authors and Affiliations

  1. State Grid Henan Electric Power Company Economic and Technology Research Institute, Zhengzhou, China

    Yongle Zheng, Huixuan Li, Shiqian Wang, Xiaoliang Jiang, Peng Li & Hongkai Zhang

  2. North China Electric Power University, Beijing, China

    Zhongfu Tan & Yijun Jiang

Authors
  1. Yongle Zheng
    View author publications

    Search author on:PubMed Google Scholar

  2. Huixuan Li
    View author publications

    Search author on:PubMed Google Scholar

  3. Shiqian Wang
    View author publications

    Search author on:PubMed Google Scholar

  4. Zhongfu Tan
    View author publications

    Search author on:PubMed Google Scholar

  5. Xiaoliang Jiang
    View author publications

    Search author on:PubMed Google Scholar

  6. Peng Li
    View author publications

    Search author on:PubMed Google Scholar

  7. Yijun Jiang
    View author publications

    Search author on:PubMed Google Scholar

  8. Hongkai Zhang
    View author publications

    Search author on:PubMed Google Scholar

Contributions

Yongle Zheng conceived the study, designed the overall Deep-DRO framework, and supervised the methodological development and system modeling. Huixuan Li developed the deep learning modules, including the GNN–Transformer hybrid forecasting model, and contributed to the uncertainty analysis and data preprocessing. Shiqian Wang implemented the hierarchical multi-agent reinforcement learning architecture and carried out the training, convergence analysis, and robustness evaluation. Zhongfu Tan contributed to the mathematical formulation of the distributionally robust optimization layer and supported theoretical validation and sensitivity studies. Xiaoliang Jiang conducted the case studies, prepared simulation datasets, and performed comparative experiments across Baseline, Stochastic, DRO, and Deep-DRO models. Peng Li assisted in the design of numerical experiments, result interpretation, and the development of reliability and emission-related performance indicators. Yijun Jiang (corresponding author) coordinated the project, refined the optimization strategy, guided the integration of learning modules with robust optimization, and provided overall technical supervision. Hongkai Zhang contributed to manuscript writing, figure preparation, and revisions, and supported the interpretation of technical findings and their practical implications. All authors reviewed and approved the final manuscript.

Corresponding author

Correspondence to Yijun Jiang.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zheng, Y., Li, H., Wang, S. et al. Multi-agent coordination and uncertainty adaptation in deep learning–assisted hierarchical optimization for renewable-dominated distribution networks. Sci Rep (2026). https://doi.org/10.1038/s41598-026-35945-0

Download citation

  • Received: 19 November 2025

  • Accepted: 09 January 2026

  • Published: 13 January 2026

  • DOI: https://doi.org/10.1038/s41598-026-35945-0

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Download PDF

Associated content

Collection

Microgrid Design and Optimization

Advertisement

Explore content

  • Research articles
  • News & Comment
  • Collections
  • Subjects
  • Follow us on Facebook
  • Follow us on Twitter
  • Sign up for alerts
  • RSS feed

About the journal

  • About Scientific Reports
  • Contact
  • Journal policies
  • Guide to referees
  • Calls for Papers
  • Editor's Choice
  • Journal highlights
  • Open Access Fees and Funding

Publish with us

  • For authors
  • Language editing services
  • Open access funding
  • Submit manuscript

Search

Advanced search

Quick links

  • Explore articles by subject
  • Find a job
  • Guide to authors
  • Editorial policies

Scientific Reports (Sci Rep)

ISSN 2045-2322 (online)

nature.com sitemap

About Nature Portfolio

  • About us
  • Press releases
  • Press office
  • Contact us

Discover content

  • Journals A-Z
  • Articles by subject
  • protocols.io
  • Nature Index

Publishing policies

  • Nature portfolio policies
  • Open access

Author & Researcher services

  • Reprints & permissions
  • Research data
  • Language editing
  • Scientific editing
  • Nature Masterclasses
  • Research Solutions

Libraries & institutions

  • Librarian service & tools
  • Librarian portal
  • Open research
  • Recommend to library

Advertising & partnerships

  • Advertising
  • Partnerships & Services
  • Media kits
  • Branded content

Professional development

  • Nature Awards
  • Nature Careers
  • Nature Conferences

Regional websites

  • Nature Africa
  • Nature China
  • Nature India
  • Nature Japan
  • Nature Middle East
  • Privacy Policy
  • Use of cookies
  • Legal notice
  • Accessibility statement
  • Terms & Conditions
  • Your US state privacy rights
Springer Nature

© 2026 Springer Nature Limited

Nature Briefing AI and Robotics

Sign up for the Nature Briefing: AI and Robotics newsletter — what matters in AI and robotics research, free to your inbox weekly.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing: AI and Robotics