Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Advertisement

Nature Communications
  • View all journals
  • Search
  • My Account Login
  • Content Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • RSS feed
  1. nature
  2. nature communications
  3. articles
  4. article
Extreme Illuminated Vision Processing with a Graded Alloyed Perovskite In-sensor Computing Network
Download PDF
Download PDF
  • Article
  • Open access
  • Published: 10 April 2026

Extreme Illuminated Vision Processing with a Graded Alloyed Perovskite In-sensor Computing Network

  • Zhenye Zhan1,2 na1,
  • Yueheng Lu1 na1,
  • Yongjian Zheng1,
  • Nana Pang1,
  • Yujian Zheng1,
  • Dongxu Lin3,
  • Huanyong Li  ORCID: orcid.org/0000-0003-3932-35394,
  • Wen Li4,
  • Jian Chen5,
  • Tingting Shi1,
  • Xiaomu Wang  ORCID: orcid.org/0000-0001-8975-56262,6 &
  • …
  • Weiguang Xie  ORCID: orcid.org/0000-0002-3706-63591 

Nature Communications (2026) Cite this article

  • 3349 Accesses

  • Metrics details

We are providing an unedited version of this manuscript to give early access to its findings. Before final publication, the manuscript will undergo further editing. Please note there may be errors present which affect the content, and all legal disclaimers apply.

Subjects

  • Optical materials and structures
  • Sensors
  • Sensors and biosensors

Abstract

In-sensor computing is proposed to reduce energy expenditure and processing latency by unifying sensing and computation within the hardware layer, yet the application under extreme illuminating scenario remains constrained by simultaneously obtaining broadband responsivity, large linear dynamic range and fast response. Here, we report a fully vapor-deposited graded Pb-Sn alloyed perovskite heterojunction photodiode with improved crystal quality. It enables the detection of light from visible to infrared light with a 230 dB linear dynamic range and 33 ns response time. We also develop a wafer-scale imaging processor by integrating the photodiode to a reconfigurable array. With this approach, we demonstrate biomedical detection and spatiotemporal trajectory encoding. The in-sensor processor realizes low-power high-resolution visible to infrared wavelength edge detection, adaptive background suppression under dim light and noise-immune high-speed dynamic imaging. Our results extend the options for in-sensor computing hardware, and thus pave a way toward practical artificial intelligent machine vision.

Similar content being viewed by others

Day-Night imaging without Infrared Cutfilter removal based on metal-gradient perovskite single crystal photodetector

Article Open access 30 August 2024

A monolithically integrated near-infrared imager with crystallization- and oxidation-modulated tin-lead perovskites

Article Open access 04 September 2025

Ultraweak light-modulated heterostructure with bidirectional photoresponse for static and dynamic image perception

Article Open access 30 November 2024

Data availability

The source data that support the plots within this paper are provided with this paper. Other data that support the findings of this paper are available from the corresponding author upon request. Source data are provided with this paper.

Code availability

The codes used for LSTM network training are available from the corresponding authors upon request.

References

  1. Wan, T. et al. In-sensor computing: materials, devices, and integration technologies. Adv. Mater. 35, e2203830 (2023).

    Google Scholar 

  2. Sangwan, V. K. & Hersam, M. C. Neuromorphic nanoelectronic materials. Nat. Nanotechnol. 15, 517–528 (2020).

    Google Scholar 

  3. Cho, S. W., Jo, C., Kim, Y.-H. & Park, S. K. Progress of materials and devices for neuromorphic vision sensors. Nano-Micro Lett. 14, 203 (2022).

    Google Scholar 

  4. Zhou, F. & Chai, Y. Near-sensor and in-sensor computing. Nat. Electron. 3, 664–671 (2020).

    Google Scholar 

  5. Xiong, Z. et al. Parallelizing analog in-sensor visual processing with arrays of gate-tunable silicon photodetectors. Nat. Commun. 16, 4728 (2025).

    Google Scholar 

  6. Li, T. et al. Reconfigurable, non-volatile neuromorphic photovoltaics. Nat. Nanotechnol. 18, 1303–1310 (2023).

    Google Scholar 

  7. Cui, B. et al. Ferroelectric photosensor network: an advanced hardware solution to real-time machine vision. Nat. Commun. 13, 2022 (1707).

    Google Scholar 

  8. Cai, Y. et al. 8-bit states in 2D floating-gate memories using gate-injection mode for large-scale convolutional neural networks. Nat. Commun. 16, 2649 (2025).

    Google Scholar 

  9. Ouyang, B. et al. Bioinspired in-sensor spectral adaptation for perceiving spectrally distinctive features. Nat. Electron. 7, 705–713 (2024).

    Google Scholar 

  10. Pan, X. et al. Parallel perception of visual motion using light-tunable memory matrix. Sci. Adv. 9, eadi4083 (2023).

    Google Scholar 

  11. Mennel, L. et al. Ultrafast machine vision with 2D material neural network image sensors. Nature 579, 62–66 (2020).

    Google Scholar 

  12. Pi, L. et al. Broadband convolutional processing using band-alignment-tunable heterostructures. Nat. Electron. 5, 248–254 (2022).

    Google Scholar 

  13. Huang, H. et al. In-sensor compressing via programmable optoelectronic sensors based on van der Waals heterostructures for intelligent machine vision. Nat. Commun. 16, 3836 (2025).

  14. Jiang, T. et al. Tetrachromatic vision-inspired neuromorphic sensors with ultraweak ultraviolet detection. Nat. Commun. 14, 2281 (2023).

    Google Scholar 

  15. Jang, H. et al. In-sensor optoelectronic computing using electrostatically doped silicon. Nat. Electron. 5, 519–525 (2022).

    Google Scholar 

  16. Zhou, S. et al. Dual-mode photodetectors mimicking retinal rod and cone cells for high dynamic range image sensor. Laser Photonics Rev. 19, 2402192 (2025).

  17. Liao, F. et al. Bioinspired in-sensor visual adaptation for accurate perception. Nat. Electron. 5, 84–91 (2022).

    Google Scholar 

  18. Morteza Najarian, A. et al. Sub-millimetre light detection and ranging using perovskites. Nat. Electron. 5, 511–518 (2022).

    Google Scholar 

  19. Zhou, Y. et al. Self-powered perovskite photon-counting detectors. Nature 616, 712–718 (2023).

    Google Scholar 

  20. Tsarev, S. et al. Vertically stacked monolithic perovskite colour photodetectors. Nature 642, 592–598 (2025).

    Google Scholar 

  21. Ollearo, R. et al. Ultralow dark current in near-infrared perovskite photodiodes by reducing charge injection and interfacial charge generation. Nat. Commun. 12, 7277 (2021).

    Google Scholar 

  22. Ma, Y. et al. Day-Night imaging without Infrared Cutfilter removal based on metal-gradient perovskite single crystal photodetector. Nat. Commun. 15, 7516 (2024).

    Google Scholar 

  23. Im, J., Stoumpos, C. C., Jin, H., Freeman, A. J. & Kanatzidis, M. G. Antagonism between spin–orbit coupling and steric effects causes anomalous band gap evolution in the perovskite photovoltaic materials CH3NH3Sn1–xPbxI3. J. Phys. Chem. Lett. 6, 3503–3509 (2015).

    Google Scholar 

  24. Reo, Y. et al. Vapour-deposited high-performance tin perovskite transistors. Nat. Electron. 8, 403–410 (2025).

  25. Chen, X. et al. Improved conductivity of 2D perovskite capping layer for realizing high-performance 3D/2D heterostructured hole transport layer-free perovskite photovoltaics. ACS Nano 19, 4299–4308 (2025).

    Google Scholar 

  26. Ortiz-Cervantes, C., Román-Román, P. I., Vazquez-Chavez, J., Hernández-Rodríguez, M. & Solis-Ibarra, D. Thousand-fold conductivity increase in 2D perovskites by polydiacetylene incorporation and doping. Angew. Chem. Int. Ed. Engl. 130, 14078–14082 (2018).

    Google Scholar 

  27. Xu, P. & Liu, F. First-principles investigation on the photovoltaic properties of lead free earth abundant (CH3NH3)2SnI6 perovskite. J. Appl. Phys. 129, 125701 (2021).

  28. Funabiki, F., Toda, Y. & Hosono, H. Optical and electrical properties of perovskite variant (CH3NH3)2SnI6. J. Phys. Chem. C 122, 10749–10754 (2018).

    Google Scholar 

  29. Derbel, N. & Kanoun, O. (eds.). Advanced Methods for Human Biometrics (Springer, Cham, 2021).

  30. FAULDS, H. Poroscopy: the Scrutiny of Sweat-pores for Identification. Nature 91, 635–636 (1913).

    Google Scholar 

  31. Sheng, W., Zheng, Z. & Zhu, H. A novel approach to palm vein image segmentation combining multi-scale convolution and swin-transformer networks. Sci. Rep. 15, 17539 (2025).

    Google Scholar 

  32. Ren, H., Sun, L., Fan, X., Cao, Y. & Ye, Q. IIS-FVIQA: finger vein image quality assessment with intra-class and inter-class similarity. Pattern Recognit. 158, 111056 (2025).

    Google Scholar 

  33. Hou, B., Zhang, H. & Yan, R. Finger-vein biometric recognition: a review. IEEE Trans. Instrum. Meas. 71, 1–26 (2022).

    Google Scholar 

  34. Kim, H.-L. & Kim, S.-H. Pulse wave velocity in atherosclerosis. Front. Cardiovasc. Med. 6, 41 (2019).

    Google Scholar 

  35. Pereira, T., Correia, C. & Cardoso, J. Novel methods for pulse wave velocity measurement. J. Med. Biol. Eng. 35, 555–565 (2015).

    Google Scholar 

  36. McCombie, D. B., Reisner, A. T. & Asada, H. H. Adaptive blood pressure estimation from wearable PPG sensors using peripheral artery pulse wave velocity measurements and multi-channel blind identification of local arterial dynamics. In 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, pp 3521–3524.

  37. PM, N., Karthik, S., Joseph, J. & Sivaprakasam, M. Experimental validation of dual PPG local pulse wave velocity probe. In IEEE International Symposium on Medical Measurements and Applications (MeMeA). pp 408–413 (2017).

  38. Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735–1780 (1997).

    Google Scholar 

  39. van Houdt, G., Mosquera, C. & Nápoles, G. A review on the long short-term memory model. Artif. Intell. Rev. 53, 5929–5955 (2020).

    Google Scholar 

  40. Baker, M. A. et al. Femtosecond laser ablation (fs-LA) XPS—a novel XPS depth profiling technique for thin films, coatings and multi-layered structures. Appl. Surf. Sci. 654, 159405 (2024).

    Google Scholar 

  41. Chandler, C. W. et al. Femtosecond laser ablation (fs-LA) XPS depth profiling of lead halide perovskite thin film solar cells. Surf. Interface Anal. 57, 246–252 (2025).

    Google Scholar 

  42. Fang, Y., Armin, A., Meredith, P. & Huang, J. Accurate characterization of next-generation thin-film photodetectors. Nat. Photon. 13, 1–4 (2019).

    Google Scholar 

  43. Pecunia, V. et al. Guidelines for accurate evaluation of photodetectors based on emerging semiconductor technologies. Nat. Photon. 19, 1178–1188 (2025).

    Google Scholar 

Download references

Acknowledgements

This work was financially supported by the National Natural Science Foundation of China (Grant Nos. 62325404 and 62174072) and the National Key Research and Development Program of China (Grant No. 2022YFA1203500). The authors are very grateful to Dr. Qingqin Ge and Dr. Paul Mack at Thermo Fisher Scientific (China) Co., Ltd. for the XPS measurements and the helpful discussions. The authors gratefully acknowledge the assistance of Lin Wang from the Analytical and Testing Center of Jinan University for the XPS analysis.

Author information

Author notes
  1. These authors contributed equally: Zhenye Zhan, Yueheng Lu.

Authors and Affiliations

  1. Guangdong Provincial Engineering Technology Research Center of Vacuum Coating Technologies and New Energy Materials, Department of Physics, Jinan University, Guangzhou, China

    Zhenye Zhan, Yueheng Lu, Yongjian Zheng, Nana Pang, Yujian Zheng, Tingting Shi & Weiguang Xie

  2. School of Optics and Photonics, Beijing Institute of Technology, Beijing, China

    Zhenye Zhan & Xiaomu Wang

  3. Aerospace and Informatics Domain, Beijing Institute of Technology, Zhuhai, China

    Dongxu Lin

  4. Analytical and Testing Center of Jinan University, Guangzhou, China

    Huanyong Li & Wen Li

  5. Instrumental Analysis & Research Center, Sun Yat-Sen University, Guangzhou, China

    Jian Chen

  6. School of Electronic Science and Engineering, Nanjing University, Nanjing, China

    Xiaomu Wang

Authors
  1. Zhenye Zhan
    View author publications

    Search author on:PubMed Google Scholar

  2. Yueheng Lu
    View author publications

    Search author on:PubMed Google Scholar

  3. Yongjian Zheng
    View author publications

    Search author on:PubMed Google Scholar

  4. Nana Pang
    View author publications

    Search author on:PubMed Google Scholar

  5. Yujian Zheng
    View author publications

    Search author on:PubMed Google Scholar

  6. Dongxu Lin
    View author publications

    Search author on:PubMed Google Scholar

  7. Huanyong Li
    View author publications

    Search author on:PubMed Google Scholar

  8. Wen Li
    View author publications

    Search author on:PubMed Google Scholar

  9. Jian Chen
    View author publications

    Search author on:PubMed Google Scholar

  10. Tingting Shi
    View author publications

    Search author on:PubMed Google Scholar

  11. Xiaomu Wang
    View author publications

    Search author on:PubMed Google Scholar

  12. Weiguang Xie
    View author publications

    Search author on:PubMed Google Scholar

Contributions

Z.Z. and W.X. conceived the concept. T.S., W.X., and X.W. supervised the project. Z.Z. designed, fabricated, and measured the devices and circuits. Y.L. characterized the films, and W.L. conducted the XPS characterization. Z.Z. and Y.L. developed the imaging system and motion trajectory experimental platform. Y.Z. (Yongjian Zheng), N.P., Y.Z. (Yujian Zheng), D.L., H.L., and J.C. analyzed the data. Z.Z., T.S., X.W., and W.X. wrote the paper. All the authors discussed the results and implications and reviewed the paper.

Corresponding authors

Correspondence to Tingting Shi, Xiaomu Wang or Weiguang Xie.

Ethics declarations

Competing interests

The authors declare no competing interests.

Peer review

Peer review information

Nature Communications thanks Su-Ting Han, Xiangyue Meng and Ye Zhou for their contribution to the peer review of this work. A peer review file is available.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary Information (download PDF )

Transparent Peer Review file (download PDF )

Source data

Source Data (download XLSX )

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhan, Z., Lu, Y., Zheng, Y. et al. Extreme Illuminated Vision Processing with a Graded Alloyed Perovskite In-sensor Computing Network. Nat Commun (2026). https://doi.org/10.1038/s41467-026-71638-y

Download citation

  • Received: 28 September 2025

  • Accepted: 24 March 2026

  • Published: 10 April 2026

  • DOI: https://doi.org/10.1038/s41467-026-71638-y

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Download PDF

Advertisement

Explore content

  • Research articles
  • Reviews & Analysis
  • News & Comment
  • Videos
  • Collections
  • Subjects
  • Follow us on Facebook
  • Follow us on X
  • Sign up for alerts
  • RSS feed

About the journal

  • Aims & Scope
  • Editors
  • Journal Information
  • Open Access Fees and Funding
  • Calls for Papers
  • Editorial Values Statement
  • Journal Metrics
  • Editors' Highlights
  • Contact
  • Editorial policies
  • Top Articles

Publish with us

  • For authors
  • For Reviewers
  • Language editing services
  • Open access funding
  • Submit manuscript

Search

Advanced search

Quick links

  • Explore articles by subject
  • Find a job
  • Guide to authors
  • Editorial policies

Nature Communications (Nat Commun)

ISSN 2041-1723 (online)

nature.com footer links

About Nature Portfolio

  • About us
  • Press releases
  • Press office
  • Contact us

Discover content

  • Journals A-Z
  • Articles by subject
  • protocols.io
  • Nature Index

Publishing policies

  • Nature portfolio policies
  • Open access

Author & Researcher services

  • Reprints & permissions
  • Research data
  • Language editing
  • Scientific editing
  • Nature Masterclasses
  • Research Solutions

Libraries & institutions

  • Librarian service & tools
  • Librarian portal
  • Open research
  • Recommend to library

Advertising & partnerships

  • Advertising
  • Partnerships & Services
  • Media kits
  • Branded content

Professional development

  • Nature Awards
  • Nature Careers
  • Nature Conferences

Regional websites

  • Nature Africa
  • Nature China
  • Nature India
  • Nature Japan
  • Nature Middle East
  • Privacy Policy
  • Use of cookies
  • Legal notice
  • Accessibility statement
  • Terms & Conditions
  • Your US state privacy rights
Springer Nature

© 2026 Springer Nature Limited

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing