Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Article
  • Published:

A neuromorphic imager based on a cascaded optoelectronic synapse

Abstract

The human retina can provide inspiration for the development of optoelectronic devices for artificial vision systems. It has, in particular, a curved geometry for low optical aberration imaging and is capable of signal preprocessing, in part due to its high synaptic facilitation. However, it remains challenging to create artificial synaptic devices with mechanical softness, curvilinear form factors and superior synaptic facilitation. Here we report a cascaded two-stage optoelectronic synapse that uses silicon photovoltaic cells to modulate sodium-alginate-gated synaptic transistors. The photovoltaic cells and an electric double-layer capacitor convert the initial light signal into a gate voltage (stage one), which then controls the postsynaptic current in the channel of the synaptic transistor (stage two). This cascaded synaptic signal transmission mechanism results in high synaptic facilitation of the postsynaptic signal. The system exhibits stable and long-term linearly potentiated characteristics, enhancing the accuracy of pattern recognition. We use an array of the cascaded optoelectronic synapses to create a curvy, kirigami-structured neuromorphic imager, which mimics the curved geometry and neural signal transmission of the human retina and provides visual information sensing and preprocessing functions.

This is a preview of subscription content, access via your institution

Access options

Buy this article

USD 39.95

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Overview and working principle of the cascaded optoelectronic synapse.
Fig. 2: Device structure and electrical characteristics of the EDL synaptic transistor.
Fig. 3: Cascaded optoelectronic synapse.
Fig. 4: Linearly potentiated synaptic plasticity for neuromorphic computing.
Fig. 5: Curvy neuromorphic imager.

Similar content being viewed by others

Data availability

The data that support the findings of this study or additional data related to this paper are available from the authors upon request.

References

  1. Rim, S.-B., Catrysse, P. B., Dinyari, R., Huang, K. & Peumans, P. The optical advantages of curved focal plane arrays. Opt. Express 16, 4965–4971 (2008).

    Article  Google Scholar 

  2. Choi, C. et al. Human eye-inspired soft optoelectronic device using high-density MoS2-graphene curved image sensor array. Nat. Commun. 8, 1664 (2017).

    Article  Google Scholar 

  3. Ko, H. C. et al. A hemispherical electronic eye camera based on compressible silicon optoelectronics. Nature 454, 748–753 (2008).

    Article  Google Scholar 

  4. Kim, M. et al. Cuttlefish eye–inspired artificial vision for high-quality imaging under uneven illumination conditions. Sci. Robot. 8, eade4698 (2023).

    Article  Google Scholar 

  5. Gu, L. et al. A biomimetic eye with a hemispherical perovskite nanowire array retina. Nature 581, 278–282 (2020).

    Article  Google Scholar 

  6. Zhang, K. et al. Origami silicon optoelectronics for hemispherical electronic eye systems. Nat. Commun. 8, 1782 (2017).

    Article  Google Scholar 

  7. Wässle, H. Parallel processing in the mammalian retina. Nat. Rev. Neurosci. 5, 747–757 (2004).

    Article  Google Scholar 

  8. Choi, C. et al. Curved neuromorphic image sensor array using a MoS2-organic heterostructure inspired by the human visual recognition system. Nat. Commun. 11, 5934 (2020).

    Article  Google Scholar 

  9. Hu, Y. et al. Ultralow power optical synapses based on MoS2 layers by indium-induced surface charge doping for biomimetic eyes. Adv. Mater. 33, 2104960 (2021).

    Article  Google Scholar 

  10. Buonomano, D. V. Decoding temporal information: a model based on short-term synaptic plasticity. J. Neurosci. 20, 1129–1141 (2000).

    Article  Google Scholar 

  11. Guo, P., Jia, M., Guo, D., Wang, Z. L. & Zhai, J. Retina-inspired in-sensor broadband image preprocessing for accurate recognition via the flexophototronic effect. Matter 6, 537–553 (2023).

    Article  Google Scholar 

  12. Kim, M. S. et al. Bio-inspired artificial vision and neuromorphic image processing devices. Adv. Mater. Technol. 7, 2100144 (2022).

    Article  Google Scholar 

  13. Buonomano, D. V. & Maass, W. State-dependent computations: spatiotemporal processing in cortical networks. Nat. Rev. Neurosci. 10, 113–125 (2009).

    Article  Google Scholar 

  14. Yedutenko, M., Howlett, M. H. C. & Kamermans, M. High contrast allows the retina to compute more than just contrast. Front. Cell. Neurosci. https://doi.org/10.3389/fncel.2020.595193 (2021).

  15. Han, C. et al. Light-stimulated synaptic transistor with high PPF feature for artificial visual perception system application. Adv. Funct. Mater. 32, 2113053 (2022).

    Article  Google Scholar 

  16. Wen, S., Li, J., Wang, Z., Zhang, Z. & Zhang, J. Low-power and high PPF feature synaptic transistors with 3D interface based on SnO2 nanofibers for neuromorphic application. Appl. Phys. Lett. 123, 043503 (2023).

    Article  Google Scholar 

  17. Jackman, S. L. & Regehr, W. G. The mechanisms and functions of synaptic facilitation. Neuron 94, 447–464 (2017).

    Article  Google Scholar 

  18. Wang, Y. et al. Photonic synapses based on inorganic perovskite quantum dots for neuromorphic computing. Adv. Mater. 30, 1802883 (2018).

    Article  Google Scholar 

  19. Park, H.-L. et al. Retina-inspired carbon nitride-based photonic synapses for selective detection of UV light. Adv. Mater. 32, 1906899 (2020).

    Article  Google Scholar 

  20. Zhao, Y. et al. Two-terminal photonic neuromorphic devices with short/long-term plasticity based on interface charge effects. Org. Electron. 83, 105749 (2020).

    Article  Google Scholar 

  21. Xiao, W. et al. High photosensitivity light-controlled planar ZnO artificial synapse for neuromorphic computing. Nanoscale 13, 2502–2510 (2021).

    Article  Google Scholar 

  22. Wu, S. M. Synaptic organization of the vertebrate retina: general principles and species-specific variations: the Friedenwald Lecture. Investig. Ophthalmol. Vis. Sci. 51, 1264–1274 (2010).

    Article  Google Scholar 

  23. Shiells, R. & Falk, G. Signal transduction in retinal bipolar cells. Prog. Retin. Eye Res. 14, 223–247 (1995).

    Article  Google Scholar 

  24. Liu, Y. H., Qiang Zhu, L., Shi, Y. & Wan, Q. Proton conducting sodium alginate electrolyte laterally coupled low-voltage oxide-based transistors. Appl. Phys. Lett. 104, 133504 (2014).

    Article  Google Scholar 

  25. He, Y., Yang, Y., Nie, S., Liu, R. & Wan, Q. Electric-double-layer transistors for synaptic devices and neuromorphic systems. J. Mater. Chem. C 6, 5336–5352 (2018).

    Article  Google Scholar 

  26. Zhu, L. Q., Wan, C. J., Guo, L. Q., Shi, Y. & Wan, Q. Artificial synapse network on inorganic proton conductor for neuromorphic systems. Nat. Commun. 5, 3158 (2014).

    Article  Google Scholar 

  27. Liu, Y., Wan, X., Zhu, L. Q., Shi, Y. & Wan, Q. Laterally coupled dual-gate oxide-based transistors on sodium alginate electrolytes. IEEE Electron Device Lett. 35, 1257–1259 (2014).

    Article  Google Scholar 

  28. Yu, F. et al. Chitosan-based polysaccharide-gated flexible indium tin oxide synaptic transistor with learning abilities. ACS Appl. Mater. Interfaces 10, 16881–16886 (2018).

    Article  Google Scholar 

  29. Meitl, M. A. et al. Transfer printing by kinetic control of adhesion to an elastomeric stamp. Nat. Mater. 5, 33–38 (2006).

    Article  Google Scholar 

  30. Sim, K. et al. Metal oxide semiconductor nanomembrane–based soft unnoticeable multifunctional electronics for wearable human-machine interfaces. Sci. Adv. 5, eaav9653 (2019).

    Article  Google Scholar 

  31. Rim, Y. S. et al. Direct light pattern integration of low-temperature solution-processed all-oxide flexible electronics. ACS Nano 8, 9680–9686 (2014).

    Article  Google Scholar 

  32. Yang, C.-S. et al. All-solid-state synaptic transistor with ultralow conductance for neuromorphic computing. Adv. Funct. Mater. 28, 1804170 (2018).

    Article  Google Scholar 

  33. Seo, S. et al. Artificial optic-neural synapse for colored and color-mixed pattern recognition. Nat. Commun. 9, 5106 (2018).

    Article  Google Scholar 

  34. Sun, J. et al. Optoelectronic synapse based on IGZO-alkylated graphene oxide hybrid structure. Adv. Funct. Mater. 28, 1804397 (2018).

    Article  Google Scholar 

  35. Fuller, E. J. et al. Li-ion synaptic transistor for low power analog computing. Adv. Mater. 29, 1604310 (2017).

    Article  Google Scholar 

  36. Guenter, B. et al. Highly curved image sensors: a practical approach for improved optical performance. Opt. Express 25, 13010–13023 (2017).

    Article  Google Scholar 

  37. Jung, I. et al. Dynamically tunable hemispherical electronic eye camera system with adjustable zoom capability. Proc. Natl Acad. Sci. USA 108, 1788–1793 (2011).

    Article  Google Scholar 

  38. Rao, Z. et al. Curvy, shape-adaptive imagers based on printed optoelectronic pixels with a kirigami design. Nat. Electron. 4, 513–521 (2021).

    Article  Google Scholar 

  39. Hong, Y. et al. Boundary curvature guided programmable shape-morphing kirigami sheets. Nat. Commun. 13, 530 (2022).

    Article  Google Scholar 

  40. Choi, G. P. T., Dudte, L. H. & Mahadevan, L. Programming shape using kirigami tessellations. Nat. Mater. 18, 999–1004 (2019).

    Article  Google Scholar 

  41. Celli, P. et al. Shape-morphing architected sheets with non-periodic cut patterns. Soft Matter 14, 9744–9749 (2018).

    Article  Google Scholar 

  42. Sim, K. et al. Three-dimensional curvy electronics created using conformal additive stamp printing. Nat. Electron. 2, 471–479 (2019).

    Article  Google Scholar 

Download references

Acknowledgements

C.Y. gives thanks for the financial support from the National Science Foundation (CAREER Grant No. 2224645, ECCS Grant No. 1509763 and CPS Grant No. 2227062) and the Office of Naval Research Young Investigator Program (Grant No. N00014-18-1-2338).

Author information

Authors and Affiliations

Authors

Contributions

Y.L. and C.Y. conceived the study and designed the research. Y.L., Z.R. and H.S. performed the experiments. Y.L., H.S., Y.M.S., Z.F., C.G. and C.Y. analysed the data. Y.L. and H.S. performed the simulation. Y.L., Z.R., H.S. and C.Y. wrote the paper. All the authors revised the paper.

Corresponding author

Correspondence to Cunjiang Yu.

Ethics declarations

Competing interests

The authors declare no competing interests.

Peer review

Peer review information

Nature Electronics thanks Huipeng Chen, Changsoon Choi and Nazek El-Atab for their contribution to the peer review of this work.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary Information

Supplementary Note, Table 1 and Figs. 1–21.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, Y., Rao, Z., Shim, H. et al. A neuromorphic imager based on a cascaded optoelectronic synapse. Nat Electron (2026). https://doi.org/10.1038/s41928-025-01540-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Version of record:

  • DOI: https://doi.org/10.1038/s41928-025-01540-w

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing