Abstract
The next generation of smart imaging and vision systems will require compact and tunable optical computing hardware to perform high-speed and low-power image processing. These requirements are driving the development of computing metasurfaces to realize efficient front-end analog optical pre-processors, especially for edge detection capability. Yet, there is still a lack of reconfigurable or programmable schemes, which may drastically enhance the impact of these devices at the system level. Here, we propose and experimentally demonstrate a reconfigurable flat optical image processor using low-loss phase-change nonlocal metasurfaces. The metasurface is configured to realize different transfer functions in spatial frequency space, when transitioning the phase-change material between its amorphous and crystalline phases. This enables edge detection and bright field imaging modes on the same device. The metasurface is compatible with a large numerical aperture of ~0.5, making it suitable for high resolution coherent optical imaging microscopy. The concept of phase-change reconfigurable nonlocal metasurfaces may enable emerging applications of artificial intelligence-assisted imaging and vision devices with switchable multitasking.
Similar content being viewed by others
Introduction
In the past decade, convolution neural networks (CNNs), a class of deep learning models for artificial intelligence (AI), have been widely used to solve target classification and recognition problems, with applications ranging from image-based medical diagnostics to real-time object detection for self-driving vehicles1,2,3,4. Practically, convolution layers—the fundamental front-end building blocks in CNNs—are responsible for most of the energy consumption, mainly due to the numerous multiplication operations they need to perform, which also ultimately slows down the processing speed in conventional electronic processors. Using light as carriers to process information has been a long-term vision due to the lower latency, smaller loss, and larger data throughput. Problems like relatively large footprints and scale-up issues make full optical solutions challenging but part substitution by photonic devices at the front end of a system is a feasible way to push the boundary of this field. There has been substantial progress in developing photonic integrated circuits5,6, while alternatively free-space optics can manipulate input coherent light where two-dimensional information such as images is encoded directly, and process information without costly pre- and post-processing such as data vectorizations and electro-optical conversions. By operating directly in the spatial frequency space, these devices can also dramatically speed up computation and reduce energy consumption compared to digital matrix multipliers.
A traditional optical method to process information in the spatial frequency space is to use a 4-f system7, in which a lens transforms the spatial frequency space to the real space on the confocal plane and a spatially varying optical filter with position dependent transmittance is applied on that plane. Recently, metasurfaces have emerged as promising platforms in image processing. One class of metasurfaces is “local” metasurfaces8,9,10,11,12,13,14 that tailor the spatial wavefront by engineering the aperture response as a function of the spatial position. Directly using this as a spatially varying filter in a 4-f system is one option to implement spatial frequency modulation and image processing15 but the system will be bulky due to the long 4-f distance and limited by paraxial approximation. Engineering the point spread function of a metalens—a main class of local metasurfaces—is another way to implement spatial frequency modulation indirectly by doing convolution in real space directly without a 4-f system16,17,18, but it relies on precise optimization and control of spatially varied nanostructures’ geometry. In contrast, a “nonlocal” metasurface19,20,21,22,23,24,25,26, whose meta-atoms tailor the input wave collectively and result in real space invariant but spatial frequency space variant response, can directly modulate the Fourier component of light fields and can therefore be readily integrated into the front- and/or back-end of an optical system. This in turn leads to compact designs that can be easily incorporated into a range of optical systems. Moreover, unlike local metasurfaces, nonlocal metasurfaces possess geometrically uniform nanostructures, so are more compatible with facile and large-area nanofabrication approaches, such as interference photolithography and nanoimprint lithography. Due to these advantages, nonlocal metasurfaces are emerging as promising platforms to process information in the optical domain, with interesting applications such as image differentiators27,28,29,30,31, space squeezers32,33,34, light bullet generations35 and reciprocal lenses36 recently reported in the literature. However, such approaches so far have invariably used static metasurfaces that can perform a single function or processing task, limiting their impact and appeal for complex systems. Integrating multiple functionalities over a single nonlocal metasurface may bring significant processing advantages. In turn, this requires a nonlocal metasurface with capability for reconfiguration, which is the focus of the present work.
Very different from traditional local metasurfaces where the phase and amplitude response depend on meta-atoms locally and require individual control of meta-atoms, nonlocal metasurfaces have spatially uniform optical response, which makes globally switching metasurfaces enough to implement various functions. A reconfigurable nonlocal metasurface capable of image processing was recently proposed and demonstrated on a mechanical stretchable polydimethylsiloxane (PDMS) based platform37,38. Alternatively, phase-change materials (PCMs), the approach we use here, are good candidates to be applied for reconfigurable metasurfaces, due to their relatively large refractive index difference (Δn > 0.7) between their crystalline and amorphous states, and the non-volatility of such states, i.e., no energy consumption is required to remain in any particular state, although the switching operation itself consumes energy. Only recently have these materials been used to introduce reconfigurability in metasurfaces, such as focus-varied metalens39,40, beam steering devices41,42, filtering43 and more, raising significant interest in the area. The recent discovery of low-loss and lossless PCMs44 and the substantial progress in developing integrated heaters capable of in-situ switching of PCM layers and meta-atoms41,45,46,47,48, make them suitable for all-solid-state integrated meta-devices.
In this work, we theoretically propose and experimentally demonstrate a reconfigurable nonlocal metasurface made of Sb2Se3, an optical lossless PCM in the near-infrared region. This phase-change nonlocal metasurface showcases a different transfer function in the spatial frequency space when switched between its amorphous and crystalline phases, and, in the example demonstrated here, is able to perform edge detection and bright field imaging in the two distinct PCM phases. Our nonlocal metasurface is compatible with a numerical aperture (NA) of ~0.5, and an optical bandwidth of 50 nm corresponding to fractional bandwidth of 1/21 in theory, which enables applications in coherent optical imaging systems with high optical resolution. Furthermore, a dual-functionality coverslip based on the fabricated phase-change nonlocal metasurface (meta-coverslip) is demonstrated. The introduced concept of phase-change nonlocal metasurfaces may also enable all-solid-state dynamically tunable light modulators operating in the spatial frequency space.
Results
A three-dimensional (3D) schematic of our conceptual phase-change nonlocal metasurface is shown in Fig. 1a. The metasurface consists of arrayed PCM nanopillars on a transparent substrate. With the nanopillars in different phase-states (amorphous or crystalline), the metasurface performs different functions. Here, the input image’s edge is retrieved after light from the original image passes through the metasurface when the PCM is in the amorphous phase, i.e., edge detection mode, while no transformation happens when the PCM is in its crystalline phase, producing a bright field mode image. In this work, the nanopillars are realized by depositing and etching optically low-loss PCM Sb2Se3 on a sapphire substrate. The edge detection is implemented via a Laplacian operator in real space, which corresponds to a multiplication operator with a parabolic form in spatial frequency space (or called k-space below), while the bright field mode corresponds to a pass-through-type transformation (shown in Fig. 2b). Therefore, in order to implement a dual function nonlocal metasurface, the transfer function t(kx, ky) in k-space should be proportional to kx2+ky2 in the edge detection mode, while remaining flat (t(kx, ky)=1) in the bright field mode24. Our general method is to first design the metasurface working in one material phase in the edge detection mode which relies on a vertically oriented dipole resonance24,28 and associated quasi bound states in the continuum (BICs)49,50,51 to create a transmittance strongly dependent on incident angle, then to check whether transmittance is independent of incident angle in the other phase, so yielding the bright field mode. This requires the dipole resonance responsible for the incident angle dependent transmittance in the amorphous phase to shift far enough after the material crystallization such that the resonant bandwidth is fully off the working wavelength and the dependence on incident angle disappears. The large refractive index change of PCMs between the two phases makes the large resonance shift possible and helps to achieve the dual function image processing we desire.
a 3D illustration of the phase-change nonlocal metasurface performing the dual functions of edge detection in the amorphous phase and bright field imaging in the crystalline phase of Sb2Se3. b Schematic of the working principle of the metasurface in k-space, corresponding to the Fourier transform of the operation in real space
a Measured refractive index of Sb2Se3 in the amorphous and crystalline phase. b 3D model of a unit cell of the metasurface with the configuration of incident light. h = 300 nm, D = 350 nm, and P = 460 nm. c, d Simulated magnitude of transmissive coefficient spectra vs. incidence angle for the metasurface in the amorphous and the crystalline phase, where the azimuthal angle φ = 0°. e Representative SEM image of a fabricated metasurface. Scale bar: 2 μm. f, g Calculated and measured spatial frequency dependent transfer function of the metasurface in the amorphous (f) and crystalline phase (g) at the working wavelength of 1050 nm, corresponding to the dashed lines in (c) and (d)
Before optimizing the spatial frequency dependent (i.e. k-dependent) transmittance, we measured the complex refractive index of the amorphous and crystalline Sb2Se3 film using an ellipsometer. The measured results, shown in Fig. 2a, demonstrate that Sb2Se3 has low optical loss (imaginary part of the refractive index <0.1) at wavelengths above 1000 nm in either phase, and the change of the real part of the refractive index between the two phases can be as large as 0.7 to 1 in the near-infrared region. In turn, the resonant wavelengths of the nanopillars can shift significantly between the two phases, resulting in a large contrast of the transfer function, which gives opportunities to implement different functions on a device with the fixed geometry.
We first design the metasurface working for edge detection in the amorphous phase and then check if the transfer function in the crystalline phase satisfies the bright field mode. The 3D model of the nanopillar unit cell with the geometric parameters and the illumination configuration are shown in Fig. 2b. We simulated the transmissive coefficient spectra of a periodic array of Sb2Se3 nanopillars—with sizes and periodicity specifically optimized to deliver edge detection in the amorphous state and bright field imaging in the crystalline state—as a function of incident angle with varied incident polarization states and structural phases of Sb2Se3. Here the transmissive coefficient is defined by the square root of the diffractive efficiency of the 0th transmissive order. The diffraction efficiency of the metasurface was simulated by the rigorous coupled wave analysis (RCWA) method52. The simulated spectra exhibit a strong angle dependent contrast in the p-polarized incident state in the amorphous phase (Fig. 2c), which can be explained by the synergy of multiple resonances. The in-plane electric and magnetic dipole Mie resonances of the disks are close to each other in the spectrum at normal incidence, creating a broad band with almost zero transmittance from 980 nm to 1150 nm at normal incidence. With the increase of incidence angle, the Mie resonance induced spectral band is squeezed by the emergence of a nonlocal out-of-plane resonant mode. This mode is a symmetry-protected BIC, fully decoupled from free space at the Γ point, so it cannot be excited by normal incident light. At oblique incidence the symmetry is broken and the radiative decay significantly increases as the wave vector moves away from the Γ point, which leads to a quasi-BIC (q-BIC) mode coupled to the p-polarized oblique incident light, causing more transmission for high spatial frequencies. A detailed BIC mode analysis is shown in Supplementary Information (Note A). By contrast, there is not much change in the spectra with the increased incident angle in the crystalline phase, as shown in Fig. 2d. No significant change of transmittance as a function of the incident angle was observed in the s-polarization state for either phase of the material. From the simulations shown in Fig. 2c, d, the metasurface behaves as a high-pass filter in spatial frequency in the amorphous phase and works as an all-pass filter in the crystalline phase from 1030 to 1080 nm. Therefore, our dual function metasurface has 50 nm bandwidth in theory.
We fabricated the metasurface using conventional processes, including Sb2Se3 film sputtering, electron beam lithography (EBL), and reactive ion etching (RIE) (see Methods). The fabricated sample was finally characterized by scanning electron microscopy (SEM) and a representative captured image shows the high quality of the fabrication (Fig. 2e). To validate our design, we used a laser diode with emission wavelength of 1050 nm to measure the incident angle dependent the transfer function (Fig. 2f, g). The transfer function is defined as the magnitude of transmissive coefficient, i.e. square root of the intensity transmittance which can be directly measured. The measurement setup is described in Methods. A strong spatial frequency dependent transfer function was experimentally demonstrated for the amorphous phase and p-polarized incidence, which coincides well with the simulation results. The amplitude of the transfer function reaches 0.9 when kx/k0 approaches 0.5, which means that the edge detection mode is efficiently (81% = 0.92) compatible with an NA of 0.5. In the other cases (crystalline phase or s-polarization), the measured transfer function is not sensitive to the variation of the spatial frequency. The measured transmissive coefficient is a little higher than the simulated results in the amorphous phase for low transmittance. This could be attributed to the imperfect sample fabrication such as geometry uniformity and stitching errors inducing unwanted forward scattering but collected by the detector. This overestimation is further amplified on the plot by the square root when the transmittance is low. In the crystalline phase, the transfer function is flat as a function of spatial frequency, allowing us to image objects in bright field mode. There is an amplitude difference in the transmissive coefficient between measurements (0.35) and simulations (0.65) in the crystalline phase. We attribute this to scattering loss resulting from the increased non-uniformity/roughness of the crystallized metasurface, as commonly observed for phase-change films and shown for our case in Fig. S2. Additional characterization before and after crystallization can be found in Figs. S3, S4. Also see simulated transfer functions of diameter varied uniform metasurfaces in Fig. S5 and simulated transfer functions of disordered metasurfaces with the consideration of random profile changes in Fig. S6. At the technical level, it is possible to constrain the volume change and improve the uniformity by capping with a suitable dielectric layer around the nanopillar.
We numerically analyze the two-dimensional (2D) transfer function of our designed metasurface used for 2D image processing. We link the input electric field of the imaged object to the s- and p- polarized electric field components relative to the ground plane of the metasurface, and subsequently obtain the transfer function by introducing the simulated transmissive coefficients for s- and p- polarized incidence. The configuration of the input object and the metasurface is schematically shown in Fig. 3a. Starting from the linear polarized light, we denote Ein(x,y)u as the input electric field of the imaged object in real space, where u is the unit vector along the polarization direction. The input electric field in k-space is denoted by Fin(kx,ky)q(kx,ky), where Fin(kx,ky) is the Fourier transform of Ein(x,y) and q(kx,ky)=(k×u)×k/|k|2. Then we have the p- and s- polarized components: Ep(kx,ky)=Fin(kx,ky)q(kx,ky)∙ep and Es(kx,ky)=Fin(kx,ky)q(kx,ky)∙es, where es = (k×z)/|k| and ep =(k×es)/|k| when k is not parallel with z. For the special case of k//z, i.e. kx=ky = 0, we set es = 0 and ep = y (y and z are the unit vectors along the y and z direction, respectively). Hence, the output electric field Fout(kx,ky) after the metasurface in the k-space can be generally written as31
where the subscript p and s represents the p- and s-polarization, respectively. tpp, tps, tsp and tss are the transmissive coefficients of the metasurface from one incident polarization to another output polarization. For example, tps is the transmissive coefficient between the s-polarized incident light and the p-polarized transmitted light. The calculated amplitude of transmissive coefficients as the function of kx and ky in different phases are shown in Fig. 3b, c, g, h. In the amorphous phase, the amplitude of the co-polarization coefficient tpp significantly increases with the incident angle for all azimuthal angles and we could approximate it as a paraboloid described by kx2+ky2 in k-space ignoring the slight azimuthal anisotropy. The maxima were reached at the boundary of the k-space circle with values no less than 0.7. In contrast, tss is much lower than tpp within the circle of NA < 0.5 and goes to zero when φ approaches 0° and 90°, so we approximately treated it as zero. In the crystalline phase, tpp and tss are nonzero and nearly invariant in k-space. The cross-polarization coefficients tps and tsp (the amplitude of ~0.2 corresponds to power transmittance of only 4%) are small enough compared with co-polarization coefficients tpp and tss (the amplitude of ~0.9 corresponds to power transmittance of 81%) (Fig. S7). Even though our sample was fabricated on sapphire substrate (c-cut), the optical axis is perpendicular to the ground plane, so the tiny birefringence effect of the substrate has no contribution to tps and tsp. Besides, the very slight anisotropy of the refractive index has negligible effect on the transmission profile in k-space (Fig. S8). From the above analysis we simplify the polarization dependent transmissive coefficient matrix as
a Schematic of relationship between the polarization states of the imaged object and the incident light on the metasurface. b, c The calculated 2D co-polarization transmissive coefficients for p- and s-polarized incident light relative to the metasurface plane in the amorphouse phase. d–f The calculated 2D transfer functions for different polarized illuminations on the samples: x-polarized, y-polarized, and circular polarized. The results of left and right hand circular polarized states are the same due to the symmetry of the metasurface. g–k The calculated 2D transmissive coefficients and transfer functions of the same configurations as in (b–f) but in the crystalline phase
This equation implies that our metasurface nearly blocks the s-polarized propagation and applies the Laplacian operator on p-polarized light. Furthermore, to understand the operation by the metasurface in image processing we define the 2D transfer function of the metasurface as
This allows us to calculate the 2D transfer function of the imaged object illuminated by different polarizations of light via numerically simulated polarization dependent transmissive coefficients. The calculated results for x-polarized, y-polarized and circular polarized incidence in the amorphous phase are shown in Fig. 3d–f. The transfer function is close to kx2 but almost invariant with ky when the light is x-polarized, which means that the image is only differentiated along the x direction corresponding to the operator ∂x2. For the same reason, the y-polarized input light only induces differentiation along the y direction, i.e. ∂y2. In contrast, using circular polarized light makes the transfer function close to kx2+ky2, corresponding to differentiation along both directions, i.e. ∂x2 + ∂y2. These optical properties of the metasurface enable detection of edges vertical to the polarization of the incident linear polarized light and full edge detection using circular polarized light31. We also calculated the transfer functions of the metasurface in the crystalline phase at different polarizations in Fig. 3i–k, which display near invariance to different k-vectors.
Next, we experimentally demonstrate the phase-change reconfigurability of our nonlocal metasurface, supporting dual imaging functions, i.e., edge detection mode in the amorphous phase and bright field mode in the crystalline phase. The measurement setup is based on a purpose-built microscope schematically illustrated in Fig. 4a. A 1951 USAF negative resolution test target (used here as the imaged object) was illuminated by the same diode laser beam with the wavelength of 1050 nm, and the metasurface was inserted between the test target and the objective to filter the spatial frequencies of the image before being collected by the imaging system. Test target imaging results show the good edge detection capability of the metasurface in the amorphous phase and the selectivity of enhanced edges depending on the incident polarization because of the polarization-sensitive transfer function shown in Fig. 3. The metasurface behaves like a left-right and an up-down edge detection kernel filter with horizontal and vertical polarization orientations, respectively, and full edge detection was implemented by illuminating a circular polarized light (Fig. 4b). To test the resolution of the edge detection operation, we imaged patterns with different group and element numbers on the 1951 USAF test target and observed that the edge detection operation works well for feature sizes larger than 3.5 μm. Compared to the amorphous phase, the measured results from the crystalline Sb2Se3 metasurface shown in Fig. 4c show straightforward bright field imaging with little differences, other than overall intensity reduction, between the images shown and those without the metasurface (Fig. S9).
a Schematic of the optical imaging setup in experiments, where the metasurface and the test chart are separated by ~0.1 mm. b, c Optical images of a negative 1951 USAF test target with the existence of the metasurface in the amorphous and crystalline phases. Different linear polarization orientations used in experiments are marked as arrows. Scale bar: 15 μm. d, e Measured and calculated light intensity profiles of the test target along several dashed lines from (i) to (vi) marked in (b) and (c). Blue and red curves represent the results with and without the metasurface, respectively. All curves are normalized to the maximum of each
In our experiments, we retrieved the gray values as the light intensity along the dashed lines on the captured images in Fig. 4b, c and plotted them in Fig. 4d. We also show in the figure the experimental results obtained with no metasurface present. First, we notice that there is no significant difference in the profile with and without the metasurface in the crystalline phase. The good overlap of the blue and red curves demonstrates the fidelity of the metasurface working in bright field mode, which works well for feature sizes as small as 2.2 μm, the smallest feature size on the test target used in experiments. More imaging results of smaller features are shown in Fig. S10. For the bright field mode, the theoretical resolution limit of our system is 1.05 µm while it is out of the range of the resolution test chart. For the edge detection mode, the width of the obtained edge lines is also limited by the diffraction limitation of 1.05 µm, so it is difficult to clearly distinguish the edges when the feature size is smaller than around 4× diffraction limit (see Fig. S11). When the metasurface operates in the edge detection mode, double lines appear at the edges of patterns due to the introduced Laplacian operator, which coincides well with theoretical results shown in Fig. 4e. In the simulations, we first Fourier transform the real space profile to a k-space profile, then apply the simulated transfer function, and finally inversely Fourier transform it back to real space. Details are described in the Supplementary Information (Note J). Besides, we also quantified the signal noise ratio of our edge detection results, which is >20 (see Fig. S12).
Finally, we demonstrate a dual-functionality coverslip based on the phase-change nonlocal metasurface (meta-coverslip), as shown in Fig. 5a. The metasurface was fabricated on one side of an ultrathin coverslip (0.1 mm thick) and the other side of the coverslip was placed in contact with the object to be imaged. The coverslip is made of sapphire, to ensure smaller deformation and less fragility during the fabrication process, but it can readily be replaced by other transparent substrates, such as cheap glass coverslips. The measurement setup and the illumination wavelength are the same as Fig. 4. Figure 5b, c shows the imaging results of onion epidermal cells and sodium carbonate crystals when the metasurface works in the edge detection and the bright field modes. The boundaries and shapes are quite clear when Sb2Se3 is amorphous, while they become much less identifiable when the metasurface is in the crystalline phase. Although in this work crystallization of Sb2Se3 is achieved by heating the metasurface on a hot plate at 225°C for 5 min and only one-way switching was shown, we stress that, ultimately, there will be no necessity with the phase-change scheme to insert and remove the metasurface or apply an external force (as in the case of mechanically reconfigurable nonlocal metasurfaces) to switch between the bright field and edge detection microscopy modes. Instead, it is envisaged that in situ switching of the metasurface using integrated microheaters, as demonstrated for example by Zhang et al.37, could be implemented and make non-volatile cyclable switching possible.
a A photograph of the phase-change nonlocal metasurface fabricated on a coverslip used to image onion epidermal cells. The different colored blocks are metasurfaces with different periodicities fabricated on the same substrate. b The imaging results for onion epidermal cells in the amorphous and crystalline phases of the metasurface. Scale bar: 15 μm. c The imaging results for thin sodium carbonate crystals self-grown on glass substrate. Scale bar: 15 μm
Discussion
In conclusion, we have demonstrated a solid-state lossless phase-change nonlocal metasurface working as a reconfigurable spatial frequency filter. The metasurface can perform the dual function of bright field imaging and edge detection imaging. We have experimentally demonstrated one proof-of-concept application, a reconfigurable coverslip, for microscopy using our reconfigurable nonlocal metasurface. Our demonstration opens the door to active nonlocal metasurfaces targeting potential advanced applications such as dynamic spatial frequency filters for different image processing, tunable spacer squeezers32,33,34 and active reciprocal lenses36. A parallel work using VO2 as the PCM was recently reported53. VO2 is a volatile PCM, requiring the temperature to be continuously held above threshold to keep the metasurface in one mode. By using a non-volatile PCM, we can eliminate power consumption while the function is being held once the PCM is already set or reset. The state of VO2 only depends on the current temperature of the material, but the state of a non-volatile PCM such as Sb2Se3 is controlled by the past crystallization and amorphization process of the material, which makes dynamic switching non-trivial. Therefore, the next challenge is to address dynamic tunability with integrated heaters to make these metasurfaces switchable at the timescales of the crystallization and the amorphization of these active materials, something that has been achieved in reflective displays54, but that may require significant further work for transmissive metasurfaces.
Methods
Sample fabrications
The 300 nm thick Sb2Se3 film was first sputtered on the clean sapphire substrate. Next a 300 nm thick negative tone electron beam resist (ma-N 2403) layer was spin-coated on the Sb2Se3 film. The pattern was then transferred on the resist layer by EBL (JEOL JBX5500 50 kV with an exposure dose of 250 μC/cm2) and the develop process (MF-319 for 1 min then rinsed by DI water). We used the fluorine-based RIE process (Oxford Instruments, CHF3, 5 mT, 250 W) to etch the sample and removed the remaining resist by MICROPOSIT Remover 1165 to get the final device. The size of the fabricated metasurfaces is ~400 × 400 μm2.
Optical measurements
The incident angle dependent intensity transmittance of the metasurface at the wavelength of 1050 nm was measured by the same purpose-built setup shown in Fig. 4a, but with a slight modification. The schematic setup is shown in Fig. S13. First, the laser beam from a fiber-coupled diode laser (Thorlabs, MCLS1) was collimated to free space with a beam diameter of ~3 mm, passed through a polarizer, and then slightly focused on the metasurface by a lens (f = 200 mm) to make sure that the spot size is smaller than the area of the metasurface. Then, the transmissive light was collected by an objective with a small NA of 0.1 and coupled to a photodiode power sensor (Thorlabs, S122C). The use of a small NA objective is to make sure the working distance is large enough for sample rotation. The intensity transmittance is calculated by the ratio of the measured power with and without the metasurface.
In this work all optical measurements in the amorphous phase were conducted first after the as-deposited thin film and the metasurface was fabricated. Then we heated the same thin film and metasurface on a hot plate at 225°C for 5 min to fully crystallize the PCM. Finally, we measured all results in the crystalline phase of the metasurface.
Data availability
The data that support the findings of this study are available from the corresponding author on request.
References
Krizhevsky, A., Sutskever, I. & Hinton, G. E. ImageNet classification with deep convolutional neural networks. Proceedings of the 26th International Conference on Neural Information Processing Systems. Lake Tahoe: Curran Associates Inc., 2012, 1097–1105.
Rawat, W. & Wang, Z. H. Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput. 29, 2352–2449 (2017).
Wu, B. C. et al. SqueezeDet: unified, small, low power fully convolutional neural networks for real-time object detection for autonomous driving. Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Honolulu: IEEE, 2017, 446–454.
Gu, J. X. et al. Recent advances in convolutional neural networks. Pattern Recognit. 77, 354–377 (2018).
Shen, Y. C. et al. Deep learning with coherent nanophotonic circuits. Nat. Photonics 11, 441–446 (2017).
Feldmann, J. et al. Parallel convolutional processing using an integrated photonic tensor core. Nature 589, 52–58 (2021).
Goodman, J. W. Introduction to Fourier Optics. (Englewood: Roberts & Company, 2005).
Yu, N. F. et al. Light propagation with phase discontinuities: generalized laws of reflection and refraction. Science 334, 333–337 (2011).
Ni, X. J., Kildishev, A. V. & Shalaev, V. M. Metasurface holograms for visible light. Nat. Commun. 4, 2807 (2013).
Huang, L. L. et al. Three-dimensional optical holography using a plasmonic metasurface. Nat. Commun. 4, 2808 (2013).
Wang, S. M. et al. A broadband achromatic metalens in the visible. Nat. Nanotechnol. 13, 227–232 (2018).
Khorasaninejad, M. et al. Metalenses at visible wavelengths: diffraction-limited focusing and subwavelength resolution imaging. Science 352, 1190–1194 (2016).
Arbabi, A. et al. Subwavelength-thick lenses with high numerical apertures and large efficiency based on high-contrast transmitarrays. Nat. Commun. 6, 7069 (2015).
Zheng, G. X. et al. Metasurface holograms reaching 80% efficiency. Nat. Nanotechnol. 10, 308–312 (2015).
Tanriover, I., Dereshgi, S. A. & Aydin, K. Metasurface enabled broadband all optical edge detection in visible frequencies. Nat. Commun. 14, 6484 (2023).
Swartz, B. T. et al. Broadband and large-aperture metasurface edge encoders for incoherent infrared radiation. Sci. Adv. 10, eadk0024 (2024).
Wang, S. et al. Metalens for accelerated optoelectronic edge detection under ambient illumination. Nano Lett. 24, 356–361 (2024).
Zheng, H. Y. et al. Multichannel meta-imagers for accelerating machine vision. Nat. Nanotechnol. 19, 471–478 (2024).
Kwon, H. et al. Nonlocal metasurfaces for optical signal processing. Phys. Rev. Lett. 121, 173004 (2018).
Shastri, K. & Monticone, F. Nonlocal flat optics. Nat. Photonics 17, 36–47 (2023).
Song, J. H. et al. Non-local metasurfaces for spectrally decoupled wavefront manipulation and eye tracking. Nat. Nanotechnol. 16, 1224–1230 (2021).
Zhou, Y. et al. Multiresonant nonlocal metasurfaces. Nano Lett. 23, 6768–6775 (2023).
Zhang, J. H. et al. Spatially entangled photon pairs from lithium niobate nonlocal metasurfaces. Sci. Adv. 8, eabq4240 (2022).
Cordaro, A. et al. High-index dielectric metasurfaces performing mathematical operations. Nano Lett. 19, 8418–8423 (2019).
Overvig, A. & Alù, A. Diffractive nonlocal metasurfaces. Laser Photonics Rev. 16, 2100633 (2022).
Chai, R. H. et al. Emerging planar nanostructures involving both local and nonlocal modes. ACS Photonics 10, 2031–2044 (2023).
Kwon, H. et al. Dual-polarization analog 2D image processing with nonlocal metasurfaces. ACS Photonics 7, 1799–1805 (2020).
Zhou, Y. et al. Flat optics for image differentiation. Nat. Photonics 14, 316–323 (2020).
Long, O. Y. et al. Polarization-independent isotropic nonlocal metasurfaces with wavelength-controlled functionality. Phys. Rev. Appl. 17, 024029 (2022).
Cotrufo, M. et al. Dispersion engineered metasurfaces for broadband, high-NA, high-efficiency, dual-polarization analog image processing. Nat. Commun. 14, 7078 (2023).
Cotrufo, M. et al. Polarization imaging and edge detection with image-processing metasurfaces. Optica 10, 1331–1338 (2023).
Guo, C., Wang, H. W. & Fan, S. H. Squeeze free space with nonlocal flat optics. Optica 7, 1133–1138 (2020).
Chen, A. B. & Monticone, F. Dielectric nonlocal metasurfaces for fully solid-state ultrathin optical systems. ACS Photonics 8, 1439–1447 (2021).
Reshef, O. et al. An optic to replace space and its application towards ultra-thin imaging systems. Nat. Commun. 12, 3512 (2021).
Guo, C. et al. Structured 3D linear space–time light bullets by nonlocal nanophotonics. Light Sci. Appl. 10, 160 (2021).
Liu, W. Z. et al. Imaging with an ultrathin reciprocal lens. Phys. Rev. X 13, 031039 (2023).
Malek, S. C. et al. Active nonlocal metasurfaces. Nanophotonics 10, 655–665 (2020).
Zhang, X. M. et al. Reconfigurable metasurface for image processing. Nano Lett. 21, 8715–8722 (2021).
Shalaginov, M. Y. et al. Reconfigurable all-dielectric metalens with diffraction-limited performance. Nat. Commun. 12, 1225 (2021).
Wang, M. Y. et al. Varifocal metalens using tunable and ultralow-loss dielectrics. Adv. Sci. 10, 2204899 (2023).
Zhang, Y. F. et al. Electrically reconfigurable non-volatile metasurface using low-loss optical phase-change material. Nat. Nanotechnol. 16, 661–666 (2021).
de Galarreta, C. R. et al. Nonvolatile reconfigurable phase-change metadevices for beam steering in the near infrared. Adv. Funct. Mater. 28, 1704993 (2018).
de Galarreta, C. R. et al. Reconfigurable multilevel control of hybrid all-dielectric phase-change metasurfaces. Optica 7, 476–484 (2020).
Delaney, M. et al. A new family of ultralow loss reversible phase-change materials for photonic integrated circuits: Sb2S3 and Sb2Se3. Adv. Funct. Mater. 30, 2002447 (2020).
Abdollahramezani, S. et al. Electrically driven reprogrammable phase-change metasurface reaching 80% efficiency. Nat. Commun. 13, 1696 (2022).
Zhou, W. et al. In-memory photonic dot-product engine with electrically programmable weight banks. Nat. Commun. 14, 2887 (2023).
Fang, Z. R. et al. Ultra-low-energy programmable non-volatile silicon photonics based on phase-change materials with graphene heaters. Nat. Nanotechnol. 17, 842–848 (2022).
Wang, Y. F. et al. Electrical tuning of phase-change antennas and metasurfaces. Nat. Nanotechnol. 16, 667–672 (2021).
Huang, L. J. et al. Ultrahigh-Q guided mode resonances in an All-dielectric metasurface. Nat. Commun. 14, 3433 (2023).
Jin, R. et al. Toroidal dipole BIC-driven highly robust perfect absorption with a graphene-loaded metasurface. Nano Lett. 23, 9105–9113 (2023).
Zhou, C. B. et al. Bound states in the continuum in asymmetric dielectric metasurfaces. Laser Photonics Rev. 17, 2200564 (2023).
Hugonin, J. P. & Lalanne, P. RETICOLO software for grating analysis. Print at https://doi.org/10.48550/arXiv.2101.00901 (2025).
Cotrufo, M. et al. Reconfigurable image processing metasurfaces with phase-change materials. Nat. Commun. 15, 4483 (2024).
Hosseini, P., Wright, C. D. & Bhaskaran, H. An optoelectronic framework enabled by low-dimensional phase-change films. Nature 511, 206–211 (2014).
Acknowledgements
This research was supported by European Union’s Horizon 2020 research and innovation program (Grant No. 101017237, PHOENICS Project) and European Union’s EIC Pathfinder program (Grant No. 101046878, HYBRAIN Project and No. 101098717 RESPITE Project). This research was funded in part by the UKRI [EP/T023899/1, EP/R001677/1, EP/W003341/1 and EP/W022931/1]. A.A. acknowledges supports from the Air Force Office of Scientific Research MURI program. C.R.de G. acknowledges funding from the Marie Sklodowska-Curie Individual Fellowship 101068089 (METASCALE).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
H.B. serves as a Guest Editor of Special Issue on Optics and Photonics at the University of Oxford for the Journal. No other author has reported any competing interests.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Yang, G., Wang, M., Lee, J.S. et al. Nonlocal phase-change metaoptics for reconfigurable nonvolatile image processing. Light Sci Appl 14, 182 (2025). https://doi.org/10.1038/s41377-025-01841-x
Received:
Revised:
Accepted:
Published:
Version of record:
DOI: https://doi.org/10.1038/s41377-025-01841-x
This article is cited by
-
From performance to structure: a comprehensive survey of advanced metasurface design for next-generation imaging
npj Nanophotonics (2025)
-
Diffractive tensorized unit for million-TOPS general-purpose computing
Nature Photonics (2025)
-
Role of the thermomagnetic coupling mechanism in phase-change materials for advanced applications
Discover Applied Sciences (2025)
-
Fabrication and structural analysis of amorphous GeTe4, Sb2Te3 and Ge20SbxTe80-x thin films prepared by thermal evaporation
Journal of Materials Science: Materials in Electronics (2025)







