Abstract
Micro-objects levitated in a vacuum are an exciting platform for precision sensing due to their low dissipation motion and the potential for control at the quantum level. Arrays of such sensors would offer increased sensitivity, directionality, and in the quantum regime the potential to exploit correlation and entanglement. We use neuromorphic detection via a single event based camera to record the motion of an array of levitated microspheres. We present a scalable method for arbitrary multiparticle tracking and control by implementing real-time feedback to simultaneously cool the motion of three uncoupled objects, a demonstration of neuromorphic sensing for real-time control at the microscale.
Similar content being viewed by others
Introduction
Modern technology relies on mechanical sensors, from accelerometers in mobile devices1 to wearable health monitors2. As sensors are miniaturised, their surface-to-volume ratio increases and they dissipate more energy via their thermal contacts and through surface strain3, limiting their performance. By levitating nano- or microparticles under ultra-high vacuum conditions, using optical, electrical or magnetic fields4,5, one creates a mechanical oscillator with remarkably low dissipation6,7. Force sensitivities of yoctonewtons8,9 and torque sensitivities at the 10−27 N m Hz−1/2 level10 have been achieved, with levitating sensors achieving quality factors in excess of 1010 6, motivating researchers to use these systems to search for dark matter7,11,12 and gravitational waves13,14.
The control of levitated particles allows the exploration of a wide range of fundamental science4,5, and the demonstration of cooling to the ground state of an optical potential15,16,17,18,19,20 opens the door to macroscopic quantum physics21,22,23,24. An emerging frontier in this field is the study of arrays of particles, which in the quantum regime would allow the generation of entanglement25 and tests of quantum gravity26,27. Interactions have been observed between pairs of levitated nanoparticles in optical28,29,30,31, electrodynamic (Paul)32 and magnetic33 traps. Detecting and controlling multiple particles in vacuum has so far involved either single particle control with sympathetic cooling31,32,34 or small arrays of optical traps35,36. Some applications will require the control of arrays of tens, or even thousands, of levitated particles11.
We use neuromorphic imaging for the control of arbitrary particle arrays across a wide field-of-view. Neuromorphic sensors are highly efficient detectors that mimic neurobiological information gathering37,38,39,40,41. Dynamic vision sensors (DVS) are neuromorphic sensors that mimic the retinal response42, detecting changes across a threshold on each pixel in an array asynchronously to produce a stream of events43, ideally suited for object tracking44. Together with event-driven processing algorithms45,46,47, DVS can achieve microsecond temporal resolution, sub-millisecond latency and high dynamic range detection (> 120 dB) with minimal data output at low power consumption38,41,48. Therefore, DVS are highly suited to high-speed and real-time applications requiring low power in environments with uncontrolled light levels, such as in robotics49, autonomous driving50 and space flight51, as well as finding applications in microscopy52,53 and astronomy54. In this work, we use an event-based camera (EBC) with integrated DVS to monitor the motion of an array of levitated particles with a bandwidth high enough to demonstrate real-time simultaneous feedback control of multiple uncoupled particles in an array.
We implement cold damping feedback55 to cool the motion of the levitated particles56,57, a technique with demonstrated quantum ground state cooling capabilities16,17,18. We cool a single microsphere to a temperature of a few Kelvin and a single degree of freedom of multiple particles. In this work, the number of objects we can simultaneously control is only limited by the number of output channels in our feedback electronics. This single-device method for cooling and controlling particles in arrays is readily scalable due to the low data output of neuromorphic detection. Arrays of cooled micro-sensors will lead to enhanced signal-to-noise sensing through sensor fusion58,59,60, enable force gradient sensing25, and provide a larger interaction area without increasing the mass of the sensor11. Due to the low power consumption of neuromorphic detectors, our presented methods are ideal for integration into chip-scale technology61.
Results
Neuromorphic imaging of levitated particle arrays
We levitate arrays of charged 5 μm diameter silica microspheres in a linear Paul trap under vacuum conditions62,63,64,65 (see ‘Methods’) and record their motion using an EBC66, see Fig. 1a. The charged particles form a stable array due to the Coulomb repulsion between them. Our particular Paul trap geometry (Fig. 1b) and the particles’ distribution of charge, means that our particle arrays are non-uniform.
a Schematic of the experimental setup: neuromorphic imaging via an event-based camera (EBC) tracks the positions of particles levitated in an array by a linear Paul trap (four grey electrodes, black and blue endcap electrodes). An FPGA (Field Programmable Gate Array) system processes this data to generate a feedback signal, which is applied to a control electrode (blue) near the particle array. b A schematic of the linear Paul trap, including the coordinate axes {x, y, z} for the levitated particles, in contrast to the imaging coordinates \(\{\, {y}^{{\prime} },{z}^{{\prime} }\}\) in (a). c An EBC image of an array of 10 particles. The EBC identifies each particle and tracks its motion (within the marked coloured box), assigning each particle an individual object ID (coloured numbers) which tags the streamed data. Each object is represented by only a few pixels (white for increasing intensity, blue for decreasing intensity), making the volume of streamed data very low.
The EBC uses a neuromorphic DVS, which is an array of independent pixels featuring contrast detectors that output an event38 in response to light levels on the pixel crossing a user-defined threshold. Pixels which do not experience the required level-change output no signal, removing the data-redundancy present in conventional cameras38, while allowing the full sensor to be used at all times, sometimes referred to as a dynamic region-of-interest. The EBC hardware bundles asynchronous events into equal-length frames, and uses filters to identify objects within its field-of-view44, after which a proprietary generic tracking algorithm (GTA) tracks the motion of each object independently. We have previously demonstrated single-particle object tracking with an SNR above 35 dB, and for a more detailed analysis of EBC performance in the context of levitated microparticles, see ref. 66.
The EBC allows the tracking of multiple objects with a high bandwidth and a linear scaling in data output with the number of tracked objects, as compared to a rapid increase in data volume with increased region-of-interest in a conventional camera. In our system, with fixed magnification, tracking a single particle at 1 kHz using the entire field-of-view (3.75 mm2) of the EBC uses ~100 kB s−1 as compared to 64,800 kB s−1 using a standard CMOS camera (Thorlabs CS165MU/M) at the same frame rate and field-of-view. This means that the EBC can track many hundreds of particles before the data volume becomes comparable to standard camera technology. By not having to restrict the region-of-interest, the EBC can track objects dispersed over several hundred micrometres whilst retaining high spatial resolution66. The low data volume leads to a correspondingly low power consumption, see Supplemental Materials S5 for more details.
In Fig. 1c, we show an example of a single neuromorphic sensor being used to detect and track 10 levitated particles simultaneously. The EBC identifies each object and tracks it in 2D (illustrated by the coloured boxes), assigning each one a stable identification number allowing us to process the position data of each particle independently. The linear Paul trap defines the coordinate system {x, y, z} for the levitated particles, Fig. 1b. The image on the EBC has a coordinate system \(\{{y}^{{\prime} },{z}^{{\prime} }\}\), Fig. 1a. The {x, y} axes are projected at 45∘ onto the \({y}^{{\prime} }\)-axis, and the \({z}^{{\prime} }-\) and z-axes are parallel, see Supplementary Materials S1. This projection allows us to detect all three axes of motion of the levitated particles.
In Fig. 2a, we reconstruct the motion and relative position of four levitated particles obtained from the 1 kHz tracking algorithm of the EBC, which can be accessed in real-time. Particles levitated by a Paul trap undergo harmonic motion. In Fig. 2b, we generate the power spectral density (PSD) from the motion of each particle in the array of four to analyse their motion in frequency space. Each particle has a different charge-to-mass ratio (see Supplementary Materials S3) and is levitated in a different part of the confining field, meaning each particle has different frequency modes of oscillation, which are well separated under vacuum conditions. Below, we use this fact to independently cool the motion of multiple particles.
a Reconstructed 2D position of four levitated microparticles tracked in real-time at a 1 kHz framerate. The amplitude of motion depends on the charge of each particle and where it sits within the levitating potential. Particles 2 and 4 are closest to and furthest from the Paul trap centre (the centre of the coordinate axes), respectively. b Position power spectral densities (PSDs) reconstructed from the 2D position tracking of the four particles in (a) (green trace: \({y}^{{\prime} }\)-direction, purple trace: \({z}^{{\prime} }\)-direction). Each particle is independently tracked. We observe interactions between particles in the array: \({x}_{{{{\rm{C}}}}}^{(1)}\), \({x}_{{{{\rm{C}}}}}^{(2)}\), \({x}_{{{{\rm{C}}}}}^{(3)}\) and \({x}_{{{{\rm{C}}}}}^{(4)}\) are four collective modes of all the four particles in the x-direction. We also see the individual bare modes in the y- and z-directions. For information on identifying modes, see Supplementary Materials S2 and S3.
The four particles are aligned along the x-axis. Motion of the charged particles in this direction leads to coupling between them via the Coulomb interaction31,32,33,67. This is evident via the collective modes xC seen in Fig. 2b. By controlling the separation between the particles, we can control the coupling strength, see Supplementary Materials S2 for further details. For the multi-particle cooling presented below, we work in a regime where the coupling between the modes is too small to measure, and perform cooling along the z-direction.
The signal-to-noise for the different particles varies due to non-uniform illumination and varying coupling to electronic noise. It ranges from 3 to 30, with exact values given in Supplementary Materials S3. All data in this work is taken at gas pressures of 2.0–4.5 × 10−2 mbar unless otherwise stated.
Single particle cold damping using neuromorphic imaging
There are many reasons why it is desirable to control the energy of a levitated particle. Although the sensitivity of a levitated sensor does not increase through cooling68, rapid damping of the motion increases the stability and measurement bandwidth of the system. Reduction of the particle energy to the ground-state of the levitating potential15,17,19 opens up a toolbox of quantum control5 and sensitivity enhancement69,70 mechanisms.
Cold damping is a feedback method whereby a force proportional to the velocity of an oscillator opposes its motion. Depending on the phase of the feedback force relative to the motion, this method damps (cools) or amplifies (heats) the oscillator. When cooling, the input and output noise of the feedback electronics limit the ultimate temperature.
We process the position data from the EBC using a field programmable gate array (FPGA) to generate a feedback signal proportional to velocity, with variable gain and phase. This signal is filtered and applied to a control electrode, see Fig. 1a.
Figure 3a shows the PSD of a particle’s measured motion along the z-axis as it is cooled via cold damping. The shape of the PSD from the in-loop detector is given by refs. 55,57:
where ω = 2π × f, m is the particle’s mass, ωz is the mode frequency, T0 is the bath temperature and Γt = Γ0 + Γfb(ϕ) is the total momentum damping rate on the particle’s motion, with Γ0 being the calculable momentum damping rate due to the pressure of the surrounding gas4 and \({\varGamma }_{{{{\rm{fb}}}}}(\phi )={\varGamma }_{{{{\rm{fb}}}}}\cos (\phi+{\phi }_{0})\) being the additional damping controlled by the feedback gain, which is feedback-phase ϕ dependent, with ϕ0 the uncontrollable phase delay caused by electronics and data processing. The term Snn is the feedback circuit noise that is modelled as white noise. When Γfb is large, the feedback can introduce extra noise and lead to heating, as discussed in refs. 57,61,71. The parameters T0, Γ0 and Γfb(ϕ) can be extracted from a measured PSD by fitting Eq. (1) to the data. Due to voltage noise from the amplifiers driving our Paul trap, the equilibrium temperature of our particles without cooling ranges from T0 = 400–1500 K, depending on their charge and spatial location in the trap; hence, we express temperatures as a ratio. The equilibrium temperatures for all particles in this paper are given in Supplementary Material S6.
a A selection of single particle PSDs of the measured motion along the z-axis with different feedback gains (Γfb/2π), fit with Eq. (1). b Extracted centre of mass (CoM) temperature TCoM relative to initial temperature T0 over a wider range of feedback gains than presented in (a). c Effect of the feedback loop phase delay on the temperature of the particle. d Variation in single particle temperature with fixed feedback gain and phase, as the background gas pressure decreases. When the pressure reaches 10−3 mbar we cool to the noise floor of our system, as indicated by the grey shaded region, corresponding to TCoM = (6.8 ± 0.7) K. b–d include the model in Eq. (2) with the parameters extracted by fitting Eq. (1) to the PSDs of the measured particle motion—the pink shaded areas represent the uncertainty in these parameters. All experimental error bars in the figure are derived by taking 15 repeated experiments at each set of parameters to calculate a mean and standard deviation.
According to the equipartition theorem, the temperature of a levitated particle experiencing cold damping is31,57,72:
Experimentally, the temperature of each mode TCoM can be extracted from Eq. (2) after fitting the measured PSD over the corresponding resonance peak with Eq. (1)57. In Fig. 3b, we show the effect of increasing Γfb on the temperature of a single mode of a single particle.
The cooling depends on the phase between the feedback signal, which is proportional to velocity, and the detected motion of the particle. Eq. (2) is fit to experimental data as ϕ is varied in Fig. 3c, with Γfb and ϕ0 as free parameters. The fitted value of ϕ0 is 370° ± 5∘, noting that one period of phase delay does not significantly affect cooling for an underdamped oscillator73, see Supplementary Materials S4. The value of Γfb obtained by fitting the data in Fig. 3c with Eq. (2) agrees with the value obtained at the same feedback gain by fitting the data with Eq. (1), Γfb/(2π) = (0.82 ± 0.05) Hz, (0.70 ± 0.09) Hz, respectively.
Finally, in Fig. 3d, we show the variation in temperature with Γ0 by reducing the gas pressure, with Γfb and ϕ fixed at around 6 Hz and 0°, respectively. At a pressure of 10−3 mbar, we reach the noise floor of our system, indicated by the grey region, at a temperature corresponding to TCoM = (6.8 ± 0.4) K, representing 17 dB of cooling. The optimal Γfb can be derived from Eq. (2), see Supplementary Materials S7. To further improve cooling, one can improve particle illumination and imaging, decrease the noise in the levitation electronics, and replace the GTA of the EBC with an optimised tracking algorithm. Object tracking has the potential to track levitated microparticles at the shot-noise limit74.
Simultaneous cooling of microparticles in an array
Our neuromorphic imaging system tracks the motion of every object it identifies. We are able to process this information and make a feedback loop for each degree of freedom that is detected. Each feedback loop consists of a dedicated FPGA and a set of analogue filters, and we are limited in our experiment to three loops in total. We stress that this is not a limitation of detection or processing power, simply the number of FPGA outputs available to us. For each degree of freedom the phase and gain of each feedback loop must be optimised, and filters must be set accordingly.
In Fig. 4a, we cool two orthogonal degrees of freedom (the x- and z-oscillation modes) of a single particle. We are sensitive to all three degrees of freedom due to the angle our imaging system makes to the principal axes of the trap, see Supplementary Methods S1. The geometry of our Paul trap allows the control of all degrees of freedom with a single electrode.
a Cooling of two orthogonal modes of a single particle’s motion along the x- and z-directions. b Cooling of two levitated particles' motion along the z-direction. c Cooling of three levitated particles' motion along the z-direction. a–c also include the model from Eq. (2) as shaded coloured regions, with the area representing uncertainty in our experimental parameters. d The PSDs of the motion along the z-direction of the three particles in (c) before and after cooling (particle 1, 3, 2 in order of increasing frequency). Solid lines are fits to the model in Eq. (1), which are used to extract the parameters used in the models (shaded regions) in (a–c). All experimental error bars in the figure are derived by taking 15 repeated experiments at each set of parameters to calculate a mean and standard deviation.
We optimise and fix the feedback parameters, then lower the background pressure to reduce Γ0, hence lowering the temperature TCoM. The temperature is limited not by our noise floor, but by imperfect filtering, pumping energy from the feedback signal into the y-mode, since it is close in frequency to the z-mode. At low pressures, this causes the particle to become unstable, preventing us from further lowering the pressure. Cross-talk between particle modes would also limit the ultimate cooling temperature, which could be resolved by a better design of the feedback electrodes75.
In Fig. 4b, we extend our cooling to the z-mode of two separate particles. As we lower the pressure, the temperature of each mode drops, reaching ~10 dB and ~15 dB of cooling. Since only high-pass filters are used when cooling in the z-direction (see ‘Methods’), unfiltered noise from one particle is able to heat the uncooled modes of the other. At lower pressures, this causes particle instability and prevents further cooling.
In Fig. 4c, we cool the z-mode of three different particles, with the corresponding PSDs shown in Fig. 4d. To the best of our knowledge, this is the first demonstration of cooling more than two levitated particles. The issue of imperfect filtering is more pronounced when dealing with more particles, as there are more modes of the system overlapped with the unfiltered noise. We still achieve better than 7 dB of cooling. Filtering can be improved either by separating the particle modes and applying band-pass filtering, or through the use of phase-locked loops76,77. For the data in Fig. 4b–d, we adjust the particle spacing via the Paul trap voltages until the Coulomb interaction is weak enough such that there are no coupled modes, see Supplementary Materials S2. Collective modes in particle arrays can be cooled via sympathetic cooling in the limit that the feedback damping rate is smaller than the coupling strength between the modes31,32.
The EBC used in this study has a sensor size of 640 × 480 pixels, with each particle image occupying 25 × 25 pixels (the coloured boxes in Fig. 1c) and having a motional amplitude of 4 pixels. As long as the centre of the particles are separated by approximately 60 pixels, the particles can be individually tracked. Hence, without changing our imaging system, we could simultaneously track up to 500 particles with this EBC. Considering the fact that object tracking allows for sub-pixel resolution52,78, by changing the magnification of the imaging system, this EBC would be capable of simultaneously tracking at least 2000 levitated microparticles, with a correspondingly high data volume.
Discussion
We have presented a scalable method for the detection and control of microparticles levitated in an array using a single neuromorphic detector. Neuromorphic imaging is ideally suited to this task, due to its natural affinity with detecting the motion of multiple objects44,79 and low data-transfer rate38. The tracking speed in our work is limited by the proprietary tracking algorithm of the EBC. Commercial neuromorphic imaging sensors, such as the one used in this study, transfer data from the sensor to the camera hardware at GHz rates48. The development of custom algorithms has enabled object tracking at 30 kHz by working with the asynchronous data streamed from a DVS using only 4 MB of RAM on a standard 2.9 GHz Dual Core CPU52. For a fixed frame rate, the data volume is fixed regardless of the particle motion frequency. If the frame rate is increased, data are transferred more rapidly from the camera and the data volume and bandwidth increase. By pushing above 100 kHz, neuromorphic sensors would be suitable for feedback cooling optically levitated particles to the quantum ground state of motion17, considering the shot-noise limited potential of object tracking74,78. This would require custom tracking algorithms and interfacing the sensor directly with FPGA or neuromorphic processing electronics38,80, which would also enable the read-out and control of object alignment and rotation79,81.
We believe that the particle control method presented in this work could be extended to an array of order 100 microparticles (see Supplementary Materials S8). Multichannel FPGA systems with high-quality digital filters are a common tool in research labs. Paul traps are stable at low pressures82, where the motional frequencies of levitated particles have sub-Hz linewidths83. The naturally varying charge-to-mass ratio of charged microparticles, along with application of electric field gradients, will enable the spectral separation of motional modes, making possible single-particle control and cooling even for large arrays. The neuromorphic detection and cooling presented here is independent of the levitation method, as long as there is optical illumination, meaning it is suitable for small dielectrics in optical traps, charged absorptive materials in Paul traps (such as organic material)57, and magnetically levitated objects.
Since the motion of levitated sensors is well understood, simple machine learning could be used to optimise all of the feedback parameters57 in an array, and optimal tracking algorithms used, which have been shown to enable quantum-level control17. When combined with the low power consumption of neuromorphic imaging technology (less than 30 mW per tracked particle, see Supplementary Materials S5), and great progress in chip-scale particle levitation61, integrated devices containing arrays of quantum sensors are closer to being a reality.
Methods
Experimental setup
Figure 5 shows the experimental setup surrounding our linear Paul trap. The trap consists of four parallel cylindrical trapping electrodes forming a square, with two coaxial cylindrical endcap electrodes, one of which we call the control electrode, which is used for feedback control. The distance from the trap centre to the surface of the 1 mm-diameter trapping electrodes is r = 1.15 mm, and one opposing-pair is driven with 360 V amplitude at 1 kHz. Of the other pair of the four electrodes, the lower one has a constant voltage of 3V applied to minimise single-particle micromotion. The two endcaps are 300 μm in diameter and separated by 800 μm, with a slight misalignment along the \({z}^{{\prime} }\)-axis, which causes particles to be trapped along a diagonal in the \({y}^{{\prime} }-{z}^{{\prime} }\) plane. The proximity of the electrodes to the centre of the trap means that a voltage applied to either one will create a field with a significant component in all three axes, enabling 3D control with a single electrode.
A pulsed laser is used to launch particles into the trap via LIAD84. Particles are illuminated with a CW laser from above, and imaged onto an EBC from below. The EBC software runs on a PC, and the tracking algorithm outputs data to a series of FPGAs, which process the data to produce a feedback signal for each degree of freedom of each particle. Each signal is then filtered with analogue filters (not shown), and then all signals are summed together and drive the control electrode.
Laser-induced acoustic desorption (LIAD)84 is used to launch microparticles into the trap at a pressure of 1 mbar, and then the pressure is lowered to carry out the experiments presented in this manuscript. We typically trap particles of positive charge, ranging from 2 × 103 e to 2 × 104 e.
To image the particles, 18 mW of laser light of wavelength 520 nm is weakly focused onto the array. The scattered light is imaged onto an EBC (Prophesee EVK1 -Gen3.1 VGA (camera sensor: Prophesee PPS3MVCD, 640 × 480 pixels)) using a long working distance microscope. The camera is precisely calibrated using a method outlined in detail in ref. 66. When dealing with multiple particles, calibration is performed via displacing a translation stage on which our imaging system is mounted by a known amount.
Data processing
The data pipeline is shown in Fig. 6. The operation of the EBC is described in detail in ref. 66. The GTA of the EBC outputs 2D position data for each object it detects. The EBC is communicated with via a Python script, which separates this 2D information into two 1D data streams for each object. The script passes each data stream to one of three FPGA systems (Red Pitaya STEMlab 125-14) to output the position of each particle. The FPGA clock is synchronised to the clock of the EBC to ensure timing consistency. Code on the FPGA computes the velocity from the position data and adds a variable gain and phase to the signal to generate the feedback signal. There is a latency of 10 ms in this pipeline, see Supplementary Materials S4. EBCs are available with FPGA systems on the camera hardware, which will significantly reduce this latency.
The EBC takes asynchronous data from the neuromorphic sensor, bundles it into events, accumulates the data over time to generate frames, and then detects and identifies objects. This information is passed to a computer, which uses a generic tracking algorithm (GTA) to track the motion of each object in 2D. The tracking data for each object is split into two 1D data streams using simple Python code, and then each data stream is sent to a separate FPGA. The FPGAs each calculate the velocity from the position data, add a variable gain and phase shift, and generate voltage outputs. These are separately filtered using analogue filters, and the signals are combined with a summing amplifier, the output of which is sent to the control electrode to cool the particles.
Each feedback signal is filtered with an analogue filter to isolate each frequency component of motion: a high-pass filter for the fz signal (Wavefonix 3320 HPF 24 dB per Octave) and a low-pass filter for the fx signal (Wavefonix 2140 LPF 24 dB per Octave). The filtered feedback signals are combined with a summing amplifier and sent to the control electrode.
Data availability
The data supporting this article are openly available from the King’s College London research data repository, KORDS, at https://doi.org/10.18742/28069136.
Code availability
The code used in the present work is available from the corresponding authors upon request.
References
Shaeffer, D. K. Mems inertial sensors: a tutorial overview. IEEE Commun. Mag. 51, 100–109 (2013).
Chircov, C. & Grumezescu, A. M. Microelectromechanical systems (MEMS) for biomedical applications. Micromachines 13, 164 (2022).
Imboden, M. & Mohanty, P. Dissipation in nanoelectromechanical systems. Phys. Rep. 534, 89–146 (2014).
Millen, J., Monteiro, T. S., Pettit, R. & Vamivakas, A. N. Optomechanics with levitated particles. Rep. Prog. Phys. 83, 026401 (2020).
Gonzalez-Ballestero, C., Aspelmeyer, M., Novotny, L., Quidant, R. & Romero-Isart, O. Levitodynamics: Levitation and control of microscopic objects in vacuum. Science 374, eabg3027 (2021).
Dania, L. et al. Ultrahigh quality factor of a levitated nanomechanical oscillator. Phys. Rev. Lett. 132, 133602 (2024).
Moore, D. C. & Geraci, A. A. Searching for new physics using optically levitated sensors. Quantum Sci. Technol. 6, 014008 (2021).
Liang, T. et al. Yoctonewton force detection based on optically levitated oscillator. Fundam. Res. 3, 57–62 (2022).
Ranjit, G., Cunningham, M., Casey, K. & Geraci, A. A. Zeptonewton force sensing with nanospheres in an optical lattice. Phys. Rev. A 93, 053801 (2016).
Ahn, J. et al. Ultrasensitive torque detection with an optically levitated nanorotor. Nat. Nanotechnol. 15, 89–93 (2020).
Gadi, A., Carney, D. & Moore, D. C. Coherent scattering of low mass dark matter from optically trapped sensors. Phys. Rev. Lett. 128, 101301 (2022).
Yin, P. et al. Experiments with levitated force sensor challenge theories of dark energy. Nat. Phys. 18, 1181–1185 (2022).
Arvanitaki, A. & Geraci, A. A. Detecting high-frequency gravitational waves with optically levitated sensors. Phys. Rev. Lett. 110, 071105 (2013).
Winstone, G. et al. Optical trapping of high-aspect-ratio nayf hexagonal prisms for kHz-MHz gravitational wave detectors. Phys. Rev. Lett. 129, 053604 (2022).
Delić, U. et al. Cooling of a levitated nanoparticle to the motional quantum ground state. Science 367, 892–895 (2020).
Tebbenjohanns, F., Mattana, M. L., Rossi, M., Frimmer, M. & Novotny, L. Quantum control of a nanoparticle optically levitated in cryogenic free space. Nature 595, 378–382 (2021).
Magrini, L. et al. Real-time optimal quantum control of mechanical motion at room temperature. Nature 595, 373–377 (2021).
Kamba, M., Shimizu, R. & Aikawa, K. Optical cold damping of neutral nanoparticles near the ground state in an optical lattice. Optics Express 30, 26716–26727 (2022).
Piotrowski, J. et al. Simultaneous ground-state cooling of two mechanical modes of a levitated nanoparticle. Nat. Phys. 19, 1009–1013 (2023).
Ranfagni, A., Børkje, K., Marino, F. & Marin, F. Two-dimensional quantum motion of a levitated nanosphere. Phys. Rev. Res. 4, 033051 (2022).
Millen, J. & Stickler, B. A. Quantum experiments with microscale particles. Contemp. Phys. 61, 155–168 (2020).
Barker, P. & Shneider, M. Cavity cooling of an optically trapped nanoparticle. Phys. Rev. A 81, 023826 (2010).
Chang, D. et al. Cavity opto-mechanics using an optically levitated nanosphere. Proc. Natl. Acad. Sci. USA 107, 1005–1010 (2010).
Romero-Isart, O., Juan, M. L., Quidant, R. & Cirac, J. I. Toward quantum superposition of living organisms. New J. Phys. 12, 033015 (2010).
Rudolph, H., Delić, U., Aspelmeyer, M., Hornberger, K. & Stickler, B. A. Force-gradient sensing and entanglement via feedback cooling of interacting nanoparticles. Phys. Rev. Lett. 129, 193602 (2022).
Bose, S. et al. Spin entanglement witness for quantum gravity. Phys. Rev. Lett. 119, 240401 (2017).
Marletto, C. & Vedral, V. Gravitationally induced entanglement between two massive particles is sufficient evidence of quantum effects in gravity. Phys. Rev. Lett. 119, 240402 (2017).
Arita, Y., Wright, E. M. & Dholakia, K. Optical binding of two cooled micro-gyroscopes levitated in vacuum. Optica 5, 910–917 (2018).
Rieser, J. et al. Tunable light-induced dipole-dipole interaction between optically levitated nanoparticles. Science 377, 987–990 (2022).
Liška, V. et al. Cold damping of levitated optically coupled nanoparticles. Optica 10, 1203–1209 (2023).
Penny, T., Pontin, A. & Barker, P. Sympathetic cooling and squeezing of two colevitated nanoparticles. Physical Review Research 5, 013070 (2023).
Bykov, D. S., Dania, L., Goschin, F. & Northup, T. E. 3D sympathetic cooling and detection of levitated nanoparticles. Optica 10, 438–442 (2023).
Slezak, B. R. & D’Urso, B. A microsphere molecule: the interaction of two charged microspheres in a magneto-gravitational trap. Appl. Phys. Lett. 114, 244102 (2019).
Arita, Y. et al. All-optical sub-kelvin sympathetic cooling of a levitated microsphere in vacuum. Optica 9, 1000–1002 (2022).
Vijayan, J. et al. Scalable all-optical cold damping of levitated nanoparticles. Nat. Nanotechnol. 18, 49–54 (2023).
Hüpfl, J. et al. Optimal cooling of multiple levitated particles through far-field wavefront shaping. Phys. Rev. Lett. 130, 083203 (2023).
Ambrogio, S. et al. Equivalent-accuracy accelerated neural-network training using analogue memory. Nature 558, 60–67 (2018).
Roy, K., Jaiswal, A. & Panda, P. Towards spike-based machine intelligence with neuromorphic computing. Nature 575, 607–617 (2019).
Xiao, T. P., Bennett, C. H., Feinberg, B., Agarwal, S. & Marinella, M. J. Analog architectures for neural network acceleration based on non-volatile memory. Appl. Phys. Rev. 7, 031301 (2020).
Liao, F., Feichi, Z. & Chai, Y. Neuromorphic vision sensors: principle, progress and perspectives. J. Semicond. 42, 013105 (2021).
Sharma, D. et al. Linear symmetric self-selecting 14-bit kinetic molecular memristors. Nature 633, 560–566 (2024).
Vanarse, A., Osseiran, A. & Rassau, A. A review of current neuromorphic approaches for vision, auditory, and olfactory sensors. Front. Neurosci. 10, 115 (2016).
Lichtsteiner, P., Posch, C. & Delbruck, T. A 128×128 120 db 15 μs latency asynchronous temporal contrast vision sensor. IEEE J. Solid-State Circuits 43, 566–576 (2008).
Ni, Z., Ieng, S.-H., Posch, C., Régnier, S. & Benosman, R. Visual tracking using neuromorphic asynchronous event-based cameras. Neural Computation 27, 925–953 (2015).
Nguyen, A., Do, T.-T., Caldwell, D. G. & Tsagarakis, N. G. Real-time 6dof pose relocalization for event cameras with stacked spatial LSTM networks. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (IEEE, 2019).
Rebecq, H., Ranftl, R., Koltun, V. & Scaramuzza, D. High speed and high dynamic range video with an event camera. IEEE Trans. Pattern Anal. Mach. Intell. 43, 1964–1980 (2019).
Cannici, M., Ciccone, M., Romanoni, A. & Matteucci, M. Asynchronous convolutional networks for object detection in neuromorphic cameras. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (IEEE, 2019).
Gallego, G. et al. Event-based vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 44, 154–180 (2020).
Zhu, L., Mangan, M. & Webb, B. Neuromorphic sequence learning with an event camera on routes through vegetation. Sci. Robot. 8, eadg3679 (2023).
Gehrig, D. & Scaramuzza, D. Low-latency automotive vision with event cameras. Nature 629, 1034–1040 (2024).
Sikorski, O., Izzo, D. & Meoni, G. Event-based spacecraft landing using time-to-contact. In Proc. IEEE/CVF Conference on Computer Vision 1941–1950 (IEEE, 2021).
Ni, Z., Pacoret, C., Benosman, R., Ieng, S. & Régnier, S. Asynchronous event-based high speed vision for microparticle tracking. J. Microsc. 245, 236–244 (2012).
Mangalwedhekar, R. et al. Achieving nanoscale precision using neuromorphic localization microscopy. Nat. Nanotechnol. 18, 380–389 (2023).
Ng, Y., Latif, Y., Chin, T.-J. & Mahony, R. Asynchronous Kalman filter for event-based star tracking. In Proc. European Conference on Computer Vision 66–79 (Springer, 2022).
Poggio, M., Degen, C. L., Mamin, H. J. & Rugar, D. Feedback cooling of a cantilever’s fundamental mode below 5 mk. Phys. Rev. Lett. 99, 017201 (2007).
Tebbenjohanns, F., Frimmer, M., Militaru, A., Jain, V. & Novotny, L. Cold damping of an optically levitated nanoparticle to microkelvin temperatures. Phys. Rev. Lett. 122, 223601 (2019).
Conangla, G. P. et al. Optimal feedback cooling of a charged levitated nanoparticle with adaptive control. Phys. Rev. Lett. 122, 223602 (2019).
Palit, S. Signal extraction from multiple noisy sensors. Signal Process. 61, 199–212 (1997).
Sasiadek, J. Sensor fusion. Annu. Rev. Control 26, 203–228 (2002).
Nazarahari, M. & Rouhani, H. 40 years of sensor fusion for orientation tracking via magnetic and inertial measurement units: methods, lessons learned, and future challenges. Inf. Fusion 68, 67–84 (2021).
Melo, B., T Cuairan, M., Tomassi, G. F. M., Meyer, N. & Quidant, R. Vacuum levitation and motion control on chip. Nat. Nanotechnol. 19, 1270–1276 (2024).
Kane, B. E. Levitated spinning graphene flakes in an electric quadrupole ion trap. Phys. Rev. B 82, 115441 (2010).
Kuhlicke, A., Schell, A. W., Zoll, J. & Benson, O. Nitrogen vacancy center fluorescence from a submicron diamond cluster levitated in a linear quadrupole ion trap. Appl. Phys. Lett. 105, 073101 (2014).
Millen, J., Fonseca, P. Z. G., Mavrogordatos, T., Monteiro, T. S. & Barker, P. F. Cavity cooling a single charged levitated nanosphere. Phys. Rev. Lett. 114, 123602 (2015).
Delord, T., Nicolas, L., Schwab, L. & Hétet, G. Electron spin resonance from nv centers in diamonds levitating in an ion trap. New J. Phys. 19, 033031 (2017).
Ren, Y. et al. Event-based imaging of levitated microparticles. Appl. Phys. Lett. 121, 113506 (2022).
Svak, V. et al. Stochastic dynamics of optically bound matter levitated in vacuum. Optica 8, 220–229 (2021).
Monteiro, F. et al. Force and acceleration sensing with optically levitated nanogram masses at microkelvin temperatures. Phys. Rev. A 101, 053835 (2020).
Mason, D., Chen, J., Rossi, M., Tsaturyan, Y. & Schliesser, A. Continuous force and displacement measurement below the standard quantum limit. Nat. Phys. 15, 745–749 (2019).
Černotík, O. & Filip, R. Strong mechanical squeezing for a levitated particle by coherent scattering. Phys. Rev. Res. 2, 013052 (2020).
Penny, T., Pontin, A. & Barker, P. Performance and limits of feedback cooling methods for levitated oscillators: a direct comparison. Phys. Rev. A 104, 023502 (2021).
Dania, L., Bykov, D. S., Knoll, M., Mestres, P. & Northup, T. E. Optical and electrical feedback cooling of a silica nanoparticle levitated in a Paul trap. Phys. Rev. Res. 3, 013018 (2021).
Debiossac, M., Grass, D., Alonso, J. J., Lutz, E. & Kiesel, N. Thermodynamics of continuous non-markovian feedback control. Nat. Commun. 11, 1360 (2020).
Werneck, L. R. et al. Cross-correlation image analysis for real-time single particle tracking. Rev. Sci. Instrum. 95, 073708 (2024).
Gosling, J. M. H. et al. Feedback cooling scheme for an optically levitated oscillator with controlled cross-talk. Preprint at arXiv https://doi.org/10.48550/arXiv.2506.17172 (2025).
Jain, V. et al. Direct measurement of photon recoil from a levitated nanoparticle. Phys. Rev. Lett. 116, 243601 (2016).
Vovrosh, J. et al. Parametric feedback cooling of levitated optomechanics in a parabolic mirror trap. J. Opt. Soc. Am. B 34, 1421–1428 (2017).
Bullier, N. P., Pontin, A. & Barker, P. F. Super-resolution imaging of a low frequency levitated oscillator. Rev. Sci. Instrum. 90, 093201 (2019).
Apps, A., Wang, Z., Perejogin, V., Molloy, T. L. & Mahony, R. Asynchronous Multi-Object Tracking with an Event Camera. IEEE International Conference on Robotics and Automation (ICRA), 794–800 https://doi.org/10.1109/ICRA55743.2025.11127984 (2025).
Furmonas, J., Liobe, J. & Barzdenas, V. Analytical review of event-based camera depth estimation methods and systems. Sensors 22, https://www.mdpi.com/1424-8220/22/3/1201 (2022).
Kim, H., Leutenegger, S. & Davison, A. J. Real-time 3d reconstruction and 6-DOF tracking with an event camera. in Computer Vision—ECCV 2016 (eds Leibe, B., Matas, J., Sebe, N. & Welling, M.) 349–364 (Springer International Publishing, 2016).
Bykov, D. S., Mestres, P., Dania, L., Schmöger, L. & Northup, T. E. Direct loading of nanoparticles under high vacuum into a Paul trap for levitodynamical experiments. Appl. Phys. Lett. 115, 034101 (2019).
Pontin, A., Bullier, N., Toroš, M. & Barker, P. Ultranarrow-linewidth levitated nano-oscillator for testing dissipative wave-function collapse. Phys. Rev. Res. 2, 023349 (2020).
Nikkhou, M., Hu, Y., Sabin, J. A. & Millen, J. Direct and clean loading of nanoparticles into optical traps at millibar pressures. Photonics 8, 458 (2021).
Acknowledgements
The authors would like to thank Prof David Moore for useful discussions, Dr Ruvi Lecamwasam for assistance with writing FPGA code, and Dr John Dale for bringing neuromorphic imaging to our attention. This work is supported by STFC Grant ST/Y004914/1, EPSRC Grant EP/S004777/1 and ERC Starting Grant 803277.
Author information
Authors and Affiliations
Contributions
Y.R.—experimental design and build, data taking, data analysis. B.S.—experimental design. R.Y.—data taking. Q.W.—supporting simulations. J.P.—data analysis. M.R.—experimental design. J.M.—experimental design, data analysis.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Communications thanks Sreetosh Goswami and the other anonymous reviewer(s) for their contribution to the peer review of this work. [A peer review file is available].
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ren, Y., Siegel, B., Yin, R. et al. Neuromorphic detection and cooling of microparticles in arrays. Nat Commun 16, 10658 (2025). https://doi.org/10.1038/s41467-025-65677-0
Received:
Accepted:
Published:
Version of record:
DOI: https://doi.org/10.1038/s41467-025-65677-0








