Introduction

Edge states in two-dimensional (2D) systems can act as a unique one-dimensional (1D) conductive channel and play an important role in electron transport, which merits applications in spintronics and optoelectronics. For example, the quantum spin Hall effects in 2D topological insulators is endowed by the topological edge states exhibiting dissipationless electron transport channels1. Theoretically, when a homogeneous 2D electron gas is penetrated by a strong magnetic field, spin-polarized edge states will emerge2, which can host pure 1D chiral current along the edges. Spin-polarized edge states have been reported in several 2D materials. For examples, pristine zigzag graphene nanoribbons have been confirmed to possess stable ferromagnetic coupling along the edge and antiferromagnetic coupling across the edge, which can be further tuned by edge modification3,4,5,6. Also, 1D magnetic metallic channels have been reported in MoS2 nanoribbons and Mo edges of MoS2 islands7,8,9, and two symmetrical Pt edges in PtS2 exhibit both metallic and magnetic properties with spin up and spin down configurations10. Moreover, as good candidates for the quantum anomalous Hall effect, magnetic topological insulators with spin-polarized chiral edge states1,11,12,13 have been suggested to construct spintronics and quantum computing devices. However, the direct observation of spin-polarized edge states in intrinsic magnetic insulators is still rare.

Tailoring 2D materials with bulk-boundary correspondence is a fascinating and feasible approach for generating specific edge states, and it is more convenient than growing nanoribbons and conventional 1D metal wires14,15. More importantly, edge states with exotic quantum properties could be tuned by precisely controlling the terminations and orientations of 2D materials. For example, 1D topologically nontrivial edge states can be obtained in 2D quantum spin Hall insulators when the bulk insulators are terminated by edges16,17,18. However, the realization of spin-polarized edge states in 2D materials with thickness down to the monolayer limit is still lacking and remains challenging.

2D transition metal dihalides MH2 (M = V, Mn, Fe, Co, Ni; H = Cl, Br, I), with intrinsic band gap and magnetism19,20,21,22,23,24, are possible candidates for magnetic topological materials25. Among them, monolayer NiI220,21,22,23,26,27,28,29,30,31,32,33,34 as shown in Fig. 1a was recently suggested to be a 2D type-II multiferroic semiconductor23, exhibiting proper-screw helix spin ordering and chirality-dependent electric polarization down to the monolayer limit23. Although the single-layer multiferroic NiI2 have been studied by Raman spectroscopy, second harmonic generation (SHG) etc35, it remains essentially unknown how the coupling between the spin ordering and electric polarization can persist along one-dimensional edge. In this work, we successfully synthesized NiI2 monolayer on an iodine-modified Au(111) surface by molecular beam epitaxy (MBE) for the first time. Spin-polarized scanning tunneling microscopy/spectroscopy (SP-STM/STS) measurements revealed that significant spin-polarized 1D edge states occur at the Ni-terminated edges of NiI2 islands rather than the I-terminated edges. Density functional theory (DFT) calculations show that the monolayer NiI2 has broken three-fold symmetry due to the striped spin ordering giving rise to the orientation-selective spin-polarized edge states. Our results suggest that monolayer NiI2 with orientation-selective spin-polarized edge states can not only act as a new platform for 2D obstructed atomic insulators, but may contribute to the development of spintronic devices and exotic quantum computing.

Fig. 1: Monolayer NiI2 islands grown on iodine modified Au(111).
figure 1

a Side view and top view of the crystal structure of monolayer NiI2. b Topography of the Au(111) surface reconstructions with herringbone pattern (100 × 100 nm2; Vs = −3.0 V, Is = 50 pA). c STM image of iodine modified Au(111) (100 × 100 nm2; Vs = −1.0 V, Is = 50 pA). d Topography of NiI2 monolayer islands on I/Au(111) substrate (300 × 300 nm2; Vs = 1.1 V, Is = 50 pA). The white dotted lines outline the shapes of the NiI2 islands. e, f Atomically resolved STM topographic image with Cr tip and top view of the crystal structure of monolayer NiI2 with spin spiral order. Line profile along purple line in atomic-resolution image. The spin directions are labeled by red arrows.

Results

Growth and atomic structure of monolayer NiI2

In experiments, we grew NiI2 on a clean Au(111) surface which exhibits a clear herringbone structure (Fig. 1b), by directly evaporating NiI2 powder from a homebuilt evaporator. However, due to the easy decomposition of NiI2 during growth when the source temperature increases, iodine atoms will first emerge from the evaporator and consequently be deposited on the Au(111) substrate, resulting in an iodine-covered Au(111) surface without the pristine herringbone reconstruction (Fig. 1c). High-resolution STM images taken on an iodine-covered Au(111) surface reveal two different structures in Supplementary Information Fig. S1a and S1b, which have been previously reported36. The pre-adsorption of iodine on Au(111) and the formation of iodine-modified Au(111) reconstruction [denoted by I/Au(111)] could eliminate the strain on the pristine Au(111) surface acting like buffer layer. Consequently, the successively grown 2D materials on such I/Au(111) surface can be expected to exhibit weaker interface interactions and retain most of their pristine physical properties.

As the source temperature increases, NiI2 islands with hexagonal shape form on the I/Au(111) surface, as shown in the STM image of Fig. 1d, which exhibits two opposite orientations with respect to the Au(111) surface. The inset line profile implies that the height of the islands relative to I/Au(111) is ~6.8 Å, corresponding qualitatively to one monolayer thickness of the islands. The high-resolution STM images taken on the surface of the islands reveal hexagonal closely-packed protrusions with a lattice constant of a = 4.0 ± 0.05 Å and two stripes pattern within 9 × √3 supercell (Fig. 1e and Figure S1). It was recently proposed the spatial modulation of striped pattern arises possibly from the novel magnetic structure of one-dimensional spin spiral in multiferroic NiI2 monolayer as shown in Fig. 1f37,38. The possibility that the moiré structure is the origin of 9 × √3 supercell is excluded by the continuous visualization of stripes across the substrate steps [Supplementary Information Fig. S2]. Combining the island height and the lattice constant, we infer that these islands are NiI2 monolayers, and that the atoms on the island surface are iodine atoms. The top sublayer consists of iodine atoms due to the I-Ni-I crystal structure, which is consistent with previous reports19,22,23,26. To further confirm the composition of the sample, we have performed X-ray photoelectron spectroscopy (XPS) measurements on monolayer sample on I/Au and NiI2 powder. The binding energy peaks of Ni-2p3/2, I-3p3/2, I-3d and Au-4f of sample are shown in Supplementary Information Fig. S3. The results of XPS showed that the binding energy peak shapes and energy positions of Ni and I in sample as same as those in NiI2 powder, and are consistent with previous reports39,40. Hence, we confirmed that the islands on I/Au surface was NiI2.

STS measurements of orientation-selective spin-polarized edge states

To reveal the electronic structures of monolayer NiI2, we performed STS measurements on monolayer NiI2 island with W tip. Figure 2a shows a hexagonal NiI2 island exhibiting alternating edge length. Since the surface atoms resolved by atomic-resolution STM images should be top-layer iodine atoms according to the I-Ni-I crystal structure, we can superimpose the atomic model of NiI2 on the atomic-resolution STM images of NiI2 islands with different edges, then determine the types of terminated atoms. According to the atomic-resolution images of the island edges of NiI2, we can conclude that there are two kinds of zigzag edges in such hexagonal NiI2 islands (Fig. 2b): Ni-edge and I-edge, corresponding to the long and short edges in Fig. 2a respectively. The line profiles across the I-edge and Ni-edge of NiI2 island in Fig. 2b and the results are shown in Supplementary Information Figure S4. The distinct line profiles across the edges can distinguish different terminated atoms. The dI/dV spectrum taken on the terrace of NiI2 islands shows a characteristic gap of 1.65 eV, with the conduction band minimum (CBM) located about 850 meV above the Fermi level (Fig. 2c).

Fig. 2: The orientation-selected edge states of an NiI2 island measured with a W tip.
figure 2

a STM image of monolayer NiI2 island with hexagonal shape (Vs = 0.3 V, Is = 100 pA). b Top view of ball model and high-resolution STM images of hexagonal NiI2 island terminated by Ni-edges and I-edges (Vs = 0.5 V, Is = 100 pA). The overlying atomic model is denoted by colors: Itop: blue; Ni: gray; Ibottom: yellow. c dI/dV spectra taken in the Ni-edge, interior terrace, and I-edge of the NiI2 island in (a). The gray arrow indicates the position of the edge state. d Spatially resolved dI/dV map along the black dotted lines shown in (a). e Vertically stacked dI/dV mappings of the same NiI2 island depending on different sample bias voltages.

The STS of Ni-edge shows an extra shoulder in the density of states (DOS) at 700–900 meV with considerably higher intensities than on the terrace, suggesting the existence of edge states at the Ni-edge. In contrast, STS images taken at the I-edge show the same feature as on the terrace, and there is no extra shoulder of DOS. Therefore, the edge state shows distinctive orientation selectivity. The evolution of the edge states in real space is also illustrated in the color map in Fig. 2d, which consists of a series of dI/dV curves acquired along a line across Ni-edge of the NiI2 island. A prominent edge state occurs at Ni-edges at 700–900 meV, while the DOS of the inner terrace is weak and spatially homogenous. The energy window of this delineated edge state is about 200 meV.

Figure 2e shows the corresponding dI/dV mappings of the same NiI2 island taken at a series of sample biases. The significant edge states can be observed at the three symmetrical Ni-edges in the energy range 800–900 meV above the Fermi level, but are absent at the I-edges. The penetration depth of edge state across the Ni-edges is about 2 nm, indicating that the distribution of edge states in NiI2 exhibits a certain degree broadening in real space. Factors such as the electronic wave function distribution and the decay behavior of the edge states could contribute to this characteristic penetration depth in the STS measurements. When the bias is above 1 eV, the edge states immerse within the bulk states and can’t be distinguished. Orientation-selective edge states can also be observed simultaneously on two neighboring islands with opposite orientations, as shown in Supplementary Information Fig. S5.

Furthermore, we performed SP-STM experiments to detect the spin-polarized edge states of monolayer NiI2 using Cr tip. Before characterizing the NiI2 island with Cr tip, we first checked the spin polarized ability of Cr tip on the Cr(100) surface, in which the neighbor Cr layers have a antiparallel spin orientation [Supplementary Information Fig. S6]. Figure 3a illustrates a hexagonal NiI2 island exhibiting a spin spiral with stripe modulation, and the stripe modulation can extend to the edges of NiI2 island. The six edges of the NiI2 island are composed of alternating Ni-edge and I-edge, as observed in the island in Fig. 2a. The STS of Ni-edge by Cr tip still reveals an additional peak at about 0.9 eV, signifying the existence of edge states at the Ni-edge, whereas no such states are observed at the I-edge (Fig. 3b). Therefore, the clear orientation selectivity of the edge states in NiI2 is a prevalent phenomenon. Referring to the detection method of spin-polarized edge states in other systems41,42,43, we measured the dI/dV spectra [state 1 (Ni1): blue curve and state 2 (Ni2): red curve] on Ni-edges at two different tip spin states (tip state 1 and 2), as show in top panel of Fig. 3c. Then we set the dI/dV spectra taken at I-edge as a reference signal at a certain tip spin state [light grey curve in Fig. 3c], and calculated spin asymmetry of Ni-edge state (Sa) through taking the difference of the dI/dV signal divided by the corresponding reference [Sa = (Ni2-I2)/I2 – (Ni1-I1)/I1, green curve in Fig. 3c]. The distinct spin asymmetry of the edge states indicates that the edge states are spin-polarized, as shown in bottom panel of Fig. 3c. For comparison, we recorded the dI/dV signals on Ni-edge and I-edge by W tip with two different tip states, then calculated the spin asymmetry using the same method with Cr tip. The results are shown in Supplementary Information Figure S7. The spin asymmetry of Ni-edges is quite small at two different tip states, which is significantly different from those obtained by Cr tip with different tip states, suggesting the presence of spin tunneling current. Figure 3d shows the corresponding dI/dV mappings of the NiI2 island in Fig. 3a. The edge states can be observed at the three symmetrical Ni-edges in the energy range from 800 meV to 900 meV, but are absent at the I-edges. Meanwhile, the spin spiral stripe modulation of the terrace extends to the edges. There is always defect on the edges of NiI2 islands, and the edge defects affect the spin states and edge states. Figure 3d indicates an island with defects on edge, which exhibits the modulation stemmed from spin spiral configurations. We can observe the presence of defects along the Ni-edges of the NiI2 island, which induces in the discontinuity of edge states along the edge. Additionally, the spin-polarization modulation is also influenced in areas where defects occur on the terrace and edges.

Fig. 3: The orientation-selected spin-polarized edge states of an NiI2 island measured with a Cr tip.
figure 3

a SP-STM image of monolayer NiI2 island with stripe modulation (Vs = 0.87 V, Is = 100 pA). b dI/dV spectra taken in the Ni-edge, interior terrace, and I-edge of the NiI2 island. The gray arrow indicates the position of the edge state. c Spin resolved point spectroscopy at the Ni-edge position indicated by red with blue point in (a) for the tip spin state 1 (blue curve) and tip spin state 2 (red curve). The resulting energy-resolved spin polarization is given by the green curve in the bottom panel of (c). Light grey curve represent the background asymmetry obtained over I-edge (reference). d Vertically stacked dI/dV mappings of the same NiI2 island depending on different sample bias voltages. e Spin-polarized tunneling spectra at positive and negative out-of-plane magnetic fields (±6 T) obtained on one position in the inset. The inset indicates the STM image of NiI2 island with Ni-edge. f dI/dV signal as a function of the magnetic field at Vs = 0.8 V. The out-of-plane magnetic field was swept upward (black points) and downward (red points). Error bar indicate the resolution of the differential conductance in the measurement. The hysteresis loop is fitted as dot lines.

Furthermore, we performed the SP-STM experiment under external magnetic fields. Figure 3e shows the dI/dV curves taken on the Ni-edge of a monolayer NiI2 island with oppositely applied magnetic fields (B = ± 6 T). It is obvious that the edge state intensity is changed under reversed magnetic field, confirming the existence of spin-polarized tunneling current. Furthermore, a series of dI/dV spectra are obtained as the magnetic field (±7 T) is sweeping forth and back. Figure 3f shows the edge state intensity (Vs = 0.8 V) as a function of magnetic field. We can observe a hysteresis loop with two approximate plateaus corresponding to two spin-polarized states, exhibiting a similar ferromagnetic hysteresis. Additionally, the dI/dV plateaus is sensitively depend on several parameters such as bias, atomic sites and Cr tip states44. Combining the above STS results with external magnetic field, we believe that the edge states of NiI2 island is spin-polarized.

First-principles calculations of edge states

To understand the orientation selectivity of the edge states, we performed first-principles calculations on an NiI2 monolayer and on nanoribbons. We chose experimental lattice constants of the monolayer NiI2 to construct the primitive cell. As a type-II multiferroic materials in bulk form, the nature of spin ordering and electric polarization in ultimate limit of NiI2 monolayer is recently under hot debate20,21,22,23,24,26,27,28,29,30,31,32,33. Then in the spirit of previous reports23,33, we first studied the ground state by choosing a variety of spin ordering in DFT calculations, including ferromagnetic (FM), collinear-antiferromagnetic (collinear-AFM), bicollinear-AFM (bc-AFM), zigzag-AFM and in plane 7 × 1 spin spiral order, in plane 9 × √3 spin spiral order, canted plane 4.5 × √3 spin spiral order, as shown in Supplementary Information Figure S8. If the energy of 4.5 × √3 spin spiral state is set as a reference, the relative energies with respect to other spin configurations are listed in Supplementary Information Table S1. Clearly, the 4.5 × √3 spin spiral state with broken three-fold rotational symmetry has lower energy, which agree well with the latest work38.

First-principles calculations show that the band gap of NiI2 is smaller than the STS measurements. The Hubbard’s U = 4.2 eV and Hund’s exchange coupling constant J = 0.8 eV for Ni 3d orbitals are adopted in the following, according to the references33,38. The calculated magnetic moment is 1.42 μB per Ni mainly from Ni 3 d orbitals. Figure 4a shows the band structures of NiI2 in the 4.5 × √3 spin spiral state with spin orbit coupling (SOC). It is clear that the NiI2 monolayer is a insulator with a large band gap of 1.2 eV.

Fig. 4: The calculated electronic states of NiI2 monolayer and nanoribbon.
figure 4

a Band structures of NiI2 monolayer with SOC included in the 4.5 × √3 spin spiral state. b The upper and lower panels show the edge geometric structures and magnetic structures of zigzag nanoribbons terminated by Ni and I atoms, respectively. The spin orientations of each Ni atom are labeled by red arrows. The edge states for the freestanding NiI2 nanoribbons with c Ni-terminated edges and d I-terminated edges. The edge states are marked by purple arrow. e The distribution of partial charge density of the Ni-terminated edge states at the Γ point as denoted by purple arrow in c. The isosurface is set to 1 × 10–6e/Å3. The planar-averaged charge density across the nanoribbon width is shown in the right part of (e). f The distribution of magnetization density of the nanoribbons in the spin-spiral state. The yellow and cyan contours represent positive and negative moments along the x direction, respectively. The isosurface is set to 1.5 × 10–3e/Å3.

We then calculated the band structures by constructing zigzag NiI2 nanoribbons terminated by two kinds of edges (Ni-terminated and I-terminated) as shown in Fig. 4b. The relaxed magnetic structure of the nanoribbon edge, reveal that the magnetic structure of the edge atoms maintains the spin spiral order, which is consistent with the bulk state. From the band structures of the Ni-terminated nanoribbon (Fig. 4c), it is clear that there are unoccupied edge states completely disentangled with higher energy bands throughout the Brillouin zone (BZ) located near the bottom of the conduction band. In contrast, the band structures of the I-terminated nanoribbon has a clean band gap without additional states (Fig. 4d), indicating that the edge states of monolayer NiI2 have a clear orientation selectivity. In addition, the emergence of edge states is related to the edge termination rather than spin configurations. At the NiI2 island edge, the Ni atoms at the Ni-edge are exposed, with their unfilled d orbitals forming an unsaturated bond state. Excess electrons are thus prone to forming dangling bonds. The edge states obtained in calculations are including the status of dangling bonds. We have also added the results of bc-AFM, FM and in plane 9 × √3 spin spiral states calculations to the Supplementary Information Fig. S9S11, showing that such edge states can also be provided. Figure 4e shows the real spatial distribution of charge density of the edge states, which are clearly localized at the edges of the Ni-terminated nanoribbon. The right panel of Fig. 4e shows the planar-averaged charge density across the nanoribbon, which exhibit the penetration width of 1.0 nm resembling to the broadening width of localized states shown in Fig. 2e. The distribution of magnetization density of the nanoribbon (Fig. 4f) shows a periodic stripe modulation in both the edge and bulk states, indicating that they have the same magnetic structure, which is consistent with the experimental observation and the optimization calculation of the magnetic structure. Therefore, the 1D edge states of the NiI2 monolayer terminated by Ni atoms are spin-polarized panetrating the spin spiral state far beyond nanometer agreeing with the experimental observation of stripe pattern. Due to the broken inversion symmetry from the spin spiral ordered magnetic structure, NiI2 monolayer exhibits ferroelectric polarization characterized by real-space modulation of magnetization state.

Further discussions on orientation-selective edge states in 2D trivial insulator

Recently, Xu et al.45,46 provided the full classification of three-dimensional (3D) obstructed atomic insulators (OAIs) by the real space invariants (RSIs) in 3D topologically trivial insulators. All of them present a filling anomaly under certain open-boundary conditions and exhibit obstructed surface states (OSSs) or higher order obstructed edge states (OESs)45,46,47,48. Although the spin-polarized edge states shown in Fig. 4c, e are topologically trivial without bulk-boundary correspondence, the exotic magnetic configuration breaking the inversion symmetry of atomic structure provide new possibility to tune the polarization in the monolayer limit. Moreover, the edge states in NiI2 throughout the 1D BZ disentangling with the higher conduction band and lower valence bands show similar behaviors with OESs in Maxene systems like MoSi2N447 and breathing Kagome systems like Nb3TeCl749, which offers a potential platform for realizing 2D OAI and higher order topological states. The disentanglement of edge states with inherently large gaps provides a noise-free background for experimental development of ultra-low dissipation spintronic devices. In addition to cutting off two types of atoms on crystal structure, it is also possible to manipulate the edge states by doping other elements (substitution atoms) during growth to modify crystal structures50,51. The potential applications of 2D OAI on catalysis48 and superconductivity52 will have the opportunity to extend the applications of spin-polarized edge states of monolayer NiI2, which may serve as a 1D catalytic active site53 or a 1D topological superconductivity54,55.

Discussion

In summary, we have successfully synthesized the monolayer NiI2 islands on an iodine-modified Au(111) substrate. SP-STM/STS measurements and first-principles calculations reveal that spin-polarized edge states exist at the Ni-terminated edges but not at the I-terminated edges in monolayer NiI2. The edge states of NiI2 have well-defined orientation selectivity and spin-polarization. This result will be beneficial for tuning edge states by edge modification and it has potential applications in the development of spintronic devices in 2D magnetic insulators. Furthermore, the unique edge states that rely on specific cutoff edges in topologically trivial systems allow the use of NiI2 to provide insight into the study of OAI materials.

Methods

Sample fabrication and SP-STM/STS characterization

The experiments were performed in a homebuilt low-temperature STM with an MBE system (base pressure ~10−8 Pa). The iodine was first evaporated onto a clean Au(111) substrate by using a homebuilt evaporator (NiI2 powder, 99.5%). Then NiI2 powder was evaporated onto the iodine-modified Au(111) substrate by slightly increasing the evaporation temperature of the evaporator and was annealed at ~100°. After growth, the sample was transferred to an STM chamber without breaking the vacuum. All the STM and spin-polarized STM images were taken at 5 K using an electrochemically etched W tip and Cr tip. The tip states are changed by applying the pulse voltage. We performed in situ spin-polarized STM measurements with an applied out-of-plane magnetic field at 4.6 K in the Unisoku STM (1300) system. The STS spectra were taken by using a lock-in amplifier with a modulation voltage from 10 to 20 mV at a frequency of 667 Hz. The STM/STS data were processed using free WSxM software56.

Theoretical calculations

Calculations were performed using the plane-wave basis set as implemented in the Vienna ab initio simulation package (VASP) software package57,58.The generalized gradient approximation (GGA) of the Perdew-Burke-Ernzerhof (PBE) formulation was used to calculate the exchange-correlation potentials in the electronic structure calculations59. The projector augmented wave (PAW) method was employed to model the electron-ion interactions60,61. The effective on-site Coulomb U and exchange interactions J, were introduced to treat the strong correlation of the localized electrons of the transition metal ions62,63,64. The effective values of U and J applied on Ni 3d electrons were 4.2 eV and 0.8 eV, respectively. A k mesh of 1 × 6 × 1 was used to sample the whole Brillouin zone (BZ), and a Gaussian smearing of 0.05 eV was adopted for the Fermi surface broadening. After convergence tests, the kinetic-energy cutoff of the plane-wave basis was set to be 500 eV. The total energy convergence and the atomic force tolerance were set to 10−5 eV and 0.01 eV/Å, respectively. The edge states were studied using tight-binding methods by the combination of Wannier9065 and WannierTools66 software packages.