Arxiv:2101.05763V1 [Cond-Mat.Str-El] 14 Jan 2021 Netism in the Kagome Lattice [6] and ﬁnd That the Volume- Along the C-Axis (Figure 2A) [19–25]

preprint(January 15, 2021)

Intriguing magnetism of the topological kagome magnet TbMn6Sn6

C. Mielke III,1, 2 Wenlong Ma,3 V. Pomjakushin,4 O. Zaharko,4 X. Liu,2 J.-X. Yin,5 S.S. Tsirkin,2 T.A. Cochran,5 M. Medarde,6 V. Porée,4 D. Das,1 C.N. Wang,1 J. Chang,2 T. Neupert,2 A. Amato,1 S. Jia,3, 7 M.Z. Hasan,5 H. Luetkens,1 and Z. Guguchia1, ∗ 1Laboratory for Muon Spin Spectroscopy, Paul Scherrer Institute, CH-5232 Villigen PSI, Switzerland 2Department of Physics, University of Zürich,Winterthurerstrasse 190, Zurich, Switzerland 3International Center for Quantum Materials, School of Physics, Peking University, Beijing, China 4Laboratory for Neutron Scattering and Imaging, Paul Scherrer Institut, CH-5232 Villigen PSI, Switzerland 5Laboratory for Topological Quantum Matter and Spectroscopy, Department of Physics, Princeton University, Princeton, New Jersey 08544, USA 6Laboratory for Multiscale Materials Experiments, Paul Scherrer Institut, CH-5232 Villigen PSI, Switzerland 7CAS Center for Excellence in Topological Quantum Computation, University of Chinese Academy of Science, Beijing, China Magnetic topological phases of quantum matter are an emerging frontier in physics and material science [1–10]. Along these lines, several kagome magnets have ap- peared as the most promising platforms. Here, we explore magnetic correlations in the transition-metal-based kagome magnet TbMn6Sn6 [11]. Our results show that the system exhibits an out-of-plane ferrimagnetic structure P 6/mm0m0 (comprised by Tb and Mn moments) with slow magnetic fluctuations in a wide temperature range. ∗ These fluctuations exhibit a slowing down below TC1 ' 120 K and a slightly modified quasi-static magnetic state is established below TC1 ' 20 K. A canted variation of the P 6/mm0m0 structure is possible, where all moments contribute to a net c-axis ferrimagnetic state which exhibits zero net in-plane components. Alternatively, a small incommensurate k-vector could arise below TC1. We further show that the temperature evolution of the anomalous Hall conductivity (AHC) is strongly influenced by the low temperature magnetic crossover. More importantly, the here identified magnetic state seems to be responsible for the large quasi-linear magnetoresistance as well as for the appearance of quantum oscillations, which are related to the quantized Lan- dau fan structure featuring a spin-polarized Dirac dispersion with a large Chern gap. Therefore the exciting perspective of a magnetic system arises in which the topological response can be controlled, and thus explored, over a wide range of parameters.

I. INTRODUCTION which originates in frustrated interplanar exchange in- teractions that trigger strong magnetic fluctuations, was discussed as the reason for the topological Hall effect. With distinguished symmetry and associated geomet- This suggests that detailed experimental studies to un- rical frustration, the kagome lattice can host peculiar derstand the magnetic fluctuations as well as the static states including flat bands [1], Dirac fermions [2, 3] and magnetic structure of these systems is necessary to re- spin liquid phases [4, 5]. Magnetic kagome materials are veal the coupling between relativistic electrons and the an ideal setting in which strongly correlated topologi- magnetic properties. cal electronic states may emerge [6–12]. In particular, transition-metal-based kagome magnets [1–6, 13–18] are In this so-called 166 materials, TbMn6Sn6 contains emerging as outstanding candidates for such states, as the heavy rare earth Tb crystallizes in a HfFe6Ge6-type they feature both large Berry curvature fields and un- structure (space group P 6/mmm) and is composed of usual magnetic tunability. As an example, we estab- hexagonal Tb layers containing Sn atoms and Mn kagome lished Co3Sn2S2 as a material that hosts frustrated magnets, stacked in the sequence -Mn-Tb-Mn-Mn-Tb-Mn-

arXiv:2101.05763v1 [cond-mat.str-el] 14 Jan 2021 netism in the kagome lattice [6] and find that the volume- along the c-axis (Figure 2a) [19–25]. Structurally, com- wise magnetic competition drives the thermodynamic or pared with the Co3Sn2S2 system consisting of a Co3Sn quantum evolution of the intrinsic AHC, thereby tuning kagome layer and a Sn2 honeycomb layer, the RMn6Sn6 its topological state. A number of nontrivial magnetic system features a pristine Mn3 kagome layer (Fig. 2a), phases and a large topological Hall effect was also ob- as the Sn atoms are pushed away from the kagome layer served in another rare earth-transition metal based sys- by the chemical pressure from the R atoms. TbMn6Sn6 tem YMn6Sn6 [18]. A new nematic chirality mechanism, has two different magnetic sublattices: Tb- and Mn- sublattices. Previous neutron diffraction studies indi- cated that this compound exhibits in-plane ferrimagnetic ordering between Tb and Mn sublattices below the Curie ∗ Electronic address: [email protected] temperature TC = 423 K [19, 22], due to the strong Tb- 2

Mn exchange interaction. It was also reported that when ab-plane (Fig. 1b) along the direction of the magnetic the temperature drops to TC2 = 320 K [19, 22], a spin field. reorientation transition occurs and the easy magnetization direction changes from the ab-plane at high temperatures to the c-axis at low temperatures. From the elec- We observe a large and sharp transition occurring tronic point of view, TbMn Sn exhibits Shubnikov-de 6 6 at T ' 320 K, corresponding to the spin reorien- Haas quantum oscillations with nontrivial Berry phases C2 tation transition noted in previous neutron diffraction at relatively low fields (from ∼ 7 T), a large AHC (0.14 studies [19, 22]. This marks the transition between e2/h per Mn kagome layer), arising from Berry curvature a high-temperature in-plane magnetic phase to a low- fields, and quasi-linear (∝ H1.1) magnetoresistance (MR) temperature ferrimagnetic phase with magnetic moments likely resulting from linearly dispersive electrons [11, 16]. oriented out-of-plane, along the crystallographic c-axis. Moreover, TbMn Sn was found to demonstrate a bulk- 6 6 More importantly, when the magnetic field was applied boundary correspondence between the Chern gap and the along the c-axis, we observed a large reduction of zero- topological edge state, as well as Berry curvature field field cooled susceptibility χ below T ∗ ' 120 K correspondence of Chern-gapped Dirac fermions [11, 16]. ZFC C1 Thus, it is identified as a promising topological magnetic and settling into a negligibly small slightly diamagnetic system [11, 16]. Other than the identified high static plateau below TC1 ' 20 K. On the other hand, the field cooled susceptibility χFC shows a weak temperature de- magnetic ordering temperatures of TbMn6Sn6, microscopic studies of spin fluctuations and its tunability re- pendence across 120 K and down to the base-T . This main largely unexplored. gives rise to a much larger hysteresis in TbMn6Sn6 below 120 K than in the T -range of 120 K – 320 K. The Here we utilize high resolution muon-spin rotation plateau completely disappears with the application of (µSR), a very powerful local magnetic probe, in combina- higher magnetic fields, as it is not visible with the ap- tion with magnetization, powder and single crystal neu- plication of even a modest field of 70 mT. The reduction tron diffraction to systematically characterize the phase of χ is also less pronounced in 70 mT. The susceptibil- diagram, uncovering intriguing slow magnetic fluctua- ZFC ity, measured for a field applied in the ab-plane, is largely tions in TbMn Sn in a wide temperature range down 6 6 insensitive to the low-T transition (see Fig. 1b). A closer to 1.7 K. These fluctuations slow down below T ∗ ' 120 C1 view, shown in the inset of Fig. 1b, presents weak hys- K and freeze into a new quasi-static magnetic state be- teresis below T ∗ ' 120 K, suggesting a slightly differ- low T ' 20 K, which is suggested to be different and C1 C1 ent low temperature ferrimagnetic phase with moments more disordered than the ideal out-of-plane ferrimagnetic having a very weak component in the ab-plane. So, the state, observed at higher temperatures. T is considered C1 large difference between the FC and ZFC response is not as a magnetic crossover temperature signaling a slowing caused by the appearance of the in-plane structure but, down of magnetic fluctuations rather than being regarded rather, is consistent with the scenario that different out- as a true phase transition temperature. We also find of-plane ferrimagnetic domains tend to cancel out (anti- that the AHC does not follow the temperature evolu- align) after ZFC. If we FC the sample even in low fields, tion of the static Tb and Mn moments, but it is strongly then the domains align. This suggests that both mag- influenced by the observed low-temperature magnetic netic orders above and below 120 K are c-axis aligned, crossover. Moreover, the large linear MR and the quan- but slightly different from each other. This conclusion is tum oscillations, which are related to the quantized Lan- also substantiated by the field dependent measurements dau fan structure featuring a spin-polarized Dirac dis- of ZFC magnetization at T = 1.8 K, 250 K, and at 350 persion with a large Chern gap, appear below T ∗ and C1 K, measured for the field applied along the c-axis (Figure T , respectively. Thus, an intimate coupling between C1 1c) and along the ab-plane (Figure 1d). The critical fields the novel low-T magnetic state and the quantum-limit above which the magnetization plateau appears are sim- Chern gapped phase of TbMn Sn is concluded. 6 6 ilar for T = 1.8 K and 250 K. The only difference is that the data collected at 1.8 K show a plateau up to 12 mT, before increasing and then entering the linear regime, im- II. RESULTS plying that the plateau, which is a characteristic feature for the low-T state, is easily destroyed by weak applied A. Macroscopic magnetic properties fields. For H k c, the saturated magnetization does not occur at 350 K until a relatively high applied magnetic First, we carried out temperature and field depen- field of ' 1.2 T (inset of Figure 1c), much higher than dent magnetization experiments. The temperature de- 175-200 mT at 5 K and 250 K (Fig. 1c). Conversely, pendence of the zero-field-cooled (ZFC) and field-cooled when the field is applied along the ab-plane, saturation is (FC) macroscopic magnetic moment for TbMn6Sn6, almost immediately achieved upon application of 40 mT recorded in low fields of µ0H = 5 mT and 70 mT, are at 350 K, while at the base temperature the plateau was shown in Figs. 1a and b. The single crystal was oriented never achieved even under maximum applied field (7 T). both with the crystallographic c-axis along the direction These results are compatible with the in-plane ferrimag- of the applied magnetic field (Fig. 1a), and with the netic order at 350 K. 3

* a T C 1 T C 2 b T C 2 T * 0 . 1 2 C 1 0 . 0 1 5 F C - 4 ) ) 3 x 1 0 1 1 0 . 1 0 F C - - e e O O - 4 1 1 2 x 1 0 - - 0 . 0 8

0 . 0 1 0 g g u u - 4

m 1 x 1 0 m Z F C e

e 0 . 0 6 ( ( Z F C

0 1 0 0 2 0 0 H H 0 0 0 . 0 0 5 0 . 0 4 µ µ / / M M T C 1 5 m T a l o n g ( 0 0 1 ) 0 . 0 2 5 m T w i t h i n a b - p l a n e 7 0 m T a l o n g ( 0 0 1 ) 7 0 m T w i t h i n a b - p l a n e 0 . 0 0 0 0 . 0 0 0 1 0 0 2 0 0 3 0 0 4 0 0 0 1 0 0 2 0 0 3 0 0 4 0 0 T e m p e r a t u r e ( K ) T e m p e r a t u r e ( K ) c d 3 0 2 5 1 . 8 K ) ) 1 1 - 5 K - 2 5 g 2 0 g u 2 5 0 K u m m

e e 2 0

( ( 1 . 8 K 1 5 n n

o o 3 5 0 K

i 0 5 0 0 1 0 0 0 1 5 0 0 i

t t 1 5 a 2 5 a z 1 0 z i i t 2 0 3 5 0 K t e e

n 1 5 n 1 0 g g

a 5 1 0 a

M 5 M 5 0 0 0 0 5 0 1 0 0 1 5 0 2 0 0 2 5 0 3 0 0 0 1 0 0 0 2 0 0 0 3 0 0 0 4 0 0 0 5 0 0 0 6 0 0 0 F i e l d ( m T ) F i e l d ( m T )

Figure 1: Temperature and field dependent macroscopic magnetic properties. (a-b) The temperature dependence of the zero-field cooled (sample was cooled down to the base-T in zero magnetic field and the measurements were done upon warming) and field-cooled (the sample was cooled down to the base-T in an applied magnetic field and the measurements were done upon warming) magnetization, measured in an field of 5 mT and 70 mT, applied along the (001) direction (a) and applied ∗ within the ab-plane (b). Arrows mark the magnetic transition temperatures TC1, TC1 and TC2. (c-d) The field dependence of the zero-field cooled magnetization, recorded at various temperatures with the field applied along the (001) direction (c) and within the ab-plane (d).

B. Determination of magnetic structure decrease with decreasing temperature and a plateau below 50 K, as depicted in Fig. 2b. We see no new peaks appearing over the entire measured temperature range. The magnetization data presented above clearly The fact that the nuclear structure is unchanged and only demonstrate the presence of a magnetic transition or the magnitude of the magnetic moments varies with tem- ∗ perature follows from the fits of high resolution neutron crossover in TbMn6Sn6 at TC1 ' 120 K in addition to the magnetic transitions at TC2 = 315 K and TC = 430 diffraction. K known from previous studies. In order to substantiate In order to solve the magnetic structure, we performed the presence of the novel magnetic phase transition in refinements of the neutron powder diffraction patterns TbMn6Sn6, we probed the crystal and magnetic struc- with different structural and magnetic models (see the tures of TbMn6Sn6 in the temperature range of 2 - 306 Supplementary Information). The collected diffraction K using high resolution neutron powder [26, 27] and sin- patterns were first refined with powder matching via the gle crystal diffraction. The crystal structure was well LeBail method with FullProf [30], in which all magnetic refined by the Rietveld method, employing a hexagonal Bragg peak intensities are fitted separately without any lattice structure in the space group P 6/mmm, No. 191. model, which confirmed the k-vector (k = 0) found by Lattice constants a and c show a smooth monotonous previous studies [19, 22]. With the propagation vector 4

e 6 0 0 f 7 0 0 g P 6 / m m ' m ' , 2 5 0 K P 6 / m m ' m ' , 7 0 K 7 0 0 P 6 / m m ' m ' , 2 K 2 2 2 5 0 0 χ = 0 . 9 7 6 0 0 χ = 2 . 6 2 χ = 2 . 8 7 ) ) ) 6 0 0 s s s s i n g l e c r y s t a l t t t i i i n n n 5 0 0 u u u

5 0 0 4 0 0 . . . b b b r r r 4 0 0 a a a ( ( ( 4 0 0

3 0 0 d d d e e e t t t 3 0 0 a a a 3 0 0 l l l u u u 2 0 0 c c c l l l 2 0 0 a a a 2 0 0 C C C 1 0 0 1 0 0 1 0 0

0 0 0 0 2 0 0 4 0 0 6 0 0 0 2 0 0 4 0 0 6 0 0 8 0 0 0 2 0 0 4 0 0 6 0 0 8 0 0 O b s e r v e d ( a r b . u n i t s ) O b s e r v e d ( a r b . u n i t s ) O b s e r v e d ( a r b . u n i t s )

Figure 2: Crystal and magnetic structures of TbMn6Sn6. (a) Magnetic structure of TbMn6Sn6. Φ is the deviation angle from the c-axis. Φ = 0◦ indicates out-of-plane ferrimagnetic order and Φ = 90◦ indicates the in-plane ferrimagnetic order. The Mn atoms construct a kagome lattice (red middle size circles), while the Tb atoms (turquoise larger circles) form a honeycomb structure. (b) The temperature dependence of the lattice constants a and c in TbMn6Sn6. (c) The temperature dependence of the terbium and manganese magnetic moments. The error bars represent the s.d. of the fit parameters. (d) The field dependence of the (001) peak, recorded at 2 K and 130 K. (e-g) Comparison between calculated and observed intensities of the diffraction peaks at three different temperatures: 2 K, 70 K, and 250 K. The black line denotes perfect agreement between observed and predicted intensities at 250 K, which is not the case at 70 K and 2 K. at the Γ-point, symmetry analysis was performed using the ISODISTORT tool based on ISOTROPY soft- 5

a b c 3 7 0 K I I I I I I ) ) s s t t i i 2 0 K n 3 4 0 K n u u

. . 3 4 0 K b

b I I r r a 3 1 5 K a ( (

I ) ) 1 0 K I I I ) . B B ( ( u . P P I I a

3 0 0 K I I , , (

3 2 0 K n n

y I o o r i i

t 7 . 5 K t t e u u I I I b

b I I m i i r r 3 1 5 K m t t I I s

s I y i i s 5 0 K 5 K d d

A I I d d l l e e I I i i

I f 3 0 0 K f

3 . 9 K l 5 K l a a n n I I r r I I I e e t t 2 . 8 K 1 0 0 K n n I

1 . 8 K I I I I I I 1 . 8 K 5 0 K 0 . 0 0 . 1 0 . 2 1 0 0 0 2 0 0 0 1 0 0 0 2 0 0 0 T i m e ( µs ) F i e l d ( m T ) F i e l d ( m T )

Figure 3: Zero-field µSR signals for TbMn6Sn6. Zero field time spectra, recorded at various temperatures in the temperature range between 1.8 K to 370 K. The solid lines are the fit of the data using Eq. 2. s. Error bars are the s.e.m. in about 106 events. The error of each bin count n is given by the s.d. of n. The errors of each bin in A(t) are then calculated by s.e. propagation. (b-c) Fourier transform amplitudes of the oscillating components of the µSR time spectra, indicating the internal field distribution P (B), as a function of temperature.

∗ ware, [28, 29] BasiRep program [30] and software tools TC1: 2 K, 70 K and 250 K. The c-axis ferrimagnetic of the Bilbao crystallographic server [31]. With k = P 6/mm0m0 model describes the data at 250 K very well. 0, there are three magnetic irreps that allow non-zero The grey line in Fig. 2e denotes perfect agreement be- magnetic moments on both Tb and Mn sites; mGM2+, tween observed and predicted intensities. At 2 K, how- mGM5+ and mGM6+. The maximal most symmetric ever, the P 6/mm0m0 model does not fit the observed subgroup mGM2+ (P 6/mm0m0 No. 191.240) fits the diffraction pattern well. Intensities of several strong data best, with a similar χ2 to the fit obtained via the peaks match poorly with the model. The χ2 value for the LeBail method, implying that the model can hardly be refinement at 2 K is a factor of three larger than at 250 improved. We note that the model P 6/mm0m0 describes K. At 70 K, the fit is also worse than at 250 K, but still the data equally well over the whole temperature range. slightly better than at 2 K. Similar to powder diffraction The temperature dependence of the estimated magnetic data analysis, we attempted fits with only in-plane mag- moments of Tb and Mn are shown in Fig. 2b. They netic moments, as allowed by the other hexagonal Shub- both increase monotonically with decreasing temperature nikov groups (irreps GM3±, GM4±), and were unable to down to 100 K and stay nearly constant below this tem- find any better solution. We also attempted a hybrid two- perature. phase model, one with in-plane magnetic moments and one with moments out-of-plane, and achieved a fit equiv- Since powder neutron diffraction experiments give alent to purely in-plane magnetic moments. Moreover, powder averaged information, we might miss some pos- the absence of the (001) reflection is also a strong indica- sible subtle changes in the magnetic state, as anticipated tion of the absence of net in-plane moments. Finally, we by magnetization measurements. To further and more attempted fits in the orthorhombic Cm0m0m, mSG No. precisely check the low temperature magnetic structure 65.485, which is generated by the mGM5+ irrep and is a of TbMn6Sn6 single crystal neutron diffraction was mea- subgroup of P 6/mm0m0 and allows two independent Mn- sured at a few selected temperatures above and below 6 sites. We achieved a similar goodness of fit (see Supple- The temperature dependences of the internal magnetic mental Information for a more complete discussion about fields and the relative fractions of the three internal field attempted fits). So, the combination of powder and sin- components for the single crystal of TbMn6Sn6 are shown gle crystal neutron diffraction measurements establishes in Figures 4a and b, respectively. There is a sharp and 0 0 the c-axis ferrimagnetic P 6/mm m order in TbMn6Sn6 large (by a factor of 6) increase of the internal field across at high temperatures and suggests that the low-T mag- the high-temperature in-plane ferrimagnetic to a low- netic state also possesses a c-axis aligned structure that temperature c-axis ferrimagnetic phase transition tem- is somewhat different from the ideal out-of-plane ferri- perature TC2 ' 320 K, as shown in Figure 4a. However, magnetic P 6/mm0m0 arrangement. there is a temperature range of about 15 K (marked by At 2 K, the magnetic order stays c-axis aligned under a vertical grey line) in which both in-plane and c-axis the in-plane magnetic field as high as 10 T (see Fig. 2d). ferrimagnetic phases coexist in the sample but macro- At 230 K, the spin reorientation transition from the c- scopically phase separated (see Figure 4b), pointing to- axis to the ab-plane is induced, signaled by the abrupt wards a first-order nature of the phase transition at TC2. emergence of the (001) peak at a critical in-plane mag- Upon lowering the temperature below 310 K, the inter- netic field of 4.9 T (see Fig. 2d). nal field for the out-of-plane component monotonously decreases down to the lowest temperature of 1.7 K. The internal field of the additional component monotonously C. Microscopic details of static and dynamic increases below 25 K and saturates below 10 K. As can magnetic state be clearly seen in Figure 4b, the fraction of component I increases at the cost of component II. Component I even- tually attains a volume fraction of 90% at 1.7 K and thus To gain further insight into the intriguing magnetic becomes the dominant state. In addition to the magnetic properties of TbMn Sn , we employed the µSR tech- 6 6 ordering temperature, internal field, and magnetic frac- nique, which serves as an extremely sensitive local probe tion, we also obtained information about the direction of for detecting microscopic details of the static magnetic the internal magnetic field at the muon site by evaluating order, ordered magnetic volume fraction, and magnetic the data from all four positron detectors surrounding the fluctuations. The local probe feature makes µSR a per- sample: Forward-Backward (F-B) and Up-Down (U-D) fect complementary technique to neutron diffraction and (see Fig. 4e-f) (details are given in the supplementary magnetization measurements. information). In a single crystal with a fully magneti- Fig. 3a displays representative zero-field (ZF) µSR cally ordered state, the amplitude of the oscillation is a time spectra for TbMn6Sn6 taken at various tempera- measure of the angle between the initial muon spin po- tures in the range from 1.8 K – 400 K. ZF µSR spectra larisation and the internal field θ (see Fig. 4e, where reveal clear oscillations of the muon decay asymmetry the muon spin precession around the internal magnetic which is proportional to the muon spin polarization. This field, for two extreme cases B ⊥ c and B k c, is indicates the existence of a well-defined internal field at int int schematically illustrated). For the internal field direc- the muon stopping sites in the sample in the whole inves- tion, shown in the top panel of Fig. 4f, the µSR signal tigated temperature range leading to a coherent preces- from F-B detectors exhibits maximum amplitude and no sion of the muon spin ensemble. This signal is expected oscillations will be detected in the U-D detectors. The for well defined long-range magnetic order. Interestingly, opposite would be observed for the configuration shown depending on the temperature range, either a single or in the bottom panel of Fig. 4f. The measured ampli- a superposition of two distinct well separated precession tude FUD of the oscillations detected on U-D detectors is frequencies can be clearly seen in the µSR spectra. To shown in Figure 4a as a function of temperature. In the better visualize the effect of temperature on the magnetic temperature range between 1.7 K and 310 K, the maxi- response, we show the Fourier transform amplitudes of mum amplitude is found on U-D detectors (FUD is nearly the oscillating components of the µSR time spectra as 100 %) and no oscillations are found on F-B detectors. a function of temperature (Fig. 3b and c), which is a This indicates that the static internal field is pointing to- measure of the probability distribution of internal fields wards the c-axis and no drastic spin reorientation takes sensed by the muon ensemble. Coming from high temper- place in the temperature range of 1.7 K – 310 K. This atures, we observe only one low field component below is consistent with the c-axis ferrimagnetic order obtained 400 K (component III in Fig. 3c), then a coexistence from neutron diffraction. Above 310 K, the magnitude of of a low and high field components (component III and FUD is reduced by a factor of two, which indicates that component II, respectively) between 330 K and 315 K the internal field is pointing somewhere in the ab-plane, (Fig. 3c), and the high field component persists down which is consistent with the spin reorientation transition to the base-T (Fig. 3b-c). Remarkably, below 20 K a from c-axis to the ab-plane. second higher component appears (component I), which becomes the dominant component at the base tempera- We note one more important aspect. If the magnetic ture of 1.7 K (Figure 2b). The spectra below 20 K are order would be fully static with the internal field point- also characterised by loss of a few percent of the initial ing along the c-axis, only a weak depolarization of the asymmetry. µSR signal would be observed in the F-B detector. In 7

Figure 4: Static order and dynamic fluctuations in TbMn6Sn6. (a) The temperature dependences of the internal magnetic fields for the three magnetic components. Vertical lines mark the critical temperatures TC1 and TC2. TC2 is the transition temperature from high temperature low field to low temperature high field component, while TC1 is the transition temperature, below which two high field components, exhibiting volume wise competition, are observed. The error bars represent the s.d. of the fit parameters. Right axis depicts the amplitude of the oscillating component of the µSR signal from up-down (U-D) positron detectors. (b) The temperature dependences of the relative volume fractions (f1, f2, f3) of the three magnetically ordered regions. (c) Zero-field µSR signals from Forward-Backward (F-B) positron detectors, recorded at various temperatures. (d) The temperature dependence of dynamic depolarization rate of the µSR signal, measured in F-B positron ∗ detectors. Arrows mark the magnetic transition temperature TC1 and the temperature TC1 for the onset of visible magnetic fluctuations. (e) A schematic overview of the experimental setup for the muon spin forming 45◦ with respect to the c-axis of the crystal. The sample was surrounded by four detectors: Forward (F), Backward (B), Up (U) and Down (D). (f) Schematic illustration of the muon spin precession around the internal magnetic field for two cases: (top) The field is perpendicular to the c-axis and points towards the U-detector. θ is the angle between the magnetic field and the muon spin polarization at t = 0. (bottom) The field is parallel to the c-axis of the crystal and points towards the F-detector.

contrast, a fast depolarization of the implanted muons seen in Fig. 4c, the depolarization rate λL of the µSR is seen in a wide temperature range (see Fig. 4c). The signal in the F-B detectors shows a weak temperature de- ∗ fast depolarization of the µSR signal in the F-B detector pendence down to TC1 ' 120 K, below which λL2 shows is direct evidence for the involvement of fluctuations in a large increase. It reaches its maximum at TC1 ' 20 K the magnetic state of TbMn6Sn6 in the time window of and decreases rapidly at lower temperatures. The ampli- the technique ( 10−5 to 10−12 s). That the fluctuations tude of the dynamic signal also decreases below 20 K, but are the cause of the observed muon spin depolarization it still exists even at the base-T of 1.7 K. The increase ∗ is also supported by the measurement under 300 mT ap- of λL2 below TC1 is the signature of a slowing of mag- plied in the F-B direction (longitudinal field geometry), netic fluctuations until a quasi-static order is established which show a negligible field effect on the depolarization below TC1 and a coherent precession with slightly higher rate at 300 K (see the Supplementary Information). As frequency than the original is seen. Therefore, the TC1 8

* T c 1 T c 1 1 f

) ,

0 . 8 T b B A µ ( O

M n t Q n

, 8 e ) m T o 8 0 . 6 (

R σ n A H ( S 1 ) M M ×

σ ×

1 ( S 2 )

A H 6 3 . 0

. 0 . 4 3

0 M R a t 8 T

, )

) Q u a n t . o s c i l . a m p l i t u d e B 1 - µ

f (

m 1 t c n 1 0 . 2 -

4 e Ω m 3 o 0 1 m

(

b H T

A 0 . 0

σ 2 0 1 0 0 2 0 0 3 0 0 T e m p e r a t u r e ( K )

Figure 5: Comparison between electronic and magnetic properties of TbMn6Sn6. The temperature dependence of the in-plane anomalous Hall conductivity, the relative fraction f1 of the low-T novel magnetic component, the value of the magnetoresistance at 8 T (after Ref. [16]), the amplitude of the quantum oscillations (after Ref. [11]), and the magnetic moments of Tb as well as Mn, for TbMn6Sn6. S1, and S2 denote two diﬀerent samples. should be considered as a crossover temperature signal- connection with the magnetic properties. ing a slowing down of magnetic ﬂuctuations rather than being regarded as a true phase transition temperature. E. Discussion

D. Transport measurements The combination of powder and single crystal neutron diffraction establishes the c-axis ferrimagnetic Extended Hall conductivity and magnetoresistance P 6/mm0m0 order between Mn and Tb moments in measurements on TbMn6Sn6 were recently reported [16]. TbMn6Sn6 at high temperatures below TC2 ' 305 K Here, we show the AHC for two pieces of the single crys- and suggest that the low-T magnetic state also possesses tals from the same batch of TbMn6Sn6, which was ob- a c-axis aligned structure that is slightly different from 2 0 0 tained using the formula σAH = ρAH /ρxx, where ρAH the ideal out-of-plane ferrimagnetic P 6/mm m arrange- and ρxx are the anomalous Hall and the zero-field lon- ment. µSR and macroscopic magnetization measure- gitudinal resistivity, respectively. As it was previously ments clearly uncover another transition in TbMn6Sn6 at ∗ 0 0 shown, ρxx drops over 100 times from 300 K to 2 K TC1 ' 120 K, besides the c-axis ferrimagnetic P 6/mm m whereas σAH increases with decreasing temperature (see order at higher temperatures. µSR shows that the tran- ∗ Figure 5). This implies the dominant intrinsic contri- sition at TC1 is related to a slowing down of magnetic bution arising from the Berry curvature fields in total fluctuations and is considered a crossover rather than a anomalous terms. It is noteworthy that for one sample true phase transition. A static component in µSR sig- σAH shows an upturn across TC1 ' 20 K, while for the nal occurs only below TC1 ' 20 K. The slightly higher other sample from the same batch and with the same (by 15 %) muon spin precession frequency of the new residual-resistance ratio σAH shows a weak downturn at low-T component I as compared to the one of the high- low temperatures. However, the downturn is not as sharp T ferrimagnetic P 6/mm0m0 component (component II) as upturn. These seemingly inconsistent results and pre- indicates that the fluctuations freeze into a slightly differ- vious transport measurements will be discussed below in ent magnetic structure. The fact that the fraction of the 9 component I increases at the cost of component II with possibility could be a structure with two independent Mn decreasing temperature indicates that the slowing down sites and moments, which is allowed by lower symmetry process proceeds in the following fashion: when the fluc- out-of-plane ferrimagnetic models such as orthorhombic tuations slow down and reach static enough conditions Cm0m0m. The Cm0m0m structure is essentially the same that we start observing the coherently precessing µSR as P 6/mm0m0, but with two different Mn sites. Even a signal below TC2 ' 20 K, the patches of such static re- small difference between Mn moments can be enough to gions increase with decreasing temperature and the frac- explain the difference in the internal fields, observed in tion of the corresponding signal increases. However, even µSR above and below TC1 ' 20 K. For instance, if at high at the base-T of 1.7 K, the component I does not acquire temperatures two different Mn moments fluctuate along the full fraction and the moments are not yet fully static. the c-direction, the produced time-averaged field at the This suggests that the establishment of a full volume muon site can be different than the one produced after static order might appear only in the zero-temperature the fluctuations freeze with some defined net moment at limit. Considering the fact that neutron diffraction de- low temperatures. An additional possibility is the pres- picts the static order in the whole temperature range, ence of some small incommensurability below TC1 ' 20 we conclude that the moments fluctuate at a rate of the K, e.g., the k-vector is shifted from the Γ-point. order of MHz, yet slower than the nearly instantaneous In order to explore the correlation between the mag- time scale of neutron scattering. As µSR probes the time netic properties found in this work and the topological averaged structure for fluctuations faster than the time aspects [11, 16] of TbMn6Sn6, in Fig. 5 we compare the window, the combination of static coherent oscillations temperature dependence of the AHC, the MR and the and magnetic fluctuations in the µSR signal can be un- amplitude of the quantum oscillations to the tempera- derstood if the time averaged structure at high temper- ture evolution of the Tb and Mn moments as well as the atures is such that the net static internal field points amplitude of the low-T magnetic component: along the c-axis. The presence of magnetic fluctuations (1) We find that the amplitude of the quantum oscil- can also explain the magnetization data. In the SQUID lations [11], which reveals the Landau quantization from measurements, which is a slower probe than µSR, a large the bulk crystal, sets in below TC1 ' 20 K at which the difference between the FC and ZFC response is observed new quasi-static magnetic component starts to appear ∗ below TC1 ' 120 K, e.g., in the region where fluctua- (see Figure 5). tions slow down. Since domains become more static, dif- (2) It was previously [16] shown that the MR of ferent out-of-plane ferrimagnetic domains tend to cancel TbMn6Sn6 exhibits a quasi-linear field dependence (∝ out (anti-align) after ZFC. The domains try to minimize 1.1 H ) only at temperatures below TC1 ' 20 K. It was the total magnetization. However, if we FC even in low explained to stem from the quantum limit [32] of the lin- fields, then the domains align with the external fields in- early dispersive spin-polarized Dirac band with a large stead. But at temperatures higher than T ∗ ∼ 120 K, the C1 Chern gap. In Fig. 5, we point out that the MR domains are highly dynamic on microsecond time scales changes sign from negative to positive across the mag- and the overall effect is averaged out and no hysteresis is netic crossover T ∗ ' 120 K and the absolute value of registered in the magnetization data. C1 MR at 8 T increases substantially across TC1. Thus, from The origin and precise nature of slow fluctuations down Fig. 5 it is evident that the Dirac band related MR effect to the lowest measured temperatures in TbMn6Sn6 is is enhanced upon approaching the novel low-T magnetic not understood. They can come either from the Tb and state. Mn sublattices individually, or can be a combined effect. (3) We find that the temperature dependence of One possibility for the finally established base-T struc- σAH (T ) is strongly influenced by the low temperature ture could be a weakly canted ferrimagnet, in which case magnetic crossover. Namely, while σAH (T ) for the two ∗ Tb moments are canted (by Φ1, Figure 2a) from the c- samples perfectly coincide with each other above TC1 ∼ axis less than the Mn moments (by Φ2) such that the net 120 K, distinct temperature behaviour is seen at lower in-plane component of the total moment is nearly zero. temperatures. For one sample, σAH increases with de- In this case, the direction of the net moment will still creasing temperature with a stronger increase across TC1. be along the c-axis but the overall structure would be For the second sample, the linear increase of σAH over a canted version of the ferrimagnetic P 6/mm0m0. Such a wide temperature range changes into a nearly temper- a canting can, in principle, come from the competition ature independent behaviour followed by a weak down- of magnetocrystalline anisotropy energies of the Tb- and turn across the temperature TC1. We also show that Mn-subsystems [22–25]. If the moments fluctuate slowly the σAH (T ) does not follow the temperature evolution around the cones with small Φ1 and Φ2 at high temper- of the Tb and Mn moments which indicates the intrinsic atures, this could give rise to the time averaged c-axis nature of the AHC in TbMn6Sn6, arising from the non- static field and produce the defined precession frequency trivial magnetic-topological state. Distinct behaviour of in µSR experiments. When these fluctuations slow down the low temperature σAH (T ) in different samples might and freeze into the static state with defined, even smaller be caused by distinct magnetic domain distribution (dif- and distinct values of Φ1 and Φ2, then this gives a slightly ferent strains due to different cooling rate together with different value of the µSR precession frequency. Another strong magnetostriction, may influence the magnetic do- 10 main distribution), which opens new opportunities for of the magnetic structure at various temperatures. In tunable topological magnetic states. This might also mo- a µSR experiment, positive muons implanted into a tivate a future direction of research to study the magneto- sample serve as an extremely sensitive local probe to structural coupling in this topological system TbMn6Sn6. detect small internal magnetic fields, ordered magnetic volume fractions and magnetic fluctuations in the bulk of magnetic materials [35]. Density functional theory III. SUMMARY calculations were used to explore the electronic band structure and to calculate the Berry curvature-induced The exploration of topological electronic phases that anomalous Hall conductivity. Neutron diffraction is result from strong electronic correlations is a frontier in used to determine the magnetic structure. The tech- condensed matter physics. Kagome lattice systems are niques of µSR, neutron diffraction, transport and DFT an ideal setting in which strongly correlated topologi- complement each other ideally as we are able to study cal electronic states may emerge. Our key finding is the detailed temperature dependence of the magnetic the identification of a novel low-temperature magnetic order parameter and ordered volume fractions with µSR experiments, and correlate them with the measured and state in TbMn6Sn6, which is coupled to its topological properties. Namely, a combination of neutron diffrac- calculated anomalous Hall conductivity. tion, µSR and magnetization measurements indicate that the system TbMn6Sn6 exhibits out-of-plane ferrimag- Sample preparation: Details of the sample prepara- netic P 6/mm0m0 order between Mn and Tb moments tion, characterization, and the Hall effect measurements with slow magnetic fluctuations in a wide temperature are described elsewhere [11, 16]. range 1.7 K – 315 K. The moments fluctuate at a rate of the order of MHz, yet slower than the nearly instan- High resolution neutron powder diffraction taneous time window of neutron scattering. The fluctu- measurement: The magnetic and crystal structure ∗ ations start to slow down below TC1 ' 120 K, forming of TbMn6Sn6 have been studied with neutron powder quasi-static patches only below TC1 ' 20 K and become diffraction (NPD) experiments carried out at the Swiss enhanced in a volume-wise manner upon further lower- Neutron Spallation Source (SINQ), at the Paul Scherrer ing of temperature. The established quasi-static mag- Institute in Villigen, Switzerland. Several single crystal netic state below TC1 is suggested to be slightly differ- samples were crushed into a fine powder and loaded ent than the ideal out-of-plane ferrimagnetic state ob- into a 6-mm diameter vanadium can. The diffraction served at higher temperatures. A canted variation of patterns were collected on the High Resolution Powder the P 6/mm0m0 structure is possible, where all moments diffractometer for Thermal neutrons (HRPT) using contribute to a net c-axis ferrimagnetism and exhibit a wavelengths λ = 1.8857 A˚ and λ = 2.449 A˚ (Ge- ◦ ◦ zero net in-plane moment. Alternatively, a small incom- monochromator (822), 2θmax = 160 , 2θstep = 0.1 ) in mensurate k-vector could be responsible for the novel the temperature range from 1.50-306 K. High-statistic magnetic phase observed below TC1. The interplay be- acquisitions for magnetic structure refinements were tween this intricate magnetism and the spin-orbit cou- made. pled band structure further induces non-trivial variations of its topological properties, which is characterized by Temperature and field dependent single crystal the influence of the low temperature magnetic crossover neutron diffraction measurements: Single crystal on the temperature evolution of AHC as well as by the neutron diffraction was performed on our sample using appearance of the large quasi-linear MR and the quan- the thermal single crystal diffractometer ZEBRA, at the tum oscillations, related to the quantized Landau fan SINQ/PSI. A single crystal hexagon was approximately structure featuring spin-polarized Dirac dispersion with a 4 mm in diameter and 0.4 mm in thickness, the c-axis large Chern gap, within the low-T magnetic state. These was along the thin part of the crystal. After the experiments will stimulate further theoretical studies to single-crystallinity check and alignment by Laue X-ray obtain a microscopic understanding of the relation be- diffraction, the sample was mounted to a 0.3-mm-thick tween the slow fluctuations, novel magnetic ground state rectangular sheet of aluminum with GE varnish, then and the quantum-limit Chern gapped phase. bound with thin aluminum wires before being wrapped in 0.1 mm aluminum foil. The sample was then mounted in a cryomagnet with vertical field up to 10 Tesla. The IV. METHODS incident neutron wavelength of 1.18 A˚ was selected by the Ge 311-monochromator. Datasets were measured General remarks: We concentrate on the high with the 3He tube detector at 250 K, 70 K, and 2 K, and resolution [33, 34] muon spin relaxation/rotation (µSR) in 5 T applied magnetic field at 250 K. The magnetic measurements of the temperature dependence of the field was applied along the (1-10) direction, within the magnetic moment as well as on the magnetically ordered ab-plane. Field dependence was measured up to 8 T at volume fraction in the single crystals of TbMn6Sn6 2 K for the (110), (002) reflections and at 230 K for the and on the high resolution neutron powder diffraction (001), (002), and (110) reflections, respectively. From 11 our collected datasets, we performed refinements with mor frequency 2πνµ = γµ/(2π)Bµ [muon gyromagnetic −1 the FullProf suite using the ISODISTORT program ratio γµ/(2π) = 135.5 MHz T ]. online to generate the Shubnikov subgroups. The longer Longitudinal-field (LF) and zero-field µSR experi- wavelength of λ = 2.3 A˚ (PG monochromator) and the ments on the single crystalline samples of TbMn Sn 2D detector were used to detect any incommensurate 6 6 were performed at the πM3 beamline of the Paul feature near or splitting of the 002 reflection on cooling Scherrer Institute (Villigen, Switzerland), using the between 225 K and 25 K. No new features have been low background GPS instrument [33]. The specimen found. was mounted in a He gas-flow cryostat and CCR with the c-axis parallel to the muon beam direction in order µSR experiment: In a µSR experiment nearly 100 % to cover the temperature range between 1.7 K and 400 K. spin-polarized muons (µ+) are implanted into the sample one at a time. The positively charged µ+ thermalize at interstitial lattice sites, where they act as magnetic Analysis of ZF-µSR data: The ZF-µSR spectra microprobes. In a magnetic material the muon spin pre- from Up-Down positron detectors were fitted using the cesses in the local field Bµ at the muon site with the Lar- following model [36]:

3 X −λT,j t −λL,j t AZF,UD(t) = fT,j cos(2πνjt + φ)e + fL,je . (1) j=1

The model (1) is an anisotropic magnetic contribution temperature range, either a single, or two distinct well characterized by an oscillating transverse component separated precession frequencies can be clearly seen in and a slowly relaxing longitudinal component. The the µSR spectra. Spectra near the base-T requires the longitudinal component arises due to the parallel addition of the third broad oscillating component with orientation of the muon spin polarization and local the internal field value very close to the one, observed at magnetic field components. In polycrystalline samples high temperatures. In addition, the spectra below 20 K with therefore randomly oriented fields this results in a are also characterised by a missing small fraction of the 1 so-called one-third tail with fL = 3 . For single crystals, initial asymmetry, which points to a more disordered fL varies between unity and zero as the orientation static state below 20 K than the one above. between field and polarization changes from being parallel to perpendicular. Note that the whole volume of the sample is magnetically ordered in the whole The ZF-µSR spectra from Forward-Backward positron investigated temperature range. Depending on the detectors were fitted using the following dynamic model:

−λF B,fastt −λF B,slowt AZF,FB(t) = Afaste + Aslowe . (2)

The two terms represent a fast and a slow relaxation V. ACKNOWLEDGMENTS component, respectively, and λF B,fast and λF B,slow are the muon-spin-relaxation rates for each component. The µSR experiments were carried out at the Swiss Muon Source (SµS) Paul Scherrer Insitute, Villigen, Switzerland using the high resolution GPS instrument (πM3 beamline). The neutron diﬀraction experiments were performed at the Swiss spallation neutron source Data availability: All relevant data are avail- SINQ (HRPT and ZEBRA diﬀractometers), Paul Scher- able from the authors. The data can also be found rer Institute, Villigen, Switzerland. The magnetization at the following link http://musruser.psi.ch/cgi- measurements were carried out on the MPMS device of bin/SearchDB.cgi. the Laboratory for Multiscale Materials Experiments, Paul Scherrer Institute, Villigen, Switzerland. Z.G. 12 and C.M. thank Romain Sibille and Dariusz Jakub by the China Scholarship Council (CSC). This work was Gawryluk for their useful discussions. T. N. and S. S. also supported by the Swiss National Science Foundation T. acknowledge support from the European Research (R‘Equip grant no. 206021 139082) Council (ERC) under the European Unions Horizon 2020 research and innovation programm (ERC-StG- Neupert757867-PARATOP). S. S. T. is additionally Competing interests: The authors declare that supported by the grant No. PP00P2 176877 by the they have no competing interests. Swiss National Science Foundation. X. L. was supported

[1] Jia-Xin Yin, Songtian S. Zhang, Guoqing Chang, Qi (2009). Wang, Stepan Tsirkin, Zurab Guguchia, Biao Lian, [15] S. Nakatsuji, N. Kiyohara, and T. Higo, Large anomalous Huibin Zhou, Kun Jiang, Ilya Belopolski, Nana Shumiya, Hall effect in a non-collinear antiferromagnet at room Daniel Multer, Maksim Litskevich, Tyler A. Cochran, temperature. Nature 527, 212-215 (2015). Hsin Lin, Ziqiang Wang, Titus Neupert, Shuang Jia, [16] W. Ma et. al., Rare earth engineering in RMn6Sn6 topo- Hechang Lei, M. Zahid Hasan. Negative flatband mag- logical kagome magnets. arXiv:2007.09913 (2020). netism in a spin-orbit coupled kagome magnet. Nature [17] A.K. Nayak, et. al., Large anomalous Hall effect driven Physics 15, 443-448(2019). by a nonvanishing Berry curvature in the noncolinear an- [2] J-X. Yin, et. al., Giant and anisotropic spin-orbit tun- tiferromagnet Mn3Ge. Sci. Adv. 2, e1501870 (2016). ability in a strongly correlated kagome magnet. Nature [18] N.J. Ghimire et. al., Novel magnetic states and nematic 562, 91-95 (2018). spin chirality in the kagome lattice metal YMn6Sn6. Sci- [3] L. Ye, et. al., Massive Dirac fermions in a ferromagnetic ence Advances 6(51), eabe2680 (2020). kagome metal. Nature 555, 638-642 (2018). [19] B.C. El Idrissi, G. Venturini, B. Malaman, and D. [4] T.-H. Han, et. al., Fractionalized excitations in the spin- Fruchart, J. Less Common Met. 175, 143 (1991). liquid state of a kagome-lattice antiferromagnet. Nature [20] N. Zajkov, N. Mushnikov, M. Bartashevich, and T. Goto, 492, 406-410 (2012). J. Alloy. Compd. 309, 26 (2000). [5] S. Yan, D.A. Huse, and S.R. White, Spin-liquid ground [21] L. Zhang et al., Unusual magnetic behavior of some rare- state of the S=1/2 kagome Heisenberg antiferromagnet. earth and manganese compounds (Universiteit van Am- Science 332, 1173-1176 (2011). sterdam [Host], 2005). [6] Z. Guguchia, J. Verezhak, D. Gawryluk, S. S. Tsirkin, J. [22] G. Venturini, B. E. Idrissi, and B. Malaman, J. Magn. -X. Yin, I. Belopolski, H. Zhou, G. Simutis, S.-S. Zhang, Magn. Mater. 94, 35 (1991). T. A. Cochran, G. Chang, E. Pomjakushina, L. Keller, [23] D. Clatterbuck and K. Gschneidner, J. Magn. Magn. Z. Skrzeczkowska, Q. Wang, H. C. Lei, R. Khasanov, A. Mater. 207, 78 (1999). Amato, S. Jia, T. Neupert, H. Luetkens, M. Z. Hasan. [24] B. Malaman, G. Venturini, R. Welter, J. Sanchez, P. Vul- Tunable anomalous Hall conductivity through volume- liet, and E. Ressouche, J. Magn. Magn. Mater. 202, 519 wise magnetic competition in a topological kagome mag- (1999). net. Nature Communications 11, 559 (2020). [25] Guang-Hua Guo, and Hai-Bei Zhang, Journal of Alloys [7] N.J. Ghimire and I.I. Mazin, Topology and correla- and Compounds 448, 17-20 (2008). tions on the kagome lattice. Nature Materials 19, 137- [26] Schefer, J., Fischer, P., Heer, H., Isacson, A., 138(2020). Koch, M., and Thut, R. A versatile double- [8] B. Keimer, and J.E. Moore, The physics of quantum ma- axis multicounter neutron powder diffractometer. Nu- terials. Nat. Phys. 13, 1045-1055 (2017). clear Instruments and Methods in Physics Research [9] J. Wang, and S.-C. Zhang, Topological states of con- Section A: Accelerators, Spectrometers, Detectors densed matter. Nature Materials 16, 1062-1067 (2017). and Associated Equipment, 288(2), 477-485 (1990). [10] M.Z. Hasan, and C.L. Kane, Topological insulators. Rev. doi:https://doi.org/10.1016/0168-9002(90)90141-R. Mod. Phys. 82, 3045-3067 (2010). [27] P. Fischer, G. Frey, M. Koch, M. Konnecke, V. Pom- [11] J-X. Yin, et. al., Quantum-limit Chern topological mag- jakushin, J. Schefer, et. al., Phys. B 146, 276-278, (2000). netism in TbMn6Sn6. Nature 583, 533-536 (2020). [28] H.T. Stokes, and D.M. Hatch, Isotropy Subgroups of the [12] X.G. Wen, Colloquium: Zoo of quantum-topological 230 Crystallographic Space Groups (1988). phases of matter. Rev. Mod. Phys. 89, 041004-1 - 041004- [29] B.J. Campbell, H.T. Stokes, D.E. Tanner, and D.M. 17 (2018). Hatch, J. Appl. Crystallogr., 39, 607 (2006). [13] E. Liu, Y. Sun, N. Kumar, L. Muechler, A. Sun, L. Jiao, [30] Rodriguez-Carvajal, J. Phys. B 192, 55 (1993). S.-Y. Yang, D. Liu, A. Liang, Q. Xu, J. Kroder, V. Su, [31] M. Aroyo, J. Perez-Mato, D. Orobengoa, E. Tasci, G. de H. Borrmann, C. Shekhar, Z. Wang, C. Xi, W. Wang, W. la Flor, and A. Kirov, Bulg. Chem. Commun., 43, 183 Schnelle, S. Wirth, Y. Chen, S.T.B. Goennenwein, and (2011). C. Felser, Giant anomalous Hall effect in a ferromagnetic [32] A.A. Abrikosov, Quantum linear magnetoresistance. Eu- kagome-lattice semimetal. Nature Physics 14, 1125-1131 rophys. Lett., 49(6), 789-793 (2000). (2018). [33] A. Amato, H. Luetkens, K. Sedlak, A. Stoykov, R. [14] L.A. Fenner, A.A. Dee, and A.S. Wills, Non-collinearity Scheuermann, M. Elender, A. Raselli, and D. Graf. The and spin frustration in the itinerant kagome ferromag- new versatile general purpose surface-muon instrument net Fe3Sn2. J. Phys.: Condens. Matter 21, 452202(7pp) (GPS) based on silicon photomultipliers for µSR mea- 13

surements on a continuous-wave beam. Review of Scien- Supplementary Information tific Instruments 88, 093301 (2017). [34] Z. Guguchia, F. von Rohr, Z. Shermadini, A. T. Lee, TbMn6Sn6 containing the heavy rare earth Tb crys- S. Banerjee, A. R. Wieteska, C. A. Marianetti, B. A. tallizes in a HfFe6Ge6-type structure (space group Frandsen, H. Luetkens, Z. Gong, S. C. Cheung, C. P 6/mmm). It is composed of hexagonal Tb layers con- Baines, A. Shengelaya, G. Taniashvili, A. N. Pasupathy, E. Morenzoni, S. J. L. Billinge, A. Amato, R. J. Cava, taining Sn atoms and Mn kagome nets, stacked in the se- R. Khasanov, Y. J. Uemura, Signatures of the topologi- quence -Mn-Tb-Mn-Mn-Tb-Mn- along the c-axis (Figure cal s+− superconducting order parameter in the type-II 1a-b). Possible atomic assignment of the kagome lattice Weyl semimetal Td-MoTe2. Nature Communications 8, and magnified image of scanning tunneling microscopy of 1082 (2017). the manganese-terminating surface is shown in Figures [35] P. Dalmas de Reotier and A. Yaouanc, Muon spin rota- 1c-d. tion and relaxation in magnetic materials. J. Phys. Con- dens. Matter 1997, 9, 9113. [36] Suter, A. and Wojek, B.M. Musrfit: a free platform-independent framework for µSR data analysis. A. Temperature dependence of spin fluctuations P hysics P rocedia 30, 69-73 (2012). and direction of the internal magnetic field

Apart from the magnetic ordering temperature and the magnetic fraction, it is instructive to evaluate the temperature dependence of the spin fluctuations, as well as the direction of the internal magnetic field. This was done through zero-field (ZF) µSR experiments. The measurements were performed with the initial muon spin polarization at an angle of 45◦ with respect to the c-axis of the crystal, as illustrated in Fig. S2h. The sample was surrounded by two pairs of detectors: Forward-Backward (F-B) and Left-Right (U-D). Figures S2a, d and f show representative zero-field (ZF) µSR time spectra for the single crystal TbMn6Sn6, recorded using U-D at 1.8 K, 300 K, and 340 K, respectively. Figures S2b, e and g show representative zero-field (ZF) µSR time spectra for the single crystal TbMn6Sn6, recorded using F-B at 1.8 K, 300 K, and 340 K, respectively. In a single crystal with a fully magnetically ordered state, the amplitude of the oscillation is proportional to the angle between the muon spin polarization and the internal field θ (see Fig. S2i, where the muon spin precession around the internal magnetic field, for two extreme cases Bint ⊥ c and Bint k c, is schematically illustrated). For the internal field direction, shown in the top panel of Fig. S2i, the µSR signal from F-B detectors exhibits the maximum amplitude and no oscillations will be detected in the U-D detectors. The opposite will be observed for the configuration shown in the bottom panel of Fig. S2i. Thus, by evaluating the data from all four detectors one can obtain useful information on the direction of the internal field and therefore the local spin configuration. At T = 1.8 K and 300 K, the oscillations with maximum amplitude (see Fig. S2a and d, oscillating around zero) are observed on U-D detectors, while no oscillations were found on F-B detectors. This indicates that the internal field is pointing towards the c- axis from 300 K down to 1.8 K and no spin reorientation takes place in this temperature range. We further note one important aspect; if the magnetic order is fully static with the internal field pointing along the c-axis, only a weak depolarization of the µSR signal would be observed on the F-B detector. In contrast, a fast depolarization of the implanted muons is seen in a wide temperature range (see Fig. S2c). The fast depolarization of the µSR 14 signal on F-B is direct evidence for the fluctuating mag- ing the ISODISTORT tool based on ISOTROPY soft- netic moments in TbMn6Sn6. That the fluctuations are ware [5, 6]. With ISODISTORT we determined the mag- the origin of the observed muon spin depolarization is netic Shubnikov groups present within the maximal sub- also supported by measurements under 300 mT, which group, and attempted fitting the collected patterns at shows negligible field effect on the depolarization rate at 1.5 K, 5 K, and 250 K to many of the different max- 300 K (see Figure S2e). If the depolarization were caused imal subgroups. In particular, we focused on compar- by a wide distribution of static fields, then a small field ing in- and out-of-plane structures, and models allow- would be enough to fully recover the muon spin polar- ing different sites for the same atomic species. Specifi- ization. Above 310 K, oscillations with equal amplitude cally, we tested: all variations of the P 6/mmm hexagonal are observed on U-D and F-B detectors. Accordingly, the space group, with various models allowing either in-plane 0 0 magnitude of FUD is reduced by a factor of two, which or out-of-plane magnetic moments; Cm m m, SG No. indicates that the internal field is pointing somewhere in 65.485, allowing two different Mn sites with mz compo- 0 0 the ab-plane, consistent with the spin reorientation tran- nents; Cmm m SG No. 65.486, allowing mx and my in- sition from c-axis to the ab-plane, reported previously plane magnetic moments; and finally P 20/m and P 20/m0, from neutron diffraction studies [1]. SG’s No. 10.44 and 10.46, respectively, which allow mx and mz magnetic components. For powder diffraction data, only two structures achieved good fits to the col- 0 0 0 0 B. High resolution neutron powder diffraction lected data: P 6/mm m No. 191.240 and Cm m m SG 0 0 measurement in TbMn6Sn6 No. 65.485. P 6/mm m consists of two sublattices oriented antiferromagnetically relative to one another, as shown in Figure 2c. The Tb and Mn magnetic moments The magnetic and crystal structure of TbMn Sn have 6 6 are collinear, and point along the z-direction. The mo- been studied via neutron powder diffraction (NPD) ex- ments of each sublattice are parallel among themselves periments carried out at the Swiss Neutron Spallation and antiparallel to the other sublattice. Thus, the over- Source (SINQ, at the Paul Scherrer Institute in Villigen, all structure is a collinear ferrimagnetic structure. The Switzerland. Several single crystal samples were crushed model with Cm0m0m symmetry is also c-axis ferrimag- into a fine powder and loaded into a 6-mm diameter vana- netic, essentially the same as P 6/mm0m0 but allowing dium can. The diffraction patterns were collected on the two different Mn sites. Of these, the higher-symmetry High Resolution Powder diffractometer for Thermal neu- P 6/mm0m0 was selected as the preferred candidate struc- trons (HRPT) using wavelengths λ = 1.8857 A˚ and λ = ture, since it has a higher symmetry and also because 2.449 A˚ (Ge [822], 2θ = 160◦, 2θ = 0.1◦) in the max step the refinements in Cm0m0m converged to two very sim- temperature range from 1.5-306 K. The structure was ilar magnetic moment sizes on the two Mn sites (nearly well refined by Rietveld refinements to the raw neutron the same within the error bar). We note that the model diffraction data, employing a hexagonal lattice structure P 6/mm0m0 describes the data equally well over the whole in the space group P 6/mmm, No. 191. An example of temperature range, consistent with previous reports [1]. the refinement profile at various temperatures is shown in With this structure we clearly see the segregated kagome Fig. S4, indicating a fairly good refinement. Only a very layers containing purely Mn atoms, separated by hexag- small impurity phase has been detected, with a maximum onal layers of Sn and Tb [3]. peak intensity at 2θ = 37.6692◦ at 1.5 K. This secondary phase has been identified as elemental tin, probably orig- inating from residual flux on the surface of the crystals, similar to previous reports [2]. In order to ensure that C. Temperature and field dependent single crystal there were no missing peaks (eg. the (0 0 1) peak), we neutron diffraction measurements in TbMn6Sn6 also collected the diffraction pattern with a wavelength λ = 2.449 A˚ and were unable to detect any additional Single crystal neutron diffraction was performed on our peaks at low-q values. Unfortunately, as the magnetic or- sample using ZEBRA, at the SINQ/PSI. A single crystal dering temperature of 425 K [3] was not achievable in the sheet was selected that was approximately 4 mm in di- experimental setup, we could not go above the magnetic ameter and 0.4 mm in thickness. The flux-grown crystals ordering temperature to observe the purely nuclear struc- were small, thin sheets; the thin axis was determined to ture in the paramagnetic phase; however, with increasing be along the crystallographic c-axis (see Fig. S6). The se- temperature we do see the magnetic peak intensity de- lected crystal had a semi-hexagonal shape; when aligned creasing. Since the magnetic ordering is ferrimagnetic, using Laue X-ray diffraction, it was very clear that the the magnetic peaks add to the intensity at the nuclear c-axis was along the thin part of the crystal, and the peak positions. Consistent with this hypothesis, between a− and b−axes were aligned with the hexagonal edges the maximum and base temperatures no new peaks were of the crystal (see Fig. S6). After the alignment and observed. single-crystallinity of the selected sample were checked Fits to this data were performed using the FullProf by Laue X-ray diffraction, the sample was mounted to suite [4], with the use of the internal tables for neutron a 0.3-mm-thick rectangular sheet of aluminum with GE scattering lengths. Symmetry analysis was performed us- varnish, then bound with thin aluminum wires before be- 15 ing wrapped in 0.1 mm aluminum foil. similar when allowed to refine, and the extinction cor- The sample was then mounted in a cryomagnet with rection decreased slightly with decreasing temperature. vertical field up to 10 Tesla. The incident neutron en- This acts as a self-consistency check, since the scale fac- ergy was selected at 1.18 A,˚ and a longer wavelength tor is related to the physical quantity of sample present (λ = 2.3 A)˚ was used upon cooling with 2D detectors (which did not change over the course of neutron scat- to try and detect any incommensurate features, however tering experiments), and the extinction correction is a nothing was seen even with access to shorter scattering Becker-Coppens phenomenological mathematical model vectors. Full matrices of reflections were measured with employed to obtain better fits which relates to the mo- the point detector at 250 K, 70 K, and 2 K, and in 5 T saicity and absorption corrections [4, 7]. The magnetic applied magnetic field at 250 K. The magnetic field was moments refined from single crystal neutron diffraction applied along the ab-plane. Field dependence was mea- data were similar to the moments obtained from NPD; sured up to 8 T at 2 K for the (110), (002) reflections in general, the Tb moment size was about 1 µB larger, and at 230 K for the (001), (002), and (110) reflections, and the Mn moment size was generally 1 µB smaller. respectively. At 230 K, we found a spin reorientation transition occurring at Hc = 4.8 T applied field, marked In order to verify the low temperature hexagonal by the sudden appearance of diffraction intensity at the structure, a number of other models were attempted. (0 0 1) peak position (see Fig. S5). At 2 K, there was no We attempted fits with a hybrid two-phase model, one visible transition up to 10 T applied field. with in-plane magnetic moments and one out-of-plane, From our collected matrix of diffraction intensities and achieved a rather poor fit. We also fit the observed and points, we performed refinements with the FullProf diffraction peaks to the orthorhombic Cm0m0m, SG No. suite using the ISODISTORT program online to generate 65.485 structure also found from NPD refinements. The the Shubnikov subgroups. An ideal fit to the collected quality of fit was equivalent to the higher-symmetry diffraction intensities was obtained at 250 K using the hexagonal structure, and furthermore the two different same magnetic structure used for the NPD refinements, Mn mz components converged to the same value within P 6/mm0m0, space group No. 191.240 (see Fig. S7). At standard deviation. While a lower-symmetry structure both 70 K and 2 K, however, the χ2 values were about cannot be completely ruled out, it seems that the twice as large, and several peaks were more poorly-fitted hexagonal P 6/mm0m0 structure fits best to the collected (see Fig. S7), even applying the extinction correction. neutron diffraction data. It is worth mentioning that the scale factors were all

[1] Idrissi et al., J. Less-Common Metals 175, 143 (1991). [10] P. E. Blöchl, Phys. Rev. B 50, 17953 (1994). [2] Clatterbuck et al., J. Magn. Magn. Mater. 207, 78 [11] G. Kresse and D. Joubert, Phys. Rev. B 59, 1758 (1999). (1999). [12] J. P. Perdew, K. Burke, and M. Ernzerhof, Phys. Rev. [3] Yin et al., Nature 583, 533 (2020). Lett. 77, 3865 (1996). [4] Rodr´ıguez-Carvajal, J., J. Phys. B 192, 55 (1993). [13] Xinjie Wang, Jonathan R. Yates, Ivo Souza, and David [5] Stokes, H. T. and Hatch, D. M., Isotropy Subgroups of Vanderbilt, Ab initio calculation of the anomalous Hall the 230 Crystallographic Space Groups (1988). conductivity by Wannier interpolation. Phys. Rev. B 74, [6] Campbell, B. J. et al., J. Appl. Crystallogr. 39, 607 195118 (2006). (2006). [14] A. A. Mostofi, J. R. Yates, Y.-S. Lee, I. Souza, D. Vander- [7] Becker, P. J., and Coppens, P., Acta Cryst. A 30, 129 bilt, and N. Marzari, Computer Physics Communications (1974). 178, 685 (2008). [8] G. Kresse and J. Hafner, Phys. Rev. B 48, 13115 (1993). [15] A. A. Mostofi, J. R. Yates, G. Pizzi, Y.-S. Lee, I. Souza, [9] G. Kresse and J.Furthmuller, Computational Materials D. Vanderbilt, and N. Marzari, Comput. Phys. Commun. Science 6, 15 (1996). 185, 2309 (2014). 16

a c

10nm-1 ⊗ � d

Mn x High Sn y Tb Low

Figure 6: Crystal structure of TbMn6Sn6. Three dimensional representation (a) and top view (b) of the atomic structure of TbMn6Sn6. The Mn atoms construct a Kagome lattice (red middle size circles), while the Tb (brown small size circles) and Tb atoms (dark green large size circles) form a honeycomb and a triangle structure, respectively. (b) Kagome lattice structure of the Co3Sn layer. (c) Possible atomic assignment of the kagome lattice. (d) Magniﬁed image of scanning tunneling microscopy of the manganese-terminating surface taken at 4.2 K. Data are taken at the tunneling junction: V = 50 mV, I = 0.8 nA, T = 4.2 K. 17

Figure 7: Zero-field µSR signals for TbMn6Sn6. Zero-field µSR signals for TbMn6Sn6 recorded at 1.8 K, 300 K and 340 K, for up-down (a,d,f) and forward-backward detectors (b,e,g). (c) Zero-field µSR signals from F-B detectors, recorded at various temperatures. (h) A schematic overview of the experimental setup for the muon spin forming 45◦ with respect to the c-axis of the crystal. The sample was surrounded by four detectors: Forward (F), Backward (B), Up (U) and Down (D). (i) Schematic illustration of the muon spin precession around the internal magnetic field for two cases: (top) The field is perpendicular to the c-axis and points towards the L-detector. θ is the angle between the magnetic field and the muon spin polarization at t = 0. (bottom) The field is parallel to the c-axis of the crystal and points towards the F-detector. 18

2 0 4 0 6 0 8 0 1 0 0 1 2 0 1 4 0 1 6 0 2 2 2 4 2 6 1 3 5 1 3 6 1 3 7 1 3 8 ) ) 2 1 λ

N P D , H R P T - S I N Q = 1 . 8 8 6 Å - 0

1 0 -

T b M n S n ( S G P 6 / m m ' m ' , N o . 1 9 1 . 2 4 0 ) , 1 . 5 K ( O b s e r v e d

6 6 1

( ) 2 F i t t e d

= 5 . 3 6 1

D i f f e r r e n c e O b s e r v e d - F i t t e d

(

B r a g g P o s i t i o n s

C m ' m ' m , N o . 6 5 . 4 8 5 , c 2 = 4 . 9 4 ) s t i n

y r a r t i b r

A P 6 ' / m ' m ' m , N o . 1 9 1 . 2 3 8 (

y t i s

n e t n I )

2 2 c P 2 ' / m , N o . 1 0 . 4 4 , = 2 8 . 7 8

0 ) ( 2

2 (

) ) ) ) ) 1 0 0 0 1

0 0 2 1 1

0 1 0 1 0 ( ( ( ( (

2 0 4 0 6 0 8 0 1 0 0 1 2 0 1 4 0 1 6 0 2 2 2 3 2 4 2 5 2 6 2 7 1 3 5 1 3 6 1 3 7 1 3 8 2 θ ( d e g ) 2 θ ( d e g ) 2 θ ( d e g )

Figure 8: (Color online) Magnetic structure comparison for TbMn6Sn6. In order to solve the magnetic structure, we performed refinements on the NPD patterns with different structural and magnetic models. Possible magnetic Shubnikov groups were generated from the hexagonal P 6/mmm space group using ISODISTORT [5, 6]. The maximal symmetry subgroup is P 6/mm0m0, No. 191.240, which consists of Tb and Mn sublattices oriented antiferromagnetically relative to one another, with moments along the c-axis. The other model which fits comparably well (Cm0m0m, No. 65.485) has lower symmetry, allowing for two independent Mn sites and moments. Space group No. 191.238 is the isostructural model to 191.240, however with magnetic moments confined to the ab-plane. The final structure considered here was incorporated because it is a low-symmetry monoclinic model, P 20/m, SG No. 10.44 which allows for different Mn and Tb sites and has no structural constraints. With this model, mx and mz moments are allowed. 19

2 0 4 0 6 0 8 0 1 0 0 1 2 0 1 4 0 1 6 0 2 2 2 4 2 6 1 3 5 1 3 6 1 3 7 1 3 8

N P D , H R P T - S I N Q λ = 1 . 8 8 6 Å T b M n 6 S n 6 ( S G P 6 / m m ' m ' ) , 1 . 5 K O b s e r v e d F i t t e d D i f f e r e n c e O b s e r v e d - F i t t e d B r a g g P o s i t i o n s

5 0 K

) s t i n U

y 1 0 0 K r a r t i b

r A (

y t i s n e t

n 2 0 0 K I

) ) 0 6

) 1

2 3 0 6 K 1

- 0

( 2

( -

(

)

(

2 0 4 0 6 0 8 0 1 0 0 1 2 0 1 4 0 1 6 0 2 2 2 4 2 6 1 3 5 1 3 6 1 3 7 1 3 8 2 θ ( d e g ) 2 θ ( d e g ) 2 θ ( d e g )

Figure 9: (Color online) NPD temperature evolution of TbMn6Sn6. Here the temperature dependence of the reﬁnements is displayed. We see no new peaks appearing over the entire measured temperature range, only a change in peak intensities with temperature; this is a good indication that the nuclear structure is the same over the entire measured temperature range (1.5 K - 306 K), and that only the magnitude of the magnetic moments changes with temperature. It also suggests a ferro- or ferrimagnetic structure, as there is no (001) peak present which would be present in the diﬀraction pattern of an antiferromagnetic structure. To ensure this, we scanned up to λ = 2.449 A˚ and saw no (001) peak. 20

8 0

) T b M n S n

. 6 6 u . a

( 6 0

y t i ≈ s H c r , 2 3 0 K 4 . 9 T n e t

n 4 0 i

d e

t 2 K a r

g 2 0 2 3 0 K e t n I ( 0 0 1 ) 0 0 2 4 6 8 1 0 F i e l d ( T ) 3 0 0 ) .

u 2 5 0 . a (

y t

i 2 0 0 s n e t

n 1 5 0 i

d e t

a 1 0 0 r

g 2 K e t

n 5 0 2 3 0 K I ( 0 0 2 ) 2 5 0 K 0 0 2 4 6 8 1 0 F i e l d ( T )

) 3 5 0 . u . a (

y t i

s 3 0 0 n

e 2 K t n i

2 3 0 K d e

t 2 5 0 a r g e t n I 2 0 0 ( 1 1 0 ) 0 2 4 6 8 1 0 F i e l d ( T )

Figure 10: (Color online) Field dependence of single crystal neutron diffraction peak intensities for TbMn6Sn6. With the single crystal neutron diffractometer ZEBRA (SINQ/PSI), we followed several peak intensities with temperature and applied field. At 230 K, we were able to induce the spin reorientation transition, signaled by the abrupt emergence of the (001) peak at a critical applied field of 4.9 T applied in-plane (top panel). At the base temperature (2 K), however, such a spin reorientation transition was not induced, even with the maximum applied magnetic field of 10 T. This transition was also noticed on the (110) peak (lower panel); however, in the middle panel, no transition was noticed. Coherent with NPD, the (002) peak is a purely nuclear peak, with no magnetic contribution, which is why it is not affected by a change in the magnetic structure induced by applied magnetic field. 21

a) b)

Figure 11: (Color online) Single crystal X-Ray and Neutron Diffraction for TbMn6Sn6. In figure a) we see the diffraction pattern obtained from Laue X-ray diffraction. This technique was used to select a single crystal sample for neutron diffraction and check for the presence of twins. The platelike crystal was oriented with the thin direction along the X-ray beam; this is the crystallographic c-axis. In Figure b) we see the fit from our refinement in P 6/mm0m0 of the single crystal neutron diffraction data taken at 250 K with χ2 = 0.97. The grey line denotes perfect agreement between observed and predicted intensities. 22

a ) 7 0 0

6 0 0

5 0 0 d e t a

l 4 0 0 u c l

a 3 0 0 C 2 0 0 P 6 / m m ' m ' , 2 K χ2 = 2 . 8 7 1 0 0

0 0 2 0 0 4 0 0 6 0 0 8 0 0 O b s e r v e d b ) 7 0 0 6 0 0

5 0 0 d e t 4 0 0 a l u c l 3 0 0 a C 2 0 0 P 6 / m m ' m ' , 7 0 K 1 0 0 χ2 = 2 . 6 2

0 0 2 0 0 4 0 0 6 0 0 8 0 0 O b s e r v e d c ) 6 0 0

5 0 0

4 0 0 d e t a l

u 3 0 0 c l a

C 2 0 0

P 6 / m m ' m ' , 2 5 0 K 1 0 0 χ2 = 0 . 9 7

0 0 2 0 0 4 0 0 6 0 0 O b s e r v e d

Figure 12: (Color online) Single crystal Neutron Diffraction and agreement with NPD structure for TbMn6Sn6. Neutron single crystal diffraction fits performed using the FullProf Suite. The data were fitted well to the same collinear, c-axis aligned ferrimagnetic hexagonal structure P 6/mm0m0 No. 191.240 found with NPD and previously reported [1]. In panel c), data collected at 250 K has been fitted using the same parameters as for NPD. In panel a) and b) the data collected at 2 K and 70 K have been refined. We can see that the fits at 2 K and 70 K are have a less good quality of fit; the most intense peaks are also not as well-fitted as in the 250 K refinement. All models have similar scale factors when refined, and were refined using the Extinction Model 1 in the FullProf suite, with decreasing values with temperature. The grey line represents ideal agreement between theory and experimentally observed data.