Arxiv:1710.08987V3 [Math.AG]

arXiv:1710.08987v3 [math.AG] 31 May 2021 OII ITA INDELRCHARACTERISTICS EULER SIGNED VIRTUAL MOTIVIC N PLCTOST AAWTE INVARIANTS VAFA-WITTEN TO APPLICATIONS AND .Amtvclclzto oml 15 ...... formula localization motivic A 4. .MtvcVf-itnter 19 ...... theory Vafa-Witten Motivic 5. .Tegoa ha fvnsigcce on cycles vanishing of sheaf global The 3. .Itouto 2 ...... cone . the on . Preliminaries . 2. Introduction 1. egtdb h ern ucini h indElrcharact Euler signed the is function M Behrend charac the Euler by weighted weighted the characteristic Euler taking When ii aaWte nainsfrK ufcs hsmotivic the This of surfaces. result K3 the for invariants Vafa-Witten tivic hc stesm a ntno rnh steK-theoretical Thomas. the as of branch) invariants instanton (at same the is which aihn ylso h oa eua ucin epoeamo a compact prove circle We and good function. the regular under local formula calization the of cycles vanishing h rtcllcso eua ucin nti oew prov we note this In function. regular a of locus critical the on a hoy h scheme The theory. tuto ha of sheaf struction Abstract. n hmsascaeascheme a associate Thomas and d sapiain ecluaetemtvcgnrtn series generating motivic the calculate we applications As ymtvcmethod. motivic by N ciia ceei h es fJye yasmn norient an assuming By Joyce. of sense the in scheme -critical hr xssagoa oiefor motive global a exists there ..Mtvcvnsigcce 12 ...... the The of . statement . general 4.2. The . . 4.1. . cycles vanishing Motivic 3.5. 3.1. ..Sm-ymti btuto hoy...... 8 ...... theory obstruction 3.3. Semi-symmetric 3.2. ..Oinainon Orientation 3.4. ..MtvcVf-itnivrat 20 19 ...... 22 . . . surfaces the . K3 . of for . Proof . 1.3-Calculations . Theorem . . of 5.4. . Proof . invariants . Vafa-Witten 5.3. ring Motivic motivic on structure 5.2. Power 5.1. ..Lclmdl...... 7 ...... model Local 2.3. ..Aeincns...... 6 ...... cone . The . cones 2.2. Abelian 2.1. o n scheme any For d N ciia cee 8 ...... schemes -critical χ M sa is y gnsfrVf-itnivrat fK surfaces, K3 of invariants Vafa-Witten for -genus n contains and , N G m sacn over cone a is d lclzto oml o h cone the for formula -localization ciia cee...... 9 ...... scheme -critical UFN JIANG YUNFENG N M Contents χ 7 ...... ihapretosrcinter,Jiang theory, obstruction perfect a with y N gnsi oolr . 24 ...... 1.4 Corollary in -genus d N 1 ciia cee 11 ...... schemes -critical M ihsmercpretobstruction perfect symmetric with 6 ...... N siszr eto.Locally section. zero its as M oal ie ytemtv of motive the by given locally ie yteda fteob- the of dual the by given N G m C ato 15 . . . . . -action 8 ...... ∗ ato for -action Vafa-Witten eitcof teristic that e eisgives series ftemo- the of rsi of eristic ii lo- tivic N ation N N N N 16 . . . is is . 2 YUNFENG JIANG

References...... 25

1. Introduction Let M be a scheme (or DM stack) with a perfect obstruction theory E• in the sense of [25], [3]. Denote by vd = rank(E•), which is the virtual dimension. In [18], Jiang and Thomas associate with M a scheme N, which admits a symmetric obstruction theory in the sense of Behrend in [1]. Roughly this ∗ scheme N = Tot(obM ) is the total space of the dual of the obstruction • sheaf obM associated with the obstruction theory E . For the mathematical definition, • N := Spec(Sym obM ), which is the abelian cone of the obstruction sheaf obM . Let π : N → M be the projection. There is a Gm-action on N scaling the fibers and the fixed locus is M. In [18], the following four invariants are studied: (1) The Ciocan-Fontanine-Kapranov/Fantechi-Göttsche signed virtual Euler characteristic of M defined using its own obstruction theory; (2) Graber-Pandharipande’s virtual Atiyah-Bott localization of the virtual cycle of N to M; (3) Behrend’s weighted Euler characteristic of N by the Behrend function νN ; (4) Kiem-Li’s cosection localization of the virtual cycle of N to M. [18] proves that (1) = (2), and (3) = (4). The invariant (1) = (2) is deformation invariant, while (3) = (4) is not. Moreover the invariant (3) = (4) is the signed Euler characteristic of M. A similar related situation was studied in [15]. It turns out that both of these invariants are useful, which are related to the Vafa-Witten invariants for projective surfaces or local surfaces, see [34], [35]. In the setting of derived algebraic geometry as in [33], N is (−1)-shifted symplectic because it is the (−1)-shifted cotangent bundle T ∗(M, E•)[−1] of (M, E•), if (M, E•) comes from a quasi-smooth derived scheme. In [22], Joyce proves that the underlying scheme N of a (−1)-shifted symplectic derived scheme is a d-critical scheme, which is defined in [22], but the converse is not true. Since a scheme M with a perfect obstruction theory E• is not always induced from a quasi-smooth derived scheme, in the paper [18], the authors start from a derived scheme (M, E•), and construct N by taking derived cotangent bundle of (M, E•). We prove in this paper that N is a d-critical scheme in the sense of [22]. Of course N does not always come from a (−1)-shifted symplectic derived scheme. Also N does not always have a symmetric obstruction theory in [1]. Let KN be the canonical line bundle for the d-critical scheme N defined in [22, Definition 2.31]. We assume that the d-critical scheme N has an 1 2 orientation, i.e., a square root KN exists. So from [4], there is a unique VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 3

MFφ µˆ µˆ µˆ L−1 µˆ global motive N ∈ MN , where MN = K0 (VarN )[ ] and K0 (VarN ) is the equivariant Grothendieck ring of varieties. On each d-critical chart (R, A, s, i) of the d-critical scheme (N,s), the motive

φ ⋆ φ µˆ MF | e = i (MF ) ⊙ Υ(Q e e e) ∈ M e, e e e e N R A,e se R,A,s,e i R e φ − dim(A)/2 where MF e = L ⊙ [[A0, ˆι] − MF e ]| e is the motivic vanishing A,se A,se R MF cycle; A,e se is the motivic nearby cycle defined in [14, Definition 7.9]; and 1 e µˆ e e e L 2 e Υ(QR,A,s,e i) = ⊙ ([R, ˆι] − [Q, ρˆ]) ∈ MR is the motive of the principal Z e e 2-bundle QR,A,s,eei as in [4, §2.5]. This ring admits a new product ⊙, which is defined by [4]. Moree details can be found in [14, §7.1]. In this paper we prove a motivic localization formula for the global motive MFφ G N under the m-action on N, removing the preservation of the orienta- 1 2 G tion KN of the m-action as in [14, Theorem 7.17]. The cone N admits a good, circle-compact action of Gm by scaling the fibers of N. The fixed locus is M. Our main result is: Theorem 1.1. (Theorem 4.8) Let (N,s) be the oriented d-critical scheme in Proposition 3.6 and µ is the good, circle-compact action of Gm on N. MFφ µˆ Let N ∈ MN be the global motive of N. Then we have the following localization formula. • φ rank(E ) MF L− 2 N = ⊙ [M]. ZN ZM Our method to prove Theorem 1.1 follows from the argument of the motivic nearby cycle under the good, circle-compact action of Gm in [32]. In our situation Nicaise and Payne [32] prove the conjecture of Davison and Meinhardt on the motivic nearby fiber in [8], i.e., the motivic nearby cycle −1 MF e A,se = [s (1)]. We use this motivic cycle to prove the localization formula. This is parallel to the result in Theorem A.1 of [7], where the author proves thate in this situation the pushforward to M of the vanishing cycle sheaf φse of the local regular function s on a d-critical chart is the shifted constant sheaf on M. Our contribution here is that we prove this statement for the motivic vanishing cycle using thee result by Nicaise and Payne in [32] who use the techniques of semi-algebraic subsets. Note that we do not need to use the techniques of semi-algebraic sets in [32], only a result there. As an application of Theorem 1.1, we show that vd χ(N,νN ) = (−1) χ(M) by the motivic method. This equality was proved by a direct topological calculation in [18]. Motivic Vafa-Witten theory. Let S be a smooth projective surface. Motived by S-duality and Vafa-Witten’s equation in [38], Tanaka-Thomas [34], [35] have developed a theory counting stable and semistable Higgs pairs 4 YUNFENG JIANG

(E, φ) where E is a torsion free rank r coherent sheaf on S, and φ : E → ⊥ ⊥ E ⊗ KS is a OS-linear morphism called the Higgs field. Let NL := NL (S, c) represent the moduli space of Gieseker stable Higgs pairs with Chern class ∗ c = (r, c1, c2) ∈ H (S, Z), fixed determinant det(E) = L and trace free ⊥ φ. In [34], the moduli space NL is proved to be isomorphic to the moduli space of stable two dimensional torsion sheaves on X := Tot(KS ) supported on S. Since X is a Calabi-Yau threefold (not compact), the moduli space ⊥ NL admits a symmetric obstruction theory in [1]. Therefore there exists a ⊥ virt ⊥ ⊥ virtual fundamental class [NL ] ∈ H0(NL ). The space NL is not compact, but admits a C∗-action scaling the Higgs field and the fixed locus is compact. The Vafa-Witten invariants are defined by virtual localization 1 VWc(S)= virt ⊥ C∗ virt e(N ) Z[(NL ) ] where e(N virt) is the Euler class of the virtual normal bundle. These invariants are called the SU(r)-Vafa-Witten invariants. On the other hand the following invariants ⊥ vwc(S)= χ(NL ,νN ) ⊥ are defined as Behrend’s weighted Euler characteristic of NL weighted by the ⊥ Z Behrend function νN : NL → . These two invariants VW(S) and vw(S) are not the same for general surfaces, especially for general type surfaces, but for surfaces with KS < 0 and K3 surfaces, VWc(S)=vwc(S), see [34], [29]. ⊥ From a general theory in [23], the moduli space NL admits an orientation 1 2 MFφ ⊥ K ⊥ . Let ⊥ be the global motive on NL obtained by gluing the local NL NL motive of vanishing cycles of the local function. The motivic Vafa-Witten invariants are defined as: Definition 1.2. M MFφ vwc (S)= [ ⊥ ]. ⊥ NL ZNL In [36], R. Thomas defined the K-theoretical Vafa-Witten invariants using the virtual structure sheaf and an orientation of the moduli spaces. His invariants are the K-theoretical refinement of the invariants VW(S). Our motivic Vafa-Witten invariants are only the motivic refinement of the invariants vw(S). They give the same refinement for K3 surfaces. ⊥ The locus N ⊂ NL consisting of Higgs pairs (E, φ) such that the corre- ⊥ C∗ sponding E is stable is a quasi-projective subscheme of NL . The -fixed locus of N is just M := ML(S, c), which is the moduli space of stable torsion free coherent sheaves with topological invariants c. This fixed component C∗ ⊥ is the Instanton Branch of the -fixed locus of NL , see [34]. The space N → M is an affine cone over M, and is just the situation in Theorem 1.1. Thus Theorem 1.1 gives a calculation of the motivic Vafa-Witten invariants. VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 5

MFφ MFφ Let N := ⊥ |N be the restriction of the global motive on N. In NL this paper we calculate the motivic Vafa-Witten invariants for K3 surfaces. We fix in c0 = (r, c1, c2) the rank r and c1 are coprime, so that the moduli space ML(S, c0) is an irreducible smooth variety. We form the generating series vwM (S)= vwM (S)qc2 . r,c1 (r,c1,c2) c X2 We have the following result: Theorem 1.3. Let S be a smooth projective K3 surface. Fix the rank r and the first Chern class c1 such that they are coprime. The motivic generating series of motivic Vafa-Witten invariants is given by: r−1 n −L−1[S] M r− 1 − 1−r c2 1 πi r−1 jc2 2πij 1 vw (S)= q r 2r 1 · e r 1 · 1 − e r q r . r,c1 r Xj=0 nY≥1 We prove Theorem 1.3 using Theorem 1.1, and reduce the calculation to the general motive of M. From Yoshioka [39], M is birational equivalent to the Hilbert scheme of points on S. Everything is reduced to the calculation of the motive of the Hilbert scheme of points on S, and then we use Göttsche’s result in [9]. Recall that there is a ring homomorphism e : K0(VarC) → Z[u, v] from the Grothendieck ring of varieties to Z[u, v] given by the Hodge-Deligne polynomial of varieties. The χy-genus is just e(y, 1), i.e., u = y, v = 1. If we define vwχ (S)= vwχ (S)qc2 r,c1 (r,c1,c2) c X2 as the generating series of the χy-genus of the Vafa-Witten invariants, where vwχ (S) := χ (M (S, (r, c , c ))). (r,c1,c2) y L 1 2

As a corollary of Theorem 1.3 we calculate the χy-genus: Corollary 1.4. Let S be a smooth projective K3 surface. Fix the rank r and the ﬁrst Chern class c1 such that they are coprime. Then the χy-genus of the Vafa-Witten invariants is given by: r−1 χ r− 1 − 1−r c2 1 πi r−1 jc2 2πij 1 −1 vw (S)= q r 2r 1 · e r 1 · ∆(e r q r ,y) , r,c1 r Xj=0 where e 2 ∆(q,y) := (1 − qn)20 (1 − yqn)2 1 − y−1qn . n≥1 Y Thus we gete similar result as in [36] where R. Thomas uses K-theoretical Vafa-Witten invariants to calculate the case of K3 surfaces, and also prove Conjecture 4.6 in [10] using motivic method. Discussion. Our motivic series of the Vafa-Witten invariants give the same result as in [36] for K3 surfaces, since for a K3 surface S, VW(S) = vw(S). 6 YUNFENG JIANG

As pointed out in [34], the big Vafa-Witten invariants VW(S) are the cor- rect invariants for the S-duality. It is especially interesting for general type surfaces. Vafa-Witten actually predicted an S-transformation formula from the gauge group SU(r) to its Langlands dual SU(r)/Zr. In the case of K3 surfaces, the prime rank case is proved in [17], and higher rank case is studied in [20]. The method we use is moduli space of optimal gerbe twisted sheaves on K3 surfaces. The K-theoretical and elliptic genus version of the S-duality conjecture for K3 surfaces are proved in [21]. The K-theoretical reﬁnement version of the S-duality implies an S-duality transformation for motivic Vafa-Witten invariants. Outline. This note is organized as follows. In Section 2 we review the construction of the cone N, and prove that N is a d-critical scheme. We prove a motivic localization formula of the oriented d-critical scheme N under Gm- action in Section 4, and apply it to get the weighted Euler characteristic of the cone N. Finally in Section 5 we apply the motivic localization formula to calculate the motivic generating series of the motivic Vafa-Witten invariants for K3 surfaces. Acknowledgements. This paper is motivated by the study by Tanaka- Thomas [34], [35] on the Vafa-Witten invariants for projective surfaces. I would like to thank R. Thomas for sending me the above papers before posting on arXiv. Many thanks to B. Szendroi for the valuable discussion on motivic invariants of Hilbert schemes of points on C3, and S. Payne for the discussion on motivic nearby cycles and motivic Minor ﬁbers via semi- algebraic sets. Y. J. is partially supported by NSF Grant DMS-1600997.

Notation. Throughout the paper we work for with a projective scheme • M over κ with perfect obstruction theory E → LM . The one dimensional torus is denoted by Gm. When we work on the motivic Vafa-Witten theory ∗ everything is over C and Gm = C .

2. Preliminaries on the cone N We brieﬂy recall the construction of the abelian cone N in [18].

2.1. Abelian cones. Let F be coherent sheaf over M. There is an associated cone π C(F ) := SpecSym• F −→F M over M. Cones of this form are called abelian in [3, Section 1]. The grading • on Sym F endows C(F ) with a Gm-action

Gm × C(F ) −→ C(F ) induced by the map Sym• F [x,x−1] ←− Sym• F VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 7 that takes s ∈ Symi F to sxi. Its fixed locus is the zero section M ⊂ C(F ) defined by the ideal Sym≥1 F . When F is locally free C(F ) = Tot(F ∗) is the total space of the dual vector bundle. More generally, for any F , the fibre of C(F ) over a closed ∗ point p ∈ M is the vector space (F |p) . In fact C(F ) represents the functor ∗ from M-schemes to sets that takes f : S → M to HomS(f F, OS). 2.2. The cone N. We fix a perfect obstruction theory • E −→ LM of virtual dimension vd := rank(E•) on the complex projective scheme M. Applying the results of the last section to the obstruction sheaf 1 • ∨ ObM := h (E ) , 1 we define π = πN : N → M to be the associated abelian cone, • π (2.1) N := C(ObM ) = SpecSym (ObM ) −→ M. 2.3. Local model. Locally we may choose a presentation of (M, E•) as the zero locus of a section s of a vector bundle E → A over a smooth ambient space A, such that the resulting complex ds • ∨ TA|M −→ E|M is E0 −→ E1 = (E ) . Then we have E• as E−1 → E0 , we get the exact sequence φ E0 −→ E1 −→ ObM −→ 0. The resolution gives an exact sequence •−1 • • φ(E0) ⊗ Sym E1 −→ Sym E1 −→ Sym ObM −→ 0. That is, • • SpecSym ObM ⊂ SpecSym E1 with ideal generated by φ(E0). Letting τ denote the tautological section of π∗ E−1, this says that E1 (2.2) −1 ∗ ∗ ∗ 0 C(ObM ) is cut out of C(E1) = Tot(E ) by the section πE1 φ (τ) of πE1 E . ∗ ∗ ∗ Therefore N = C(ObM ) is cut out of Tot(E )|M by the section πE(ds) (τ) ∗ ∗ ∗ ∗ of πEΩA|M . In turn Tot(E )|M is cut out of Tot(E ) by πEs. Therefore the ideal of N in the smooth ambient space Tot(E∗) is ∗ ∗ ∗ (2.3) πEs, πE(Ds) (τ) , where we have chosen any holomorphic connection D on E → A by shrinking A if necessary.

1Another way to describe N is as the coarse moduli space of the vector bundle stack h1/h0(E•)∨ of [3, Section 2]. 8 YUNFENG JIANG

Thinking of the section s of E → A as a linear function s on the ﬁbres of Tot(E∗), we ﬁnd that its critical locus is N. Proposition 2.4. ([18, Proposition 2.8]) N ⊂ Tot(E∗) ise the critical locus of the function s: Tot(E∗) → κ.

3. The global sheaf of vanishing cycles on N e 3.1. d-critical schemes. Let us ﬁrst recall the notion of d-critical schemes introduced in [22]. For any scheme N, Joyce [22, Theorem 2.1] proves that there exists a canonical sheaf of C-vector spaces SN on N. This sheaf SN satisﬁes the following property: for any Zariski open subset R ⊂ N and a closed embedding i : R ֒→ A into a smooth scheme A, there is an exact sequence: e

e e 2 dDR e e e e e (3.1) 0 → SN |R −→ OA/I −→ ΩA/I · ΩA → 0,

e where I ⊂ OA is the ideal sheaf of R and dDR is the de-Rham differential. Joyce shows that there is a natural decomposition e 0 C SN = SN ⊕ N C 0 where N is the constant sheaf on N. This sheaf SN , when restricted to R, is the kernel of the composition 2 e e ։ e e SN |R ֒→ OA/I ORred and Rred is the reduced scheme of R. We recall the d-critical scheme structure of Joyce. Definitione 3.2. ([22, Definition 2.5]e)A d-critical scheme is given by a pair 0 (N,s), where N is a scheme and s ∈ Γ(N, SN ) is a section such that for any point x ∈ N, there is an open neighborhood x ∈ R ⊂ N, a closed embedding i : R ֒→ A into a smooth scheme A, and a regular function f : A → A1 such 2 that s|Re = f + I . We call the data (R, A, f, i) aed-critical chart. e e e e Therefore a d-critical scheme (N,s) is roughly understood as locally the critical locus of some regular function fe one a smooth scheme, and the section s remembers the local regular function f. In particular if N = Crit(f) is the critical locus of a regular function f : A → A1, then N is a d-critical scheme and the sheaf SN is given by (3.1). e 3.2. Semi-symmetric obstruction theory. In this section we review a bit of the semi-symmetric obstruction theory in [5], [16]. Definition 3.3. ([5, Definition 3.1]) A semi-perfect obstruction theory of N consists of a covering {Nα}α∈Λ of N by affine schemes, and truncated perfect obstructin theories

φα : Eα → LNα , α ∈ Λ such that VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 9

(1) for any pair α, β ∈ Λ there exists an isomorphism

1 ∨ =∼ 1 ∨ (3.4) ψαβ : h (Eα )|Nαβ −→ h (Eβ )|Nαβ 1 ∨ such that the collections (h (Eα ), ψαβ) forms a descent data of sheaves.

(2) for any pair α, β ∈ Λ, the obstruction theories φα|Nαβ and φβ|Nαβ are ν-equivalent via ψαβ, which means that ψαβ is compatible with the infinitesimal lifting problem for the obstruction theories, see [5, Definition 2.9], and [16, Definition 3.5]. A symmetric semi-perfect obstruction theory on N is a semi-perfect obstruction theory φ = {φα,Nα, Eα, ψαβ}α∈Λ for N such that each φα is symmetric in the sense of [1]. A (symmetric) perfect obstruction theory is a (symmetric) semi-perfect obstruction theory.

For a symmetric semi-perfect obstruction theory φ = {φα,Nα, Eα, ψαβ}α∈Λ for N, the local virtual cycles glue to give a virtual fundamental cycle virt [N] ∈ A0(N). Behrend’s theorem equating the weighted Euler characteristic χ(N,νN ) with the virtual count [N]virt 1 is still true, see [16, Theo- rem 3.8] if N is proper. If N is non-proper, it does not make sense for the R integral, but χ(N,νN ) exists as an invariant. Proposition 3.5. ([16, Theorem 4.6]) There exists a symmetric semi-oerfect obstruction theory φ = {φα,Nα, Eα, ψαβ}α∈Λ for a d-critical scheme (N,s). 3.3. N is a d-critical scheme. We show that our cone N in (2.1) is a d-critical scheme. Proposition 3.6. The scheme N in (2.1) is a d-critical scheme in the sense of [22, Deﬁnition 2.5].

0 Proof. We show that there exists a section s ∈ Γ(N, SN ) satisfying the properties in Deﬁnition 3.2. Let x ∈ N be a point. Recall the projection of the cone π : N → M. We denote by x = π(x) and x ∈ M. let x ∈ R be an open subset in M. Suppose that R ⊂ A is a local embedding into a smooth scheme A. Let R = π−1(R) and R → R the projection. We have x ∈ R. We may shrink R and A if necessary so that the vector bundle E∗ is trivial and there is a relativee embeddinge e Arank E∗ . R ֒→ A := A × κ Then from the proof of [18, Proposition 2.8], one can work in local coor- e e dinates xi for A. Take a basis of sections ej of E, we get a dual basis fj ∗ ∗ for E and coordinates yj on the ﬁbers of Tot(E ). Then we can write f = j sjej, τ = j yjfj and P P f = sjyj. Xj e 10 YUNFENG JIANG

Therefore

∗ df = yjdsj + sjdyj = τ,πEDf + sjdyj j j j X X X e with zero scheme deﬁned by the ideal

∗ ∗ ∗ ∗ πE∗ (Df) (τ), πEs1, πEs2, ... , which is the same as (2.3). Then Crit(s) =∼ R. Let i : R ֒→ A be the inclusion. Then we get a d-critical chart e e e e e (R, A, f, i).

e e Let IR,A ⊂ O(A) be the ideal of Re ine Ae.e Then we have an exact sequence:

−1 −1 e e ι e e e e e e R,A i (OA) dDR i (ΩA) 0 → SN | e −→ −→ . R 2 −1 I e e I e e · i (Ω e) e R,A R,eA A e 0 e e Then locally the section s ∈ Γ(N, SN ) is given by

2 s| e = f + I e e. R R,A

e e e The d-critical chart exists around every point x ∈ R ⊂ N. To show s|R 0 glue to give a section s ∈ Γ(N, SN ), Let (S, B, g, j) be another chart such that x ∈ S, where e e e e′ e S ֒→ B := B × Arank E e κ ′ for a smooth scheme B ande vectore bundle E → B over B. Let φ : R → S be an embedding of open subsets of N such that in the diagram e e R / A

φ Φ e e S / B

Φ is a smooth embedding sincee shrinkinge A and B if necessary, we have Am Z B = A × κ for some m ∈ >0. This can be seen as follows. Let π : S → S ⊂ M and π : R → R ⊂ M be the projections, one can take local sections ′ ′ ′ (es1, · ·e · ,sr′ ) of the bundle E → B with zero locus S, such that its restrictione to E → A gives thee zero locus R of the local sections (s1, · · · ,sr) of E → A. Am Thus shrinking A and B if necessary, we may assume B = A × κ for some Z ′ ′ m ∈ >0. And the local functions g = i si · yi restrict to give the local e e P VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 11 function f. Then we have the following diagram: (3.7)

ιS,e Be e−1 e−1 j (OBe ) d j (ΩBe ) 0 / SN | e | e / 2 | e / e | e / 0 S R I R e e −1 e R S,e Be IS,B ·j (ΩB ) id i−1(Φ#) i−1(dΦ) ιRe,Ae e−1 e−1 i (OAe) d i (ΩAe) 0 / SN | e / 2 / e / 0. R I e e −1 e R,e Ae IR,A·i (ΩA)

The local function g restrict to give the local function f, therefore the ele- 2 2 ment g + I e e restricts to give the element f + I e e. S,B R,A Now for any twoed-critical charts (R, A, f, i) and (S,eB, g, j) of N, then there is a chart (R ∩ S, W , h, , k) on the intersection R ∩ S, such that there are embeddings of the charts e e e e e e e e e e f e e e e (R ∩ S, W , h, , k) ֒→ (R, A, f, i) and e e e (Re ∩ S,e Wf , h, , k) ֒→ (S,e B,e g, je) such that the local functions f and g gives the local function h. Hence there 0 0 e e f e e e e e is a section s ∈ H (SN ) and (N,s) is a d-criticale scheme. e e 3.4. Orientation on d-critical schemes.e Let (N,s)bea d-critical scheme. red There exists a line bundle KN,s on N , called the virtual canonical line bundle. From [22, Theorem 2.28 ] KN,s is the unique line bundle on N such that on the d-critical chart (R, A, s, i), there is a natural isomorphism

=∼ ⋆ ⊗2 ι : KN,s| ered −→ i (K e )| ered . e Re e e A R Definition 3.8. ([22, Definition 2.31])A d-critical scheme (N,s) is called e 1 2 red oriented if the line bundle KN,s admits a square root KN,s on N such that 1 ⊗2 2 ∼ KN,s = KN,s. We call such a d-critical scheme (N,s) an oriented d-critical scheme. Definition 3.9. ([28, Definition 2.8])A d-critical scheme (N,s) is Calabi- ∼ Yau if the virtual canonical line bundle KN,s = ON red is trivial. An oriented 1 1 2 2 ∼ d-critical scheme (N,s,KN,s) is Calabi-Yau of KN,s = ON red . Remark. It is interesting to see if our cone N is a Calabi-Yau d-critical scheme. Maulik-Toda [28] introduced the Calabi-Yau structure on a projective morphism N → B (for a scheme B) at a point b ∈ B, which means there exists an open neighborhood b ∈ U ⊂ B such that (N|U ,s|U ) is Calabi-Yau. The projection morphism π : N → M is not projective, therefore it is not interesting to have Calabi-Yau structure at a point x ∈ M. 12 YUNFENG JIANG

The cone N in (2.1) admits a Gm-action whose fixed point loci is M ⊂ N. As pointed out in [18], it is not known if the scheme N admits a symmetric obstruction theory of [1], but there is one locally since N is the critical locus of a regular function on a higher dimensional smooth scheme. In [18], the authors assume that the scheme M is the underlying scheme of a quasi- smooth derived scheme, and N is the (−1)-shifted cotangent bundle of M, therefore admits a symmetric obstruction theory. From Proposition 3.5, the d-critical scheme (N,s) admits a symmetric semi-perfect obstruction theory φ = {φα,Nα, Eα, ψαβ}α∈Λ as in Definition 3.3. The Gm-action on N induces an action on φ = {φα,Nα, Eα, ψαβ}α∈Λ and makes it a Gm-equivariant symmetric semi-perfect obstruction theory. Note that if N = α∈Λ Nα, then M = α∈Λ(Nα ∩ M). Here is a general- ization of [36, Proposition 2.6]: S S Proposition 3.10. The canonical line bundle KN,s when restricted to the fixed point locus M has a canonical square root such that for each α ∈ Λ,

1 1 2 ≥0t 2 rank≥0 KN,s|π(Nα) = det(Eα|M∩Nα ) , ≥0 G where (Eα|M∩Nα ) denotes the part of Eα|M∩Nα with nonnegative m- weights, and rank≥0 is its rank.

Proof. We can take the chart Nα to be a d-critical chart (Nα, f, A, i), then the symmetric obstruction theory Eα is given by e d◦df ∨ e e e Eα = TAe −→ ΩAe h ⋆ ⊗2 i Therefore KN,s| red = det(Eα) = i K e | red . The local calculation is the Nα A Nα same as in the proof of [36, Proposition 2.6]. Since all the local data glue, we are done. e 3.5. Motivic vanishing cycles. In this section we review the motivic vanishing cycles for d-critical schemes constructed in [4]. For a scheme N, let K0(VarN ) be the Grothendieck ring of schemes over the scheme N. It is the abelian group generated by symbols [T ] for T → N an N-scheme with relations [S] = [T ] if S =∼ T as N-schemes, and if T ⊆ S is a closed X- subscheme, then [S] = [T ] + [S \ T ]. The ring structure on K0(VarN ) is A1 A1 given by [S] · [T ] = [S ×N T ]. Let N be the N-scheme πN : × N → N L A1 and we denote it by := [ N ]. For all the positive integers n ∈ Z>0, we consider the cyclic group µn. These groups µn form a projective system with respect to the maps µnd → µn d mapping x 7→ x for all d, n ∈ Z>0. We letµ ˆ be the projective limit of the groups µn.µ ˆ is a pro-scheme. Let T → N be an N-scheme. A good µn- action on T is a group action σ : µn×T → T such that each orbit is contained in an aﬃne subscheme of T . If T is quasi-projective then any action of µn on T is a good action. A goodµ ˆ-action on T is an actionσ ˆ :µ ˆ × T → T which factors through a good µn-action for some n. The trivial action is denoted by ˆι : µn × T → T which is good. VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 13

µˆ The equivariant Grothendieck ring of schemes K0 (VarN ) is, as an abelian group, generated by the symbols [T, σˆ] where T → N is an N-scheme with a goodµ ˆ-actionσ ˆ. The relations are given by: [T, σˆ] = [S, τˆ] is T,S are isomorphic as N-schemes withµ ˆ-actions; [T, σˆ] = [S, σˆ|S] + [T \ S, σˆ|T \S] if S ⊆ T is a closed,µ ˆ-invariant N- subscheme of T ; and n n n [T × A , σˆ × τˆ1] = [T × A , σˆ × τˆ2] for any linearµ ˆ-actionsτ ˆ1, τˆ2 on A . µˆ The ring structure on K0 (VarN ) is given by [T, σˆ]·[S, τˆ] = [T ×N S, σˆ ×τˆ]. L A1 µˆ Still let = [ N , ˆι] be the Lefschetz motive in K0 (VarN ). We define µˆ µˆ L−1 MN = K0 (VarN )[ ] L µˆ µˆ to be the ring by inverting . If N = Spec κ, then K0 (VarN ) and MN µˆ µˆ µˆ are written as K0 (Varκ) and Mκ. Some properties of the K0 (VarN ) and µˆ MN are given in [4, §2], we refer the reader to [4] for more details. [4] also µˆ µˆ introduced a product ⊙ on K0 (VarN ) and MN which we recall here: Definition 3.11. ([4, Definition 2.3]) Let [T, σ], [S, τ] be two elements in µˆ µˆ K0 (VarN ) or MN . Then there exists n ≥ 1 such that the µˆ-actions σ, τ on T,S factor through µn-actions σn,τn. Define Jnb to beb the Fermat curve 1 2 n n Jn = {(t, u) ∈ (A \ {0}) : t + u = 1}. b b

Let µn × µn act on Jn × (T ×N S) by ′ ′ ′ (α, α ) · ((t, u), (v, w)) = ((α · t, α · u), (σn(α)(v),τn(α )(w))).

Write Jn(T,S) = (Jn × (T ×N S))/(µn × µn) for the quotient κ-scheme, and deﬁne a µn-action vn on Jn(T,S) by

vn(α)((t, u), v, w)(µn × µn) = ((α · t, α · u), v, w)(µn × µn).

Let vˆ be the induced good µˆ-action on Jn(T,S), and set

[T, σ] ⊙ [S, τ] = (L − 1) · [(T ×N S/µn, ˆι)] − [Jn(T,S), vˆ] µˆ µˆ in K0 (VarN ) or MN . This defines a commutative, associative product on µˆ b µˆ b K0 (VarN ), MN . In [4], for any κ-schemes N, P , there are products ⊡ µˆ µˆ µˆ ⊡ µˆ µˆ µˆ : K0 (VarN ) × K0 (VarP ) → K0 (VarN×P ); : MN × MP → MN×P by mapping ([T, σˆ], [S, τˆ]) 7→ [T × S, σˆ × τˆ]. ⊡ µˆ µˆ If P = Spec(κ), then N × Spec(κ)= N, and makes K0 (VarN ), MN into µˆ µˆ modules over K0 (Varκ), Mκ. 1 µˆ µˆ L 2 As in [4], we define in K0 (VarN ) or MN by: 1 L 2 = [N, ˆι] − [N × µ2, ρˆ], µˆ µˆ where [N, ˆι] with trivialµ ˆ-action ˆι is the identity in K0 (VarN ) or MN , and N × µ2 is the two copies of N with the nontrivialµ ˆ-actionρ ˆ induced 14 YUNFENG JIANG by the left action of µ2 on itself, exchanging the two copies of N. Then 1 1 L 2 ⊙ L 2 = L. Now let (N,s) be the d-critical scheme for the cone N in Proposition 3.6. Let (R, A, f, i) be a d-critical chart of (N,s). Then the motivic vanishing φ µˆ 1 cycle MF e e ∈ M e is defined as follows. The restriction f| e : R → A A,f Crit(f) R e e e e red is locally constant on R and f(R) is finite. We have R = e e R with c∈ef(R) e c −1 Rc = R ∩ Ac where Ac = f (c) ⊂ A. Then from [4, FormulaF (2.8)], the e φ e e µˆ e e motivic vanishing cycle MF e e ∈ M e is defined by A,f Crit(f) e e e e e e e φ − dim A µˆ (3.12) MF e e| e = L 2 ⊙ ([Ac, ˆι] − MF e e )| e ∈ MF e A,f Rc A,f−c Rc Rc

MF e e for each c ∈ f(R), where for the functione f −c on A, A,f−c is the motivic nearby cycle e e e e |I|−1 ◦ MF e e L A,f−c := (1 − ) [EI → A0, ρÎ ]. ∅6=XI⊆J e e Here we take p : B → A be the resolution of singularities of f. Let Ei, i ∈ J −1 be the irreducible components of p (A0). For each i ∈ J, let Ni be the multiplicity of Eiein thee divisor of f ◦ p on B, and νi − 1 thee multiplicity ∗ of Ei in the divisor of p (dx), where dx eis a local on vanishing volume form ◦ at any point of p(Ei). For any I ⊂ eJ, let EI e= (∩i∈I Ei) \ (∪i∈J\I Ej). Let ◦ ◦ mI = gcd(Ni)i∈I . There exist an unramified Galois cover EI → EI , with Galois group µmI introduced in [4, Definition 2.9]. [4, §2.5] also defined the motive of principle Z2-bundles. Thee reason is that the local regular functions f, when apply the change of variables of the local coordinates, has extra terms by a quadratic polynomial, which determines a principal Z2-bundle on N.e Let Z2(N) be the abelian group of isomorphism classes [P ] of principal Z2-bundles P → N, where the multiplication is given Z Z by [P ] · [Q] = [P ⊗Z2 Q] is identity is [N × 2]. Each element in 2(N) is self-inverse, and has order 1 or 2. If P → N is a principal Z2-bundle over N, then we have the motive of P defined as: Υ(P )= L−1/2 ⊙ ([N, ˆι] − [P, ρˆ]) whereρ ˆ is theµ ˆ-action on P induced by the µ2-action on P from the principal Z2-bundle structure. If P = N × Z2 is the trivial bundle, then Υ(N × Z2)= µˆ [N, ˆι]. In [4], the authors defined the ring MN , which is roughly the quotient µˆ of MN by the relation Υ(P ⊗Z2 Q) − Υ(P ) ⊙ Υ(Q) = 0. In order to let the µˆ µˆ µˆ ring MN with product ⊙ have pushforward property φ∗ : MN → MP under µˆ the morphism φ : N → P . The authors define for a scheme P , the ideal IP µˆ in (MP , ⊙) generated by the elements

φ∗(Υ(P ⊗Z2 Q) − Υ(P ) ⊙ Υ(Q)) VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 15 for all morphisms N → P and principal Z2-bundles P,Q → N. Then deﬁne µˆ µˆ µˆ MP to be the quotient MN /IP with the multiplication ⊙. When P = N, µˆ φ and φ is identity, we get the ring M . The motivic vanishing cycles MF e e, N R,A L L1/2 µˆ , and Υ(P ) are in the ring MN . Finally we recall the result in [4] about the motivic vanishing cycles for an oriented d-critical scheme. Theorem 3.13. ([4, Theorem 5.10]) For our d-critical scheme (N,s) in 1/2 Proposition 3.6, assume that there exists an orientation KN,s. Then there MFφ µˆ exists a unique motive N,s ∈ MN , called the motivic vanishing cycles of N, such that for each d-critical chart (R, A, f, i), we have φ ∗ φ µˆ MF | e = i (MF e) ⊗ Υ(Q e e ee) in M e N,s R A,e f e e R,eA,ef,i R

e e e Z where QR,A,f,ei → R is thee principal 2-bundle parametrizing local isomor- 1/2 ∗ e e e e e e e e e phisms α : KN,s|Rred → i (KA)|Rred with α ⊗ α = ιR,A,f,ei where ιR,A,f,ei : ∗ ⊗e2 KN,s| ered → i (K e )| ered is the local isomorphism. R A R e Remark. The orientation in Deﬁnition 3.8 for the moduli space of stable e coherent sheaves on Calabi-Yau threefolds has been constructed in [23].

4. A motivic localization formula

We prove a version of the Gm-localization formula for the global motive MFφ G N,s for the oriented d-critical scheme (N,s) in Proposition 3.6 under m- action scaling the ﬁbers. In [14, Theorem 7.17], the motivic localization formula for oriented formal d-critical schemes and d-critical non-archimedean K = κ((t))-analytic spaces was proved using motivic integration for formal schemes. In [14], we assume that the Gm-action on X preserves the orien- 1 2 G tation KN,s. The m-action on our cone N does not satisfy this condition.

4.1. The general statement of the Gm-action.

Deﬁnition 4.1. Let (N,s) be a d-critical scheme. A Gm-action

µ : Gm × N → N ⋆ 0 is Gm-invariant if µ(γ) (s) = s for any γ ∈ Gm, and s ∈ H (SN ), or ⋆ ⋆ G equivalently µ (s)= πN (s), where πN : m × N → N is the projection.

Deﬁnition 4.2. The Gm-action on a scheme N is called good if any orbit is contained in an aﬃne subscheme of N. Equivalently, there exists an open cover of subschemes which are Gm-invariant. Here are two results in [22], and [14].

Proposition 4.3. Let (N,s) be a d-critical scheme which is Gm-invariant under the Gm-action. Then 16 YUNFENG JIANG

(1) If the action µ is good, then any x ∈ N there exists a Gm-invariant critical chart (R, U, f, i) on (N,s) such that dim(TxN) = dim(U); (2) If for all x ∈ N we have a Gm-invariant critical chart (R, U, f, i), then the action µ is good.

Proposition 4.4. Let (N,s) be a d-critical scheme which is Gm-invariant Gm under the Gm-action. Let N be the ﬁxed subscheme. Then the ﬁxed subscheme N Gm inherits a formal d-critical scheme structure (N Gm ,sGm), .where sGm = i⋆(s) and i : N Gm ֒→ N is the inclusion map

Let (N,s) bea d-critical κ-scheme with a good Gm-action. Let

Gm Gm N = Ni iG∈J be the decomposition of the ﬁxed locus XGm into connected components, Gm Gm G such that (Ni ,si ) are oriented d-critical schemes. The action m has a decomposition

Tx(Ni) = (TxNi)0 ⊕ Tx(Ni)+ ⊕ (Tx(Ni))− where the direct sums are the parts of zero, positive and negative weights with respect to the Gm-action. Maulik [27] deﬁned the virtual index

virt Gm (4.5) ind (Ni ,N) = dimκ(Tx(N)+) − dimκ(Tx(N)−) Gm so that it is constant on the strata Ni . This virtual index is essential in [27] to prove the motivic localization formula, see also [14, Theorem 7.17]. We don’t need it here. Suppose that the d-critical κ-scheme (N,s) is oriented, i.e., there exists 1 2 a square root KN,s for the canonical line bundle KN,s. Then we denote by MFφ µˆ µˆ µˆ L−1 N,s ∈ MN the global motive for N in [4]. Here MN = K0 (VarN )[ ] is the equivariant Grothendieck ring of varieties over X with a new product ⊙ deﬁned in [4], and reviewed in [14, §7.3]. Deﬁnition 4.6. We call the action

µ : Gm × N → N circle-compact if the limit limλ→0 µ(λ)x exists for any x ∈ N. If X is proper, then any Gm-action on N is circle-compact. For the d-critical scheme (N,s) in Proposition 3.6, we have:

Proposition 4.7. There exists a good and circle compact Gm-action on the oriented d-critical scheme (N,s) for the cone π : N → M.

4.2. The Gm-localization formula for the cone N. Theorem 4.8. Let (N,s) be the d-critical scheme in Proposition 3.6 and µ is the good, circle-compact action of Gm on N. Assume that there is an VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 17

1 µˆ 2 MFφ orientation KN,s and let N ∈ MN be the global motive of N. Then we have the following localization formula.

MFφ L−(rank(E0)−rank(E−1))/2 N = ⊙ [M]. ZN ZM MFφ Remark. We remark here that N N means pushforward to a point, µˆ hence the absolute motive in Mκ.R In practice, our N will be the moduli space of stable Higgs sheaves (E, φ) on a surface or surface DM stack S as in [34], [19]. A recent result in [23] shows that there is a natural orientation data on the moduli stack of coherent sheaves on Calabi-Yau threefold, and this orientation data, when restricting to the moduli space of torsion 2-dimensional sheaves on X := Tot(KS) 1 2 (which is isomorphic to N) gives the orientation KN,s.

Proof. Let (R, A, s, i) be a d-critical chart of (N,s). Recall that from [4], [14], the motive

e e e eφ ⋆ φ µˆ MF | e = i (MF ) ⊙ Υ(Q e e e) ∈ M e, N R A,e se R,A,s,e i R e φ − dim(A)/2 where MF e = L ⊙ [[A0, ˆι] − MF e ]| e is the motivic vanishing A,se A,se R MF cycle; A,e se is the motivic nearby cycle deﬁned in [14, Deﬁnition 7.9]; and − 1 e µˆ e e e L 2 e Υ(QR,A,s,e i) = ⊙ ([R, ˆι] − [Q, ρˆ]) ∈ MR is the motive of the principal Z e e 2-bundle QR,A,s,eei as in [4, §2.5] and recalled in [14, §7.3]. The canonical line bundle KN,s is the uniquee line bundle on N such that on the d-critical chart (R, A, s, i), there is a natural isomorphism

=∼ ⋆ ⊗2 ι : KN,s| ered −→ i (K e )| ered . e e e e R A R The principal Z -bundle Q e e e parametrizes the local isomorphisms 2 R,A,s,e i e 1/2 =∼ ⋆ (4.9) K | e −→ i (K e)| e N,s Rred A Rred µˆ e given by the orientation. The producte⊙ in MR is given in [4, Definition 2.3] and we reviewed it in Definition 3.11. We now prove the result on the d-critical chart (R, A, s, i). We prove that the following formula holds: e e e e φ − 1 dim(A)+rank(E) e (4.10) MF e = L 2 ⊙ [R]. e A,se ZR ZR Recall from Proposition 3.6 that in local coordinates each d-critical chart of N is given by ∗ (R, Tot(E )|U , s, i), ∗ ∗ where Tot(E )|U is the bundle E over an open neighborhood U of A, s ∗ is the local regular function, and R := Crit(e s), i : R ֒→ Tot(E )|U is the e e 18 YUNFENG JIANG inclusion. Trivialising E with a basis of sections ej, we get a dual basis fj ∗ ∗ for E and coordinates yj on the fibres of Tot(E ). The function

s = sjyj, Xj e G where we write the section s = j sjej, τ = j yjfj. The group m acts on N by scaling the fibre and the fixed locus is M ⊂ N. So the invariant part sGm = 0. P P rank(E∗) Since locally A = A×Aκ , and the Gm-action on N actually extends to ane action on A. Here we assume that the group Gm acts on A trivially, ∗ Arank(E ) G A1 and on κ eby positive weights w1 > 0, · · · , wr > 0. Let m act on κ by weight d> 0.e Our cone N → M case is exactly the special case that all wi, d are equal to one. So this is exactly the situation as in Theorem 4.1.1. in [32]. So from [32, Theorem 4.1.1.] we have the motivic nearby cycle −1 MF e A,se = [s (1)]. From the proof of Proposition 3.6, the critical locus R ⊂ A has ideal e −1 (si,Dsi). So over R \ R, i.e., the part of R such that si 6= 0, s (0) and −1 −0 −1 e e e s (1) are all afine subspaces in A. Hence [s (0) − s (1)]|R\R = 0. We calculate e e e e e φ − dim(A)/2 e e e MF | e = L ⊙ [[A0, ˆι] − MF e ]| e A,e se R A,se R L− dim(Ae)/2 −0 −1 = ⊙ [se (0) − s (1)]|Re e − dim(A)/2 −0 −1 −0 −1 = L ⊙ [s (0) − s (1)]|R + [s (0) − s (1)]| e e e R\R e = L− dim(A)/2 ⊙ [s−1(0)]| e R e e e e ∗ = L− dim(A)/2 ⊙ Lrank(E ) · [R]. e Let us argue the invariant

− 1 µˆ e e e L 2 Υ(QR,A,s,e i)= ⊙ ([R, ˆι] − [Q, ρˆ]) ∈ MRe 1/2 on the d-critical chart (R, A, s, i). ShrinkeR if necessary, the orientation KN,s Z e e is trivial on R. Then the principal 2-bundle QR,A,s,eei is trivial parametrizing the isomorphisms in (4.9),e e soe e e e − 1 µˆ e e e L 2 e Υ(QR,A,s,e i)= ⊙ ([R, ˆι] − [Q, ρˆ]) ∈ MR 1 1 L− 2 L 2 = ⊙ e⊙ [R, ˆι] = [R, ˆι]. e µˆ e Since the motive [R, ˆι] is the identitye in MR, we have e φ − dim(A)/2 rank(E∗) MF e L L e N |R = · · [R]. VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 19

MFφ This implies that the global motive N,s is locally on the d-critical charts given by the absolute motive of the base [R] in M, so the motives [R] glue to give [M]. Finally 1 1 1 − dim(A)/2 + rank(E∗)= − dim(A)+ rank(E∗)= − vd . 2 2 2 The result follows.e Remark. Theorem 4.8 implies one of the main result vd χ(N,νN ) = (−1) χ(M) in [18], which has applications in the study of Vafa-Witten invariants [34], [35]. One easily see this by taking the limit lim 1 , and note that L 2 →−1

φ lim MF = χ(N,νN ) 1 N L 2 →−1 ZN 0 −1 ∗ and (−1)− rank(E )−rank(E ) = (−1)dim Tot(E ) = (−1)vd, we have vd χ(N,νN ) = (−1) χ(M).

5. Motivic Vafa-Witten theory In this section we review the motivic Vafa-Witten invariants and give calculations for K3 surfaces.

5.1. Power structure on motivic ring. We recall the power structure on the Grothendieck ring K0(Varκ) following [12]. Let R be a ring. A power structure on R is a map (1 + qR[[q]]) × R → 1+ qR[[q]]) by (A(t),m) 7→ (A(q))m which satisﬁes the properties: A(q)0 = 1, A(q)1 = A(q), A(q)m+n = A(q)mA(q)n, A(q)mn = (A(q)m)n, A(q)mB(q)m = (A(q)B(q))m, and (1+ q)m =1+ mq + O(q2). From [12], there exists a power structure on the Grothendieck ring K0(VarC) , deﬁning uniquely by the property that for a variety X, ∞ (1 − q)−[X] = [Symk(X)]qk Xk=0 is the motivic zeta function. Also from [12], we have the exponential map

(5.1) Exp : qMC[[q]] → 1+ qMC[[q]] 20 YUNFENG JIANG by ∞ n n −[An] Exp [An]q = (1 − q ) . n=1 ! X nY≥1 This equation satisﬁes the substitution rule:

1 n (5.2) Exp(A(q))| 1 = Exp A (−L 2 ) q . q7→(−L 2 )nq 5.2. Motivic Vafa-Witten invariants. In this section we define the motivic Vafa-Witten invariants. Let us fix a smooth surface S and X := Tot(KS ) be the total space of canonical line bundle KS. In [34], Tanaka- Thomas defined the moduli space of stable Higgs pairs (E, φ), where E is a torsion free rank r coherent sheaf on S, and φ : E → E ⊗ KS is a OS -linear map called the Higgs field. The detail definition of the Gieseker stability and the construction of the moduli spaces are in [34]. We work on the moduli space ⊥ ⊥ NL := NL (S, c) of stable Higgs pairs on S with topological invariant c = (r, c1, c2) and tr(φ) = 0, det(E) = L ∈ Pic(S). From spectral theory in [34, §2], every Higgs pair (E, φ) corresponds to a two dimensional torsion sheaf Eφ supported on S ⊂ X. The Gieseker stability of the Higgs pair (E, φ) transforms ⊥ to the Gieseker stability of the torsion sheaf Eφ, and the moduli space NL is isomorphic to the moduli space of stable two dimensional torsion sheaves on ⊥ X with fixed determinant. Thus the moduli space NL admits a symmetric ⊥ C∗ obstruction theory as in [1]. NL is not compact, but admits a -action scaling the Higgs field (or induced by the scaling fiber action on X), the C∗-fixed locus contains two branches. Instanton Branch: The first component contains Higgs pairs (E, φ) which is C∗-fixed and φ = 0. This component is just the moduli space M := ML(S, c) of stable coherent sheaves on S with topological invariant c. Note that in this case E is stable. Monopole Branch: The second component contains Higgs pairs (E, φ) which is C∗-fixed and φ 6= 0. This component usually contains pair (E, φ), where E splits to direct sum of subsheaves which maybe nonsemistable. For general type surfaces S with pg > 0, some component in this loci is isomorphic to nested Hilbert schemes on S, see [34], [36]. The SU(r)-Vafa-Witten invariants are defined by virtual localization [11] by: 1 (5.3) VWc(S) := virt ⊥ C∗ virt e(N ) Z[(NL ) ] where e(N virt) is the Euler class of the virtual normal bundle. The small SU(r)-Vafa-Witten invariants are defined by: ⊥ (5.4) vwc(S) := χ(NL ,νN ) VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 21

⊥ which is the weighted Euler characteristic of NL weighted by the Behrend ⊥ Z function νN : NL → . In general, VWc(S) 6= vwc(S), but they are equal in two cases: the case KS < 0, and the case of K3 surfaces [29]. ⊥ Since NL is the moduli space of stable sheaves on X, from [23], this 1 2 moduli space admits an orientation K ⊥ . Therefore from [4], there exists a NL MFφ µˆ global motive ⊥ ∈ MN ⊥ . NL L

m Deﬁnition 5.5. The motivic Vafa-Witten invariant vwc (S) is deﬁned by:

vwM (S) := [MFφ ], c N ⊥ N ⊥ L Z L where the integral means pushing forward to a point. Remark. The motivic Vafa-Witten invariants can only be defined as a refinement for the invariants vw(S). In [36], R. Thomas defined the refinement K-theoretical Vafa-Witten invariants using virtual structure sheaf and 1 2 orientation K ⊥ , which refined the Vafa-Witten invariants VW(S). NL In order to apply Theorem 4.8, let

stable ⊥ ⊥ N := NL ⊂ NL ⊥ be the locus in NL consisting of Higgs pairs (E, φ) such that E is stable. Then N → M is a cone over the moduli space of stable sheaves on S, and is the situation in §2. N is a quasi-projective scheme and also admits ⊥ an induced symmetric obstruction theory from NL . The restriction of the 1 2 orientation K ⊥ gives an orientation NL

1 1 2 2 KN := K ⊥ |N . NL

MFφ The global motive ⊥ restricts to give the global motive NL

MFφ MFφ N = ⊥ |N . NL

∗ The C -ﬁxed locus of N is M = ML(S, c). We review the splitting of the perfect obstruction theory of N on M a bit here following [34, §3]. Let

pX : N × X → X; pS : N × S → S be the projections and E on N × X the universal sheaf (or Higgs pair). Let π : N ×X → N ×S be the projection. Then the pushforward π∗E = E is the 22 YUNFENG JIANG universal sheaf on N × S. Then from the diagram in ([34, Corollary 2.22]): H E E H E E H E E R ompS ( , ⊗KS)0[−1] / R ompX ( , )⊥ / R ompS ( , )0 O O O

H E E H E E H E E R ompS ( , ⊗KS)[−1] / R ompX ( , ) / R ompS ( , ) O O O id tr id tr RpS∗KS[−1] o / RpS∗KS[−1] ⊕ RpS∗OS o / RpS∗OS H E E where (−)0 denotes the trace-free Homs. The R ompX ( , )⊥ is the co-cone of the middle column and it will provide the symmetric obstruction theory ⊥ of the moduli space NL of stable trace free fixed determinant Higgs pairs. Thus we have: • H E E t−1 ∼ H E E H E E t−1 EN := R ompX ( , )⊥[1] = R ompS ( , ⊗KS)0[1]⊕R ompS ( , )0[2] where t−1 represents the moving part of the C∗-action, which is the standard representation of C∗. Then • H E E L EM := R ompS ( , ⊗KS)0[1] → M • gives the perfect obstruction theory on M. Let vd := rank(EM ) be the virtual dimension. Then from Theorem 4.8, MFφ L− vd /2 (5.6) N = [M]. ZN ZM Remark. Taking Euler characteristic of (5.6) gives: vd χ(N,νN |N ) = (−1) χ(M) ⊥ which is the invariants vw(S) contributed from N ⊂ NL . Formula (5.6) is ⊥ useful for calculations for the motivic Vafa-Witten invariants when NL has no monopole branch fixed loci. 5.3. Proof of Theorem 1.3-Calculations for K3 surfaces. Let S be a smooth projective K3 surface. In this section we perform a calculation for the motivic invariants for S. In this case X = S × C, and any C∗-fixed Higgs pair (E, φ) has vanishing Higgs field φ = 0. Therefore the moduli ⊥ space N = NL → M is a cone over the moduli space of stable sheaves M. We only have instanton branch. ∗ Fix a topological invariant c0 = (r, c1, c2) ∈ H (S, Z) such that (r, c1) = 1. Then semistablity coincides with stability and the moduli space M = ML(S, c0) is an irreducible symplectic variety which is birational equivalent to the Hilbert scheme Hilbd(S) of point on S, see [39]. Here

d = 1 − χS(c0, c0).

Sine the moduli space M = ML(S, c0) is smooth, its virtual dimension is the dimension vd=2 − χS(c0, c0). VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 23

Thus φ 1 MF L 2 χS (c0,c0)−1 [ N ]= [M]. ZN ZM We calculated 1 − r d =1+ r(c − r)+ c2. 2 2 1 Thus we write down the motivic generating series as: φ 1 M MF c2 L 2 χS (c0,c0)−1 d c2 (5.7) vwr,c1 (S)= [ N ]q = [Hilb (S)]q , c c X2 X2 We calculate the motivic series (write c2 as integers m ∈ Z): M vwr,c1 (S) −(1+r(m−r)+ 1−r c2) 1+r(m−r)+ 1−r c2 m = L 2 1 [Hilb 2 1 (S)]q Z mX∈ 1+r(m−r)+ 1−r c2 −(1+r(m−r)+ 1−r c2) 1+r(m−r)+ 1−r c2 1 2 1 r− 1 − 1−r c2 = L 2 1 [Hilb 2 1 (S)] · q r (q) r 2r 1 Z mX∈ 1+r(m−r)+ 1−r c2 r− 1 − 1−r c2 1+r(m−r)+ 1−r c2 −1 1 2 1 = q r 2r 1 · [Hilb 2 1 (S)] L q r Z mX∈

Now using the exponential form, see [2], [9], [12],

m m [S]q [Hilb (S)]q = Exp L Z 1 − q mX∈ and therefore [S] · Lq Lm[Hilbm(S)]qm = Exp . L2 Z 1 − q mX∈ Then we have 1−r 2 1 1−r 2 1−r 2 1 1+r(m−r)+ 2 c1 M r− r − 2r c1 1+r(m−r)+ 2 c1 L−1 r vwr,c1 (S)= q · [Hilb (S)] q Z mX∈ r−1 −1 2πij 1 1 1−r 2 1 r−1 2 [S] · L e r q r r− r − 2r c1 πi r jc1 = q · e · Exp 2πij 1 . r 1 − e r q r ! Xj=0 We also can write it as the inﬁnite product form. From (5.1), and since

−1 2πij 1 ∞ [S] · L e r q r 2πij 1 2πij 1 2πij 1 L−1 r r r r n+1 r r −1 2πij 1 = [S] · e q · (e q ) · (e q ) 1 − e r q r n=0 X∞ −1 2πij 1 n = L [S] · (e r q r ) . nX=1 24 YUNFENG JIANG

Therefore πij −1 2 1 L−1 [S] · L e r q r 2πij 1 n − [S] r r Exp 2πij 1 = 1 − e q . 1 − e r q r ! nY≥1 Then r−1 n −L−1[S] M r− 1 − 1−r c2 1 πi r−1 jc2 2πij 1 vw (S)= q r 2r 1 · e r 1 · 1 − e r q r . r,c1 r Xj=0 nY≥1

5.4. Proof of the χy-genus in Corollary 1.4. From [12], there exists a ring homomorphism

e : K0(VarC) → Z[u, v] given by sending each variety X to its Hodge-Deligne polynomial

ij i j X 7→ eX (u, v)= h (X)(−u) (−v) . Xi,j The χy-genus is just eX (y, 1). The χy-polynomial of the K3 surface S is 2 m χy(S) = 2+20y+2y . For the Hilbert scheme Hilb (S), from the properties the ring homomorphism in [12, Theorem 2] we have

2πij 1 [S] · L−1e r q r χy Exp 2πij 1 1 − e r q r !!

L−1 2πij 1 n − [S] = χ 1 − e r q r y   nY≥1 −1 2  2πij 1 n −y (2+20y+2y ) = 1 − e r q r nY≥1 n −20 n −2 n −2 2πij 1 2πij 1 −1 2πij 1 = 1 − e r q r 1 − y e r q r 1 − y e r q r . nY≥1 We deﬁne 2 ∆(q,y) := (1 − qn)20 (1 − yqn)2 1 − y−1qn n≥1 Y e Then we get the χy-genus of the Vafa-Witten invariants:

r−1 πij χy r− 1 − 1−r c2 1 πi r−1 jc2 2 1 −1 vw (S)= q r 2r 1 · e r 1 · ∆(e r q r ,y) . r,c1 r Xj=0 e Note that this result is similar to [36, Theorem 5.48], where Thomas got similar results using K-theoretical Vafa-Witten invariants. VIRTUAL SIGNED EULER CHARACTERISTICS AND VW INVARIANTS 25

References

[1] K. Behrend, Donaldson-Thomas invariants via microlocal geometry, Ann. of Math. 170 1307–1338, 2009, math.AG/0507523. [2] K. Behrend, J. Bryan and B. Szendroi, Motivic degree zero Donaldson-Thomas invariants, Invent. math. 192 (2013), no.1 111-160. [3] K. Behrend and B. Fantechi, The intrinsic normal cone, Invent. Math. 128 45– 88, 1997. alg-geom/9601010. [4] V. Bussi, D. Joyce and S. Meinhardt, On motivic vanishing cycles of critical loci, arXiv:1305.6428. [5] H. Chang and J. Li, Semi-Perfect Obstruction theory and DT Invariants of De- rived Objects, Communications in Analysis and Geometry 19 (2011), No. 4, p 807-830, arXiv:1105.3261. [6] K. Costello, Notes on supersymmetric and holomorphic field theories in dimen- sions 2 and 4, Pure Appl. Math. Quart. 9 73–165, 2013. arXiv:1111.4234. [7] B. Davison, The critical CoHA of a self dual quiver with potential, arXiv:1311.7172. [8] B. Davison and S. Meinhardt, The motivic Donaldson-Thomas invariants of (−2)-curves, to appear in Algebra and Number Theory, arXiv:1208.2462. [9] L. Göttsche, On the motive of the Hilbert scheme of points on a surface, Math.Res.Lett. 8, 613-627 (2001). [10] L. Göttsche and M. Kool, Virtual refinements of the Vafa-Witten formula, arXiv:1703.07196. [11] T. Graber and R. Pandharipande, Localization of virtual classes, In- vent. Math. 135 487–518, 1999. alg-geom/9708001. [12] Gusein-Zade, S.M., Luengo, I., Melle-Hernández, A., Power structure over the Grothendieck ring of varieties and generating series of Hilbert schemes of points, Mich. Math. J. 54, 353-359 (2006). [13] Y. Jiang, Motivic Milnor fiber of cyclic L-infinity algebras, Acta Mathematica Sinica, (2017), Vol. 33, No. 7, pp. 933-950, arXiv:0909.2858. [14] Y. Jiang, The moduli space of stable coherent sheaves via non-archimedean geometry, arXiv:1703.00497. [15] Y. Jiang, Note on MacPherson’s local Euler obstruction, Michigan Mathematical Journal, 68 (2019), 227-250, arXiv:1412.3720. [16] Y. Jiang, Symmetric semi-perfect obstruction theory revisited, preprint, arXiv:1811.08480. [17] Y. Jiang, Counting twisted sheaves and S-duality, preprint, arXiv:1909.04241. [18] Y. Jiang and R. Thomas, Virtual signed Euler characteristics, Journal of Alge- braic Geometry, 26 (2017) 379-397, arXiv:1408.2541. [19] Y. Jiang, and P. Kundu, The Tanaka-Thomas’s Vafa-Witten invariants for surface Deligne-Mumford stacks, arXiv:1903.11477. [20] Y. Jiang, and H.-H. Tseng, Stable pair invariants for K3 gerbes and higher rank S-duality conjecture for K3 surfaces, preprint, arXiv:2003.09562. [21] Y. Jiang, and M. Kool, Twisted sheaves and SU(r)/Zr Vafa-Witten theory, arXiv:2006.10368. [22] D. Joyce, A classical model for derived critical locus, Journal of Differential Ge- ometry, 101 (2015), 289-367, arXiv:1304.4508. [23] D. Joyce, and M. Upmeier, Orientation data for moduli spaces of coherent sheaves over Calabi-Yau 3-folds, arXiv:2001.00113. [24] Y.-H. Kiem and J. Li, Localizing virtual cycles by cosections, Jour. A.M.S. 26 1025–1050, 2013. arXiv:1007.3085. [25] J. Li and G. Tian, Virtual moduli cycles and Gromov-Witten invariants of algebraic varieties, J. Amer. Math. Soc., 11, 119-174, 1998, math.AG/9602007. 26 YUNFENG JIANG

[26] E. Looijenga, Motivic measures, Asterisque 276 (2002), 267-297, Seminaire Bour- baki 1999/2000, no. 874. [27] D. Maulik, Motivic residues and Donaldson-Thomas theory, in preparation. [28] D. Maulik and Y. Toda, Gopakumar-Vafa invariants via vanishing cycles, Invent. Math., 213 (2018), 1017-1097, arXiv:1610.07303. [29] D. Maulik and R. P. Thomas, Sheaf counting on local K3 surfaces, arXiv:1806.02657. [30] N. Nekrasov and A. Okounkov, Membranes and Sheaves, preprint, arXiv:1404.2323. [31] J. Nicaise, A trace formula for rigid varieties, and motivic Weil generating series for formal schemes, Math. Ann. (2008), 343:2, 285-349. [32] J. Nicaise and S. Payne, A tropical motivic Fubini theorem with applications to Donaldson-Thomas theory, preprint, arXiv:1703.10228. [33] T. Pantev, B. Toën, M. Vaquie and G. Vezzosi, Shifted symplectic structures, Publ. Math. I.H.E.S. 117 271–328, 2013. arXiv:1111.3209. [34] Y. Tanaka and R. Thomas, Vafa-Witten invariants for projective surfaces I: stable case, preprint, arXiv:1702.08487. [35] Y. Tanaka and R. Thomas, Vafa-Witten invariants for projective surfaces II: semistable case, preprint, arXiv:1702.08488. [36] R. P. Thomas, Equivariant K-theory and refined Vafa-Witten invariants, preprint, arXiv:1810.00078. [37] B. Toën and G. Vezzosi, Homotopical algebraic geometry II: Geometric stacks and applications, Mem. Amer. Math. Soc. 193 no. 902, 2008. math.AG/0404373. [38] C. Vafa and E. Witten, A strong coupling test of S-duality, Nucl. Phys. B 431 3–77, 1994. hep-th/9408074. [39] K. Yoshioka, Some examples of Mukai’s reflections on K3 surfaces, cJ. Reine Angew. Math., 515 (1999), 97-123. [email protected] Department of Mathematics University of Kansas 405 Snow Hall, 1460 Jayhawk Blvd Lawrence, KS 66045. USA