<<

Bulletin of the Seismological Society of America, Vol. 101, No. 1, pp. 297–312, February 2011, doi: 10.1785/0120100119 Ⓔ Short-Term Forecasting Using Early Statistics by Peter Shebalin, Clément Narteau, Matthias Holschneider, and Danijel Schorlemmer

Abstract We present an alarm-based earthquake forecast model that uses the early aftershock statistics (EAST). This model is based on the hypothesis that the time delay before the onset of the power-law aftershock decay rate decreases as the level of stress and the seismogenic potential increase. Here, we estimate this time delay from htgi, the time constant of the Omori–Utsu law. To isolate space–time regions with a relative high level of stress, the single local variable of our forecast model is the Ea value, the ratio between the long-term and short-term estimations of htgi. When and where the Ea value exceeds a given threshold (i.e., the c value is abnormally small), an alarm is issued, and an earthquake is expected to occur during the next time step. Retrospective tests show that the EAST model has better predictive power than a stationary reference model based on smoothed extrapolation of past seismicity. The official prospective test for started on 1 July 2009 in the testing center of the Collaboratory for the Study of Earthquake Predictability (CSEP). During the first nine months, 44 M ≥4 occurred in the testing area. For this time period, the EAST model has better predictive power than the reference model at a 1% level of significance. Because the EAST model has also a better predictive power than several time-varying clustering models tested in CSEP at a 1% level of significance, we suggest that our successful prospective results are not due only to the space–time clustering of .

Online Material: The EAST model; retrospective test and nine-month prospective evaluation versus time-dependent rate-based models.

Introduction The aftershock rate, Λ, is often well-described by the above completeness magnitude thresholds, several studies Omori–Utsu law, have also pointed out that the c value may change according to the magnitude range of aftershocks (Shcherbakov et al., Λ K t p ; (1) 2004) and/or the recurrence time of major earthquakes in t c the area (Narteau et al., 2002). From these findings, it can where t is the elapsed time since the , K the after- be argued that many properties of the aftershock decay rate shock productivity, p a power-law exponent, and c the time over short times remain partly unknown, despite evidence that delay before the onset of the power-law aftershock decay rate they can provide a useful source of information about the (Utsu, 1961). The c value is often interpreted, at least partially, physical mechanisms of earthquake triggering. as an artifact (Kagan, 2004, Lolli and Gasperini, 2006) related Theoretical models for aftershock production may to difficulties in detecting events shortly after a mainshock. explain systematic variations of the c value. Considering that The possible reasons are aftershocks buried in coda waves, aftershocks result from a steplike perturbation of the stress overlapping aftershock records, catalog compiler overload, field in the neighborhood of a triggering event, the vast absence or malfunction of seismic stations close to the source majority of these models assume that the amplitude of this zone, and other technical or administrative factors. For exam- perturbation is inversely proportional to the time delay before ple, the analysis of high-resolution aftershock records at the onset of the power-law aftershock decay rate. For exam- Parkfield, California, and in Japan shows that a careful iden- ple, this is the case in rate-and-state friction models (Dieter- tification of microearthquakes directly after mainshocks leads ich, 1994), in damage mechanics models (Shcherbakov and to lower c values than the ones obtained from standard earth- Turcotte, 2004; Ben-Zion and Lyakhovsky, 2006), and in quake catalogs (Vidale et al., 2004; Peng et al., 2006, 2007; static fatigue models (Scholz, 1968; Narteau et al., 2002). Enescu et al., 2007, 2009). Nevertheless, even in these Then, assuming that the amplitude of the near-field stress studies, the c value is never equal to zero (Nanjo et al., redistribution is directly proportional to the level of stress 2007). Furthermore, after analyzing catalogs of seismicity imposed by the large-scale tectonic forcing (Atkinson,

297 298 P. Shebalin, C. Narteau, M. Holschneider, and D. Schorlemmer

1987), a decreasing c value may be directly related to the on 1 July 2009. Finally, we discuss the stability of our results accumulation of stress within the seismogenic crust. and, with respect to the magnitude of the target earthquakes, To test this idea, Narteau et al. (2005) studied stacks the duration for which prospective tests have to be conducted of aftershocks sequences in southern California from the to determine the predictive power of the model. previous 20 years. To avoid artifacts arising from overlap- ping records, they did not consider large earthquakes and their aftershock sequences (Shebalin, 2004); they analyzed Early Aftershocks Statistics: Geometric Mean of only the largest aftershocks of mainshocks in the magnitude Aftershock Times versus c Value range of 2:5

t t 1 stop 1 tstart stop tstart lntstop ln c lntstart ln c Li2 c Li2 c hc t ; (9) 1 stop 1 tstart ln c ln c

where magnitude threshold Mtarget is a free parameter that can be Z X∞ z ln1 u zk adjusted to account for different factors (e.g., duration of Li2z du 2 : (10) the analysis, level of seismic activity). To follow the rules 0 u k k1 of the CSEP testing center (Schorlemmer and Gerstenberger, Figure 1 shows two numerical solutions for tstop 2007), we choose a time step δt 3 months, and we discre- 101 107 days: tstart days (solid line) and tstart tize the area covered by the test into a square grid of side 3 10 days (dotted line). In both cases, we observe that length δ 0:1°. Thus, we decompose the entire space–time htgi is a monotonic function of c with slopes that are slightly region into a three-dimensional grid of space–time cells noted cx; y; t. For each of these cells, we identify a set of mainshocks to stack the corresponding aftershock sequences with respect to the mainshock times.

Mainshock and Aftershock Selection Our declustering method uses a set of parameters {Mtarget, r1, r2, T, D, Tshort, Tlong, tstart, tstop, R0, Nmin, M M A Mmin, Mmax, Mmin} that is described in Table 1. First, we eliminate all earthquakes that are aftershocks of events with ≥ a magnitude M Mtarget by removing earthquakes of magni- r2M tude smaller than M that are within a r110 -km radius dur- ≥ ing the first T days after a magnitude M Mtarget earthquake. Second, an event is not considered a mainshock if there is at least one earthquake of the same or higher magnitude in the time interval tstop;tstop. All remaining events are consid- ered mainshocks. Their respective aftershocks are selected within R0-km radius in the time interval tstart;tstop after the mainshock’s focal time. In the model, we always take 1 tstop < days to concentrate on early aftershocks. Further- 10 more, we always take tstart > s to limit artifacts related to aftershock catalog incompleteness immediately after Figure 1. The geometric mean of elapsed times from mainshocks. mainshocks to aftershocks, htgi, with respect to the c value. 101 Numerical solutions of equation (9) for tstop days with Another critical issue of our declustering method is 6 4 tstart 10 days (solid line) and tstart 10 days (dotted line). that the selected earthquakes are classified in ranges of 300 P. Shebalin, C. Narteau, M. Holschneider, and D. Schorlemmer

Table 1 space–time volumes, we identify mainshocks and stack their Parameter Values of the EAST Model and Their Ranges* aftershocks by sorting them according to the elapsed time

Value in the from their respective mainshocks. Let us consider that Parameter Units Main Test Minimum Value Maximum Value Nshort and Nlong are the numbers of aftershocks in the two M stacks. If N Nlong, we take the same equation to calculate the Tshort a 5 4.1 7.9 htgishort value but consider that htgilong tstop. Then, we Tlong a258 50 use these short-term and long-term estimations of htgi to cal- R0 km 4 1.3 16 culate E , the alarm function of the EAST model: 1 104 1 103 a tstart d × 0 × t 1 101 3 102 3 101 stop d × × × t N 32 5 h gilong min Eax; y; t : (11) htgishort *To determine these ranges, one parameter is changed at a time, the results are compared to the main retrospective results presented in ht i 5 The g long value is used as a reference level to identify Figure 3a (Mtarget ), and the difference of the integral of the Molchan trajectory from τ 0 to τ 0:3 should not be larger than 5%. abnormally small values of htgishort (i.e., abnormally small RI RI – Because the r1, r2, and T values can be equal to 0, it is not always c values). Thus, we try to isolate space time regions with necessary to eliminate mainshocks that are themselves aftershocks of a relative high level of stress that are currently more prone large earthquakes, as this improves the predicting accuracy of the EAST to earthquakes. In practice, Ea values above a given thresh- A model only slightly. The value of M and tstart depend only on 0 min old, Ea, define the space–time cells occupied by alarms. In aftershock catalog completeness, and smaller values may be used. This ≥ M A these cells, earthquakes with magnitude M Mtarget are is also the case for higher Mmax and Tlong values. The Mmax value is given by the magnitude of the mainshock. Finally, only six parameters expected to occur during the next time step δt. In addition, M cannot be eliminated from the procedure: Mmin, D, Tshort, R0, tstop, and Nmin. larger Ea values should correspond to sites that are currently more vulnerable to target earthquakes. M M mainshocks, Mmin;Mmax, and ranges of aftershocks, A A Mmin;Mmax. Thus, we investigate only earthquakes from Retrospective Evaluation of the EAST particular magnitude ranges that can be shown to be Model in California complete even in early times of the aftershock sequence. Mainshocks should be sufficiently small to have shorter coda Before starting prospective testing of the EAST model waves such that subsequent aftershocks can be reliably in the CSEP testing center, we evaluated the model’s detected. Aftershocks should be sufficiently large to ensure performance in retrospective tests for the testing region of completeness at that particular magnitude level from the California (Schorlemmer and Gerstenberger, 2007) for the early times of an aftershock sequence. These magnitude period from 1984 to 2008. Thus, we test our underlying ranges are determined from seismological and statistical hypothesis and analyze the stability of the EAST model with M – constraints following Narteau et al. (2009) (Table 1): Mmin respect to the model parameters and the choice of the space M is determined by the global catalog completeness; Mmax is time region under consideration. According to the CSEP ex- the mainshock magnitude below which the mean magnitude periment, we always use the same time step δt 3 months A 0 1 0 1 of a given range of aftershocks remain stable; Mmin is the and the same spatial mesh of : °× : °. aftershock magnitude for which the estimation of the c value Table 1 shows the values of the parameters of the EAST remains stable as we increase the time at which we start the model and, for each of them, the range of values for which A fit. On the other hand, Mmax is not a parameter of the model the results are stable. During the testing period, approxi- any more because here we simply consider the magnitude of mately 50% of M ≥5:0 earthquakes occurred near Cape the mainshock to use the maximum number of events for Mendocino (mostly offshore), in the California–Nevada bor- each aftershock sequence. der zone, and in Mexico. In these zones, the density of seis- mic stations is lower and the number of aftershocks in the stacks is smaller. Hence, we prefer not to consider the entire The Alarm Function CSEP California testing region (dashed line in Fig. 2) in the Within the study area, each space–time cell cx; y; t is retrospective analysis. Instead, we concentrate on a more – A associated with two space time volumes with the same spa- central region where the catalogs of early M>Mmin after- tial extent, a circle with diameter D, but two different time shocks are likely to be more complete (solid line in Fig. 2). ≪ intervals Tshort Tlong. The first volume covers the recent Nevertheless, even in this case, the Ea value cannot be period from t Tshort to t. The second one covers the pre- defined everywhere because of an insufficient number of ceding period from t Tlong to t Tshort. In these two aftershocks, and some target earthquakes occurred in cells Short-Term Earthquake Forecasting Using Early Aftershock Statistics 301

2008, Zechar and Jordan, 2008). A binary outcome of the forecasts is considered. If a target earthquake occurs within an alarm, then a successful prediction is scored. Otherwise it is a failure to predict or a miss. Molchan diagrams plot the ν τ miss rate with respect to RI, a variable that is often de- scribed as the fraction of the space–time region occupied by alarms. More exactly, it is the ratio of the Poissonian earthquake frequency of the region occupied by alarms to the Poissonian earthquake frequency of the entire space–time region. These frequencies are given by the chosen reference 1 τ model. Therefore, RI is the expected miss rate of the reference model. In a Molchan diagram, each threshold value of the alarm function corresponds to a specific point. If the 1 τ corresponding miss rate of the model is smaller than RI, the model has better predictive power than the reference model. This comparison can be systematically implemented τ 0 τ 1 from RI (no alarm) to RI (permanent alarm) by decreasing the threshold value of the alarm function. Then, we can visually estimate from the so-called Molchan trajec- tory the predictive power of the model with respect to the reference model. An important property of this approach is the higher weight given to a successful prediction in a zone Figure 2. Testing regions and past seismicity in California. Dashed lines limit the CSEP California testing region. The dark of low seismicity (small earthquake frequency) than in a zone gray zone shows the region in which we perform the retrospective of high seismicity (high earthquake frequency). Another analysis of the EAST model. Solid lines limit three subregions property is that zones without seismicity are not taken into chosen for additional tests: southern, central, and north–west account. California. Gray cells cx; y show where the Ea value is defined As a null hypothesis, we here employ a relative intensity on 1 January 2009. For a period from 1984 to 2008, black circles show of M ≥5 earthquakes that occur in zones where the (RI) reference model, a time-independent model of earth- Ea value can be defined. For the same time period, open circles quake frequencies. This reference model is obtained by show epicenters of M ≥5 earthquakes that occur in zones where smoothing the location of earthquakes in the past (Kossobo- the Ea value cannot be defined. kov and Shebalin, 2003; Helmstetter et al., 2006; Molchan and Keilis-Borok, 2008; Zechar and Jordan, 2008). with undefined Ea value (see the distributions of gray cells Obviously, it would be preferable to use a time-dependent and open circles in Fig. 2, respectively). reference model of seismicity, especially in a prospective CSEP testing centers host various classes of forecast mod- test. Such a comparison of models will be done in the CSEP els. Most of them are rate based. Their outputs are estimates of testing center during a regular experiment to which our mod- – – the expected rate of earthquakes in prespecified space time el is submitted. Hence, at this stage, we prefer to keep the magnitude bins. In contrast, alarm-based forecast models do most commonly accepted RI-type time-independent model. not try to quantify earthquake rates. Instead, they concentrate Different models may have different spatial resolution, – on the identification of space time regions with high seismo- different smoothing length, and different time scales. Here, genic potential. Alarm-based models have at least one control we use the same spatial resolution and smoothing length as in parameter, the so-called alarm function (Zechar and Jordan, the EAST model in order to assess the gain in prediction 2008). This alarm function is evaluated at every point in space power that may be attributed to the temporal aspect of our and time. Its higher values correspond to a higher, but usually forecast model. Furthermore, mainshocks and aftershocks unknown, probability of earthquakes. Then, because it is are identified using the declustering method of Gardner impossible to estimate this probability, a threshold value is and Knopoff (1974), and we use the longest time period used to determine if an alarm is issued locally. By adjusting available with respect to catalog completeness in California the amplitude of this threshold, it is possible to cover any frac- before the beginning of the retrospective test. In practice, we tion between 0 and 1 of the space–time region with alarms. use M ≥3 earthquakes from 1960 to 1984. We suppose that Then, the quality of the prediction has to be quantified with this magnitude threshold is sufficiently low to guarantee a respect to the entire range of threshold values. correct evaluation of the RI reference model in all spatial Molchan diagrams (Molchan, 1990, 1991) are usually cells in which an earthquake may occur. Then, for each used to evaluate the performance of the space–time predic- spatial cell cx; y of the EAST model, the RI reference model tion of an alarm-based model with respect to a chosen refer- is obtained by calculating the rate of M>3 mainshocks in ence-model or null hypothesis (Molchan and Keilis-Borok, circles of diameter D 25 km. 302 P. Shebalin, C. Narteau, M. Holschneider, and D. Schorlemmer

1 τ In what follows, Molchan diagrams are always con- calculate the miss rate distribution of mean value RI. structed according to the same convention: Then, the upper limit of the shaded region is simply the α quantiles of this miss-rate distribution. • The solid line is the Molchan trajectory calculated from the τ 0 τ 1 highest ( RI ) to the smallest ( RI ) threshold value Figure 3 shows a comparison between the prediction of 0 Ea of the alarm function. the EAST model and the prediction of the RI reference model ∈ 5 5 5 6 Ⓔ • The dotted line is the Molchan trajectory that incorporates for three different Mtarget values, Mtarget f ; : ; g.( The zones in which the Ea value cannot be defined because of same comparisons for the entire CSEP testing region are an insufficient number of aftershocks in the stacks. To ob- available as an electronic supplement to this paper.) tain this curve, we replace the alarm function of the EAST In all three cases, the Molchan trajectories show that model by the seismic rate of the reference model in all the the EAST model has better predictive power than the RI cells cx; y; t in which the Ea value has not been defined. reference model at a significance level of 1%. In addition, 0 Then, when the threshold Ea of the alarm function reaches steeper Molchan trajectories with increasing Mtarget values its lowest value, we complement the space–time region suggest that the EAST model works better in zones where occupied by the alarm with the cell cx; y; t, which has large events did occur. Equivalently, we may say that the a decreasing seismic rate in the reference model. Thus, apparent slope of the expected earthquake-size distribution τ we have an increasing RI value, and we can calculate is likely to decrease in the space–time region occupied by the corresponding miss rate ν. alarms. • ν 1 τ The dashed diagonal line RI corresponds to an In Figure 4 and Figure 5, we analyze in more detail the unskilled forecast model with respect to the reference mod- space–time structures of alarms for two threshold values of 0 2 0 τ 0 1 0 el, considering an infinite number of target earthquakes the alarm function: Ea : ( RI : in Fig. 3) and Ea 1 0 τ 0 22 (see Zechar and Jordan, 2010, for a finite number of target : ( RI : in Fig. 3). Figure 4 shows the histogram of earthquakes). the duration of successful alarms for four different Mtarget • ∈ 4 5 5 5 6 δ The shaded area is the zone of the Molchan diagram in values, Mtarget f ; ; : ; g. Using the time step t which the prediction of the EAST model is better than 3 months, we obtain the duration of a successful alarm by the prediction of the RI reference model at a level of sig- counting the number of consecutive times the Ea value ex- α 1% 0 nificance of (Kossobokov and Shebalin, 2003; ceeded the threshold value Ea before a predicted M>Mtarget Shebalin et al. 2006; Zechar et al., 2007). In other words, earthquake. The median of all distributions is approximately only 1% of the best predictions of the RI reference model one year; and, in about 80% of the cases, the alarm duration fall in the shaded region. To find the limit of this area at a is less than two years. These results suggest a characteristic τ given RI value, we consider that the number of earth- time scale of less than a year for the forecast of the EAST quakes predicted by the reference model is a random vari- model. In this case, the time step δt 3 months used in able that follows a binomial distribution with parameters n the CSEP testing center is small enough to be implemented and P. n is the number of M>Mtarget earthquakes in the in the EAST model. – τ space time region under consideration. P is the probability Figure 5 shows the evolution of RI with respect to time to predict a M>Mtarget in this region according to the RI for the entire region of the retrospective test (solid lines reference model. From this binomial distribution, we can in Fig. 2) and three subregions (dotted lines in Fig. 2).

Figure 3. Retrospective evaluation of the EAST model in California from 1984 to 2008 for three Mtarget values: (a) Mtarget = 5, (b) Mtarget = 5.5, (c) Mtarget = 6. Using a Molchan diagram, we compare the prediction of the EAST model to the prediction of the RI reference model. 0 The solid line is the Molchan trajectory calculated from the highest to the lowest threshold value Ea of the alarm function. The dotted line is the Molchan trajectory that incorporates zones where the Ea value cannot be defined (see text). The dashed diagonal line corresponds to an unskilled forecast model with respect to the reference model. The shaded area indicates the zone of the Molchan diagram in which the prediction of the EAST model is better than the prediction of the RI reference model at a level of significance α 1%. Short-Term Earthquake Forecasting Using Early Aftershock Statistics 303

Figure 4. Distributions of the duration of successful alarms: (a) Mtarget = 4, (b) Mtarget = 5, (c) Mtarget = 5.5, and (d) Mtarget = 6. Histograms 0 0 in light and dark gray correspond to Ea 1 and Ea 2, respectively. Solid and dashed lines mark the 50% and 80% quantiles, respectively.

τ The RI values are systematically larger at the beginning of with a different level of seismicity, we perform two indepen- the retrospective test. Interestingly, the number of M> dent analyses from 1 January 1984 to 30 June 1992 and from Mtarget earthquakes is also larger in this earlier period. To 1 July 1992 to 31 December 2008 (Fig. 6). In both cases, check the stability of the prediction algorithm on two periods Molchan trajectories are quite similar to each other and

(a) (c) 0.3 0.3

0.2 0.2 RI RI τ τ

0.1 0.1

0.0 0.0 1985 1990 1995 2000 2005 1985 1990 1995 2000 2005

(b) (d) 0.3 0.3

0.2 0.2 RI RI τ τ

0.1 0.1

0.0 0.0 1985 1990 1995 2000 2005 1985 1990 1995 2000 2005

τ Figure 5. Temporal evolution of RI in (a) the entire region covered by the test and in (b) southern, (c) central, and (d) northwest 0 0 California (see the solid and dotted lines in Fig. 2). Dashed and solid lines correspond to Ea 1 and Ea 2, respectively. 304 P. Shebalin, C. Narteau, M. Holschneider, and D. Schorlemmer

(a)1.0 (b)1.0 (c) 1.0 61 targets of M ≥5 28 targets of M ≥5.5 9 targets of M ≥6

0.8 0.8 0.8

0.6 0.6 0.6 α=0.01 α=0.01 α=0.01

0.4 0.4 0.4

0.2 0.2 0.2

0.0 0.0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 τ τ τ RI RI RI

(d)1.0 (e) 1.0 (f) 1.0 66 targets of M ≥5 14 targets of M ≥5.5 4 targets of M ≥6

0.8 0.8 0.8

0.6 0.6 0.6 α=0.01 α=0.01 α=0.01

0.4 0.4 0.4

0.2 0.2 0.2

0.0 0.0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 τ τ τ RI RI RI

Figure 6. Retrospective evaluation of the EAST model in California for two time periods and three Mtarget values: (a and d) Mtarget =5, (b and e) Mtarget = 5.5, and (c and f) Mtarget = 6. Using a Molchan diagram, we compare the prediction of the EAST model to the prediction of the RI reference model. Arbitrarily, we choose two time periods with approximately the same number of M ≥5:0 earthquake from January 1984 to June 1992 (top diagrams) and from July 1992 to December 2008 (bottom diagrams). For comparison, a thin dashed line shows the result obtained in Figure 3 from January 1984 to December 2008. do not exhibit any substantial changes when compared to the (17 October 1989, Mw 6.9) and Parkfield (28 September – main retrospective result that covers the entire period (Fig. 3). 2004, Mw 6.0) events are in the space time regions where We conclude that the EAST model is stable in time despite the Ea value cannot be defined. However, high Ea values are the permanent evolution of seismic activity and the asso- observed nearby. Actually, the results in central California ciated variation of alarm distributions. become as good as in other subregions if we decrease the A 1 8 We believe that the EAST model can be applied world- minimum aftershock magnitude threshold from Mmin : A 1 7 wide in a large diversity of active tectonic settings. To verify to Mmin : and take the centroid locations instead of that the EAST model can be generalized to different seismic the locations for the Loma Prieta and Parkfield zones, we use the same set of parameters to perform a retro- events. spective analysis of three subregions in California (dotted Short-term and long-term estimations of htgi values lines in Fig. 2). Namely, we consider southern, central, and range from 5 × 102 to 5 × 101 day in more than 99% northeast California. Figure 7 shows the corresponding Mol- of the cases. These values correspond to (1) Ea values close ∈ 5 5 5 6 102 102 chan diagrams for three Mtarget values, Mtarget f ; : ; g.We to unity, with extreme values in the range of ; , and 104 102 see that the EAST model has a good performance in two of the (2) c values that range from to day, taking tstart 107 101 three subregions. In northeast California, despite the small day and tstop day in equation (9). These obser- number of targets, the result is even better than for entire vations are in good agreement with reported c values in California (Fig. 3). About 50% of M ≥5:0 earthquakes, California for the same aftershock magnitude ranges (Nar- 60% of M ≥5:5 earthquakes, and both M ≥6:0 earthquakes teau et al., 2002; Shcherbakov et al., 2004). Figure 8 shows τ are forecast with RI value as small as 4%. Nevertheless, EAST forecast maps before the three largest earthquakes in results are worse in central California because we cannot dis- southern California during the period of the retrospective tinguish between the miss rate of the EAST model and the miss test: Landers (28 June 1992, Mw 7.3), Northridge (17 Jan- rate of the RI reference model at a significance level of 1%. uary 1994, Mw 6.7), Hector Mine (16 October 1999, The main reason is that the epicenters of the Loma Prieta Mw 7.1). These maps also give an idea of the temporal Short-Term Earthquake Forecasting Using Early Aftershock Statistics 305

Northeast California (a) 1.0 (b) 1.0 (c) 1.0 23 targets of M≥5 11 targets of M≥5.5 2 targets of M≥6

0.8 0.8 0.8

0.6 0.6 0.6 α=0.01 α=0.01 α=0.01

0.4 0.4 0.4 Miss Rate Miss Rate Miss Rate

0.2 0.2 0.2

0.0 0.0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 τ τ τ RI RI RI

1.0 (e)1.0 (f) 1.0 (d) 18 targets of M≥5 7 targets of M≥5.5 3 targets of M≥6

0.8 0.8 0.8

0.6 0.6 0.6 α=0.01 α=0.01 α=0.01

0.4 0.4 0.4 Miss Rate Miss Rate Miss Rate

0.2 0.2 0.2

0.0 0.0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 τ τ τ RI RI RI

(g) 1.0 (h) 1.0 (i) 1.0 83 targets of M≥5 23 targets of M≥5.5 7 targets of M≥6

0.8 0.8 0.8

0.6 0.6 0.6 α=0.01 α=0.01 α=0.01

0.4 0.4 0.4 Miss Rate Miss Rate Miss Rate

0.2 0.2 0.2

0.0 0.0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 τ τ τ RI RI RI

Figure 7. Retrospective evaluation of the EAST model in (top) northeast, (center) central, and (bottom) southern California from 1984 to 2008 for three Mtarget values: (left) Mtarget = 5, (central) Mtarget = 5.5, and (right) Mtarget = 6. Using a Molchan diagram, we compare the prediction of the EAST model to the prediction of the RI reference model. For comparison, thin dashed lines show the result obtained in A 1 7 Figure 3 for California. For central California, thin solid lines show the Molchan trajectory using Mmin : and centroid locations instead of the epicenter locations for Loma Prieta and Parkfield (see text). variation of the forecasts from our model. For comparison, calculated; this is in contrast to the EAST maps, which are Figure 8d shows the forecast of the RI model that we used as more fragmented and with sharp peaks. a reference model in the Molchan diagrams. We use the same smoothing procedure for all these maps, but the RI map looks The EAST Model in the CSEP Testing Center more smoothed than the EAST maps. The main reason is the for California absence of Ea values in about 90% of the space–time regions cx; y; t due to the restrictive aftershock selection process We submitted the EAST model to the CSEP testing center (see the Mainshock and Aftershock Selection section). for California in April 2009. To entirely satisfy the CSEP The RI reference model has nonzero values in many of these requirements, we use Mtarget = 3.95 and expand the predic- cells because of the long time period over which it has been tion to the entire state of California (dashed lines in Fig. 2). 306 P. Shebalin, C. Narteau, M. Holschneider, and D. Schorlemmer

Figure 8. Examples of EAST forecast maps and RI map. EAST forecast maps show the distribution of Ea values before the three largest events in southern California from 1984 to 2008: (a) Landers forecast map from 1 April to 30 June 1992. (b) Northridge forecast map from 1 January to 31 March 1994. (c) Hector-Mine forecast map from 1 October to 31 December 1999. (a) and (b) have the same color scale as (c). Circles show epicenters of M>5 earthquakes that occurred during the corresponding forecasts. For the RI map (d), shading represents a number of earthquakes. For each cell cx; y; t, we count M ≥3:0 earthquakes in circles of diameter D 25 km from 1960 to 1984. The color version of this figure is available only in the electronic edition.

Note that we expect an increasing number of misses outside the RI maps, we use the same smoothing procedure as pre- the region of the retrospective test (solid lines in Fig. 2) viously described here but count the number of M ≥3:0 because of an increase of the completeness threshold of events in the period from 1960 to 2008. Nevertheless, in the network, especially in offshore areas. the retrospective analysis, we have observed that target earth- The prospective test of the EAST forecast model for quakes often occur in cells of high Ea value but of moderate California started officially on 1 July 2009. To date, three RI frequency. Hence, we currently use a modified Ea value three-month forecast periods have ended; and, based on these nine months of seismicity, we can perform a comparison E x; y; t between the predictive power of the EAST model and the a Ea1x; y; t λ ; (12) predictive power of the RI reference model. To produce gx; y Short-Term Earthquake Forecasting Using Early Aftershock Statistics 307

Figure 9. EAST forecast maps for the periods from (a) 1July–30 September 2009, (b) 1 October–31 December 2009, and (c) 1 January– 30March 2010. For this last period, the Ea1 value is calculated from the number of aftershocks shown in (d). Circles show epicenters of M ≥ Mtarget earthquakes that occurred during the corresponding forecasts. The color version of this figure is available only in the electronic edition.

where λgx; y is the smoothed frequency of M ≥4 earth- During the first nine months of the test, 44 target earth- quakes since 1960, calculated using a two-dimensional quakes have occurred in the region under consideration, 21 of Gauss filter with standard deviation of 10 km. All the other them in cells cx; y; t with relatively high Ea1 value (Fig. 9). model parameters have the same values as in the third col- Figure 10a shows that the EAST model has better predictive umn of Table 1. power than the RI reference model at a significance level 308 P. Shebalin, C. Narteau, M. Holschneider, and D. Schorlemmer of 1%. For example, approximately 40% of the target earthquakes have occurred during the first nine months of τ earthquakes are predicted with a RI value that is less than the test. This number is obviously too small to obtain statis- 0.05. In addition, the current performance of the EAST tically significant results. Then, we have extrapolated the model is better than that obtained retrospectively in the EEPAS and PPE forecasts to Mtarget = 3.95 and performed Ⓔ whole CSEP testing region. Not surprisingly, the predictive the joint analysis for both Mtarget values. The Molchan power of the EAST model is even higher within the reduced diagrams for all these tests are available as an electronic area of the retrospective test (Fig. 10b). These stimulating supplement to this paper (Figs. S2–S7). In all cases, the EAST results are mostly due to the successful forecast of a swarm model outperformed the time-dependent reference models. ≥ For M = 3.95, this result is obtained with a 1% signifi- of 11 M Mtarget earthquakes in central California (Fig. 9b). target cance level. Furthermore, the three-month EAST model shows However, 10 other events occurred in cells with high Ea1 values in northern California and near the United States– much better performance than one-day ETAS and STEP mod- Mexico border (Fig. 9b,c). Even if we exclude the 11 events els. This may be partially the result of a lower spatial resolu- of the swarm from the comparison, the EAST model still tion in those models. Nevertheless, the final evaluation of the EAST model, as well as a reliable estimation of its relative ac- has better predictive power than the RI reference model. curacy compared with time-independent and time-dependent Accordingly, we suggest that our successful prospective models, obviously requires a longer-term analysis of the results are not due only to the space–time clustering of prospective test. aftershocks. To test the influence of earthquake clustering, we take advantage of the CSEP experiment by comparing the Discussion and Perspectives prediction of the EAST model with the prediction of four The working hypothesis of the EAST forecast model is time-dependent rate-based clustering models. Two are three- that the time delay before the onset of the aftershock decay months models proposed by Rhoades (2007): Every Earth- rate is anticorrelated with the level of stress in the seismo- quake a Precursor According to Scale (EEPAS; 5 versions) genic crust. To characterize this time delay, we work at small and Parkfield Prediction Experiment (PPE; 2 versions). Two spatial (<10 km) and temporal (<12 hr) scales to concen- others are one-day models: epidemic-type aftershock se- trate on the effect of coseismic stress perturbation and to re- quence (ETAS; Ogata, 1998, prepared for the test in California duce the influence of other factors that may control the by Zhuang and Liukis) and short-term earthquake probability distribution of aftershocks (e.g., afterslip [Peng and Zhao, (STEP; Gerstenberger et al., 2005). The three-months models 2009] or fluids [Mori et al., 2008]). In addition, we introduce 4 95 are tested in California for Mtarget = 4.95. Only six M> : a new quantity htgi, the geometric mean of the elapsed times (a) 1.0 (b) 1.0 44 targets of M≥4 34 targets of M≥4

0.8 0.8

0.6 0.6 α=0.01 α=0.01

0.4 0.4 Miss Rate Miss Rate

0.2 0.2

0.0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 τ τ RI RI

Figure 10. Evaluation of the EAST model in California from 1 July to 31 December 2009 for Mtarget = 3.95 in (a) the CSEP testing region and (b) the region used in the retrospective test (Fig. 2). Using a Molchan diagram, we compare the prediction of the EAST model to the 0 prediction of the RI reference model. The solid line is the Molchan trajectory calculated from the highest to the lowest threshold value Ea of the alarm function. The dotted line is the Molchan trajectory that incorporate zones where the Ea value cannot be defined (see text). The dashed diagonal line corresponds to an unskilled forecast model with respect to the reference model. The shaded area indicates the zone of the Molchan diagram in which the prediction of the EAST model is better than the prediction of the RI reference model at a level of significance α 1% Short-Term Earthquake Forecasting Using Early Aftershock Statistics 309 from mainshocks to aftershocks. We could have continued values are mostly due to short-term forecasts of triggered on to estimate the c value of the Omori–Utsu law (Utsu, events (Helmstetter et al., 2006, Kagan and Jackson, 2000). 1961) or the λb value of the limited power-law model (Nar- Considering only mainshocks, the prediction power of these teau et al., 2002). However, any model explaining the onset models is significantly lower (Kossobokov, 2006; Schorlem- of the power-law aftershock decay rate is an idealization of a mer et al., 2010). This may be also the case for the EAST real behavior that is more complex. For this reason, we con- model, especially for small Mtarget values for which an in- sider a nonparametric value such as the geometric mean htgi creasing number of target earthquakes may be aftershocks. λ as a more meaningful quantity than the c value and the b For this reason, we now estimate the predictive power of value to assess the time delay before the onset of the after- the EAST model when all M>Mtarget aftershocks are re- shock decay rate. moved. To identify mainshocks and aftershocks, we use In both, retrospective and prospective tests, the EAST the declustering algorithm of Gardner and Knopoff (1974) model shows better performance than the RI reference model. and repeat the retrospective evaluation of the EAST model Nevertheless, we complement our analysis by using this using only M>Mtarget mainshocks as the target. Using reference model in space–time regions in which we cannot Ea1 values, Figure 12 shows the corresponding probability identify at least Nmin aftershocks. The results of the alarm- ∈ 4 4 5 5 gain curves for three Mtarget values, Mtarget f ; : ; g, and based model therefore may be biased by aftershock produc- a comparison with the probability gain curves obtained with tivity, and we have to test that the Ea value is the dominant M>M aftershocks. In all cases, the EAST model has contribution to the model. With this objective in mind, we target better predictive power than the RI reference model. For repeat the retrospective analysis using only the space–time M <5, the EAST model has a higher predictive power regions cx; y; t in which the E value is defined. Accord- target a with M>M aftershocks for a small threshold value ingly, we only consider M>M earthquakes that oc- target target of the alarm function (high rate of hits). For high threshold curred in these regions from t to t δt. Thus, we keep 91 values of the alarm function (low rate of hits) the EAST mod- events out of 124 for M = 5, 31 out of 42 for M = 5.5, target target el works better if the M>M aftershocks are removed. and 10 out of 13 for M = 6. Figure 11 also shows that in target target For M = 5, the performance of the EAST model is always these cases the predictive power of the EAST model is better target better without than with aftershocks. Combined with the that the predictive power of the RI reference model at a 1% fact that the number of M>M aftershock decrease with significance level. Consequently, there is no clear influence target of the fragmented distribution of aftershocks on the perfor- an increasing Mtarget value, this result may also explain why EAST M mance of the forecast of the EAST model. the model works better for higher target values From the Molchan diagrams, we can systematically (see Fig. 3). estimate the probability gain γ (Aki, 1981): This paper has two goals. First, it proposes a new alarm- based model that may improve assessment. 1 ν γ Second, it tests whether the time delay before the onset of τ : (13) RI the power-law decay rate can be used to characterize the In a vast majority of cases, the comparisons between the level of stress in the seismogenic crust. We think that the EAST model and the RI reference model show γ values close results presented here extend the set of evidence that allows to 10. In other forecast models, similar probability gain us to answer positively to this question. In Figure 12,the

(a) 1.0 (b) 1.0 (c) 1.0 93 targets of M≥5 32 targets of M≥5.5 10 targets of M≥6

0.8 0.8 0.8

0.6 0.6 0.6 α=0.01 α=0.01 α=0.01

0.4 0.4 0.4 Miss Rate Miss Rate Miss Rate

0.2 0.2 0.2

0.0 0.0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 τ τ τ RI RI RI

Figure 11. Retrospective evaluation of the EAST model in the space–time regions of California in which the Ea value can be defined. This evaluation covers a period from 1984 to 2008 for three Mtarget values: (a) Mtarget = 5, (b) Mtarget = 5.5, and (c) Mtarget = 6. Using a Molchan diagram, we compare the prediction of the EAST model to the prediction of the RI reference model. The solid line is the Molchan 0 trajectory calculated from the highest to the lowest threshold value Ea of the alarm function. The dashed diagonal line corresponds to an unskilled forecast model with respect to the reference model. The thin line limits the zone of the Molchan diagram in which the prediction of the EAST model is better than the prediction of the RI reference model at a level of significance α 1%. 310 P. Shebalin, C. Narteau, M. Holschneider, and D. Schorlemmer

15 (a) ≥ – 1279 targets of M 4 the rate of hits per space time cell cx; y; t. In this case, the γ (456 mainshocks) probability of having an M>Mtarget earthquake during the 10 next time step is likely to decrease extremely rapidly with respect to the Mtarget value. As a result, for practical applica- 5 tions, it may be more useful to detect peak areas and peak periods in the probability map. Additional development of

Probability Gain, α=0.01 the EAST model in combination with other methods might 0 further resolve this problem, too (Schorlemmer and Wiemer, 0.0 0.2 0.4 0.6 2005). Rate of Hits, 1-ν A definitive evaluation of the EAST model in the CSEP testing center requires long-term analysis. Using the Mol- 25 (b) ≥ 404 targets of M 4.5 chan diagrams of the retrospective evaluation, we can try to γ 20 (150 mainshocks) estimate this time for different Mtarget values. In practice, we 15 take the Molchan trajectories obtained in California from 4 5 6 1984 to 2008 for Mtarget f ; ; g (two of them are plotted 10 in Fig. 3). Then, we recalculate the α 1% quantiles of the 5 miss-rate distribution for an increasing number of events. As Probability Gain, α=0.01 this number increases, the standard deviation of this binomial 0 0.0 0.2 0.4 0.6 distribution is decreasing, and the zone in which the null- ν hypothesis cannot be rejected narrows and focuses around Rate of Hits, 1- 1 τ the diagonal RI. When the Molchan trajectory is entirely α 50 below this critical level , we note the corresponding number ≥ (c) 45 128 targets of M 5 of events. We obtain values of 65 for M = 4, 40 for M γ (57 mainshocks) target target 40 = 5, and 8 for M = 6. Using the corresponding average 35 target 30 seismic rate, we conclude that the EAST model need to be 25 tested for 1 year for Mtarget = 4, 5 years for Mtarget =5, 20 15 and 10 years for Mtarget = 6. Taking into account that, in a 10 forward test, results may be slightly worse, the duration of Probability Gain, 5 the test may become a little longer. 0 0.0 0.2 0.4 0.6 ν Rate of Hits, 1- Conclusions

Figure 12. Probability gain plots for the retrospective evalua- In a new alarm-based model, called the EAST model, the tion of the EAST model: (black line) with and (gray line) without time delay before the onset of the aftershock decay rate is M>M aftershocks . This evaluation covers a period from 1984 target used to identify space–time regions with a higher level of to 2008 for three Mtarget values: (a) Mtarget = 4, (b) Mtarget = 4.5, and γ (c) Mtarget = 5. The values are calculated from the RI reference stress and, consequently, a higher seismogenic potential. model. Circles indicate the limit at which we start to incorporate Retrospective analysis and the current evaluation in the CSEP – space time regions in which the Ea value is not defined. As in a testing center show some promising results that indicate the α 1% Molchan diagram, the shaded areas show the quantiles feasibility of the approach and that support our working of the miss-rate distribution. hypothesis. Hence, we conclude that early aftershock decay rate may be a powerful way to estimate the evolution of the difference between the probability gain curves with and level of stress within the seismogenic crust and, more without M>M aftershocks also support this hypothesis. target generally, a diagnostic tool for earthquake activity at both In fact, a vast majority of M>M aftershocks are likely target regional and local scales. to result from a perturbation of the state of stress in zones where the level of stress may be significantly lower before the mainshock. At the three-month time step of the EAST Data and Resources model, it is impossible to capture such abrupt variations, and the model performs better when we remove aftershocks. The prospective test of the EAST model is carried out in A possible direction for further investigations is to refine the the framework of the Collaboratory for the Study of Earth- space–time mesh of the EAST model to forecast large after- quake Predictability (CSEP; http://www.cseptesting.org/). shocks with the same accuracy. The Advanced National Seismic System (ANSS) earthquake Another perspective is to develop a frequency-based catalog was searched using http://quake.geo.berkeley.edu/ forecast model using retrospective results of the EAST model. cnss/catalog-search.html. Most of the plots were made In fact, for different ranges of Ea value, the long-term aver- using the Generic Mapping Tools version 4.2.1 (www aged expected frequency of events may be calculated from .soest.hawaii.edu/gmt; Wessel and Smith, 1998). Short-Term Earthquake Forecasting Using Early Aftershock Statistics 311

Acknowledgments Narteau, C., P. Shebalin, and M. Holschneider (2005). Onset of power law aftershock decay rates in southern California, Geophys. Res. Lett. 32, This paper has been improved by the constructive comments of no. B03306, 5 pp., doi 10.1029/2005GL023951. J. Zechar and two anonymous reviewers. The authors are also grateful to Narteau, C., P. Shebalin, and M. Holschneider (2008). Loading rates in M. Liukis for invaluable help in installing the EAST model in CSEP and California inferred from aftershocks, Nonlin. Proc. Geophys. 15, the evaluation of the prospective forecasts. This work has been partially 245–263. supported by the French Ministry of Research (ANR-09-RISK-02-001/ Narteau, C., S. Byrdina, P. Shebalin, and D. Schorlemmer (2009). Common CASAVA). dependence on stress for the two fundamental laws of statistical , Nature 462, 642–645. References Ogata, Y. (1998). Space-time point-process models for earthquake occur- rences, Ann. Inst. Statist. Math. 50, 379–402. Aki, K. (1981). A probabilistic synthesis of precursory phenomena, in Peng, Z., and P. Zhao (2009). Migration of early aftershocks following the : An International Review, Maurice Ewing 2004 , Nature Geosci. 28, 877–881. Series 4, D. Simpson and P. Richards (Editors), American Geophysical Peng, Z. G., J. E. Vidale, and H. Houston (2006). Anomalous Union, Washington, D.C., 566–574. early aftershock decay rate of the 2004 Mw 6.0 Parkfield, California, Atkinson, B. K. (Editor) (1987). Fracture Mechanics of Rocks, Academic earthquake, Geophys. Res. Lett. 33, L17307, doi 10.1029/ Press, New York, 534 pp. 2006GL026744. Ben-Zion, Y., and V. Lyakhovsky (2006). Analysis of aftershocks in a litho- Peng, Z. G., J. E. Vidale, M. Ishii, and A. Helmstetter (2007). Seismicity rate spheric model with seismogenic zone governed by damage rheology, immediately before and after main shock rupture from high frequency Geophys. J. Int. 165, 197–210. waveforms in Japan, J. Geophys. Res. 112, no. B03306, doi 10.1029/ Dieterich, J. (1994). A constitutive law for rate of earthquake production and 2006JB004386. its application to earthquake clustering, J. Geophys. Res. 99, 2601– Rhoades, D. A. (2007). Application of the EEPAS model to forecasting 2618. earthquakes of moderate magnitude in southern California, Seismol. Enescu, B., J. Mori, M. Miyazawa, and Y. Kano (2009). Omori-Utsu law c- Res. Lett. 78, 110–115. values associated with recent moderate earthquakes in Japan, Bull. Scholz, C. (1968). Microfractures, aftershocks and seismicity, Bull. Seismol. Seismol. Soc. Am. 99, 884–891. Soc. Am. 58, 1117–1130. Gardner, J., and L. Knopoff (1974). Is the sequence of earthquakes in south- Schorlemmer, D., and M. Gerstenberger (2007). RELM Testing Center, ern California with aftershocks removed Poissonian?, Bull. Seismol. Seismol. Res. Letts. 78, 30–36. Soc. Am. 5, 1363–1367. Schorlemmer, D., and S. Wiemer (2005). Microseismicity data forecast Gerstenberger, M. C., S. Wiemer, L. M. Jones, and P. A. Reasenberg (2005). rupture area, Nature 434, 1086–1086. Real-time forecasts of tomorrow’s earthquakes in California, Nature Schorlemmer, D., S. Wiemer, and M. Wyss (2005). Variations in 435, 328–331. earthquake-size distribution across different stress regimes, Nature Helmstetter, A., Y. Y. Kagan, and D. D. Jackson (2006). Comparison of 437, 539–542. short-term and time-independent earthquake forecast models for south- Schorlemmer, D., J. D. Zechar, M. Werner, D. D. Jackson, E. H. Field, ern California, Bull. Seismol. Soc. Am. 96, 90–106. T. H. Jordan (, and The RELM Working Group). First results of Jordan, T. H. (2006). Earthquake predictability, brick by brick, Seismol. Res. the regional earthquake likelihood models experiment, Pure Appl. Lett. 77, 3–6. Geophys. 167, no. 8–9, 859–876. Kagan, Y. Y. (2004). Short-term properties of earthquake catalogs and Shcherbakov, R., and D. L. Turcotte (2004). A damage mechanics model for models of earthquake source, Bull. Seismol. Soc. Am. 94, 1207–1228. aftershocks, Pure Appl. Geophys. 161, 2379–2391. Kagan, Y. Y., and D. D. Jackson (2000). Probabilistic forecasting of earth- Shcherbakov, R., D. L. Turcotte, and J. B. Rundle (2004). A generalized quakes, Geophys. J. Int. 143, 438–454. Omori’s law for earthquake aftershock decay, Geophys. Res. Lett. Kossobokov, V. (2006). Testing earthquake prediction methods: The west 31, L11613, 5 pp., doi 10.1029/2004GL019808. Pacific short-term forecast of earthquakes with magnitude mw ≥5:8, Shebalin, P. (2004). Aftershocks as indicators of the state of stress in a fault Tectonophysics 413, 25–31. system, Dokl. Earth Sci. 398, 978–982. Kossobokov, V., and P. Shebalin (2003). Earthquake prediction, chap. 4 Shebalin, P., V. Kellis-Borok, A. Gabrielov, I. Zaliapin, and D. Turcotte in Nonlinear Dynamics of the Lithosphere and Earthquake (2006). Short-term earthquake prediction by reverse analysis of Prediction, V. I. Keilis-Borok and A. A. Soloviev (Editors), 141– lithosphere dynamics, Tectonophysics 413, 63–75. 205, Springer-Verlag, New York, 141–207. Sibson, R. H. (1974). Frictional constraints on thrusts, wrench and normal Lolli, B., and P. Gasperini (2006). Comparing different models of aftershock faults, Nature 249, 542–544. rate decay: The role of catalog incompleteness in the first times after Utsu, T. (1961). A statistical study on the occurrence of aftershocks, main shock, Tectonophysics 423, 43–59. Geophys. Mag. 30, 521–605. Molchan, G. (1990). Strategies in strong earthquake prediction, Phys. Earth Vidale, J. E., Z. Peng, and M. Ishii (2004). Anomalous aftershock decay Planet. In. 61, 84–98. rates in the first hundred seconds revealed from the Hi-net borehole Molchan, G. (1991). Structure of optimal strategies in earthquake prediction, data, Eos Trans. AGU 85, no. 47, Fall Meet. Suppl., Abstract Tectonophysics 193, 267–276. S23C-07. Molchan, G., and V. Keilis-Borok (2008). Earthquake prediction: Probabil- Wessel, P., and W. Smith (1998). New, improved version of Generic istic aspect, Geophys. J. Int. 173, 1012–1017. Mapping Tools released, Eos Trans. AGU 79, no. 47, 579. Mori, J., Y. Kano, and B. Enescu (2008). Comparison of early aftershock Zechar, J. D., and T. H. Jordan (2008). Testing alarm-based earthquake sequences for the 2004 Mid-Niigata and 2007 Noto Hanto earthquakes predictions, Geophys. J. Int. 172, 715–724. in central Japan, Earth Planets Space 60, 151–154. Zechar, J., and T. Jordan (2010). The area skill score statistic for evaluating Nanjo, K. Z., B. Enescu, R. Shcherbakov, D. L. Turcotte, T. Iwata, and earthquake predictability experiments, Pure Appl. Geophys. 167, Y. Ogata (2007). Decay of aftershock activity for Japanese earth- doi 10.1007/s00024-010-0086-0. quakes, J. Geophys. Res. 112, no. B08309, 12 pp., doi 10.1029/ Zechar, J. D., T. H. Jordan, D. Schorlemmer, and M. Liukis (2007). 2006JB004754. Comparison of two earthquake predictability evaluation approaches, Narteau, C., P. Shebalin, and M. Holschneider (2002). Temporal limits of the Molchan error trajectory and likelihood, Seismol. Res. Lett. 78, 250. power law aftershock decay rate, J. Geophys. Res. 107, no. B122359, Zechar, J. D., D. Schorlemmer, M. Liukis, J. Yu, F. Euchner, P. J. Maechling, 14 pp., doi 10.1029/2002JB001868. and T. H. Jordan (2010). The Collaboratory for the Study of Earth- 312 P. Shebalin, C. Narteau, M. Holschneider, and D. Schorlemmer

quake Predictability perspective on computational earthquake science, Institutes of Applied and Industrial Mathematics Concurrency Comput. Pract. Ex. 22, 1836–1847. doi 10.1002/ Universität Potsdam cpe.1519. POB 601553, 14115 Potsdam, Germany (M.H.)

International Institute of Earthquake Prediction Theory and Mathematical Geophysics Moscow, 84/32 Profsouznaya Department of Earth Sciences Moscow 117997, Russia University of Southern California (P.S.) 3651 Trousdale Parkway Los Angeles, California 90089 (D.S.) Laboratoire de Dynamique des Fluides Geologiques Institut de Physique du Globe de Paris 75252 Paris Cedex 05, France (C.N.) Manuscript received 1 May 2010