European Space Agency

XMM-Newton and INTEGRAL weekly Mission Operations Report

XMM-INT-WOPS-14_44

Issue 1

Date: 07 November 2014

Marcus Kirsch HSO-OAX Document No :XMM-INT-WOPS-14_44 XMM-Newton and INTEGRAL weekly Issue/Rev. No : 1 Date 07/11/2014 Mission Operations Report Page : 2

Distribution List

ESOC Thomas Reiter Danielle Heinzer Andrea Kerruish Frank Dreger Andrzej Olchawa Andreas Rudolph [email protected] Federico Cordero XMMINTFCT Alastair McDonald Felicity Sheasby Marcus Kirsch Gianluca Gaudenzi Jim Martin Kenneth Scott P. Brabbin Marko Butkovic Martin Unal Klaudia Reich Frank Albrecht [email protected] Juergen Fertig Justin Howard Richard Southworth Erik Soerensen Jutta Huebner Paolo Ferri

ESAC Alvaro Gimenez Ramón Muñoz Peter Kretschmar Martin Kessler Maria Santos Lleo Erik Kuulkers Mauro Casale [email protected] Pedro Calderon Ricardo Perez

ESA HQ

ESTEC Fred Jansen Christoph Winkler Guiseppe Sarri

ESA Redu Benoit Demelenne

Astrium Tommy Strandberg

Alenia Franco Ravera Mario.Montagna

Logica COMCS_Helpdesk.de@log icacmg.com

ISDC Roland Walter Carlo Ferrigno

INT-PI Francois Lebrun J.P. Roques Giovanni Larosa Pietro Ubertini Wojte Hajdas Miguel Mas Hesse Søren Brandt A. Bazzano

Document No :XMM-INT-WOPS-14_44 XMM-Newton and INTEGRAL weekly Issue/Rev. No : 1 Date 07/11/2014 Mission Operations Report Page : 3

1. Weekly report

XMM Integral . Nominal operations . Nominal Science Operations . MCS SW release 11.1.1 + patches . Eclipse Season #26 (24.10 – for SPR/CCR critical for Eclipse 17.11) made operational 29th October. . Goldstone testing and preparation Main activities th st – successful tests 29 and 31 October . Eclipse preparation on-going . Kourou station operational validation complete 31st October Status and . Nominal for platform and all . Nominal for platform and payload performance of instruments S/C . Numerous problems with uplink bit- . Ongoing occasional RFI at all lock during AGO support (back-up stations, some sources identified Status and station during Kourou . performance of maintenance). Ground . On 31st October, problems on AGO segment forced a switch to unscheduled pass on KRU station.

. None. . INT_SC-463: IBIS activation delayed S/C Anomalies due to radiation spike (note: this is not an instrument anomaly)

. XMM-1221 General Problems . INT-3479: Communication problems G/S Anomalies During Santiago Support between NCRTS & MCS (4 instances) . CDMU patch (J3) TDC/TCL . Automation of some repetitive tasks function testing delayed until after . Development of detailed proposal for SW release 11.1.1+. Integral disposal. . Kourou station planned to be . NNO validation in second half of operational again (after November (after ROSETTA Philae maintenance) on 3rd November landing) . Kourou IFMS IP updates to be . The SIMSAT Linux / OpenVMS Future validated during Eclipse Adapter: Kick-off meeting: 06.11. activities . Eclipse season starts 6th November . KIR power outage 18.-20.11. planned . Goldstone testing and preparation . SAS calibration: 20.11. – first operational pass 6th . Disposal delta-v ORR: December November . Battery reconditioning postponed . Santiago station MRB 7th November . Automation test 18th November delayed until after SW release 11.2.0

Document No :XMM-INT-WOPS-14_44 XMM-Newton and INTEGRAL weekly Issue/Rev. No : 1 Date 07/11/2014 Mission Operations Report Page : 4

2. Detailed weekly operational events note: all times are Zulu

2.1. XMM

2014-10-27 14:44:00 (300) After WF INACTIVE SPACON realized that EPICs have been erroneously disabled in T/L at OBS_START (~15 min ago) because it was a CLOSED/CAL-CLOSED OBS. Started recovery for EPICs using CRP_EM1/2_1500. 2014-10-27 15:00:00 (300) Not enough time to recover PN within current Exposure with super ED (44 min. remaining). 2014-10-27 15:34:00 (300) After consulting SOC-on call stopped MOS-1 exposure and re- enabled S/S 3 in T/L. At this point T/L is re-joined for all INSTRUMENTS. 2014-10-27 16:04:00 (300) New MCS SW patch on top of Release 11.1.1 is installed on the B- Chain. B-Chain is restarted with the database imported. This Patch includes: - xmcs#588: access to INSTENG1_OPEN time (ARTS- XMM-1201) - xmcs#643: modification to MCS for Goldstone (ARTS- CCR-983) - xmcs#656: missing SPID numbers (ARTS-CCR-947 & 948) System constants are initialised, derived parameter processing is enabled. B-Chain connected also for TM to xnctra, Rapids Events disabled from xmca to xmcb.

2014-10-28 23:29:00 (301) Lost RF lock AGO . Requested to re-sweep. Lost RF lock again 2014- 10-29 00:15:00 (302). AR XMM-1221

2014-10-29 06:15:00 (302) Carrier up at DSN15. Warm receiver locked. Test commands successful. Repeated at 2014-10-29 06:47:00 (302) 2014-10-29 07:05:00 (302) Cold receiver locked successful. No TM received from DSN. Problems keeping downlink on warm receiver 2014-10-29 08:40:00 (302) Cold receiver locked successful from DSN15. After that station was reconfigured and warm receiver locked again. After TM was back SOE connected XMCB to NCTRS-D. OBT valid. Configuration on NCTRS-B not correct. SWS will investigate that issue before next test pass on Friday. 2014-10-29 17:03:00 (302) G/S: requested ESTRACK to perform re-sweep at AGO. Further problems with carrier down at AGO: 19:10z, 19:40z. AR XMM-1221 2014-10-29 19:47:00 (302) TC: GE1601 + LE9111 'RGS QDump' failed release due to G/S: AGO

2014-10-31 02:44:00 (304) G/S: Lost on board LOCK from G/S: AGO. AR XMM-1221 2014-10-31 02:45:00 (304) At this point ESTRACK suggested that although KRU is officially under maintenance but station engineer has informed that KRU can be used for the time being and is already tracking. In the wake of continuous TM glitches from AGO, SPACON agreed to go to KRU. AGO will be shadow tracking in case KRU control has to be relinquished. 2014-10-31 08:27:00 (304) Carrier down at KRU and requested DSN24 to bring carrier up 2014-10-31 11:54:00 (304) Validation pass start with KRU station

Document No :XMM-INT-WOPS-14_44 XMM-Newton and INTEGRAL weekly Issue/Rev. No : 1 Date 07/11/2014 Mission Operations Report Page : 5

2014-10-31 13:05:00 (304) Start Ops Inst 3405 CDMU TDC/TCL Test of Packet Filing

2014-10-31 13:13:00 (304) Completed Ops Inst. 3405 TDC/TCL packet filing working at MOC and SOC

2014-10-31 21:11:00 (304) G/S: requested ESTRACK to perform re-sweep at AGO. AR XMM- 1221 2014-11-01 22:46:00 (305) G/S: carrier down at AGO 2014-11-01 22:46:01 (305) TC: H0001 'OM TEST COMMAND' failed release due to no TC-Link from AGO - commanding for OM aborted 2014-11-01 23:51:00 (305) G/S: Lost TM from AGO 2014-11-01 23:52:00 (305) TC: PU203 'LCL TRSPTX B ON' failed release --> ED: RE0152 interrupted/aborted

2014-11-02 00:37:00 (306) G/S: data gap on VC-7 + frame out of sequence from AGO EV: Command link status set to: TC: NO BITLOCK, TM: GREEN, AR XMM-1221 2014-11-02 01:30:00 (306) G/S: carrier down at AGO 2014-11-02 01:34:00 (306) TC: H0001 'OM TEST COMMAND' failed release due to no TC-Link from AGO - commanding for OM aborted 2014-11-02 03:24:00 (306) G/S: carrier down at AGO 2014-11-02 04:28:00 (306) G/S: carrier down at AGO 2014-11-02 04:33:00 (306) TC: H0001 'OM TEST COMMAND' failed release due to no TC-Link from AGO - commanding for OM aborted 2014-11-02 05:26:00 (306) G/S: carrier down at AGO

2014-11-02 07:20:00 (306) As per OCR#3404 , SpaCon noticed discrepancy of 100 rpm on RW2 from the prediction and informed FD on Call. After a quick analysis , FD on call confirmed that it is safe until next RWO at 10.20Z 2014-11-02 10:15:00 (306) SpaCon noticed discrepancy of ~160 rpm and ~800 rpm on RW1 & RW2 respectively from the prediction and informed FD on Call. FD on call confirmed that it is safe to let RWO go from timeline. 2014-11-02 10:17:00 (306) Lost TM , Informed ECC Lost TM due to Weak Signal at VIL-2. TC: PU200 & R0211 - Failed due PTV. Suspected bad weather at VIL-2. 2014-11-02 10:20:00 (306) 2729_01_M.RWO missed due to G/S outage, FD on call called in.

2014-11-02 13:08:00 (306) Loss of AD service from AGO cmds fail for both MOS1+2 Timeline has stopped. AR XMM-1221 2014-11-02 13:46:00 (306) Loss of carrier again at ago, re-sweep needed

2014-11-02 13:54:00 (306) AGAIN loss of carrier at ago. Spacon requests KRU which is tracking at this time as ago is very unstable. 2014-11-02 14:02:00 (306) AGO is now shadow tracking and ESTRACK inform that we will have to go back too AGO once all the instrument activation is carried out as KRU is not declared green at this time. 2014-11-02 14:06:00 (306) Start guide str cmd at the end of CSL seq fails uplink, s/s1 is stopped and also cmds for mos1/2 also fail. mos1 and 2 are also disabled. 2014-11-02 14:14:00 (306) Mos 1 is in an intermediate state with FW still being powered, spacon sends ES0000 to place it into safe state

Document No :XMM-INT-WOPS-14_44 XMM-Newton and INTEGRAL weekly Issue/Rev. No : 1 Date 07/11/2014 Mission Operations Report Page : 6

2014-11-02 15:06:00 (306) spacecraft on target

2014-11-02 18:52:00 (306) Loss of on-board lock at ago

2.2. INTEGRAL

- 27/10/2014 (300) o 00:03:00 Data gaps from Kiruna (RFI from COSMOS-2436) o 03:14:00 OEM: "ACC AIMU ON" o 03:56:00 Eclipse 2 of eclipse season #25; OEM: "ACC ECLIPSE START" o 10:23:00 FCP_IBIS1_0401 - ISGRI CTX Tables uplinked; 2nd TC failed release due to dyn. PTV. SPACON missed to enable WAIT MODE  enabled dispatched o 11:29:00 TC: A3085 'RC SUN STEER INI' CEV unverified  IPS 1/6 o 16:58:19 PID #0009 lost due to OTF toggling . 16:59:00 OEMs: ACC PITCH & YAW ERROR OOL . 17:25:00 D5217 'OTF' (value= NOT REACHED/REACHED) toggling. SPACON started recovery tool. TPF 1470_0501_A.OSL applied on A/S to re-update slew #0010. o 18:36:00 TM: DD0003D 'TCO PKT LOSS' H/H-OOL (value= 67). OOL within limits in a minute, No further action by SPACON.

- 28/10/2014 (301) o 09:02:00 Data gaps on VC-0 & VC-7 from KIR (RFI of both D/L chains) o 10:36:00 Data gaps on VC-0 & VC-7 + missing packets from KIR for 2min (RFI of both D/L chains)

- 29/10/2014 (302) o 12:47:00 INT_OPS_1028: KIRUNA TMTCS-2 update . 14:57:00 Swapped operations to TMTCS-2 on NCTRS-A (prime) for testing slew sequence from AS  successful . 15:21:00 Swapped operations back to TMTCS-1 on NCTRS-A (prime) o 18:09:00 ISDC connection problems due to COMMS maintainance on external routers . 18:09:00 Link ISDS-ISDC --> DISCONNECTED(a) . 18:09:01 Link ISDS-ISDC --> CONNECTED(a) . 18:11:00 Link ISDS-ISDC --> DISCONNECTED(a) . 18:11:01 Link ISDS-ISDC --> CONNECTED(a) . 18:22:00 Link ISDS-ISDC --> DISCONNECTED(a) . 18:22:01 Link ISDS-ISDC --> CONNECTED(a) st o 18:44:00 1 time: . SYS: NCDUadmi/imca-new - NCDU: TM014 TM VC7 Onl-COM from groundst cannot be delivered to MCS . SYS: TMDS_RT/imca-new - Link TM_DDS_VC7RT DISCONNECTED . SYS: TMDS_RT/imca-new - Lost connection to NCTRS. Will try to ...

Document No :XMM-INT-WOPS-14_44 XMM-Newton and INTEGRAL weekly Issue/Rev. No : 1 Date 07/11/2014 Mission Operations Report Page : 7

. SYS: BEHVooID/icla1 - Limit Checker is not alive ESTRACK reports no impact, please investigate o 18:45:00 TC: A3084 'RP SUN STEER INI' failed release due to dyn. PTV . 18:45:01 AOCS disabled in T/L . 18:45:02 PID #0087 lost . 18:46:00 Recovery tool started . 18:53:00 Manual slew 1470_0502_M.OSL from PID #0086 to #0087 . 18:58:00 INT_OPS_494 OMC in standby after slew start  resent OMC-TCs for PID #0087 . 19:00:00 Recovery tool started . 19:05:00 TPF 1470_0503_A.OSL applied on A/S to update slew #0088 . 19:05:01 AOCS enabled in T/L + Reset IL

- 30/10/2014 (303) o 00:08:00 Data gaps & missing source packets from KIR (RFI on both D/L chains) o 02:54:59 OEM: "ACC AIMU ON" o 03:53:00 Eclipse 3 of eclipse season #25; ECLIPSE START . 05:02:00 OEM: "ACC AIMU OFF" . 05:02:00 OEM: "ACC ECLIPSE END" o 11:13:00 Partial failure of ED GEISCL03 at CEV completion stage due to on- board automatism . 11:14:00 S/S IBIS disabled on A/S . 11:17:00 ED recovery: Uplink of GC0010 (CRP_IBIS1_0010) . 11:19:00 Re-uplink of ISGRI CTX tables . 11:30:01 Timeline Recovery Guideline for IBIS continue with reuplink of ED: GEISCL03 (case a step # 4) . 11:31:00 ED GEISCL03 failed CEV (2nd attempt) due to re-increasing radiation level . 11:36:00 CRP_IBIS1_0010 - FAST TRANSITION TO SAFE CONFIGURATION . 11:44:00 FCP_IBIS1_0401 - ISGRI CTX Tables re-uplinked . 12:09:00 ED GEISCL03 re-uplinked after radiation level dropped . 12:35:00 ED GEBEXT01 uplinked . 12:36:00 ED GESTAN02 uplinked  IBIS to Science . 12:41:00 IBIS enabled in T/L + Reset IL o 13:06:00 Data gaps on VC-0 & VC-7 from KIR + missing packets (RFI from COSMOS 2459) nd o 18:52:00 2 time: . SYS: NCDUadmi/imca-new - NCDU: TM014 TM VC7 Onl-COM from groundst cannot be delivered to MCS . SYS: TMDS_RT/imca-new - Link TM_DDS_VC7RT DISCONNECTED . SYS: TMDS_RT/imca-new - Lost connection to NCTRS. Will try to ... please investigate o 21:32:00 Drop VC-0 & VC-7 + missing packets from KIR (RFI on both D/L chains)

- 31/10/2014 (304) o 08:54:00 Data gaps from KIR (RFI on both D/L chains)

Document No :XMM-INT-WOPS-14_44 XMM-Newton and INTEGRAL weekly Issue/Rev. No : 1 Date 07/11/2014 Mission Operations Report Page : 8

o 09:52:00 End testing on DSS24 as per ops instruction 3400 o 10:25:00 Data gaps from KIR (RFI on both D/L chains) o 10:25:00 Reset rate int cmd fails release . 10:27:00 TM back allthough signal to noise ratio is not so good . 10:27:00 Recovery tool started . 10:29:00 TC, A7283 reset rate int cmd sent + spacon tool started . 10:35:00 TPF, 1471_0002_M.RMU arrives, however spacon to ignore this as manual RMU cal will be due at 10:46Z rd o 21:52:00 3 time: . SYS: NCDUadmi/imca-new - NCDU: TM014 TM VC7 Onl-COM from groundst cannot be delivered to MCS . SYS: TMDS_RT/imca-new - Link TM_DDS_VC7RT DISCONNECTED . SYS: TMDS_RT/imca-new - Lost connection to NCTRS. Will try to ... th o 21:58:00 4 time: . SYS: NCDUadmi/imca-new - NCDU: TM014 TM VC7 Onl-COM from groundst cannot be delivered to MCS . SYS: TMDS_RT/imca-new - Link TM_DDS_VC7RT DISCONNECTED . SYS: TMDS_RT/imca-new - Lost connection to NCTRS. Will try to ...

- 01/11/2014 (305) o 20:30:00 More than 100 rpm discrepancy on wheel # 2 - will be cleared with next RWB @ 09:17z o 23:12:00 A5558 - A5051 'WHEEL 2 SPEED 1 - 8' S/L-OOL (value= 629.74 rpm) o 23:52:00 TPF update failed for SlewID #0085

- 02/11/2014 (306) . 00:13:00 Recovery tool started SPACON didn't notice in time that the slew update failed at 23:52z due to G/S-problems @ AGO(XMM) Recovery was started with few minutes of delay instead . 00:18:00 FDS reports that a CGS/RWB is necessary prior to next manoeuvre OSL  informed FD-Support (MT) . 00:21:00 SYS: S/S AOCS disabled in T/L . 00:27:00 OSL #0085 missed from T/L . 00:27:01 PID #0085 lost . 00:29:00 S/S OMC disabled in T/L . 00:40:00 FD-Support (MT) on site . 01:01:00 uplink TPF: 1471_0502_M.CGS provided by FD-Support 01:06:00 uplink TPF: 1471_0502_M.RWB provided by FD-Support 01:13:00 OSL #0086 missed from T/L . 01:13:01 PID #0086 lost . 01:28:00 uplink TPF: 1471_0503_M.OSL provided by FD-Support 01:39:00 OSL #0087 missed from T/L . 01:39:01 PID #0087 lost . 01:48:00 SPACON-Tool started using STR-Mapping from OSL . 01:52:00 uplink TPF: 1471_0504_M.CSL . 01:58:00 Recovery tool started . 02:33:00 CGS prior to RWB missed from T/L . 02:35:00 uplink TPF: 1471_0505_M.CGS . 02:37:00 SYS: S/S AOCS + OMC enabled in T/L + Reset IL

Document No :XMM-INT-WOPS-14_44 XMM-Newton and INTEGRAL weekly Issue/Rev. No : 1 Date 07/11/2014 Mission Operations Report Page : 9

o 02:42:00 TM: P1112 'LCL STA IMU1' SCC-FAIL (value= CLOSE) + OEM: "ACC AIMU ON" o 03:22:00 Eclipse 4 of eclipse season #25; OEM: "ACC ECLIPSE START" . 04:53:08 OEM: "ACC ECLIPSE END" (Stored) . 04:53:08 OEM: "ACC AIMU OFF" (Stored) . 07:34:03 OEM: "ACC AIMU ON" (Stored) . 07:44:03 OEM: "ACC AIMU OFF" (Stored) o 08:17:00 SpaCon noticed that guide star was lost during perigee, Hence recovery tool started to Generate CGS before RWB . 08:29:00 1472_0500_M.CGS Uplinked o 19:08:00 Missing frames from KIR (RFI on both D/L chains)

- 03/11/2014 (307) o 01:28:00 OEM: "ACC AIMU ON" . PID #0023 interrupted due to IMU on . 01:29:00 AOCS disabled in T/L . 01:33:00 OSL #0024 missed from T/L . 01:38:00 OEM: "ACC AIMU OFF" . 01:39:00 Recovery tool started . 01:47:00 Manual slew 1472_0501_M.OSL from PID #0023 to #0024 . 01:57:00 Recovery tool started . 02:02:00 TPF 1472_0502_A.OSL applied on A/S to update slew #0025 . 02:03:00 S/S AOCS enabled on the A/S