Operations with Advanced Intelligence Decision Support System for Mine Suspected Area Assessment in Croatia and Bosnia and Herzegovina

Operations with Advanced Intelligence Decision Support System for Mine Suspected Area assessment in Croatia and Bosnia and Herzegovina

Milan Bajić, Roman Turšič

ITF – R. Turšič, L. Buhin, FG UNIZ – M. Bajić, A. Krtalić; CROMAC – D. Laura, Č. Matić, CTDT Ltd. – N. Pavković

M. Bajić, Prof. Ph.D., Faculty of Geodesy University of Zagreb (FG UNIZ) E-mail: [email protected] Chair for photogrammetry and Remote Sensing Tel.:++38598460917 Kačićeva 26, 10000 Zagreb, Croatia Skype: milan.bajic.zgb

Faculty of Traffic and Transport Sciences University of Zagreb

FG UNIZ

CTDT Ltd. CROMAC ITF 1 11:40 M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 COUNTRIES/AREAS OF ITF ACTIVITIES

OTHER REGIONS/AREAS Afghanistan Azerbaijan Armenia Columbia Cyprus Gaza Strip Georgia Iraq Jordan Kazakhstan Kyrgyzstan Lebanon Tajikistan Turkmenistan ITF Short Record of Achievements (1998 – 2010)

319.382.995 USD of donations raised by ITF 105.732.625 square metres of land in SE Europe and the South Caucasus cleared through ITF 69.370 mines and UXO found and destroyed in the region of SE Europe 40.000 and more children and adults included in MRE projects on yearly basis through ITF 2.450 completed projects 1.014 mine survivors rehabilitated through ITF 800 individuals trained in the field of Mine Action (MVA, humanitarian demining, management) 130 plus public and private donors 28 donor countries 18 beneficiary countries/areas 4 countries – Macedonia, Montenegro, Serbia and Albania – achieved Mine Free status 1 regional MA body – SEEMACC ITF involment into R&D activities (1998 – 2010)

• Geografical Information System In SEE Europe (2000-2003, core activities were analysis of MAC requirements for hardware and software for GIS and images processing , development of suitable equipment and guidelines for the region, organization of tendering procedures and centralized purchases for equipment for GIS and images processing, provision of staff support to MAC and organization of IT, GIS and image processing training courses applicable to MA) • Partial involment in European Commission project ARC (Airborne Minefield Area Reduction , 2001 - 2003 ) • Partial involment in European Commission project SMART (Space and Airborne Minefield Area Reduction Tool , 2001 - 2003) • Support of development of demining machine MV 3 (implemented by DOK-ING, Croatia, 2001 – 2002) • Implementation of Advanced Intelligence Decision Support System for Croatia (2008 – 2010) • Implementation of Advanced Intelligence Decision Support System for Bosnia and Herzegovina (2009 – 2010) Croatia and Bosnia and Herzegovina – Mine situation 2009/2010 (Suspected area in km2) Country I. Category II. Category III. Category Total all:

BiH 234,70 422,85 897,78 1.555,33 MSP with sufficient data MSP without sufficient data Croatia 266,31 621,49 887,70 • Both countries has approached to Ottawa convention for prolongation of their national demining programs till 2019 (scope of problem and problem with financing of MA activities) • Bosnia and Herzegovina is now facing with a lack of donor interests in financing of Mine Action • Croatia is in a better position due to a fact that Croatia is finansing national Mine Action programme 75 % from a National budget • For both countries as main problem remains III category of suspected area • Involment of representatives from other countries with mine problem – transfer of know – how (Azerbeian) AI DSS technology supports approach to Ottava Convention

Total benefit Full = total cost Benefit B clearance Donnors support Optimal production B/C Cost C of existing B/C technology Expenditure Expenditure

B/C Cost CDSS of AI DSS B/C technology

0 ABC D Quantity of output of a Mine Action Program A:optimal mine action program, B/C>>1, B: cost equal to benefit for existing

technology, C DSS : cost for AI DSS, D: full clearance (Article 5 Ottava Convention),[4]. 6 11:40 M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Results of the first operational remote sensing project achieved 2008-2009 in Croatia First operational service for the reduction of a mine suspected area and risk assessment, by airborne remote sensing, spatial imagery and Advanced Intelligence Decion Support System (AI DSS) was applied at 158.16 km 2 at communities Gospić, Bilje and Drniš in Croatia.

Results in the community Gospić (MSA 56.84 km 2): excluded from mine suspected area 28 km 2 included into mine suspected area 6 km 2

Ratio of CROMAC’s conventional technology cost to the cost of AI DSS technology 141.83 : 1

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 7 11:40 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Application of AI DSS service in community Gospić

Legend • Red cross- hatched - for demining,

• red hatched – for search,

• yellow hatched – used at owner responsibility

• blue hatched – excluded from MSA.

before after M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 8 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Advanced Intelligence Decision Support System for Mine Suspected Area reduction and assessment Application of AI DSS rezults in MAC

Danger Map Proposals for Reconstruction of Confidence MSA reduction MSA, indicators map

Fusion, multi-objective multi-criteria processing

Airborne & satelitte Contextual data, Formalised experts’ Mine Geographic multisensor imagery information knowledge. Quality Information Indicators of mine Terrain analysis assessment of data, Information presence & absence information System System

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 9 11:40 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Airborne multisensor imagery acquisition system of the AI DSS

• Sensors’ pod (below the fuselage of the helicopter Mi-9, installation 2 h ). • Subsystem for navigation, for imagery acquisition, pre-processing. • Subsystem for the processing and interpretation (on the ground). • Flight endurance 4:15 h. • Cruising speed 110 km/h • Width of the images strip 0.33 H, H – height above terrain. • Area imaged per hour 36 km 2. • [12].

11:40 M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 10 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Airborne multisensor acquisition system of FG UNIZ & CTDT

Color IR Long wave IR Hyperspectral Color photo 4 channels 1 channel 95 channels 3 channels

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 11 11:40 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Pillars of the AI DSS

MINE ACTION CENTRE Mine action experts: scene analysis (MIS, GIS), general & special requirements on information and data acquisition

MINE SCENE NTERPRETERS DSS OUTPUT Scene understanding, satellite Fusion, danger map, imagery & DEM terrain analysis, confidence map, proposal airborne mission planning, for reduction, map of quality assessment of available conflicts MIS-AI DSS data & information

MINE SCENE INTERPRETERS MULTISENSOR Imagery processing, use of AIRBORNE SYSTEM expert knowledge, contextual information, Multisensor imagery indicators of mine presence, acquisition absence

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 12 11:40 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Metodologies used in MAC and used in AI DSS MAC , [11] MIS (Mine field records, incidents, accidents, survey, QA,..) & GIS (HOK, TK25, DOF5, DOF2). Scanned military maps. War history data, data about explosive and landmine obstacles, 3D visualisation of the terrain. AI DSS , [8], [9], [10], [4], [5] MIS, GIS, scanned military maps, war history data, data about explosive and landmine obstacles, satellite multispectral images, satellite digital elevation model (DEM). Analytic estimation of the mine suspected area (MSA). Control and statistical evaluation and quality assessment of all data sources. Detection of the indicators of mine presence (IMP) and mine absence (IMA) in the satellite images, airborne multisensor images, DOF (if available). Collecting and processing of the contextual data and information. Formalisation of experts’ knowledge (membership function, relative importance of IMP). Spatial analysis of the terrain. Classification, fusion, multi-objective, multi-criteria processing. Derivation of the maps: danger map, proposal for reduction, confidence map, map of conflicts between MIS and AI DSS data.

11:40 M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 13 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Where to apply AI DSS based on airborne and space borne assets Advanced Intelligence Decision Support System (AI DSS), based on space borne and airborne assets is aimed and is suitable for areas where access is not possible on the ground, or where ground based technology is to costly. Terrain without snow, forests, crop fields without leaves. In Croatia were sellected three regions having different characteristics. In Bosnia and Herzegovina 11 regions were considered and 3 were selected for applications of the AI DSS service. Mine Action Centre shall provide available MIS and GIS data, scanned military maps, war history documents (if exist). Experts for deployment of the explosive and land mine obstructions, military experts which know war history on the considered terrain, experts for mine action, shall derive general and special requirements regarding the difference between available and needed information and data, that should be provided by application of a AI DSS.

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 14 11:40 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 The strong indicators of mine presence – main contribution to success

11:40 M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 15 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Trenches are visible on the aerial image

16 M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Map of potentially hazardous areas outside MSA

Legend: blue – potentially hazardous area outside MSA, red – danger map inside MSA.

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 17 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Contextual data compensate lack of data in Mine Information System Example of information uncertainty: analysed 228 mine field records , 51 exist, 43 minefield polygons can be shown on a map , average positioning accuracy 40 %; 81% mine obstruction locations unknown ,[5].

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 18 11:40 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Trenches visible on the satellite image not on aerial digital ortho photo DOF 2 (M 1:2000)

DOF 2

Satellite

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 19 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Slopes of the relief, large waters are (new) indicators of mine absence

The mountain Velebit The marsh Kopački rit

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 20 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Slopes of the relief, large waters features applied

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 21 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 The indicators of mine presence and mine absence shown on MSA

IMP IMA

Note: Velebit not shown

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 22 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Conclusions

1. The Advanced Intelligence Decision Support System (AI DSS) is the first fully operational solution for the assessment of the mine suspected area (MSA), based on the airborne and space borne remote sensing combined with advanced intelligence methodology, which passed stringent operational validation. 2. Application of the AI DSS enabled Croatian Mine Action Centre (CROMAC) to exclude 26 km 2 of 56.84 km 2 MSA and include 6 km 2 to MSA in one (Gospić) of three communities where AI DSS was applied. Application of the AI DSS results for other two communities is under way. 3. Ratio of CROMAC’s conventional technology cost to the cost of AI DSS technology 141.83 : 1. 4. The European Commission supported R&D projects regarding the application of the airborne and space borne remote sensing methods and technology for needs of mine action, which never became operational. We expres scepticism regarding the ESA initiative. 5. The financial support of US Department of State by assistance of International Trust Fund, Slovenia, the financial support of Croatian Ministry of Science, education and sports and the operational support and strong feedback of CROMAC enable transformation from R&D concepts and methodologies into presented operational AI DSS. 6. We invite to the cooperation and further advancement and the development of the operations with AI DSS. 7. In October-November 2010, we will have internal Workshop (work – not presentations) in Mostar, Bosnia and Herzegovina. Information available.

11:40 M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 23 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 Acknowledgments

• The Advanced Intelligence Decision Support System (AI DSS) was developed and realised in 2007- 2008 as the operational system, by support of the Ministry for science, education and sports, of the Republic of Croatia through technology project TP-06/007-01. • The International Trust Fund for Demining and Mine Victims Assistance (ITF), Slovenia, supported operationalization and advancement of the AI DSS in Croatia (2008-2009) and in Bosnia and Herzegovina (project is under way). ITF also supported operational verification and validation of the R&D projects SMART and ARC funded by European Comission (2001-2005). • The US Department of State Bureau of Political-Military Affairs Office of Weapons Removal and Abatement, funded operational application of the AI DSS in Croatia as project of category “Fusing Data” – Impact Survey, Impact Surveillance, Land Release, and National Planning. Project was initiated by International Trust Fund for Demining and Mine Victims Assistance (ITF), Slovenia. • Croatian mine action centre (CROMAC) provided continuous operational support, data, information and expertise in mine action which were crucial for our orientation to solving the real problems instead to allocate efforts to the technical or scientific curiosities. • The AI DSS is result of the continuous efforts of many scientists, researchers, mine action experts, Croatian Air Forces pilots, research institutions and academia , fruitful cooperation between Croatian and European scientists. It was our privilege and the pleasure to work with all of them.

11:40 M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 24 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010 References [1] R. Keeley, 2005, Are we setting a wrong target , Mine Action Journal, Issue 9.1, August 2005. [2] CROMAC, 2009, National mine action strategy of the Republic of Croatia 2009 – 2019 , Croatian Mine Action Centre, Sisak , Croatia, http://www.hcr.hr/pdf/Strategija%20eng.pdf [3] CROMAC, 2009, Humanitarian demining plan 2010, Croatian Mine Action Centre, Sisak , Croatia, March 9, 2010, http://www.hcr.hr/pdf/Plan%20humanitarnog%20razminiranja%202010_ENG..doc [4] ITF, HCR-CTRO, 2009, Deployment of the Decision Support System for Mine Suspected Area Reduction Final Report 2009, V2.0.0 , ITF, CTRO, 12.09.2010, 61 P., internal for ITF, CTRO, CROMAC. [5] ITF, 2009, Deployment of the Advanced Intelligence Advanced Intelligence Decision Support System for Mine Suspected Area Reduction in Bosnia and Herzegovina , International Trust Fund for Demining and Mine Victims Assistance, Ig, Slovenia, HCR Center for Testing, Development And Training, Ltd., Zagreb, Croatia, Mine Action Center of Bosnia and Herzegovina, Sarajevo, Bosnia and Herzegovina, 2009-2010. 6] Y. Yvinec, M. Bajic, B. Dietrich, I. Bloch, S. Vanhuysse, E. Wolff, J. Willekens, 2005., Final Report, Space and Airborne Mined Area Reduction Tools, project SMART , European Commission IST-2000-25044, V3, Classification: Public, 20.04.2005, 46 p. URL: http://www.smart.rma.ac.be/ [7] M. Acheroy, Y. Yvinec, 2008, Mine-suspected Area Reduction Using Aerial and Satellite Images , in book edited by Makki K. Habib: Humanitarian Demining: Innovative Solutions and the Challenges of Technology, I-Tech Education and Publishing, Vienna, Austria, February 2008. Open Access Database www.intehweb.com [8] M. Bajić, H. Gold, T. Fiedler, D. Gajski, 2008, Development of a concept from 1998 and realization of the system for the airborne multisensor reconnaissance and surveillance in crisis situations and the protection of the environment in 2007 – 2008 , Proceedings of the First International Conference on Remote Sensing Techniques in Disaster Management and Emergency Response in the Mediterranean Region, Zadar, Croatia 22-24 September 2008, ed. M. Oulić, EARSeL, pp.401-410. [9] M. Bajić, A. Krtalić, Č. Matić, D. Vuletić, 2009, Minefield Indicators and Analytical Mine Contamination Assessment in Scientific Projects and in Practice , Book of papers, International Symposium "Humanitarian Demining 2009", 27 to 30 April 2009, Šibenik, Croatia [10] M. Bajić, L. Buhin, A. Krtalić, T. Cvetko, Z. Čanđar, H. Gold, D. Laura, Č. Matić, N. Pavković, D. Vuletić, 2009, Fusion of Data, a Priori Information, Contextual Information and Experts’ Knowledge for Support of the Decision Making About Mine Suspected Area Reduction, Book of papers, International Symposium "Humanitarian Demining 2009", 27 to 30 April 2009, Šibenik, Croatia [11] CROMAC, 2009, Survey of mine suspected area and/or buildings - area reduction in MSA , standard operating procedure 01.04, Croatian Mine Action Centre, Sisak , Croatia, November 2009, http://www.hcr.hr/pdf/01-04%20_REDUKCIJA_www_ENG_1_2010.pdf [12] T. Fiedler, M. Bajic, D. Gajski, H. Gold, N. Pavkovic, D.I. Milosevic, 2007, System for the multisensor airborne reconnaissance and surveillance In the crises situations and the protection of environment , Faculty of Geodesy University of Zagreb, Technology project TP-006/0007-01, supported by the Ministry of science, education and sports, of the Republic of Croatia, Zagreb, 2007. - 2008. (in Croatian)

M. Bajić, Operations with Advanced Intelligence Decision Support System for Suspected Area Asessment in Croatia and Bosnia and Herzegovina, 25 11:40 Workshop “Merging Mine Action Technology and Methodology”, GICHD, Geneva; 6-8.09.2010