Oracle Spatial Developments at Ordnance Survey

Ed Parsons Chief Technology Officer Who is Ordnance Survey ? Great Britain's national mapping agency An information provider...

• Creates & updates a national database of geographical information

• £ 50m ($90m) investment by 2007 in ongoing improvements

• National positioning services

• Advisor to UK Government on Geographical Information

• Highly skilled specialised staff of 1500 The modern Ordnance Survey

• Ordnance Survey is solely funded through the licensing of information products and services • Unrivalled infrastructure to maintain accuracy, !" ! currency and delivery of geographic information • 2003-4 Profit of £ 6.6m on a turnover of £116m($196m)

!" !"

"#$%&'()$*+,(+-./(+"&0%10#(2 #$%&'$'()#(*+,'()-&=+:H+N.)"-+JKK:*.&#/'0+,( /%',#A#,+.-'./+/4,%-(1)+)(3&)%+&0+A)20.0"(+3+./+)3' B#)/(78 %&+1'3)&/(+.02+(0-.0"(+&#)+4(5 %-1*$#)-3.$$(2+.$$'+$.(.&#)+%.)9*'$'()+2#)3#((%+=&)+2.%. =1&&',)#1(+1A4-1"-+%&&V++<.).+A-1$+GH)'-(/12(0"(+=)&' (.& $1%(+.02+&0610(+$()/1"($+%-1$ )3'+*)(/1$1&08-14%5+63'+('2+7-+41%-+;;*O<+1&=*-.$$' I14-,'/+J=K-(+B(6("%+1A+\&''1%%((+/#)'+%&.(/+.(0).1$(2+. 10")(.$109+57+:;*:<+.9.10$%+. %-1.,)#5(109+9'10"&:+6#2(2+$.(.*10+'0+&#)+)3'+2.;'%.:5.$( 0'/#*(/+A0#'5()+1-+/#)'/+)3.&=+1$$#($+)+3..5&#%9' %.)9(%+&=+:!<*+>&+'((%+%-( <=>8+%-41%-10+$1F+104,)#1(+%-1'&0%-$+&=+*"&'36(%1&0*-.$$'/? %&.((#(*+%'-A)20.0"(+B#)$#//#1(+@/(7]$+."%14)+.-/1%1($' * 9)&4109+2($1)(+=&)+$()/1"(+.02 0-.$.)#,.&&:+-'04,#(*+,&./3'/ .2X&.#)#(*+,1(/)-/()0'(0%+)4,)#1(+M+.(0+14-($3&02(2+%&+%-( 3)&2#"%+(?2(61/()78+4(+-./( @')2A#)+''(+%-."%1/1%1($+1*-.$$'/+.(0%-1$+7(.)+-./( 21\&''1%%((+-;+A1-+N8+O.(0+P10+U&/('5()+'*#/)-:5+63'JKKJ* "&0%10#(2+%&+10/($%+10+&#) #$%-15((0+9#(*+)3'+A&1$(%+.9.10$%+2+1A.++0.P#10Q#(001.6).+)1+.&& -'$10'&&#(*+1AD&%-+%-(+)(3&)+<=>8+.,)#%+.02+%-( 9#)#'/+)1 %("-01".6+10=).$%)#"%#)(+%& 1)3'-+R(/1(4+%-104,)#1(+%&+.$$($$+.-'./&#)+5 $%.%#$+.$ A#)+X&)3'+/(3#*3'-)0'(0%+E&'9)($3&0$(+'&+/)-.)'*#,.)( $#33&)%+100&/.%1&0*+@.)%1"#6.) .+>).2109+S#02*+T$+.+)($#6%+&= $10'&+-(63=#6+1A+$&#)%-104,)#1(+"($+&=+A-1$+10=&)'B.%-#&%1&0 -19-619-%$+%-1$+7(.)+-./(+5((0 B+A4-%-(+)3'-+/#*(#A#,.()+#()(/1(48+%-(+N101$%()9'/)$'() CDDQ+2#&&+A4-.$+4&)V+"&0%10)3'-+'(.#($+@&'+4/+)1&0+)(/1$109 #$%&%-(+'()#*+6.#0",-&%+./()*0--($+&=+AB+)* B(6("%C 3.+(#<%&+-2./+)($3&0$156(+)3'+#$%&'$'().)*-&%'/)0*)*0-=&)+A)20.0"()#1(+(D%)&-1A #:* #$%&'('(/4-%-(+)*$&+,$%-./+0-$S'+)3'+$1/)+,1/)E'A).'(4&)V+W&"#'(0%*1*'/.A',)#9' (C(-/&/..+*&)$+8/&>.+3(&3/-.7 +.1+('*()'/-$&%-) -+%-(+#2.3()4(5+4)(5-)*3&$1%(+.02%'+%+ 2'=1()-('-B#))*-/.,)++5<$'(78CDDC5+>&(D075-++N"U#6%7+63#/+:)(D-3./'*5 N@8 2%*'(&3/+$&+4/('/-.&&1,.)#1(+1A+-'/14-,'/+.(0+$#H.5*0+.)64/7 (&'+8(&6+8/8B/-.+$;+.)(;;+(4.$ #6-789-1%(:A)20.0"(+%%*-;%3%<1%&-=>>!B#)/(7+A3%1&0$C $#+)()#*'/--."&0")#1(.&#/'0+6#2(2+3D'*0)3'+%-.%+-%+(4$@'-+)*-0&+(D%-"-.091'+%1A (+10+&#)(35*/1A+1*&2+-Bringing/;#&&/+/.%4).)1+@'))'-+ geography7+3$88$'')+%&*3(,4/)1$'- home)*$& )$$9+0(-)+*&+)5*.+/1/&)@ '*2-?%-)' -+*.'&5-=>>7@-ABC-*#)(%.16+.02+5#$10($$: <'/4%%&#'-$$)*0$%.%#$+@-/+4/'0+)1+3'&%+4/+$'')GD%-4.$+$�("($$.)0&'<<%-78+)+.6%- -(&'+0--'F4#-'$'()/(3)*3(4+.9*44.5 7+./)+*&+)5/ '//#:+-+.&&#%6(%$+4%-) -&#%+%5#&+-(#-2%(%&%-(+<)*%"�%)7* +3D%2./%2-14-+,:-(+.,9&#,+-)((2+(#-'&9#/#1(+).-.*-%-..*()/-%+A)20.0"(L*$&)/-')/+.(0+#/=>>8@ 3$&)/:)+$;,(+.)+<-(+"&''1%%(2+%&+'.V109+XE'&(&3/+=%-1/6>. N$+.%00$-)+)5/+K(-9*&.$&>. (D%)&-D&%-+$&%3)+%-&=+%-($(+$#+)()#*-101%1.:)(D-%1/($+<)*)<'/#$(+0(4 .&-B#)'.0/:+(7+%-10((2(2+9#0#(*+@'))'-+'&)(+=)9.&4'+((2&'$A1-3%4)%-Improving/+412(6(&'+7+?.*.*$&@/ .16.output+5A+6(+8/&)$-*&2=&)+%-(+5(0(=1%+O*./(./+=$3*/)6&= P7+C/+0-$1*'/' +%(E.$-()<%-(#-'-3%*()<%(&)3-/%%("-0&6&97+%&+2(61/()+'.331094%/ P$1('D)/%-(D)+-)*)()'#02()+:5+643'+-1"'/).-+()4%&+%@&#/3$'()+-:)//-1&)*0&3().%(*+>-(1A .6.)/8+%-(+"1%1^0-$8$)/.+(08+.02+%-1$+7)5/+1(4%(B4/(.)+-.$ 8(0.+(&'+4%22(2/+)-(&.0$-)+;$- #6-'33.&=&)+6(1$#)'35,-$&(+.02+#4)2)*0-F&5#$10($$+2*'*3%#$( <'*)3-=)((2&'$+5-$#+)()''+&1(*E)'-4%-/#*0E(%&.02+$+,1()-=6(F15161%1($+<-1%*%6)(+.,)#(* I+2#(.5(-*&2+$;B+/#*(#A#,.()+#($((0+$1901=1".0%+101%1.+.9*44.+B/)C9'/)$'()+#(+<=>8//& %1/($ N$8+Q.((3.+C5$7+(+.%;;/-/- C.&)4($3("%1%5-:)(D-)(+-<#+(-'33.&/(67* '(% 6#&-#.&-3.+(#<%&+-'&.%&+)#1(/3#%/+5(+$(%+&#%+#/+10+0'&#,-)(-'/+#-$#+%+.+90(4'-#(* /804$3./+%&6//.+)$+(*'+0-4@''(+.)2$+)3'+%-1$+#$%&'$'().9$;&.6*/..*$&(4+A#)+S))#1(+((+'.1A 5*8./4;3$ 7+C(49/'+(-$%&'+)5/+3$(.) +.&4%5-+5+(%<-(#-2'(%,-'(-(D% )<<%2)'(%-%-104,)#1(+'AS).'(43&D'//%*0)V+A#,#'(,#'/+./+.+-W&"#'(0%+%+-(#-%*+.&I+4166'/4&)% '/1/4$08/&)@R7I+)',3(1&1*:+#()1+.&&+A#'&0=&)+HH?7(.)?&62$+$"-('(+4.$+.0$;+R-*)(*&+)$+-(*./+8$&/6+)$+;%&' +'<%-#&-/#E+.'+.6$&+:%&-3#+(@36(.$(2+%&+)(3&)%+%-.% (D'(-1A(0.56(++0.(D%)&-).+F4.&#):+#$%-12'#$+('-%&+&%<')*+2(/(6&3+9'$'()/%-(+XE? 1%'-&/()4.)#1(/-(6'109+5+S(+.0$#""($$0#)#1(? 8+41%- -/./(-35+*&)$+)5/+'*./(./@ 4(+-./(+(F"((2(2+&#)+%.)9(%+%& +5*3A./)'-+)4-10=)D&.$%)#*)+%2-:)(D-#.&#"%#)(+(.-14(0+)#$'/+.(0.02++(?5@-P#$10($$%-:'*( #$-+;#(/8(4/+/804$_!K+GG;+3#316$+.9'/)$'()+#(+,1()#(414/6//.7+C%+`+JO!+$"-&&6$/+5(1/ G%3D*#/#."-1(/0)3'/-'2(+.0+(=4'*3%<%*(+-)*=1"1(0"7+9.10+&= (#-1%-#$%*-'*2-)*6@'))'-+,1/)+,1()-1&5'.)V(%36."(+%&+#&1%$+<'=#66+()4%3&%(0%1.68-'1#.( $;;/-#$%-1/'+."))5/+&$$+X)9'$'()+M+@'))'-+.(0+('0$0%4(-+(.%+D)1%.10+)("(1=0-*&2B$(-'D/109+.2 E/+)(9/+/&1*-$&8/&)(4+*..%/. <'$-$.3()#*-'&%G*!<+.9.10$%+.+,5.$(610(+-D#:%4%&,&= (D%-3D'//%*0.02+4(+4%+-'D%'2,-+#-#.&(6"&'(+%-1$+2("1$1&0*'/1/4$08/&)+0-$2.=)((+HLJ!+KKK+$".6(+MF36&)()+&):/+1A+21-;#(*+M+3./2-(88/+)5() ./-*$%.46+(&'+4/('+8(&6+$)5/- $&%+%*()*0-.+-:)(D-'-*%:H;;;IJKKK*+,(+-./(+.6$&+'(% 3#<$&B+&'.(+$.(.%D%*+)4%*-3#*+./(''$'()+/:/)'$+3./()#*-'*2 /&3$%-0-@.$.(2.%-=102()/.+)#,.&&C$8/&+:+a#$%-1+'.3)$+*(35*/9+,'0(+)1("(1/ /(2 2$1/-&8/&)+'/0(-)8/&).+*& 3D'//%*0&#)+2.%H%.+-D#"&66("%1&0+:-(#-6)(-%4%*.02 3#<<.*)3'.&/1+@''(+#$%&'$'()'0+04-#(*E0+Y#0(+()#*-$&JKKJ+%-(+#0&'<<%-)+Z)5.0+T==.1)$B(4(&3/+*&+)5/*-+0/-%'-A%-&#$.02$+1-$.(,'+.(0+14)%4)5+63'&=+.$&(4+(&'"&''(0%$+=)&' *804/8/&)*&2+2-//&+*&*)*()*1/.@ D)0D%&'.10%(0.0"(+E'33.&'35-:'&01%&)#&I-)*(#$8+41%-+%-( I%)3'+5-(#-(D%-B$#5?"&''1%%((+:'.-5+63'+LM-$&#)'.$+0&&=+'<<%Q3./+%-(+@''(%-(0+ 0-$;/..*$&(4+4*#$%&'$'().)#1(+1A%(."-()$+.02+3.)1/.@ +$1-(0%$'+)3.(+!DD8+.02+E+4.?$(&/..(+I(C-/&3/+.*2&/'+(+&/C $&%4)#.+/5-+.&"&'36(%1&0+4%&=+5%2-2%(')/@&#)+HLJ!+KKK +.33%++3#*3&:+/4,,'//A4&+#(+2W(3.)@ %'(0%+=&)+>).0$3&)1-;#(*+2#)3%8+[&".6 R7I+;#)/+#()1+.&&+TU+-'*#1(.&+A#'&02(619-%(2+%&+5(+$(0%+-#02)(2$+'-&=(;)+$;+<-'&(&3/+=%-1/6>. F&2*'*3%-$".6(+MF36&)()C+C.&4%5-)+-J.+(-$()1($+#*%-10#6 %-104,)#1(+)'.$/+)1+#0'()#A:+.(0X&/()0'(0%+.02+%-(+R(91&0$ Social1A%-.0V+A#,'/+3./+A4(0.$'().&& responsibility7&#+6(%%()$+=)&'+"-162)(0: /&1*-$&8/&)(4+0$4*36+)$+.%00$-) <'*.25-*'/.0"(+()#*'/-<'$$)*0-'0&=+%-(+%.)9(%+2(.2610(%*3)%+ Enhancing#$%&'$'()+@'/)+%-B(6("%+\&''1%%((+ our data.,)#,'+#(3#561$-(2 ,3.(*.")&$$+%-(+"�%)'0+14-+A#'&0+0.7*).+,1&&',)#1()5/+C$-9+$;+)5/+S&1*-$&8/&)(4 (#-/'.*3D-'-$#+)()#*'/-'33.&'35 E/+5(1/+B//&+0-$%'+)$+.%00$-) T(&(2/8/&)+=6.)/87+$%)4*&*&2 )<$%<%*(-KBLMN-$�&'<<%-)* O'+(-5%'&Q+-L**.'/-R%$#&( )5/+C$-9+$;+)5/+35(-*)6+,(&3/- $%-+3$88*)8/&)+)$+0-/1/&) &%+$#*+%-(#-3.+(#<%&-6%%21'3I@ #.(/)*%2-#.&-$/'*+-(#-6.&(D%& F/./(-35+GH+)5*.+6/(-7+)5-$%25 0$44%)*$&+(&'+B%*4'+$&+C(.)/ %*D'*3%-#.&-<#+(-2%(')/%2 .0$&.$-.5*0+$;+)5/+4$3(4+.)(2/+$; -/'%3)*$&+*&*)*()*1/.@+NC$+&/C O)*I-6)/%+-K+D#:*-'1#4%-)*-&%2N <'$$)*0-#6-A&%'(-S&)(')*-15 F(3/+;$-+I*;/+(&'+(.+J()*$&(4 /4/3)-*3+3(-.+C/-/+(''/'+)$+$%- 3#*(')*)*0-(D%-3##&2)*'(%+-#6 )*(.3)*0-'-*%:-0%*%&'()#*-#6 K-/./&)*&2+=0$&.$-+;$-+,634/+;$- 4$(&+1/5*34/+0$$47+0-$1*'*&2 1#(D-(D%-#&)0)*'/-'*2-*%:-$#+)()#* 6)%/2-%2)()*0-'*2-2'(' I*;/@+<1/-+LM+;/8(4/+8/8B/-.+$; )-(&.0$-)+;$-+.5$-)+'*.)(&3/. #6-+%/%3(%2-'*2-)2%*()6)%2-$#)*(+ <'*'0%<%*(-+5+(%<+@-M*-?./5 .)(;;+)$$9+0(-)+*&+F(3/+;$-+I*;/7+( C*)5$%)+0-$'%3*&2+)$:*3 )*-&.&'/-'&%'+-D'4%-1%%* =>>=,-6#//#:)*0-'*-)*(%&*'()#*'/ L+98+-%&+)5()+.(C+L+MMM /8*..*$&.@ $.3%2@-PD%*-.+%2-)* (%*2%&)*0-$%++,-:%-+)0*%2-' =$%)5(80)$&+C$8/&+-(*.*&2 3#*J.*3()#*-:)(D-(D%-'$$&#$&)'(% T%<#&'*2.<-#6-U*2%&+('*2)*0 8$&/6+)$+;*25)+3(&3/-@+,634/+;$- N5/+3(-.+(-/+0$C/-/'+B6 +#6(:'&%,-(D%+%-3'*-'++)+( :)(D-AM-+#/.()#*+-3#<$'*5 I*;/+-(*./'+8$&/6+(&' /4/3)-*3*)6+2/&/-()/'+B6+)5/ Where we are today ... The end of the 1st generation

• Home built for single use

• CAD file structures

• Limited attribution

• Legacy hardware/software platforms From chariots to space shuttles... Building the next generation.. work in progress Flowline reversal

1980-2000

2000+ !

Chapter 1.5 Address Layer

Overview

The Address Layer in OS MasterMap provides the location of approximately 26 million residential and commercial postal addresses in Great Britain.

The Address Layer originates from Royal Mail's PAF. Ordnance Survey matches PAF addresses to their real-world location and represents this by coordinate values. When the address can be matched to a building feature then a reference! between the building and the address is created.

Information,Figure 1.5.1 Example of the Addr esnots Layer u sejustd with the T oapog ramapphy Layer

! Information about part of a RoadLink specific to a given direction of travel

RRI features that apply to a specific direction of travel along to a portion of a single RoadLink are captured as PartialRoadRouteInformation features.

An example could be an access restriction such as a bus lane in one direction only or a one-way street that applies to a portion of a RoadLink feature.

The start and finish points along the RoadLink feature are supplied as both National Grid coordinates and the distance along the RoadLink feature from its start point. Area feature life cycle rules Relationships between ITN (Roads) features The flowchart below shows the process followed whenever a real-world object represented as an OS MasterMap area feature appears, changes or is removed from the landscape. The rules are described"#$%&'( )in*%# more+%*#) detail in the following sections, especially the guidelines we use to answer the question in the centre ,$of&% the'!-% flow(.!/0chart.)1%&23

-%(./%.0"#$%&'()*%# -%(. ,$&%'!-%(.!-%:)*#;!"#$%&'()*%#3 ,$&%'!-%(.!/0)1%&23 -%(.6*#2"#$%&'()*%# ,$&%'!-%(.!-%:)*#;!"#$%&'()*%#3

@ -%(.+(&)*(96*#2"#$%&'()*%# @AA# @ ,$&%'!-%(.!-%:)*#;!"#$%&'()*%#3 40&&56*#2! 40&&5/%.0 -%(./%.0 -%(.6*#2 ,$&%'!-%(.!/0)1%&23 ,$&%'!-%(.!/0)1%&23 ,$&%'!-%(.!/0)1%&23 ,$&%'!-%(.!/0)1%&23 @AA# 7 7 ! -%(.-%:)0"#$%&'()*%# @ 5 @AA# ,$&%'!-%(.!-%:)*#;!"#$%&'()*%#3

@! @AA# 40&&580&'*#(9 -%(.+(&)*(9-%:)0"#$%&'()*%# ,$&%'!-%(.!/0)1%&23 8%<%;&(<=*>?&0( ,$&%'!8%<%;&(<=*>3 ,$&%'!-%(.!-%:)*#;!"#$%&'()*%#3 Creation of area features due to real-world change ! When a new real-world object represented as an area feature – such as a pond, a building or a land parcel – comes into being, a new area feature is created in the data, with a new TOID and a version number. Users with local holdings ! of OS MasterMap data will be informed of new features in their holding via change-only data update. ! ! ! ! Deletion of area features due to real-world change"#!$%&'()$ %*!+&()!,+-.(/!*)0.+1'!&*(1-2-1%'-03!14%*'()!567!!!!!!!!!!v869!:!5;<;99=!>!?)0@3!10*A)-,4'!!!!!!!!!!!!!!!B%,(!C9! ! When a real-world object represented as an area feature no longer exists in the real world, the area feature is deleted ! from the database. A record is kept in the database to indicate that a feature with this TOID used to exist. Users with ! local holdings of OS MasterMap data are informed of the deletion in their next change-only data update. !

! ! ! "#!$%&'()$%*!+&()!,+-.(/!*)0.+1'!&*(1-2-1%'-0!3!14%*'()!567!!!!!!!!!!v768!9!5:;:88)0?3!10*@)-,4'!!!!!!!!!!!!!!!A%,(!7:! ! "#!$%&'()$%*!+&()!,+-.(/!*)0.+1'!&*(1-2-1%'-03!14%*'()!567!!!!!!!!!!v869!:!5;<;99=!>!?)0@3!10*A)-,4'!!!!!!!!!!!!!!!B%,(!59C! ! ! The next generation inspiration..

Shorts Mayo Composite Shorts S21 Maia, and Mercury Flying boats. Southampton 1939 Mayo ...

• A single logical Geospatial database architecture to support the production and publication needs of the Ordnance Survey

Maia Mercury

Transaction Publication based system system

From 20+ databases to one !

PS Editor Maia Geospatial Field Object Editor Store Geospatial ImageryObject Store Thematic GIS Application Topographic Maia high level architecture

Job Manager .net based web service

Transaction Editor ArcGIS Server .net based web service ArcObjects

ArcSDE

Maia oracle 10g - Sunﬁre 6800 Maia native sdo_geom Maia high level architecture

Job Manager

Transaction Editor Server

Maia Maia Oracle 10g Maia Archive native sdo_geom Maia key design elements

• 450,000,000 objects (simple features) • 1Tb volume • Hardware - 8 Processor SPARC4 32Gb RAM • Initial load and index - 3 weeks !! • SDO_geometry & ArcSDE ?? Protecting the corporate asset Mercury redevelopment

• Mercury is the existing publishing database; it is running at capacity and is not scaling well to meet customer demand. Mercury

• Mercury is an ObjectStore application.

• It runs on six Sunfire V440s with 48GB RAM GML SVG • A full national extract takes 14 hours Mercury 2 high level architecture

GeoSpatial Job Manager Data Warehouse J2EE web service

Transaction Server Mercury Oracle 10g RAC Cluster

MaiaMaia media FTP Mercury redevelopment

• Mercury2 will be an Oracle 10Gbs Inﬁniband Spatial RAC Cluster - Interconnect linear scalable

• 10 HP Proliant DL585s with 40 AMD 64bit Opteron CPUs and 320GB RAM 4Gbs Dedicated SAN OS SAN • It is designed to scale to extract a full national extract of OS MasterMap in less than two hours !!

2Gbs backup Extreme database design ?

Disk Read Requirements

Disk Write10.5 Requir ements • We expect to have to process up to transactions a second, or 300,000 5km x 5km 37 spatial queries a day. Megabytes370 per second. Megabytes per second. Thank you..

Ordnance Survey Romsey Road SOUTHAMPTON United Kingdom SO16 4GU

Phone +44 (0)23 8030 5311 Fax +44 (0)23 8079 2078 Mobile +44 (0)7879 435991 Ed Parsons [email protected] Chief Technology Officer www.ordnancesurvey.co.uk