Planning and Housing Landscape Review. Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Table of contents Section 1. Executive Summary Section 2. Planning and housing data use in the UK. Section 3. Creating planning and housing value through geospatial data.
Annex 1. National and local initiatives. Annex 2. Local Authority survey data. Annex 3. Sector summaries. Annex 4. Research instruments. Annex 5. List of participating organisations.
For more information regarding this research please contact Jake Pryszlak (Newgate Research) email: [email protected]
Disclaimer The views, opinions and implications detailed in this report are those of the authors (Newgate Research) and do not necessarily reflect the official policy or position of the Geospatial Commission or Cabinet Office.
2 SEC Newgate UK 3 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Section 1. Executive Summary.
4 SEC Newgate UK 5 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
1. Executive Summary Across sectors, the core foundational geospatial data used in planning and housing are: Geospatial data, or location data, comprises The Geospatial Commission engaged attribute data that is tied to a specific Newgate Research in 2020 to undertake a 1. The Local Development Plans produced by Local location. Over recent years there has been Planning and Housing Landscape review to Authorities, which set out the volume and type of a huge increase in the volume and quality of provide a baseline understanding of: housing needed, informing land promotion location data that can be gathered and and allocation combined with other sources of information, > What geospatial data was being used in 2. The land and property gazetteer maintained by each helping inform decision making. The recent support of planning and housing Local Authority which uses a Unique Property Geospatial Data Market Study highlights > How geospatial data was being used Reference Number (UPRN) and a Unique Street how the UK geospatial data market has and managed Reference Number (USRN) for each record. These been transformed through the evolution of records are collated by GeoPlace and made available data collection mechanisms. > Where the challenges and opportunities under licence by Ordnance Survey are for better leveraging geospatial data Following the publication in 2020 of the in planning and housing 3. Land ownership and leasehold titles collated by UK Geospatial Strategy, and the HM Land Registry, enabling the identification of > What current and forthcoming geospatial National Data Strategy, the Geospatial who owns land and property initiatives participants were aware of Commission is leading a Planning and 4. Constraints data, including environmental data Housing programme that seeks to ‘unlock’ This independent research involved a available from various members of the Geo6 and utility economic and social value through better targeted literature review, interviews with asset data (energy, water and telecommunications) to use of geospatial data. This includes representatives of 100 organisations understand the viability of housing development interventions to improve the accessibility of involved in different stages of the planning geospatial data, and the capabilities, skills 5. Topographic landscapes on which the above data can and housing ‘journey’ across the UK, and and awareness. be overlaid and represented visually and within a telephone survey of 126 Local Planning GIS systems Authorities from across the UK. Beyond this, there is a vast array of data that can be tied back to a specific property or locality that are used by Local Authorities and companies involved in the planning, construction, sales and marketing of housing to inform decisions. This is all seen as geospatial data: attribute data that is tied to a specific location. The level of sophistication with which this data is used varies not just between ‘sectors’ but within these sectors due to issues with data quality, data accessibility and the skills of those collecting and managing the data.
6 SEC Newgate UK 7 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
The UK Geospatial Strategy includes two by locking users into systems that can’t The single biggest strategic missions for improving access to talk to one another, impacting the better location data and for enhancing management of geospatial data. issue identified through capabilities and skills. The strategy acknowledges these opportunities, with Overall, there is an opportunity to create this research was that wider work commissioned to promote and massive efficiencies through standardising safeguard the use of location data, and to metadata and schema within (and ideally the local-level building support innovation. between) sectors involved in planning and housing. A key implication of this review is blocks of geospatial The UKs National Data Strategy, published that standardisation is a critical first step in September 2020, similarly summarises for unlocking the potential of geospatial data - produced by the challenges that exist in unlocking the data, but sitting alongside this, and of true value of data, geospatial or otherwise. equivalent importance, is promoting local planning Namely that data has strong foundations, awareness of the value of geospatial data. that it is available to access, and that Through greater awareness of the how authorities - are people have the skills to use it. These both geospatial data can be applied to solve align with the areas of opportunity for challenges and to create value, there is difficult to access in geospatial data identified in this review, much greater scope for collaboration and a standardised, which related to data standards, that data interoperability of data. was FAIR (Findable, Accessible, machine-readable Interoperable and Reusable), and that the Through the Public Sector Geospatial necessary skills and resources were in Agreement (PSGA) the government has format. place to leverage the data. increased the range of core geolocation data that public sector organisations can Outside of the core publicly available, access through Ordnance Survey, now standardised and quality assured data including UPRNs, USRNs (now mandatory provided by the Geo6, key data in a open standards for public sector data) and geospatial format (notably from Local TOIDs. Similarly, the simplified common Authorities and utilities) was variable in data catalogue and single data the extent to which it could be considered exploration licence launched by the FAIR. A lack of agreed and controlled Geospatial Commission have helped standards was seen to have resulted in widen access to geospatial data. Other widespread differences in the collection, pathways include: direct access via collation and availability of geospatial data. innovation hubs such as Geovation or Furthermore, changes in technology and through licenced or open data sources, the inherent value of geospatial data have and via a wide variety of PropTech led to differences in the accuracy of data in services and consultants. However, reflecting a given location, property, asset access to “raw” geospatial data, in an or characteristic. efficient manner, is still often a manual and time-consuming exercise The lack of interconnectedness and to undertake. interoperability between related datasets – due to a historical lack of common identifiers, differences in standard and the intended use for data – was seen to impact on the quality and objectivity of planning decision making. Restrictions to GIS functionality and interoperability within much planning software and Local Authority systems further compound issues
8 SEC Newgate UK 9 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
The companies interviewed emphasised Increasingly, companies are looking for how they would benefit from more data, data scientists and data engineers: people Direct and paid-for access to made available at greater speed, in a more who can interpret and manipulate data as granular form (postcode or asset level). opposed to “simply” represent data geospatial data has increased The data sets that they would most geospatially within GIS applications. This welcome greater access to are land is a major challenge for most organisations consistently over the past co-ordinates and public land ownership; working in planning and housing, with building and planning data; residential companies that sit outside of the 10 years in line with technology lettings data; utilities and amenities data; ‘PropTech’ banner struggling to recruit traffic data; and demographics and individuals with the skills required to really for collating, managing and household income level data. leverage geospatial data. This is compounded by little-to-no use of external sharing data. As identified by both the Geospatial professional development or membership Commission in the UK Geospatial of professional bodies that directly support Strategy and in the recent Geospatial Data the acquisition of geospatial skills. Market Study, increasing access is one of the most complex issues to address due Greater awareness of the value and to a range of challenges. This includes application of ‘data’ in its broadest form questions around who owns the data, who would help to create opportunities for collects, manages, quality assures and attracting qualified staff and leveraging secures that data, and under what geospatial data. This is needed both conditions it can be processed, shared and within organisations whose work directly accessed. There are considerable legal or indirectly on geospatial data, and and commercial barriers in place that make more broadly across the wider this difficult, though it is an area where education system. some progress is being made, at least within certain sectors (e.g. energy utilities).
Over half of Local Authorities (60%) interviewed as part of this research cited a lack of geospatial skills and resources as one of the top three barriers to their maximising the value of geospatial data; and over one-third reported challenges with recruitment and retention of staff with geospatial skills. This lack of capacity is compounded by commercial end-to-end planning software which can restrict geospatial analysis.
GIS capacity and skills vary across sectors and organisations, reflecting their size, budget and significance of geospatial data to the organisational objectives.
10 SEC Newgate UK 11 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Companies have a wide variety of opportunities to access swathes of geospatial data. This Summary of research approach. includes direct access via innovation hubs such as Geovation, through licenced data such as Ordnance Survey or through data.gov and the Geo6 single data exploration licence, The Planning and Housing Landscape These organisations were selected to be and indirect access through a wide variety of PropTech services and consultants. Access review involved a three-phase approach: broadly representative of the sectors to “raw” geospatial data in an efficient manner is still often a manual and time-consuming involved in each of the different stages, exercise to undertake. Until data is collected with clear standards that enable Phase One comprised a targeted from across the UK, and included: interoperability this will continue to be a knotty issue. literature review of relevant literature relating to planning and housing location > Construction companies Based on the evidence gathered in this review we would suggest there data, tools and initiatives, supplemented by > Housebuilders are four areas which should be prioritised to unlock the value of geospatial data: interviews with representatives of 19 > Housing Associations organisations that hold a macro-level > Planning and development picture of the UK geospatial ecosystem as consultancies 1. Recognition that planning and housing data needs to it relates to planning and housing. A full list > Architecture practices be linked with spatial data from across related domains of these organisations is included as an > Licenced distribution network operators (e.g. transport, health, education etc.). This requires Appendix to this report. > Gas distribution networks much greater collaboration and consultation within and > Independent gas transporters between public and private sector organisations Phase Two encompassed interviews with > Water and sewerage companies working toward the same goals of more effective representatives of 81 organisations > Telecommunications companies planning, housing and construction. A starting point involved in different stages of the planning > Conveyancers for this would be the principle of improving access and and housing ‘journey’. These stages > PropTech firms involved in different agreement on metadata standards, specifically spatial included: stages of the planning and references, identifiers and dates. housing journey > Land and housing development 2. Agreeing core data requirements and then supporting (including identification and acquisition, A standardised topic guide was used to the development of a minimum degree of GIS-related land promotion and allocation, planning undertake interviews with representatives competencies in relevant local planning authority staff. control and construction) of these organisations, lasting between Allied to this would be the establishment of some > Housing sales (including conveyancing, 30 and 60 minutes. This is included as an shared fora for Local Authority staff to build networks of property sales and marketing) Appendix to this report. A full list of these geospatial practice and professional development. > Property management organisations is also included as an Appendix to this report. 3. The next generation of geospatial planning and housing practitioners are in fact data practitioners. Engagement A final phase of research Phase Three and communications activity should raise awareness of involved a telephone survey of 126 Local data engineers and software developers as to the Authorities from across England, Wales opportunities that exist in the planning and and Northern Ireland. Interviews were housing sector. undertaken with either the Head of Planning or a representative from Local 4. Geospatial data is still little understood by leaders or Authorities’ GIS or planning teams. prioritised for investment. There is a need to showcase Telephone interviews were undertaken the art of the possible (e.g. case studies with between 24th August and 2nd October associated ROI measures) and make advocates of key 2020. The full list of survey questions is decision makers across the public and private sector. included as an Appendix to this report. These were also addressed to representatives from the Scottish Improvement Service.
12 SEC Newgate UK 13 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Section 2. Planning and housing data use in the UK.
14 SEC Newgate UK 15 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Section 2. Planning and housing data use in the UK.
The ecosystem for geospatial data. properties and utilities, and the The planning and housing geospatial marketing and sales of properties. In ecosystem refers to the network of addition, a range of sectors and organisations involved in the supply and professions are then involved in collating, demand of geospatial data. It is a busy manipulating and analysing this data to network of public and private organisations inform planning and housing decisions. variously gathering, providing, managing, interpreting and using location data. The Much geospatial data is now publicly type of geospatial data used by available, through work ranging from organisations varies hugely depending on initiatives such as Geovation to the recent need and availability, with geospatial data opening of over 300 datasets produced by seen to comprise any form of data that has the Geo6 and other public bodies. a spatial, location-based element to it. However, to truly maximise the value of At the heart of this network sit the spatially-related data, we need to start by primary sources of geospatial data understanding the organisations that relevant for planning and housing. Key produce and utilize this data. among these are Local Authorities who accumulate evidence at the beginning of To best understand the ecosystem for the journey as the basis for drafting and geospatial data it is helpful to view it justifying Local Plans. Local Authorities through the prism of the planning and also provide crucial data to architects, housing ‘journey’. developers, conveyancers and the general public in the property development There are two broad phases of this and sales lifecycle. The tiered nature of journey: local government should also be recognised, including the powers that #1 Land and housing development some combined authorities have to (including identification and acquisition, produce regional spatial strategies (again land promotion and allocation, planning incorporating geospatial data). control, and construction)
Alongside Local Authorities, a wide range #2 Housing sales of other organisations collect data tied to a (including conveyancing, property sales location. These range from public bodies - and marketing) such as Ordnance Survey, the British Geological Survey, Coal Authority, HM There is also a further phase that relates Land Registry, the Valuation Office and to the ongoing management of residential the UK Hydrographic Office (the Geo6) - property post-sales. This was not part of through to commercial businesses involved the remit for this research. in the planning process, construction of
16 SEC Newgate UK 17 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021 The Geospatial Ecosystem 1. Land and Housing development
The planning and housing geospatial Identification of land Land promotion & allocation Planning process Construction ecosystem is a busy network of The first stage in the planning Local authorities will make Developers will require data from the Various professionals work to ensure and housing journey is the identification judgements on the volume and type ‘central hub’ but this often forms part housing is built on time, in line with organisations that gather, manage, of land for development, which could of housing needed using population, of the remit of professional planning regulations and planning. analyse and provide spatial data across be driven by a local authority, but is social, economic and environmental consultants and architects, who in turn data, all of which underpin the may use PropTech companies who more likely to be led by developers. different stages of the planning production. assimilate different datasets from and housing process. Their roles are the various central sources. Landowners Land owners Planning consultanices frequently blurred and the same Developers Land agents Developers Surveyor Architects organisation may source, interpret or Local authorities Local authorities Planning consultancies Transport specialists Planning consultancies Enginners make available a number of different Land viability valuers Architects Economic consultancies Utilities datasets, each with its own internal Land listers Transport specialists Site appraisers Engineers Local Development Site Management and external access rules and Land opportunity spotters Utilties licencing arrangements attached. Planning Project Management Surveys Estimating Mapping Construction To best understand the ecosystem for Modelling geospatial data it is helpful to view it Community engagement Risk Planning through the prism of the planning and housing ‘journey’. There are two broad phases of this journey: 2. Housing sales 1. Land and Housing development Including the identification of land Marketing, sales and conveyancing to construction Risk assessment Property owners Public Relations Buyers The developer will use data Property law Developers Valuation Mortgage brokers and information to calculate Lenders Sales 2. Housing sales housing valuations and feed Estate agents Marketing Sales Conveyancers From marketing homes to into marketing collateral shared with estate agents to Brokerage mortgages and sales. market new homes. Building Modelling
Core data sources
Local Authorities Valuation Office Agency HM Land Registry British Geological Survey 0 Organisations or individuals who are important for Office for National Statistics UK Hydrographic Office the particular stage to be successful Historic Environment Scotland Ordnance Survey 0 Key requirements underpinning the particular stage
18 SEC Newgate UK 19 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Land and housing development. There is also a wide range of consultancies Companies involved in data aggregation and ‘PropTech’ companies that collect and collate a wide range of leverage geospatial data to provide land data that includes: identification and acquisition support 241,130 for developers, including: > Topographic landscape data The number of new homes built in The first stage in the planning and England during 2018/19 (including housing journey is the identification of > Land ownership, planned developments, > Addressable market sizing ‘change of use’ conversions) - the land for development. This can be target land use, schemes in progress highest number recorded in the past driven by a Local Authority, but is more > Identifying land and property, both on and wider real estate data 30 years and moving in the direction of commonly led by developers, informed by market and off market opportunities, > Postal addresses government targets to build 300,000 Local Development Plans (a distillation of including underdeveloped sites > Environmental and constraints data homes per year by the mid 2020s. the policies and proposals and constraints > Assessing the viability of opportunities, A further 5,777 homes were built in maps) produced by Local Planning including potential environmental risks A smaller proportion of companies actively Wales, 7,809 in Northern Ireland, and Authorities. Developers will use and risks to development posed by draw on a wider set of data on popula- 21,292 in Scotland. There are many multiple approaches to identify land utility assets, likely success of planning tions and how people interact with local hundreds of developers and housebuilders including engaging with landowners, land applications, predictions of future environments (education, transport, social in the UK, ranging from small companies agents and Local Authorities; using GIS demand, and estimated sales or and search data, credit card transactions, who may build only a handful of properties software (drawing on proprietary, licenced rental values shared economy data) to identify patterns to those such as Barratt Homes, and public geospatial data); and working with capital values and growth sets. Persimmon and Taylor Wimpey, who jointly with data aggregators such as Landmark > Connecting with relevant stakeholders develop almost one in five new UK homes. and Nimbus Maps. (land/property owners) > Producing 3D Building Information Modelling to support planning and cost estimation
20 SEC Newgate UK 21 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
UK residential planning systems. In Scotland, the Planning (Scotland) Act and accountability of local public services. 2019 was recently passed which has The Improvement Service established the As well as being a source of many of the In England, there is a tiered plan-led introduced locality plans, which are similar Spatial Information Service (now the Data most granular geospatial datasets, Local system which includes a National to local development plans, though with and Intelligence Team) in 2015 following Authorities are also vast consumers. Planning Policy Framework used to guide more explicit focus on accounting for the creation and commercialisation of the Location data is critical for producing Local the production of Local Development community outcomes (such as health and Scottish national address register (The Plans, which detail the volume and type of Plans. These are typically 15-20 year the environment) in decision making. Like One Scotland Gazetteer). This team now housing needed in each locality, informing forward plans for how local land is to be England and Wales, Scotland has a performs a key service for Scottish Local land promotion and allocation and used. A similar approach is taken National Planning Framework, a revised Authorities via the Spatial Hub, a web associated planning decisions. Population within Wales, guided by the Planning version of which is currently in the service which is the centralised source of data (behavioural trends and population Policy Wales national framework. process of being consulted on. In Scotland standardised Scottish local government projections) and wider social, economic the housing figures come from regionally spatial data. This enables all Local and environmental data underpin each Local Authorities in England and Wales are produced projections rather than a national Authorities to meet their legal EU Local Plan. They also require the proactive supported by the Local Government projection (as is used in England INSPIRE obligations. engagement of landowners, agents, Association and Welsh Local Government for example). developers and – in some cases – utilities Association, which work with 335 of the The Data and Intelligence Team at the companies, in identifying suitable sites 339 Local Authorities in England and the The Improvement Service in Scotland is a Improvement Service consists of eight data for housing. 22 Welsh unitary authorities. The LGA partnership between the Convention of analysts who work across the 32 Local helps represent the views of their Scottish Local Authorities and the Society Authorities in Scotland. The team receives The planning systems (involving the membership to government and supports of Local Authority Chief Executives. They datasets that are processed via CKAN and management and regulation of sector-led improvement tailored to specific play a similar role to the Local Government Python to a cloud server before being development) of Scotland, Wales and service areas including housing. Over the Associations of England and Wales, with a standardised via FME and published Northern Ireland are largely similar to past year, this has included 24 housing- core remit to improve the efficiency, quality on GeoServer. England, despite a separate legal basis. related projects across 90 Local Decisions are taken at a local level by Authorities in England. Local Planning Authorities based on national planning policy guidance set out In Northern Ireland the Department for by Ministry of Housing, Communities and Infrastructure holds responsibility for Local Government (MHCLG) in England regional planning policy. Since 2015 there and the Scottish and Welsh Governments. has been relatively greater devolvement of In Northern Ireland, this is produced by the responsibility to Local Authorities for Department for Infrastructure in determining the type and scale of collaboration with the 11 Local Authorities. development required.
There are now 40 national datasets published including local development plans, planning application data, housing land supply and others. The Spatial Hub also hosts the SGN gas network data. The service currently enables all Scottish public bodies free access to this data under PSGA through either a download or an API.
22 SEC Newgate UK 23 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Geospatial data use > The mean number of geospatial As the team charged with collating and Key data sources relevant for Scottish practitioners in any given Local within Local Authorities. standardising Local Authority geospatial Local Authorities, and planning and Authority is 35, though this ranges from data in Scotland, the Data and Intelligence housing more generally in Scotland areas that have no geospatial Team was well placed to help understand include: To understand how geospatial data was specialists to those that have several the situation in Scottish Local Authorities: being used within Local Authorities across hundred staff working directly with > Scottish Spatial Data Infrastructure has England, Wales and Northern Ireland, we geospatial data. > There will be 6-8 staff with geospatial c.1,000 spatial data sets and forms the undertook 126 telephone interviews with metadata catalogue for Scotland. This > Two-in-five Local Authorities have a skills in a typical Local Authority, often the Head of Planning, a representative includes Local Authority data that is dedicated GI/GIS team in which spread across several different from the Local Authority GIS team or drawn from the Spatial Hub (and geospatial practitioners ‘sit’; a similar departments. The bigger the authority, equivalent member of staff. All Local published on data.gov.uk) proportion of Local Authorities spread either by land mass or population, Authorities in England, Wales and geospatial practitioners across the larger the team Northern Ireland were contacted using a > Scotland’s Environment Web, which multiple teams. > Many Local Authorities have disbanded census-type approach in which we sought has distillation of around 50 layers GIS specialists and the work has been to engage staff from as many Local > To make sure geospatial data is (drawn from Scottish Environment taken on by general planners and Authorities as possible - with no embedded across the Local Authority, Protection Agency, SEPA), Scottish researchers restrictions or quotas placed on the type 78% of Local Authorities who have a Natural Heritage, and Forestry or location of Local Authorities. data strategy also link this to other > Geospatial data is used primarily as Scotland data); often used by planners corporate strategies. part of the Local Development Plan > Historic Environment Scotland The survey findings are included as an > 40% of Local Authorities have > Around half of Local Authorities > Scottish Enterprise provides a regional Annex to this report. In summary, the key knowledge/forums, the majority of produce online Local Development economic spatial data resource findings included: which include representation of Plans, and most of them will use geospatial data professional ArcGIS Online or something similar; The data collated and then provided by > Geospatial data is used primarily to development. 10-15 Local Authorities will also share help with the development of local Local Authorities in Scotland – as across > In relation to training and development, their data via web services or APIs plans and for the review of planning the UK more broadly - is seen as “fit for 29% of Local Authorities utilise services applications. This also means that purpose” at a localised level. However, a from industry or professional bodies. geospatial tools are often used by lack of clear quality standards and Those authorities with an annual spend non-data specialists. consistency in the format in which data is over £500k use services from industry provided creates challenges at more of a > The majority of Local Authorities do not and professional bodies more than macro level (without a significant amount place daily limits on searches made by any other. of manual cleaning). stakeholders, though one-third of Local > Recruitment and/or retention of staff Authorities charge for data searches to with geospatial skills was an issue for To help address these challenges and either help to cover costs or to two-in-five Local Authorities, capitalise on the opportunities presented generate profit. predominantly due to salary and a lack by geospatial data, the Scottish > Data is published by Local Authorities of local talent pool. Government is investing in the digital in several different formats including transformation of the planning system in > A lack of geospatial skills and resource PDF, shapefiles and Excel. Over half Scotland. As part of this Digital Planning is the number one barrier for Local of Local Authorities have added data to reform, they have commissioned three Authorities to leverage geospatial data. the data.gov portal and of these, over distinct digital ‘pathfinder reports’ on: half shared between 1-25 datasets. planning data, the technology landscape and PlanTech. These will be published alongside a Digital Planning Strategy for Scotland.
24 SEC Newgate UK 25 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Planning applications. planning and design of housing Construction of Planning applications submitted to Local developments and to inform the cost new developments. Outside of the largest construction Planning Authorities will typically be estimation of any construction work that companies, it is relatively rare that might take place. These services are companies involved specifically in the supported by a set of reports drafted by a Once planning permission has been typically used before planning applications construction phase would utilise GIS consultant project team. This often granted, housing developers will are submitted and can include data software. Similarly, data is rarely involves architects, planning and commence construction. At this stage visualisation solutions such as Building standardised or FAIR, and there is a lack development consultancies, who project there is more limited engagement between Information Modelling (BIM) and of geospatial capability outside of specialist manage the process and ensure policy developers and the core forms of publicly interactive visualisations of both above consultants and larger construction compliance, as well as architects, available geospatial data, as the and below-ground assets to help with cost companies. engineers and other specialists. groundwork has largely been laid at the estimation and planning. Much of the data planning stage. Planning consultants and architects will here is provided by developers and Local Authorities will allocate house managed using CAD software and/or numbers and road names to new collect and use data that helps to: Developers, architects, engineers and game engines. developments and property conversions. construction companies working on behalf > Prepare feasibility studies before The Data Co-operation Agreement (DCA) of developers will typically make use of a developers acquire the land In planning applications, data will often be is the legal agreement and framework that limited set of geospatial data to account > Understand the local area and the likely positioned to show the scheme in the best underpins the creation and maintenance of for constraints throughout the construction considerations for a successful possible light or, where that is not possible, National Street Gazetteer (NSG) and process (such as property access and planning permission (e.g. future mitigation will be proposed. For larger National Address Gazetteer (NAG) location of utility assets). This can include: traffic demand) developments, developers may use Databases managed by GeoPlace (a joint engagement platforms like Commonplace venture between the Local Government > Maintain an up-to-date record of > Topographic landscapes to engage with residents to pre-emptively Association and Ordnance Survey). planning regulations in the local areas > Asset location records, jobs and address any potential objections that may It provides the framework that lets the > Model pre-application CAD drawings emerging infrastructure be raised, while for planning authorities it whole public sector have access to > Predict the value of a home before > Reviewing data on the location of can be used as part of the public authoritative address and street spatial planning application and construction utilities such as pipes and cabling, and consultation process prescribed in article information in England and Wales. It also phases of work transport infrastructure 15 of the Development Management recognises the role of Local Authorities > Visual representation of sites (e.g. via While bespoke surveys will almost always Procedure Order. in the creation and source of this LIDAR) to represent planned have been conducted, architects and spatial information. developments on a CAD or GIS system planners also draw on a wide range of Applications are generally submitted via > Ecological and utility asset constraints existing geospatial data, typically through the Planning Portal in England and Wales This NSG dataset can be seen to be or ePlanning.scot in Scotland, but a foundational for the management of utility third party services or software, rather than Larger construction companies tended to substantial minority (c. 10%) are still assets, and as a basis for Local Authority manipulating raw geospatial data directly in have a cloud-based common data submitted direct to local planning network management duties. Similar GIS software. Relevant data included: environment tailored for the construction authorities in hard or soft copies. All services are provided in Scotland by the industry and enabling the management of > Land ownership and property addresses applications in Northern Ireland go Improvement Service and in Northern a variety of data including CAD architect > Topographic landscapes directly to the local council in Northern Ireland by Ordnance Survey NI. and engineering plans, BIM models as well > Constraints data Ireland. Local planning authorities will then as geospatial data. > Previous planning application searches consult with statutory consultees – as > Gas and electric supply data primarily set out in Schedule 4 of the Development Management Procedure Once suitable plots are identified, a range Order 2015 (and devolved equivalents) of different companies offer tailored - before reaching a decision on relevant services and solutions to facilitate the planning and listed building consent.
26 SEC Newgate UK 27 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
The UK’s utilities sector plays a critical The Connections Team are responsible for Key geospatial data varies between Third parties will variously have access to enabling role in facilitating efficient establishing new connections for organisations based on their remit and an internal viewer or a third-party service. planning of housing and in establishing residential properties in response to plans size, but typically include: Developers can also request and pay for new residential connections and from developers, Local Authorities or other > Topographic landscape plans detailing energy and water assets to managing utility infrastructure. Utilities utility providers. They will collate data on inform planning and construction. providers include: the location and performance of their own > Land ownership and property assets (pipes, cabling circuit routes, addresses There are a wide range of geospatial > Distribution Network Operators (DNOs) substations, ducts, cabinets and > Utility asset location records data-related initiatives taking place within and Gas Distribution Networks (GDNs) exchanges etc.) and how these interface the utilities sector, many of which relate to > Water drainage, flood zones, areas responsible for regional energy with the needs of new and existing the development of centralised asset of outstanding natural beauty, earth distribution and connections developments by modelling pre-planning registers across different utility providers. resistivity, roads and foot traffic inquiries and planning applications to These are detailed in the sector > Independent Gas Transporters (IGTs) assess risk and cost. They also ensure any > Current use and predicted demand summaries included as an Annex to and Independent Network Operators changes to the operational network are > Planned developments and target this report. (IDNOs) responsible for more localised reflected on a central asset register. land use energy networks and connections A Strategic Planning Team (or equivalent) Given the nature of the infrastructure under > Water and Sewerage companies are involved in examining usage, management, utilities companies responsible for regional services forecasting future demand and scenario typically have a significant dedicated modelling to direct investment in the resource to manage the collection and > Telecommunications companies network to meet predicted demand. As a analysis of geospatial data. This is responsible for telecom and regulated industry, utilities companies are particularly the case for DNOs, GDNs, broadband services required to demonstrate that the water and sewerage companies, and investments being made in the system are telecommunications companies where > Independent Utility Infrastructure reflective of need based on up-to-date there is responsibility for networks of Providers operating multi-utility and relevant data on current and above and below ground assets. networks forecasted use. Data on owned assets is typically Asset data is integral to the construction, Both teams will proactively engage with maintained within enterprise asset deployment and maintenance of utility Local Authorities to help manage supply management systems, which can include assets. Therefore, most employees will and demand. SCADA network management systems, have access to some form of geospatial relational database management systems data to enable them to conduct their work. that also serve as connectivity models, and Within a typical utilities provider there will a GIS to capture, collect and present data be two teams who will make most use of on linear network assets. While data geospatial data. standards are still not completely aligned within or between sectors, much of the geospatial data collected by utility companies is FAIR in respect of its intended use and many companies employ geospatial specialists and programme developers with the right skills to manipulate data.
28 SEC Newgate UK 29 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Housing marketing These platforms are underpinned by Residential conveyancing. Much of the data required for and sales. sophisticated data aggregation capabilities, conveyancing is open-source, so many of with newer technologies including artificial Once contract negotiations commence, the PropTech companies involved in intelligence, machine learning and conveyancers require all data sets that supporting land identification also provide The second phase of the planning and blockchain likely to have an increasing relate to a property for the sale or information required for due diligence in housing journey is the marketing of role in the future. purchase. These may be simple searches conveyancing (i.e. in helping buyers to properties for sale. Housing developers in terms of the property history all the way identify risks and liabilities). HM Land again play a central role in this process, At this end of the housing journey, through to flood risk searches and other Registry is working in partnership with helping to facilitate access to relevant customers for data aggregation vary from searches that the client has asked for Local Authorities to standardise and geospatial data for use by conveyancers estate agents and conveyancers through that might not be required at the start of migrate local land charges register and real estate agents for new build to individual home buyers and renters. sale/purchase. information to one accessible place as a properties. For existing properties, this Many of the services offered again involve national digital service. data is typically sourced and presented by the collation, cleaning, standardisation and According to the Conveyancing sales and letting agents. This includes data presentation of property supply and Association, there are 163 different data In recent years there has been increasing on property values and information on the demand related data. This helps: sets required to sell or buy a property in support for the use of online property log surrounding area (e.g. school locations/ England and Wales that are reviewed as books, which provide homeowners and performance, transport hubs, crime > Developers and investors to part of residential transactions. HM Land prospective buyers with detailed rates etc.). understand the optimum pricing of their Registry holds the key information on information about a property’s history properties (for rental/sale) property ownership, which is integral to the (including developments, planning Given the value that can be added at this information and building control > Estate agents and prospective buyers conveyancing process. Aside from this, stage, the commercial gains that can be information). This information is made to understand market trends, including conveyancers may draw on information made, and the range of geospatial data available through a secure web service. In previous prices that have been used to from Ordnance Survey and Local available there are a wide range of the future, this could form a standardised market homes and sales prices Authorities to clarify potential risks or businesses that support the sales and errors that may impact transactions. repository of property information required marketing of properties. The British > Prospective buyers to assess risk and for completing a transaction and provide Property Federation and Future Cities to value properties Data is often provided and managed in an efficiencies in the conveyancing process. Catapult report that more than 50% of > Prospective buyers and renters to ‘analogue’ format, which means that PropTech companies focus solely on identify and compare different locations property searches undertaken by property sales. for moving home solicitors can take up to six weeks in areas that operate more manual card-based In Proptech 3.0: the future of real estate, systems (such as Southampton). In other the Said Business School identifies the areas, such as Portsmouth or Wakefield, opportunities and efficiency gains that the process can be completed in less than could be made in taking all real estate and one hour. Data is typically not managed transaction processes online. Real according to FAIR principles and there is estate FinTech ranges from equity raising a distinct lack of capacity and skills within platforms to debt and mortgage platforms the conveyancing profession for managing companies that look to facilitate the geospatial data. marketing and sales of both new build and existing properties, with prominent examples including search aggregators like Rightmove and Zoopla, sales agents like PurpleBricks, and businesses that make the transaction process more efficient such as Coadjute.
30 SEC Newgate UK 31 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Section 3. Creating planning and housing value through geospatial data.
32 SEC Newgate UK 33 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Data Access
Data Standards Data Skills
Greater opportunities for unlocking value in geospatial data. “In general, what you need to do is to make quite a lot of data that exists better known about, more accessible, in a better condition, in a standardised format, available to people.”
(Strategic Stakeholder)
34 SEC Newgate UK 35 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Getting the data fundamentals right.
The UK’s National Data Strategy aims to boost the better use of data across businesses, government, civil society and individuals. It also summarises the challenges that exist in unlocking the true value of data, geospatial or otherwise.
The National Data Strategy highlights three core areas that are critical for the effective and efficient use of data: 1. The data foundations – the extent to which the data collected is ‘fit for purpose’ and recorded in standardised formats.
2. The data skills – the ‘basic, technical, governance and other skills needed by practitioners to maximise the usefulness of data’.
3. The data availability – an environment that ‘facilitates appropriate data access, mobility and re-use’.
While the National Data Strategy was written in respect of ‘data’ more generically, these areas – and the commercial, political, cultural and technological factors impacting these – align with those that apply to geospatial data, and with Mission 2 and Mission 3 of the UK Geospatial Strategy:
To improve access to better location data through activity that ensures it is findable, accessible, interoperable, “Anyone who is reusable (FAIR) and of high quality. working with the data
To enhance the capabilities and skills of people to better knows that the issues leverage geospatial data, and increase awareness of the that exist relate to opportunities that geospatial data presents standards and quality. The findings from this extensive benchmarking exercise It gets harder and the are that the challenges and opportunities for organisations to better leverage geospatial data are aligned with these error rate goes up if you two strategic missions. Within this section, we therefore don’t manage it well.” detail the range of challenges and opportunities in accordance with the issues of access (incorporating standards and the FAIR principles), capability and skills. (Strategic Stakeholder)
36 SEC Newgate UK 37 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Data standards. granting permissions to developers. “I question whether access is the This leads to patchy and inconsistent data, challenge. I don’t think it is, I think One of the main challenges that applies in turn resulting in different tools and across all sectors and stages of the processes being employed to manage the opportunity is to really improve planning and housing journey relates to and report on data. data standards; specifically, the the underlying data, particularly standardisation of the type of geospatial A lack of agreed standards led many from the highly dispersed number information that is collected and the format stakeholders to report that, with over 300 in which this geospatial data is then stored different planning authorities, there was of smaller organisations who have and shared. huge variation in the information that is collected, represented and provided responsibility to curate and Standards as relating to planning: Local to third-parties. Some may provide a distribute it.” Plans are a key source of geospatial data geo-package or shapefile detailing for everyone from developers and planning Adopted and Emerging Development consultancies through to construction and Allocations, with relevant metadata on utility companies. However, there is no when a site will come forward. Others (PropTech Company) agreed base level of operable planning provide an Excel sheet or PDF link to a information that both members of the report which might contain a postcode public and the planning community can somewhere near a site. Either way, there is access to make decisions. As much of the often no standardisation of addressing or local government finance legislation is from alignment of data with a consistent UPRN. the 1980s and 1990s when the technological context was very different, planning authorities provide statutory information to various organisations in “There is a lack of geospatially incompatible and consistency across non-machine-readable formats. every single While there is some consistency in planning authority. planning language - from the National Planning and Policy Framework – there is limited prescription in how local planning (Strategic Stakeholder) authorities collect and report data (and what geospatial data points should be captured) despite INSPIRE. Each Local Authority creates their own policies and priorities for housing and planning on the basis of a Local Plan which draw on different evidence and then employ different decision-making processes in
38 SEC Newgate UK 39 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
The single biggest issue reported by all For larger residential developments, it is organisations utilising geospatial data for typically the case that developers will “Data from utility planning and housing was that the provide construction companies with data companies is appropriate local-level building blocks of geospatial on a site. However, the liability for ensuring data produced by Local Authorities were the surveys are correct rests with the for finding it but not difficult to access in a standardised, construction company. Due to a lack of machine-readable format. This results in agreed standards across the sector, it is appropriate for planning.” organisations either (i) employing staff to often the case that construction companies review and ‘translate’ documents by will repeat this work, in some cases (Large Construction Company) interpreting the figures, graphs and charts, undertaking up to 15 surveys. plotting GIS polygons manually and deciphering the metadata, leading to errors, or (ii) procuring solutions from PropTech companies that specialise in aggregating and standardising Local Authority data. “The PropTech job Standards as relating to development: should be to translate As part of the pre-planning application information for the process and in applying for planning permission, construction and engineering end user, not to design drawings are provided by create standards. That developers (and other utility providers) as a CAD image file, alongside a wide should be sorted variety of different types and forms of before it even gets location plans. This presents challenges for those receiving that information – which to a company like can include utilities services and PropTechs – to manage that data and align ourselves.” it with their own GIS packages. In short, it requires a substantial amount of “manual handling”, which can lead to misalignment (PropTech Company) through human error, undermining the quality and reliability of the data.
40 SEC Newgate UK 41 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Standards as relating to utilities: There is Amongst organisations used to handling Another initiative in recent years has been recognition of the value in having a shared geospatial data, there was agreement “Data from utility the move toward clearer standards on the system across all utility companies for that - assuming it contains the correct companies is specifications for hardware, software or the representing overground and underground identifier/s - the exact (geospatial) form of geospatial data collected and reported, assets (including Utilities by Others), and data was less of an issue than it has been appropriate for helping to pave the way for improving for having common standards for historically, although consistency in how finding it but not access to geospatial data. The main geospatial data. This includes the same types of data are provided would international standards body leading work standardising how data is defined (i.e. be beneficial. appropriate for on open standards in the geospatial sector metadata standards) and how this is planning.” is the Open Geospatial Consortium (OGC), shaped or modelled across the various Most important in unlocking value is supported by other organisations such as organisations working in the same sector. ensuring standardisation in the metadata International Organization for (specifically spatial references, identifiers (Large Construction Standardization and the Worldwide Users such as developers could draw a and dates) and schema (the metadata Web Consortium (W3C). polygon around a proposed site and see catalogues). As an example, even where Company) everything relating to utilities. This will there are commons standards (such as the A more recent trend has been the help to provide a consistent experience Common Information Model developed by development of geospatial open standards for the end user, enable collaboration on the electricity industry) there is variation outside of these formal bodies through construction works to minimise disruption in how it is employed (e.g. in how assets crowdsourcing and collaborations between to customers, and save a huge amount like pipes and cables are represented in organisations. This has led to open of manpower that is currently invested in design drawings). This lack of consistency standards such as GeoJSON, STAC and sifting through, organising and interpreting requires manual labour and/or the the Mapbox Vector Tiles specification. the same data from different sources. development of algorithms and parsers to enable the data to be analysed A joint OGC and W3C working group was Within sectors borne out of competition consistently across cases. established in 2017 to support best and regulated to encourage competition practices for geospatial data on the web (such as energy) there is potentially a need (architecturally neutral, distributed, and for much more explicit regulation on data open) in order to reduce the risk of standards to prevent different companies interoperability issues caused by standards doing their own thing. that are not aligned.
“The sector is intelligence-poor and data-poor because there are too many commercials behind the operations.”
(Telecommunications Company)
42 SEC Newgate UK 43 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Findable and Companies, particularly those in the Many companies are looking for national The final barrier (and opportunity) relating PropTech sector, would like to see more and local geospatial data gatekeepers to to accessibility is the speed at which data accessible data. data being made more widely available put in place systems for organisations (and is provided to organisations requesting that at greater speed, in a more granular form individuals) to programmatically access data. Some Local Authorities and public Historically, licence cost, restrictive terms (postcode or asset level), and with greater data via an API to draw it down sector bodies have systems in place to and inconsistent definitions have been clarity around licencing restrictions. automatically. While there is recognition make this quick and easy, while others viewed as major barriers to enabling Examples of the more common data that APIs are useful for companies that were described as “glacial”. access and sharing of geospatial datasets discussed by participants in this have engineers and developers looking to supplied by national organisations such as research included: leverage that, for many organisations it is Ordnance Survey (OS) and British most appropriate to standardise data within Geological Survey (BGS) licenced for > Land co-ordinates and public a spreadsheet or shape file. “The best thing that restricted use. Participants in this research land ownership could happen to data recognised that access to spatial data > Building and planning data (including HM At a more localised level, there are large could be restricted for various Land Registry NPS, conservation swathes of geospatial data that are not across the board commercial, legal, and security reasons. areas, Article 4 directions and outcomes of planning applications) available because Local Authorities (i) are would be to add However, there was also a prevailing > Residential lettings data (volume and not mandated to provide this data for open view – rightly or wrongly - that by widening achieved rents) access, and (ii) often have insufficient location for access to spatial data, the return on > Utilities and amenities data (pipes and resources to do so. Making Local Authority investment gained through the innovation substations, lampposts, bins and everything.” geospatial data more accessible carries and application of data would more than bus stops) with it a perceived risk of breaching (Large Construction cover the costs of producing and > Traffic data (highways and public transport) licencing restrictions on sharing or maintaining that data. > Demographics and household income Company) level data combining datasets, of breaching GDPR and of users finding errors in the data. However, there has been a clear move This data is collected and maintained by a Local Authorities also generate financial toward making core geospatial data more variety of organisations and as revenue through providing searches findable and accessible – a key example acknowledged in the recent Geospatial related to housing and planning data, and being the Public Sector Geospatial Data Market Study, ‘incentives for data producing associated reports. Agreement (PSGA) and recent open sharing that encourage sharing of access to UPRN identifiers. This commercially collected data will need to be In short, there can be little in the way of improvement in address matching is seen created’ to widen access. High costs are a perceived benefits to sharing geospatial as having the potential to generate barrier to access, but there is also a wider data collected at a local level, significant efficiency benefits. issue with some of the data simply being particularly where staffing resources are inaccessible due to commercial value, already stretched. This has led to a commercial confidentiality or perceived situation where many companies employ restrictions relating to upstream licensing analysts to access data manually or GDPR. The Geospatial Strategy details (e.g. through using Freedom of Information that the Geospatial Commission will procedures, or physically visiting council actively consider opportunities to enable premises) or gather this information the sharing of private sector data, through a third-party company. This is a balancing assessments of value and key barrier to unlocking the value of public interest with commercial incentives geospatial data at scale. to invest and innovate.
44 SEC Newgate UK 45 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Interoperable data. The lack of consistency in standards presents a significant barrier to data “The reality is our data has always been There is recognition across all sectors that interoperability. In 2018 the Open Data internally focused. We’ve only generate geospatial data that this Institute ODI reported on the ‘competing needed it to serve our own purposes information has historically been and overlapping identifiers for addresses, collected, stored and managed to serve property and land’, which adds an so its shape and structure in our specific, internally-driven functions. As additional layer of complexity for analysts internal data landscape is siloed based such, there has been very limited need to looking to interpret and bring together look at how data and the systems used to different geospatial datasets’. They go on on how it’s utilised. If you want to open collate that data interact with the datasets to call for identifiers and registers to be up data you’ve got to make it available held and systems used by others (both made as accessible as possible, internally and externally). Interoperability something that is starting to happen as a and structured in a very different way to has not been a major consideration. As an result of the PSGA. what was previously intended.” example of this, a company may receive data in a geospatial format (e.g. in Interoperability and leveraging the value shapefile or MapInfo tab files), which is not of connecting different datasets has also in a format that is immediately been impacted by the lack of unique (Energy Utility) reconcilable with other key systems identifiers to link with other public datasets. (such as relational database management This has led companies, notably in the systems) or aligned with the way PropTech space, to invest in building companies manage development plans, algorithms and “hacks” for address planning applications or enquiry data on matching, in order to facilitate their own GIS. interoperability. The Data Standards Authority is looking to enhance interoperability of government data by introducing standards across government.
46 SEC Newgate UK 47 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Other examples of standardisation issues In the case of utility companies and their Reusable data. Another example is the quality of the data come in the form of the lack of drive for greater transparency and sharing held by utility companies on their own interoperability of prominent UK built of geospatial data, there is now a clear Related to standards, there is also a key assets. Inaccurate records have environment standards (CityGML, IFC and move toward agreeing common standards issue with the accuracy – and therefore implications for planning, for project LandInfra) and a built-in lack of for collecting and representing geospatial reusability – of geospatial data, which costings (and cost overruns), and for interoperability within much commercial data to allow for greater interoperability. relates to issues with data capture, transfer construction operations. In the worst case planning software, which is often bundled The advancement of FME technologies and entry on to different GIS and scenario inaccurate data is seen to pose a in with other services including data should also mean there are less barriers non-GIS platforms. risk to the health and safety of those storage, locking users in to ‘little more than presented by the format in which data is operating on sites. Alongside access to glorified document management systems’. made available in future, subject to the Different datasets have different issues local planning data, the accuracy of data This is a particular issue for local planning adoption of this software. with quality relating to the definitions and from utility companies was the primary authorities whose systems for tracking standards imposed at the time the data issue for housebuilders and construction planning applications are often Coming back to data standards, was collected, and the way in which that companies. incompatible with GIS software or wider interviewees highlighted the progress that data has subsequently been managed and platforms such as the Planning Portal and has been achieved in other areas such as updated. As an example, discrepancies in Issues with utility data are partly a London Development Database. BIM (IFC Standard) and the Internet of the data provided by a national body such legacy issue, with many assets having Things (Project Haystack). Greater clarity as the Coal Authority could result from been installed several decades ago when As the technology continues to filter down on standards will ultimately result in legacy data collection (plotting) issues and there were different tools available to to residential builds there is also an improved interoperability. where physical inspections in the process locate and plot assets. However, it is also opportunity to incorporate geospatial data of planning investigations identify features a contemporary issue with missing into BIM models. This is currently that either historically were not recorded or information from as-built and as-laid challenging due to the absence of a “In planning systems were not recorded accurately. These drawings (particularly feed connections standard set of processes to help formalise discrepancies can also be seen in and fibre cables), and field asset data from how the data flows between GIS platforms there is lots of data differences between some forms of Coal newer collection methods such as LIDAR like ESRI and other stages of the but location for the Authority data (e.g. in relation to outcrops) not aligning with older raster satellite construction process and facilities and data collected by other authorities imaging. There is also not seen to be a management. There is an opportunity here geospatial element in such as the BGS. cost-effective solution to understand for companies involved in BIM and GIS to missing. There is no the depth of underground pipes, engage with the customer base to which changes over time with understand what a standardised data flow interoperability surface developments. might look like. between implicit and Among those familiar with BIM, there was explicit data.” “Foul and surface water are some of the hardest a view that all stages of planning, development and management of (PropTech Company) data to get your hands on. You can find out quite buildings will eventually be modelled, easily there’s a pipe in the road or there’s a cable enabling a diverse range of data to be in that road. The question is, is that pipe capable of connected. This data has the potential to become part of a real-time ecosystem for servicing the site? How much would it cost to upgrade capturing how people are interacting with it and how much would it cost if we needed to the built environment, supporting greater strategic decision making. move it?” (Housing Association)
48 SEC Newgate UK 49 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Utility companies acknowledge that there “Every time you open Data skills: current and Outside of the PropTech sector it can be can be a high degree of missing or future needs. difficult to recruit and retain staff with the inaccurate data on their assets, and the ground, you are skills needed to leverage geospatial data. construction companies and These include both digital skills in the creating data, but The exact skills required to leverage homebuilders typically find an array of widest possible sense as well as data geospatial data vary dependent on the assets un-recorded or mis-recorded in science, data engineering, geospatial and after you are done organisation collecting and managing the geo-detection surveys. There is a GIS skills. The initial challenge here is the data is essentially data, and their intended use for this data. substantial amount of work that would ensuring senior recognition and buy-in to However, across all sectors there was a need to be undertaken in order to rectify thrown in the bin. the value of investing in geospatial data relatively consistent view of the skills legacy issues to do with positional collection and management. However, As an industry we could required for analysts working with accuracy and standardising forms of among those that were using geospatial geospatial data. These included a utilities data. Agreeing a process for survey contribute to a useful data, there was a view that having these mixture of: data to be fed back from construction resource.” skills as a core part of staff competencies, companies to utilities companies may across the business, was critical to their hard, technical ‘spatial’ skills (numeracy, begin to address legacy issues. effective future operations. (Large Construction Company) cartography, GIS, Excel, project management, scripting/coding, data At a local level, geospatial data is As well as issues relating to issues of science, data engineering) “Anybody that is not collected to underpin the development of accuracy, the quality (and utility) of data local plans. Much of the geospatial data is also impacted by how recently it was softer skills (curiosity, problem solving, able to some extent to required by the Local Authorities is collated. Planning can be a lengthy and spatial awareness, communication) obtain utilise and apply collected by specialist consultants to bureaucratic process, requiring significant maintain the independence of the Local time and resource investment to generate The relative balance of these skills data and information Authority and give greater credibility to the evidence base required to pass the depends on how integral geospatial data from various sources in any resulting plan. In a similar manner, various stages of a planning application, is to different functions within an developers typically employ consultants to which in and of themselves require an organisation. However, there was a clear an effective way is going gather data in support of planning up-to-date evidence base. trend that skills needs are moving from applications, which planning authorities to be limited.” GIS technicians to data scientists and rely on in making their decisions. The issue A recurring challenge for planners and software engineers who can develop (Energy Utility) in respect of planning applications is one decision makers is the lack of currency in applications to address specific of the objectivity of the data, and therefore data on housing transactions, due to the business needs. the quality and/or validity of data 3-4 month lag in which it is available and supporting the relevant application. accurately represented from HM Land Registry. This leads to issues with “We’ve millions of understanding what is happening in the housing market in real time. With the assets which may need recent COVID-19 pandemic there is also to be slightly shifted, now a question mark in the housing and planning sector as to whether the models which is a very difficult underpinning market data assumptions are currently suitable for planning applications thing to do manually.” made before the pandemic. (Energy Utility)
50 SEC Newgate UK 51 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
“Gone are the days where you Even with recognition of the value of An associated challenge here is that those geospatial data, companies that operate graduates and professionals who do come invest heavily in big enterprise outside of the PropTech ‘banner’ still with these data science and data experience significant challenges relating engineering-based skills are not applications. It’s about small scale, to cultivating and attracting people with necessarily aware of or attracted by roles in-demand programming and data outside of the technology sector. The agile flexible applications that sit science skills. immediate thoughts that come to mind are around your core business systems, that companies working in housing are You can recruit GIS specialists who bring industries that “lay pipes in the ground”. and having that development with them critical spatial data analysis There is a need – from university onwards skills. However, increasingly businesses - to raise awareness of the opportunities capability internally, that DevOps need staff that can build software to that exist outside of ‘technology’ address specific internal needs and businesses and to attract data scientists type approach.” goals, not simply analyse and represent away from the lure of Google and (Energy Utility) existing geospatial data. These are not Amazon. There is also a challenge of skillsets that GIS analysts have received retaining skilled staff once they have formal training in. There is also very little gained practical work experience. reported use of external professional development or membership of The opportunity is very evident to professional bodies (e.g. AGI*/RGS**) companies. With the correct skills that directly support the acquisition of in-house, it will be possible for geospatial skills. organisations to develop their own applications and services to meet specific use cases.
* The Association for Geographic Information (AGI) **Royal Geographical Society (RGS)
52 SEC Newgate UK 53 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Data resources: open-source) GIS software, this would not “The fundamental question you overcoming challenges. provide any immediate cost efficiencies, and would likely incur financial and/or time keep coming back to with Local costs in transitioning to a new platform. It is commonly accepted that staff planning This also assumes that the network Authorities is ‘Have they resource within Local Authorities has been permissions and hardware capabilities impacted by budget cuts. This means there actually got the resources they are in place to enable staff to utilise is a high degree of variation in the planning other software. need?’ and arguably the answer resources available between Local Authorities, with “wealthier” district councils is ‘No’. But that is the world Hard and soft skills training for planning in the South of England having relatively authority staff would be beneficial to more resources available than those in the we live in.” support the introduction of standards and North of England where social care deficits help council staff in both strategic and (Water Company) have a proportionally higher impact. applied level planning. This includes both training around the technical skills required Many Local Authorities were seen to view to manage geospatial data and in how to geospatial data as a cost to be minimised communicate around the implications of rather than an investment that helps to geospatial data. underpin efficient planning, resulting in a longer term return on investment. This There is also an opportunity here to create means that not all planning authorities regional and national networks of have GIS officers, a geospatial data practitioners involved in the use of champion, or have cultivated an geospatial data in housing and planning to environment in which such a champion shine a spotlight on good practice and to can be identified and trained to improve shape the sector. This is particularly the collection and management of important given the speed at which the geospatial data. volume and types of geospatial data available increases, and the high degree A further compounding issue already of variance in planning resources between referenced is that most planning different Local Authorities. Currently, there authorities use commercial end-to-end appears to be limited opportunity for planning software – e.g. IDOX, Civica, professional development and sharing of Northgate – which are like closed circuits. practice within and between sectors. They lock users in, limiting interoperability and are not necessarily fit for analytical planning purposes. Even if they were to have access to an appropriate (and
54 SEC Newgate UK 55 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Data skills and resources: As we look to the future, where APIs looking forward. enable large amounts of geospatial data to become accessible and usable with the right kind of digital endpoints, the focus Digital transformation is creating a growing needs to be on helping professionals from need for both geospatial data and skills in a much wider array of professions – the construction industry itself. The blurring notably planning, construction and of boundaries between the architecture, conveyancing – to understand what can engineering and construction sectors and be achieved with geospatial data. This the geospatial industry opens up a range includes helping those who collate and of opportunities for geospatial curate geospatial data to understand what professionals. The cross-fertilisation of can be achieved with small amounts of expertise between the private and public JavaScript or Python code. sector and between practitioners with local, regional and national remits could help to raise standards (both through skills transfer and a better appreciation of applying location data and the constraints around this).
56 SEC Newgate UK 57 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Unlocking the value of Without agreement on what constitutes the appropriate data to be collected and made location data. available, specifically at a local planning authority level, the value of geospatial data The value of geospatial data is as much in will continue to be undermined by issues of its application as it is in the data itself. With quality and accessibility. advances in technology and analytical methods, greater access to geospatial data There is a need to facilitate FAIR has the potential to inform more efficient geospatial data, in a way that is user- and effective decision-making at an centered and allows for easy manipulation individual, local, regional and national and varied application. Value is dependent level. The creation of the Geospatial upon data being collected according to Commission in 2018 is testament to the agreed standards, stored and managed in recognition of the social, environmental an appropriate form. This in turn requires and economic value that can be generated planning authorities to have the skills and through layering and integrating geospatial resources to manage this process and to datasets along with other data sources to collect accurate, up-to-date data. maximise opportunities presented by data, particularly in respect of housing and With advances in mapping technologies, planning decisions and processes. machine learning and the introduction of 5G, it will become increasingly feasible for This Planning and Housing Landscape decision makers to have real-time access Review sought to understand the to detailed geospatial data. Accurate data challenges and opportunities in making can inform local needs (including use of geospatial data within planning and influencing factors like transport and housing. The evidence gathered through environmental conditions), market this Review is well aligned with key recent capability to deliver against these needs strategy publications, including both the and development work itself. However, the UK Geospatial Strategy and the UK Data actual value of this data is dependent on Strategy. The key barriers for unlocking both its underlying veracity and the the value of geospatial data are clear and intelligence applied to its interpretation. relate to data standards, data accessibility, data skills and resources.
58 SEC Newgate UK 59 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Implications. One logical outcome of greater clarity on 2. Better planning and housing decisions The location of where to build new homes standards is the generation of (new) are believed to be made by developing is not just a local issue. The Raynsford 1. Standardisation is a critical first step for geospatial data which would be more and implementing plans in collaboration. Review of Planning highlighted the lack unlocking the potential of geospatial data. accurate in representing aspects of a In actioning a new geospatial strategy, of a national spatial development plan for It is the foundation on which the real property, asset or feature. Allied to this, working on the basis of strong data England. The absence of a holistic view value of geospatial data within planning with greater standardisation of data foundations, there is an opportunity to and a consistent approach to national and housing will be achieved: the bringing foundations, there would be greater scope encourage much greater proactive planning has led to a disparate and together of diverse datasets to produce a to for data to become interoperable information sharing and engagement incoherent approach to planning and more holistic, accurate and actionable between different software applications among organisations involved in planning housing. With agreement around data understanding of how people are from GIS and geospatial analytical and housing locally, regionally standards there is the potential to interfacing with locations now, and in platforms to relational databases and and nationally. rectify this. the future. management systems. It is impossible to plan for the development There are also companies such as the All geospatial data should be collected and Given the volume of location-based data of residential housing without accounting Planning Portal and Landmark who, by represented in a way that ensures that is being collected by statutory and/or for a wide array of other public services virtue of their remit or size, hold vast standardisation in the metadata – which regulated industries, could there be scope - transport, health, social care, education - amounts of data on planning applications provide descriptive information about the for Government to push through a set of all of which relies on the use and and housing transactions. These producer, content, date/relevance and standards in a similar manner as for BIM interoperability of data tied to a location. companies can produce data and insights quality of the data – and the schema, and Planning more broadly? UPRNs have a key role to play here as a around the local, regional and national within (and potentially across) sectors. linking mechanism between the public and picture, virtually in real-time. There is also Properly regulated, this development has The MHCLG brownfield land register is a private sector. With greater standardisation scope, with something like the Planning the potential to create huge efficiencies in good example of what could be achieved of data requirements, Local Planning Portal, for data to be automatically fed processes as well as increasing the through the provisioning of data standards Authorities will be in a stronger position to back from local planning authorities on the efficacy of the ways in which data is or tools that can help local planning draw on public data to inform the creation outcomes of planning applications. What applied. authorities map and publish planning data of more ‘strategic’, and arguably more scope is there to draw on this data to an agreed target data standard. objective, local plans. to inform strategic decision making and This is an area that is already being Similarly, the Data Co-operation feed into national initiatives such as a progressed by the Data Standards Agreement is seen to be a successful There is obviously a wide array of National Planning register that could map Authority, working with the cross- example of a shared service agreement other datasets that can help to inform this different data sets according to strategies government Data Architecture community, that could hold lessons for the sharing of process – notably data from utilities and moving forward? which was established in April 2020 planning data. Is there a role for a body to construction companies – which, if suitable to improve data standards across take more centralised oversight of Local standards and processes were in place “In 2012 when regional government. Planning Authorities, setting of for sharing, could help ensure local plans expectations and the implementation were fit for purpose. As we look forward to planning was abolished, of standards? the Future Homes Standard 2025, we also abolished the Biodiversity Net Gain initiatives and Net Zero goals it will be increasingly important national scale strategic to ensure a coordinated, macro-level view datasets that went with it. on residential planning and housing. Geospatial data needs to be recognized as That was like smashing up key to this by decision makers at the your radar in a jumbo jet.“ highest level. (Strategic Stakeholder)
60 SEC Newgate UK 61 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
3. Before value can be derived from in relation to geospatial data among many geospatial data, it has to be made more of the energy companies. With initiatives accessible. There are a wide range of such as the National Underground Asset barriers to making data available, from Register there is increasing scope to GDPR, licencing and commercial develop unifying catalogues and platforms sensitivities through to ensuring that data for more ‘commercial’ geospatial data is findable, and from system which cut across different sectors (while interoperability to staff capacity. There are still providing a level of control to protect also a variety of commercial organisations security of national infrastructure). and voluntary bodies that have evolved to However, this process will take some time, help collate, aggregate, clean and serve and there is a large amount of legacy data geospatial data in such a way that it that will take many years to update. supports a given use case. Some respondents/companies have Not all organisations have the awareness, suggested there could be a role for skills or finances to draw on support from government going forward to identify companies providing data aggregation- additional data sets that could be released type services. In the case of smaller and to promote data sharing within the companies, or conversely those with more private sector. Key data sets identified as sophisticated in-house capabilities, there being beneficial to make more accessible, is a desire for geospatial data to be made at a granular level, included: more accessible. This may be in the form of an API or web-service where there is a > Land co-ordinates and public land specific application being served, or it may ownership be in the form of a spreadsheet or shape- > Building and planning data file for those looking to use the raw data. > Residential lettings data > Utilities and amenities data Through the Public Sector Geospatial > Traffic data Agreement (PSGA), the government has > Demographics and household increased the range of core geolocation income level data “Standardising data that public sector organisations can Local Authority data is a access through Ordnance Survey, now Further research would be needed to including UPRNs, USRNs (now mandatory determine where the relative value lovely aspiration but open standards for public sector data) and (in terms of ROI) is in prioritising access delivering social care TOIDs. Similarly, the simplified common to the above data. data catalogue and single data exploration programmes are more licence launched by the Geospatial important than whether a Commission have helped to widen access to geospatial data. CSV file is in the correct delineation. There are real Driven by regulators such as Ofgem and facilitated by membership bodies such as world issues which are the ENA, there has been a move more more challenging.” recently to a ‘presumed open’ standpoint (Strategic Stakeholder)
62 SEC Newgate UK 63 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
4. Assuming the standards, the strategic Outside of Local Authorities there are a While it was not within the remit of this A priority should be agreeing core data imperative and access are in place, the wide array of sectors and professions that research to make specific requirements and then supporting the next key issue to address is the skills and are utilising geospatial data, though this recommendations for the Geospatial development of a minimum degree of resources of staff to manage and utilise review has found that resource is often Commission or other public bodies, there GIS-related competencies in relevant local geospatial data. This research has found stretched, operating in siloes and using were some clear implications of this planning authority staff. Allied to this would what was commonly assumed to be the data in relative isolation (both from other research for the sector. We suggest that be the establishment of some shared for a case: on the whole, Local Authorities do sectors, datasets and use cases). Fur- there are a number of priorities, aligned for Local Authority staff to build networks of not have the level of resource needed to thermore, outside of the PropTech sector, with these implications, that would help to geospatial practice and professional harness the value of geospatial data within it is typically the case that the skillsets of truly unlock the value of geospatial data. development. planning and housing. Over the past current ‘geospatial’ staff do not extend to decade Local Authorities have had a data science and programming. While vast 1. There needs to be recognition that 3. The next generation of geospatial reduction of nearly £16 billion in core amounts of data are collected – of varying geospatial planning and housing data is planning and housing practitioners are in funding from Government while facing quality – this data is often not being one (important) form of data but that it fact data practitioners. Alongside growing demand on services through intelligently applied. needs to be linked with spatial data from standardizing the skills of local planning increasing and ageing populations. across related domains (e.g. transport, authority staff, there is a need to ensure Looking to the future it will be important for health, education etc.) for it to be applied that data engineers and software An understandable consequence of these data science students and professionals intelligently. No one organisation can developers (including graduates) are demands on Local Authority budgets is to have an awareness of the opportunities provide a solution to the challenges that aware of the opportunities that exist in the that resource and structural decisions have within the planning and housing sectors. exist in respect of data foundations, planning and housing sector. ‘Geospatial been taken that have impacted the Conversely, training is needed for GIS access and skills. This requires much data’ operating in a technical, sector- capacity to collect, manage and publicise professionals to help ensure that they are greater collaboration and consultation specific silo is overly limiting. geospatial data for wider consumption. aware of the art of the possible in com- within and between public and private Creating standards and clear processes, bining and modifying geospatial data and sector organisations working toward 4. Geospatial data doesn’t just have the with support mechanisms in place to help applying this to specific use cases. shared goals of more effective planning, potential to unlock value; it is already local planning officers to adhere to these, housing and construction. This is starting unlocking both short and long-term value will go some way to improving Future priorities. to happen at a regional level but would for many organisations across the UK. the situation. benefit from more of a national However, it is still little understood or This planning and housing landscape conversation and subsequent direction. A prioritised for investment. There is a need Membership bodies such as the GLA in review was commissioned to provide a starting point for this would be the principle to showcase the art of the possible (e.g. London and the Scottish Improvement comprehensive baseline assessment of of improving access and agreement on case studies with associated ROI Service in Scotland, play an important role how geospatial data was being used and meta-data standards, specifically spatial measures) and make advocates of key in both advocating on behalf of constituent managed by organisations working across references, identifiers and dates. decision makers across the public and Local Authorities and helping them to meet the residential development process. private sectors. their obligations in relation to INSPIRE 2. Local planning authorities are a key standards. Might there be scope for a source and user of geospatial data, yet membership body (such as the LGA) to many will continue to struggle in help facilitate support networks and standardising the collation and publication professional development for of data due to competing demands on Local Authority staff working with their resource. geospatial data?
64 SEC Newgate UK 65 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Annex 1. National, Local and Sector-specific Initiatives.
66 SEC Newgate UK 67 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
National geospatial data initiatives.
There has been a wide range of work undertaken by the Geospatial Commission, the Geo6 and wider public (and private) sector partners to promote access and standardisation of geospatial data. Relevant recent national initiatives have included:
The Data Discoverability project (through The release of the Unique Property which a simplified common data catalogue Reference Number (UPRN) and Unique was published on data.gov.uk providing Street Reference Number (USRN) under core information – using INSPIRE themes Open Government licence. This is a – on the geospatial datasets that each of foundational identifier that has the potential the Geo6 partners hold and manage). to be the standard that will align Local Authority data with wider datasets and The single data exploration licence so PropTech solutions, supporting greater anyone can access data held by the BGS, interoperability of different geospatial Coal Authority, HM Land Registry, OS and datasets. Geoplace details how the the UK Hydrographic Office, for research, UPRN is becoming embedded in other development and innovation purposes. datasets (ONS, Land Registry, DfE, DWP, GLA and LGA) Linked identifiers best practice guidance to support the integration potential of different datasets.
Enhancement of the core dataset list through each Geo6 organisation adding further detail, filling gaps, updating information and correcting errors.
68 SEC Newgate UK 69 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
HM Land Registry’s ‘Use land and Overall, there was a huge amount of The BGS has provided knowledge The Data Pathfinder, led by the property’ data service, which provides data optimism around the widespread use of exchange placements for planning Improvement Service in Scotland, is on registered leases and restrictive BIM and digital twins. The National Digital practitioners from four Local Authorities working to identify the required data covenants across England and Wales, Twin programme, run by the Centre for from across England, Wales and standards and governance to support the though is still limited through licensing Digital Built Britain (a partnership between Scotland to receive training on GIS delivery of the Digital Planning restrictions on use in order to mitigate the University of Cambridge and and online mapping Transformation Programme, which aims against potential misuse. Department for Business, Energy and to create a wholly digital planning system Industrial Strategy), has worked to develop The Digital EIA project, funded by Innovate in Scotland. HM Land Registry’s is working in an information management framework to UK, looked at ways of digitising the partnership with Local Authorities to standardize digital twins. There are Environmental Impact Assessment (EIA) To improve the partnership opportunities standardise and migrate local land synergies here with what could be process by creating a Digital EIA between different telecommunication charges register information to one achieved in respect of planning data. Framework, making it less time consuming companies and to help generate a data accessible place as a national while at the same time agreeing data sets and information rich sector, DCMS digital service. The Ministry for Housing, Communities to be captured once an EIA is complete established a Telecommunications Data and Local Government (MHCLG), often Taskforce chaired by Lord Ian Livingston BGS led on the Brownfield Risk Calculator through the work of the Digital Land Policy In 2019 GeoPlace introduced the that also includes current and former initiative, jointly commissioned by Greater Team, has been supporting digital FindMyStreet service to open access to CEO’s of Vodafone and Openreach. The Manchester planning authorities, to collect innovation in transitioning the statutory information about the road network in Data Taskforce Strategy sets out key areas and plot constraint data on a shared planning system onto a digital platform England and Wales to support local for boosting competition and innovation system to inform the identification and both at a local and national level. This highway authorities in meeting their in the UK market by building an open, promotion of brownfield land for has included a Planning Delivery Fund Highways Act Section 36 (6) obligation in sustainable and diverse telecoms supply development. Alongside this MHCLG has (2017-19); a Local Digital Fund (2018-20) providing a list of publicly maintainable chain. One key area includes data sharing led on a national dataset on brownfield that includes planning exemplars; and the streets to public. In addition, they also among telecommunication companies in sites (including an accompanying guidance publishing of viability assessments. provide the FindMyAddress service to the sector. on standards for publishing brownfield land enable personal searches for the official register data). The Future Cities Catapult developed a address, UPRN and location of every The Geospatial Research team at Knight Housing and Innovation Map that property in England, Scotland and Wales. Frank has recently worked with MHCLG to Ordnance Survey established the now considers concepts that they believe are identify publicly-owned car parks across Geovation incubator in 2009 which challenges facing the housing industry in the UK that could be readily converted to continues to fund PropTech and GeoTech connecting homes to location data. The high-density housing near key transit hubs startups in the UK, helping to develop a work has brought together stakeholders to such as train stations. bedrock of geospatial data-led tech form partnerships for the ‘greater good’ by solutions. In 2017, HM Land Registry combining skillsets and resources together joined the initiative as a strategic partner, to tackle a barrier. and both organisations continue to fund PropTech and GeoTech startups in the UK, The Coal Authority run annual outreach helping develop a bedrock of geospatial activities where they meet planning data-led tech solutions. At a more regional authorities in the defined UK coalfield to level, the Mayor of London’s Civic reinforce understanding of the statutory Innovation challenge in 2018 helped fund a processes and best practices in consulting 3D model of London to help ‘ with the Coal Authority around planning democratise planning and tackle the applications that need to account for housing crisis facing Londoners’. legacy coal mining risks.
70 SEC Newgate UK 71 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
LocalGov digital network for digital Lambeth, Southwark, Lewisham and practitioners publicises ‘Pipeline’: a list Camden Councils are working with the of 356 projects ranging from Concept to Open Systems lab, using the Local Digital Completion including those involving use Fund, to develop an open service pattern of geospatial data (e.g. Building a ‘Living in for digital planning submissions. Hackney’ web map prototype). Southwark and Camden Council is working Regional planning, through regional with the GLA, the Future Cities Catapult governance bodies such as the GLA and and Unboxed, again using the Local the combined authorities, has helped to Digital Fund, to create open, user-centred provide a more holistic perspective on back-office planning software. planning and housing across multiple Local Authorities. The is a key source of all new Waltham Forest, as part of the GovTech developments in London. The London Catalyst challenge, investigated how Datastore is a free and open data-sharing technology could be used to monitor portal where anyone can access over 700 developments of all sizes and types, datasets relating to the capital, including building an accurate picture of specific geospatial data relating to housing development status from permission to and planning. completion and occupation, improving intelligence available to planners. The GLA’s Infrastructure Mapping Application for London enables exploration of current/future development and infrastructure projects to support collaboration. It uses data from utility companies, Local Authorities, developers and the GLA
72 SEC Newgate UK 73 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
The Surrey GIS Forum developed the North Ayrshire Council established a GIS Utility initiatives. Innovate UK, BEIS and Ofgem launched Digital Services Planning Hub in response and Analytics team in 2017 to enable the Modernising Energy Data Access to the large volume of website hits relating action toward meeting the goals of the The Geospatial Commission is working to (MEDA) competition in 2019 as part of the to planning across each of its 12 councils. Local Authority digital strategy. This was create a National Underground Asset Industrial Strategy Challenge Fund (ISCF) The Hub has combined data feeds from referenced as an excellent example of Register and in 2019-20 launched two ‘Prospering from the Energy Revolution’ each Surrey council and provided access transformational change pilots, one in the North East of England (PFER) programme. Those through to the to planning applications harvested from and the other in London. The national second (pilot phase) round of the MEDA authorities in Surrey via a consistent API. Glasgow City Council has worked closely register will include assets across the gas, competition include the Icebreaker One The Hub has also provided details of the with the Urban Big Data Centre at Glasgow water, electricity, telecommunication and ‘Open Energy’ project and the Siemens API and a simple means of embedding a University on various spatial initiatives. The transport sectors and Local Authorities ‘Your Online Data Architecture’ platform, map within any web page for replication in Urban Big Data Centre is also currently and will be used to plan and carry each proposing technology-driven other regions developing a Spatial Urban Data System, out excavations. solutions to improve the accessibility and comprising social, economic, natural, quality of data in the energy sector for Milton Keynes Council worked with the built-environment and physical The National Improvement Service in businesses and consumers. A final winner Satellite Applications Catapult to develop infrastructure aspects of UK 14 cities, Scotland already collates local plans from will be announced at the end of 2020. an Urban Planning Service that used including Glasgow. all of the Local Authorities in Scotland and satellite imagery to generate a real time overlays them with network information United Utilities Safe Dig is a web service picture of developments, including the from the DNO and GDNs. that depicts the clean and wastewater longer-term impact of these (e.g. on traffic, assets of this North West England water the local environment etc.). The National Grid published their Future company on a map. It is accessible for Energy Scenarios (FES) to stimulate those excavating a site or with a Section debate and decisions on the future energy 50 notice for street works, as an system and Net Zero. alternative to a plan purchased from the Property Searches team. Energy Networks Association’s (ENA) Data Working Group is working to create an A similar third-party service is Linesearch open access central energy utility dataset, BeforeUdig, which allows individuals to with a prototype network map in Scotland specify works to be undertaken and in already developed. return receive any available utility maps and a list of utility asset owners who have assets in the search area which may be affected by the works.
74 SEC Newgate UK 75 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Annex 2. Survey of English, Welsh and NI authorities.
76 76SEC SEC Newgate Newgate UK UK 77 77SEC SEC Newgate Newgate UK UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021 Local Authority achieved sample.
Fig 1 Local Authorities in England and Wales predominantly use geospatial data to produce Local Development Plans and when reviewing planning applications To inform open access To material provided on website Review of planning applications Production of maps and plans Land charges searches Development of local plans 77% 66% 32% 25% 15%
Q: What are the primary areas where geospatial data/services are used in your planning and housing work? Base: 126
Local Authorities noted the importance of geospatial data in their current community response to Covid-19, where it was being utilised to help identify housing needs, social distancing measures and areas where public transport could be used most safely.
Participants also mentioned the use of geospatial data to inform other activities:
> corporate strategies such as public parking and social housing > planning investigations that could include flood risk and heritage area mapping enforcement areas > asset management of Local Authority owned property > asset management of right to buy properties, open spaces, property services, land purchases and completed sales
78 SEC Newgate UK 79 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021 Providing Providing geospatial data. A variety of data formats are used to make geospatial data available to internal geospatial and external stakeholders (see Figure 2). PDF, alongside shapefiles, are the most prevalent format for geospatial data, followed by excel. Only a small data. minority currently provide web map services. 87% of Local Authorities who do not place a daily limit on the number of searches someone can request. Only one Local Authority reported placing daily Web Web Map Services limits on searches, with the Raster format Shapefiles Excel Vector formats CAD format
13% JPEG remaining 13% unable to comment on this practice in 44% 32% 19% 19% 18% 11% 5% their authority. 87% Local Authorities who had not uploaded data to the data.gov portal commented that there were financial implications to collating data in the required format, which presented a barrier to providing data. Adding geospatial “I attempted this under the system called Inspire. data to Data.gov portal. This was a requirement. It was difficult to 49% of Local Authorities administer because the platform required a report having added geospatial data to the data. specific format. There was a cost associated gov portal. These include data such as future with that.” developments, (Local Authority) development limits, and listed buildings. The decision to share data is Out of those Local Authorities who had added data to the data.gov portal, the majority had uploaded not influenced by the size between 1-25 datasets (see Figure 3). There were no notable differences when compared against the of authority or its type of size of authority, if they had a data strategy or the number of GIS staff that were employed. governance. This may be 33% of Local Authorities charge for an underestimate as 51% 49% searches either to cover costs (24%) four-in-ten respondents did 25+ datasets 8% or as a profit-making action (9%). not know whether data Charging is not related to the size of had been uploaded by 10-25 datasets 26% Local Authority (by population or their authority. annual spend). 1-10 datasets 44%
Don’t know 22%
80 SEC Newgate UK 81 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Figure 4 (below) illustrates that there was a roughly even split of authorities in which Structuring and geospatial experts sit within a centralised team (44%) versus those where expertise is spread across different teams. There was no significant difference by size of authority staffing of GI/ (by spend or population).
GIS teams. Q: Does your Local Authority have a dedicated Geographic Information team or are geospatial experts dispersed across different teams (e.g. IT; Data and Insight etc.)? Base: 126
The mean number of Local Authority staff working directly with geospatial data to inform housing and planning decisions, though this ranges from zero staff Half of Local Authorities (48%) report right up to 400 in one authority. having some form of Geospatial or As would be expected, the larger ‘Information’ strategy and, of these the authority the more staff are Local Authorities, the vast majority working with geospatial data. (78%) link this strategy to wider 2% corporate strategies. 12% Over nine-in-ten Local Authorities (92%) report that non-specialists access geospatial tools such as web mapping systems. 44% 42%
44% 12% Geospatial expertise sits within There is no geospatial team one geospatial team at the local authority 42% 2% 75% Geospatial expertise is spread Don’t know Three-in-four Local Authorities report across multiple teams having a geospatial lead or co-ordinator. This doesn’t appear to be influenced by size of authority, number of staff working with geospatial data, or the presence of a geospatial strategy.
82 SEC Newgate UK 83 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021 Knowledge sharing and training.
40% of Local Authorities report having a knowledge forum/skills sharing function within their Local Authorities. A slightly higher concentration of knowledge sharing forums could Q: Does your organisation utilise services from any industry/ be seen in the South of England in comparison professional bodies for the development of skills in staff? Base: 126 to the North; knowledge forums were also seen more in authorities with larger budgets (over £500 million) relative to smaller authorities.
Overall, 29% of Local Authorities 29% 52% 19% 16% utilise services from an industry or professional bodies to help with the Yes, do use No, do not use Don’t know development of staff skills (see support services support services for skills Figure 5, right). As might be for skills development 84% expected, Local Authorities with over development £500 million annual spend are more likely to utilise services from Out of those Local Authorities who do have industry bodies. knowledge forums, 84% include some sort of geospatial data representation.
84 SEC Newgate UK 85 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
44% of Local Authorities thought it was difficult to recruit or/and retain geospatial skilled Skills and resources staff due to the salaries on offer. The other key challenge – from a recruitment perspective for the future. – was the local talent pool from which Local Authorities could recruit.
Just under half of Local Authority stakeholders interviewed think recruiting or retaining individuals with geospatial skills is not an issue or challenge while 39% think recruitment and/or retention are an issue (see Figure 6). Lack of reward / recognition Recruitment and retention of geospatial skilled
staff was more of an issue for the smaller Local Limited development opportunies Authorities (both in terms of size and budget), and there was also some geographic variation, with Competition from other geospatial emploers Salary this forming a bigger issue in the Midlands relative pool Talent in the area to other regions. 44% 40% 22% 12% 4%
Q: Why do you think recruitment or retention of individuals is an issue? Base: 50
13% 13%
Q: Is recruitment or retention of 32% individuals with geospatial skills an issue/challenge? 48% Base: 126
48% 13% No Yes - Recruitment 32% 13% Yes, both recruitment Unsure & retention
86 SEC Newgate UK 87 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021 Maximising the value of geospatial data.
By far the greatest barrier to maximising the value of geospatial data identified by those working in Local Authorities was a lack of geospatial skills and resources. Figure 8 (below) illustrates that this was a key issue for over three-fifths of Local Authorities, followed by poor quality data, lack of corporate buy-in and data strategy, and inadequate IT infrastructure/hardware.
In contrast, the geospatial skills that are currently key to Local Authorities are data capture (92%), data management (90%) and webmaps (88%). While application development is seen as key in more than half of Local Authorities (57%), programming (34%) and data science (26%) are much less of a priority. Q: What are the top 3 barriers to maximising the value of geospatial data at a Local Authority level? Base: 126
Lack of geospatial skills and resources
Poor quality data
Lack of corporate buy in and data strategy
Inadequate IT infrasctructure/hardware
Data accessibility (including licencing restrictions)
Interoperability of data
Lack of consistency in geospatial data standards
Network restrictions and/or lack of appropriate GIC software
Other 0% 10% 20% 30% 40% 50% 60% 70%
88 SEC Newgate UK 89 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Annex 3. Sector summaries.
90 SEC Newgate UK 91 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Planning. Key geospatial data: Planning consultancies typically use a wider variety of data than architects, relating to Type of organisations: There are a mixture their broader role in helping to inform and of independent and agency-led planning shape planning applications. Key consultants, developer services and geospatial data include: architecture practices that variously work on local and national projects. > Land ownership > Topographic information (Ordnance Phase of involvement: Primarily involved in Survey and MasterMaps) the planning application stage of the > Constraints data such as listed housing and planning journey, where buildings and flood risk developers use architects to produce designs and planning consultants to help > Property addresses (Ordnance Survey identify sites and gain planning permission. AddessBase; own data) > Previous planning application searches Key links: Local Authorities and local communities. Planning consultants will > Gas and electric supply data (utilities) develop positive relationships with Local Authorities to make sure their clients’ plans Managing geospatial data: Architects and are strategically aligned to the Local planning consultants typically access the Authority local plans. During the planning required information with the help of third application journey, key links may also parties rather than accessing raw data. include residents in the local area whose Apart from the regular use of CAD for views can have an influence on the representing plots and areas for success of proposed applications. development, planning consultants (and some architects) use some of the following Geospatial data use: Planning consultants tools for viewing geospatial data: and architects will collect and use data that > Civica ‘My Service Planning, Idox, helps them to: Excel and Google Sheets are all used by planning professionals as CRM and > Prepare feasibility studies before project management systems developers acquire the land (including areas of risk) > Ordnance Survey is used as the main point of call for levels information, > Understand the local area and the likely mapping and topographical information considerations for a successful planning permission > Promap is used to search for nearby facilities and other housing > Maintain an up-to-date record of developments planning regulations in the local > Natural England / Magic.gov provides areas model natural environment information cross > Pre-application CAD drawings predict government departments. They have the value of a home before planning partners including Historic England, application and construction phases Environment Agency, Forestry of work Commission
92 SEC Newgate UK 93 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Construction. In general, large housebuilders will Larger construction companies tended to Outside of the largest construction identify potential sites through local plans have a cloud-based common data companies, it is relatively rare that Type of organisations: Housebuilders and and overlay this with other raw data to environment – such as Viewpoint – tailored companies involved specifically in the construction companies ranging in size assess viability, also drawing on third party for the construction industry and enabling construction phase would utilise GIS from small local sole traders to data aggregation and analysis services. the management of a variety of data software. Instead, they tend to rely on international multi-use residential housing However, SME housebuilders who have including CAD architect and engineering specialist consultants to provide them with contractors like Balfour Beatty. more limited funds will often find suitable plans, BIM models as well as geospatial relevant information around constraints. land and development opportunities using data. Smaller construction companies and Only where companies are also involved in Phase of involvement: Primarily involved in local networks and/or services such as housebuilders used systems like the identification of larger areas of land for the construction stage of the planning and LandTech and NimbusMaps. Sharepoint or simply shared PDF files via development would they be likely to make housing journey, with some smaller email with partners and sub-contractors. use of raw geospatial data. involvement in the marketing of homes Key geospatial data: The exact data and sources vary between the type of Key links: Key links differ depending on construction company and the complexity the extent to which construction of a specific site in question, but typically businesses are involved in the planning/ they include: development of residential properties, and in the sales/marketing. Typically, links > Planned developments and target land include housing associations, land agents/ use (Local Authority plans; developer owners, and holders of any data in inquiries) relation to constraints (utilities companies, > Property addresses (Ordnance Survey highways authorities and the AddressBase) Environment Agency). > Asset location records and jobs (own data) Geospatial data use: Housebuilders and construction companies will use > Emerging infrastructure plans (own data) geospatial data to inform the construction process, particularly in relation to > Topographic landscape (Ordnance understanding constraints on a given Survey; ProMap licenced) development (such as property access > Land ownership (HM Land and location of utility assets). Beyond this, Registry licenced) there is limited use of geospatial data, > Ecological constraints data unless they are also a land developer. In (Environment Agency) this case, data will be used to explore: > Utility and infrastructure assets (Utility > Addressable market sizing the need companies, Highways England and and demand for different types of Local Authorities) property (e.g. bedrooms and garden size) Managing geospatial data: The process for > Potential residential/community support managing geospatial data varies for a development risks and constraints considerably depending on the size of the > How profitable an area of land could be company and the corresponding size of the once developed residential developments under construction.
94 SEC Newgate UK 95 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Energy utilities. Geospatial data use: Companies collate Key geospatial data: Exact data and linear network assets. GIS systems include data on the location and performance of sources vary between organisations GE Small World, GE Electric Office and Utility type: Distribution Network Operators their own assets (pipes, cabling circuit based on their remit and size, but ESRI ArcGIS. Larger DNOs and GDNs (DNOs) and Gas Distribution Networks routes, substations etc.) and how these typically include: tended to have more sophisticated (GDNs) responsible for regional energy interface with the needs of new and products and larger teams of GIS distribution and connections, and existing developments. This includes: > Topographic landscape (Ordnance technicians to update systems with data Independent Gas Transporters (IGTs) and Survey MasterMap; licenced) sent by field operatives. Independent Network Operators (IDNOs) > Maintaining an up-to-date record of the > Land ownership (HM Land Registry; responsible for more localized energy operational network on a central asset licenced) Larger utility companies also employ networks and connections. register > Property addresses (Ordnance Survey geospatial analytical platforms (such as AddressBase) > Modelling pre-planning inquiries and GSA, QGIS or NAVI) for integrating and Phase of involvement: Primarily involved in planning applications to assess risk > Asset location records and jobs (own surfacing various internal and external the Construction stage of the planning and and cost data) geospatial data sets to undertake > Water drainage, flood zones, areas of analysis for set use cases. This includes housing journey, but also have some > Examining usage and forecasting future outstanding natural beauty, earth using geo-schematic network modelling involvement in land identification, energy use (e.g. accounting for resistivity, roads and foot traffic link tools (e.g. GNVL Synergy) for allocation and planning process stages anticipated demand for electric vehicles (variously under OGL or APIs from network studies. helping developers and Local Authorities and heat pumps) to map predicted Environment Agency; BGS; MET understand existing network capacity. demand against supply capacity and to Office; SEPA; H&S Laboratories; Typically companies will provide an internal capture the level of uncertainty that’s in Canals and Rivers Trust; Improvement viewer to provide a cut of the asset data for Key links: Developers, Local Authorities future electricity pathways to meet Service Data Hub) wider internal use, while third parties will and other utility companies (including net zero Independent Connections Providers). > Current and predicted energy use (own variously have access to an internal viewer Larger energy utilities will often engage > Examining usage and demand data to data; EPC Database; Energy Savings or a third-party service such as Linesearch inform asset investment plans (in turn strategically with Local Authorities through Trust; or via consultants such as BeforeUDig. Developers can also request linked to price controls and RIIO-2) various local forums to understand their Regen) and pay for a more comprehensive pack regional development plans and to talk > Other utility assets (direct from other of materials to inform planning and about their own investment plans. This will utility companies; Network Rail; construction. then lead to more informed local plans and Linesearch BeforeUDig) and meter planning applications. point reference numbers (e.g. via Asset data is typically raster (legacy) and Exoserve) most recently vector data. Some > Planned developments and target land companies are using LIDAR data use (Local Authority plans and collected by field operatives and sent in a developer inquiries) PDF or sketch for digitizing in database. > Customer database (Contract types; The electricity sector work with the contact details; addresses) (own data) Common Information Model standard as a common way of representing network Managing geospatial data: Data on assets. Connections data includes assets is maintained within enterprise co-ordinates and a site address for entry asset management systems which can into relevant databases. Wider public include SCADA network management geospatial data (accessed under OGC or systems, relational database management via APIs) is typically in shapefile format. systems (like SAP SQL Anywhere), which also serve as connectivity models, and a GIS to capture, collect and present data on
96 SEC Newgate UK 97 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
98 SEC Newgate UK 99 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Water utilities. Geospatial data use: companies collate Key geospatial data: Exact data and the GIS team before then being made data on the location and performance of sources vary between organisations available to wider staff (e.g. to Planning Utility type: Water and wastewater services their own assets (pipes, mains, reservoirs, based on their remit and size, but Teams, Asset Management, Wastewater responsible for regional water distribution pumping and wastewater treatment typically include: Operations etc.) through an internal viewer and connections. stations) and how these interface with the or cloud-based products like ArcGIS Online both new and existing developments and > Topographic landscape (Ordnance and tools such as Geocortex Essentials Phase of involvement: Primarily involved in with environmental risk factors. Survey MasterMap; licenced) to provide internally-focused web services This includes: the Construction stage of the planning and > Land ownership (HM Land Registry; with greater functionality. housing journey, but also have some licenced) involvement in land identification, > Maintaining an up-to-date record of the Thousands of planning applications are operational network on a central asset > Property addresses (Ordnance Survey plotted on GIS annually including a allocation and planning process stages – AddressBase) helping developers and Local Authorities register in accordance with the description of the development and the understand existing network capacity and Water Act > Asset location records, jobs and application reference number. Regular environmental risks. > Modelling pre-planning inquiries and customer calls (own data) queries enable monitoring of works taking place near higher risk assets. Water planning applications to assess risk and > Environmental data such as surface companies also use data on predicted Key links: Developers, Local Authorities cost – water companies are not a water and water drainage, flood zones, demand to build hydraulic computer and other utility companies (including statutory consultee so have to contaminated land, areas of models of the network to assess capacity, Independent Connections Providers). proactively invest in sourcing outstanding natural beauty or special drawing on data from GIS. Some and reviewing scientific interest (accessed ‘manually’ Larger energy utilities will often engage companies (e.g. Welsh Water) also have a > Examining usage and forecasting future under OGL from Environment Agency; strategically with Local Authorities through dedicated department to help innovate and water use and environmental conditions BGS; MET Office; Coal Authority; various local forums to understand their extend use of GIS applications by to map predicted demand against Natural Resource Wales) regional development plans and to talk creating functions, tools or solutions that supply capacity and to inform asset > Planned developments and target land about their own investment plans. This will help leverage geospatial data. Third investment plans use (Local Authority plans, planning then lead to more informed local plans and parties will variously have access to an applications and developer inquiries) planning applications. internal viewer or a third-party service. > Customer database (Contract types; Developers can also request and pay for contact details; addresses) (own data) plans detailing water assets to inform planning and construction. Managing geospatial data: Data on assets is maintained within relational database Asset data is typically either raster management systems (like SAP SQL (legacy) or vector data, though can include Anywhere) which also serve as background image files of developer plans. connectivity models, and a GIS to Some companies are using LIDAR data capture, collect and present data on collected by field operatives and sent in a network assets. PDF or sketch for replicating in databases. Connections data includes co-ordinates GIS systems include GE Small World and and a site address which is typically ESRI ArcGIS. Data is gathered through collated in Excel format for entry into local development plan consultations, relevant databases. Wider public pre-development enquiries or planning geospatial data (accessed under OGC or applications, and where new water via APIs) is typically in shapefile format. connections, sewerage connections and requisitions are made. This is logged by
100 SEC Newgate UK 101 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Telecommunication organisations will work Managing geospatial data: Typically, closely with developers to understand how asset data is kept on proprietary software many houses are being built to predict purpose built for the telecommunications demand on the network at given times. sector.
Geospatial data use: Companies collate Eriksson Connect is also used to help data on the location and performance of design and create new broadband and their own assets (cables, ducts, cabinets telephone networks in an area. The and exchanges and splitter nodes). By software allows engineers to analyse and collecting this information, they can: design pre-build connections and joints in accordance with network regulations. Due > Maintain and keep an up-to-date to last-minute housing development record of the broadband and changes, telecommunication companies telephone network. typically design pre-build proposals and > Examine usage and forecasting future then finalise plans once construction of network capacity against different homes has begun. conditions to predict demand and inform investment decisions. They will Topographic landscapes, postal addresses also use this information to understand and asset locations are mapped using GIS who is likely to switch services. systems such as ArcGIS. Data is gathered through Local Authorities, open sources as > Explore the effect of new housing well as new housing development teams. developments on the network and Data is then logged by a case worker who whether this impacts on the number of manages and maintains a particular area Telecommunications cabinets and exchanges in the local of the network. Some information is utilities. area. cloud-based using AWS and ArcGIS which has enabled greater flexibility Key geospatial data: Sources amongst teams. Utility type: Telecommunications typically include: services responsible for installation and Asset data is usually raster, though maintenance of telephone cables, ducts, > Topographic landscape (Ordnance background images are used in relation to splitter nodes, cabinets and exchanges Survey MasterMap; licenced) new build developments that are provided that connect homes and businesses to the > Property addresses (Ordnance Survey by the architects or housebuilders. UK networks (Broadband & telephone). AddressBase) Proposed and currently live connections data includes co-ordinates and site > Asset location including telephone Phase of involvement: Primarily involved addresses that are typically collated in once a new housing development has cables, ducts, cabinets and exchanges Excel format and labelled NSI for entry gained planning permission to link to the (own data) into relevant databases. Across local broadband and telephone network; > Planned developments and target land telecommunication companies, they are this would include mapping cables, ducts, use (Local Authority plans, planning also looking to access other data and cabinets and exchanges. applications and developer inquiries) information with the help of APIs and paid data services. Key links: Housing developers and > Customer database (Contract types; Local Authorities. contact details; addresses) (own data)
102 SEC Newgate UK 103 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Conveyancing. Conveyancers will either collect data themselves or draw on third-party services Services: A conveyancer will prepare, (such as InfoTrack) to help with access to clarify and create any statutory legal datasets such as: documents such as the contracts of sale and any memorandum of transfers on > Land, property and title data behalf of a property buyer. The (HM Land Registry) conveyancing process tends to start as > Environmental risk data such as ground soon as an offer on a house or any other hazards (BGS Geosure; Coal Authority; similar transaction is accepted and is Law Society; Groundsure; Landmark) completed when the buyer receives > Property boundaries (HM Land the keys. Registry) > Warranties for boilers, gas certificates, Geospatial data use: HM Land Registry planning permissions and building hold the key information on property regulations (solicitors) ownership which is integral to the > Management information pack conveyancing process. Aside from this, containing information on plans for conveyancers may draw on information major works, restrictions from from Ordnance Survey and Local freeholder (management agency) Authorities to clarify potential risks or errors that may impact transactions. This data is typically then managed within Word, Excel or conveyancing software. There is very limited analysis of geospatial data (and certainly not in a geospatial form). Going forward, advances to technology are helping to speed up the conveyancing process for home buyers/sellers (e.g. DocuSign), and there is much support for Property Log Books as a means for people to manage and access property information.
104 SEC Newgate UK 105 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
In focus. Proptech.
106 SEC Newgate UK 107 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
PropTech: data > Real estate data (MHCLG; HM Land can include data visualisation solutions > Planned developments (Local Authority aggregation for Registry; Homes England; VOA; such as Building Information Modelling plans; GLA) purchase from other aggregators such (BIM) and interactive visualisations of both > Transport data such as tube stations, development. as CoStar and Estates Gazette) above and below-ground assets to help bus stops, public transport accessibility with cost estimation and planning. One > Postal addresses (Ordnance Survey levels (TfL; Ordnance Survey; Local Services: A large proportion of PropTech extension of this is the production of 3D AddressBase) Authorities; GeoPlace NSG; DfT) companies work in supporting pre-planning models of cities which can be used > Environmental data such as surface and planning applications, with services by architects to situate buildings in a > Environment data such as flood zones, water and water drainage, flood zones, utilised by investors and developers, wider context. air pollution levels, green belts planning consultancies, architects, and in contaminated land, areas of (Environment Agency) outstanding natural beauty or special some cases Local Authorities themselves. Geospatial data use: Exact data and > Listed buildings (National Heritage) scientific interest (Environment Agency; One key area of work here is in the sources vary between organisations based BGS, licenced) collation, cleaning, standardisation and on the service offered. Much of the data PropTech: presentation of data to enable > Education data on school location and here is managed using CAD software and customers to: performance (Google; Ofsted) game engines. facilitation of planning processes. > Transport data (TfL; Ordnance Survey; > Identify land and property, both Local Authorities; GeoPlace NSG; DfT) Companies involved in the more detailed on-market and off-market opportunities, representation of individual developments Services: A small number of PropTech including underdeveloped sites > Population data such as crime, typically either made use of surveying data companies operate in the development unemployment, socio-demographics > Assess the viability of opportunities (such as LIDAR) or utilised take-offs from phase, helping to facilitate the planning (ONS) including potential environmental risks 3D models, 2D drawings, parametric as- process itself. In England and Wales, 90% and risks to development posed by > Places of interest (Google) semblies and data already represented on of planning applications are submitted utility assets, likely success of planning GIS platforms in use. For construction electronically via the Planning Portal (a applications, predictions of future A smaller proportion of companies actively management, models can also include joint venture between MHCLG and demand, and estimated sales or draw on a wider set of data on how people scopes of work, materials, construction Terraquest Solutions), and a similar rental values interact with local environments (social costs and associated schedules, all proportion are submitted to the media, search data, credit card provided by developers and contractors. It Scottish Government’s ePlanning portal. > Connect with relevant stakeholders (land/property owners) transactions, shared economy data) to is rare that wider geospatial data is used, These services help ensure that identify patterns with capital values and and where it is used (e.g. utilities data, applications are collected and collated in a Geospatial data use: Companies involved growth sets. transport infrastructure), it is provided by standardised way on behalf of local in data aggregation both collect and collate the developer. planning authorities. a very wide range of data that could inform PropTech: data decisions. This variously includes: visualisation for For companies involved in the Over recent years, there has also been an representation of larger plots of land and expansion in services available to development. > Topographic landscape including urban developments, the foundation is raw developers and local planning authorities building curtilage (Ordnance Survey aerial imagery, which is often collected on for consulting and engaging with members Services: Once suitable plots are MasterMap, licenced) behalf of Ordnance Survey. This can then of the public on proposed developments. identified, a range of different be overlaid with wider geospatial data For larger developments, developers may > Planned developments target land use companies offer tailored services and such as: use engagement platforms like and schemes in progress (Local solutions to facilitate the planning and Commonplace to engage with Authority plans; GLA) design of housing developments, and to > Topographic landscape (Google Maps) neighbouring residents and inform the cost estimation of any > Land ownership (HM Land Registry > Land ownership (HM Land Registry community groups to pre-emptively construction work that might take place. National Polygon Service, licenced) National Polygon Service, licenced) address any potential issues or objections These services are typically used before that may be raised, while for planning planning applications are submitted and
108 SEC Newgate UK 109 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
authorities it can be used as part of the PropTech: PropTech: public consultation process prescribed in > Estate agents and prospective buyers support for conveyancing. property management. article 15 of the Development Management to understand market trends including Procedure Order. previous prices that have been used to Services: In recent years there has also Services: Recent years have seen market homes and sales prices been increasing support for the use of increased use of digital twin technologies – Geospatial data use: The Planning Portal > Conveyancers and prospective buyers online property log books that provide virtual replicas of as-built structures – processes several thousand planning to assess risk (e.g. exposure to the risk homeowners and prospective buyers with particularly in commercial developments. applications daily, all of which involve the of damage, disruption and financial loss detailed information about a property’s collation of a set of mandatory information from ground hazards) and to history (including developments, planning While there has been more limited use in on a property, depending on location and value properties information and building control residential housing, these technologies can type of development. Data tied to the > Prospective buyers and renters to information). This information is available be applied to residential developments and property can include: identify and compare different locations through a secure web service. In the used as part of the marketing and sales for moving home, accounting for needs future, this could form a standardised collateral, and also enable the collation > Access/rights of way and parking and preferences (e.g. schools, repository of property information required and analysis of data relating to the > Waste storage transport links etc.) for completing a transaction, and interaction between buildings, users > Building materials therefore provide efficiencies in the and the wider environment, helping > Flood risk, foul sewage and SSSI Geospatial data use: exact data and conveyancing process. scenario future outcomes and > Type of proposed housing including sources used vary between companies facilities management. use ownership as relevant to the solution being offered to The Residential Logbook Association is the customers but can include: MHCLG supported trade association for Geospatial data use: Digital twin models Public engagement and consultation companies providing digital logbooks for have the potential to incorporate a wide platforms provide a forum through which > Real estate data (MHCLG; Homes the residential property market. range of geospatial data, but many people share their opinions about a England; VOA; RightMove; Zoopla, companies report focusing ‘inside of the proposed development. Beyond the use of under open APIs) and data on Geospatial data use: The data collected property line’. The data collected varies a topographical map (e.g. Google Maps), properties under management including as part of a property log book is relatively depending on the intended use of there is no other geospatial data that is market value, sales prices, pictures of standardized and primarily relates to the solution. collated or collected. the property, property size and features of the property and property comments from viewings (clients) history provided by developers. For building management, it includes These include: dynamic information about the property > Land ownership (HM Land Registry) PropTech: data (e.g. temperature, humidity, CO2, VOC aggregation for sales. > Population data (ONS) > UPRN and PM2.5 values) derived from > Education data on school location and > Tenure internal sensors. > House type Services: At this end of the housing performance (Google; Ofsted) > Bedrooms, bathroom etc. In a minority of cases some digital twins journey, customers vary from estate agents > Transport data (TfL; Ordnance Survey; > Parking spaces incorporate wider data – provided by and conveyancers through to individual Local Authorities; GeoPlace NSG; DfT) > Council tax band clients - on a range of wider geospatial home buyers and renters. Many of the > Places of interest and local shops > Warranties data including: services offered again involve the collation, (Google) > Utility providers and energy information cleaning, standardisation and presentation > Traffic levels and walkability > Plans/development plans of data to enable: > Environmental risk data such as ground > Environmental factors > Any relevant legal information hazards (BGS Geosure; Coal Authority; (e.g. air pollution) > Developers and investors with data to Law Society) > Land development areas and understand the optimum pricing of their building permits properties (for rental/sale) and > Broader economic factors influencing factors (e.g. market values)
110 SEC Newgate UK 111 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Annex 4 Research instruments.
112 SEC Newgate UK 113 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Survey questions. What are the main non-Local Authority Do you place a daily limit on the number If yes, is Geospatial Information/ geospatial datasets used in support of of times people can carry out their own Geography represented there? Approximately how many staff work directly planning and housing within your searches of data held by [named Local > Yes with geospatial data to inform housing and Local Authority? Authority] > No planning decisions at your Local Authority > Yes > Unsure (e.g. in developing local plans, assessing What are the top 3 barriers to maximising > No planning applications)? the value of geospatial data at a > Unsure Does your organisation utilise services Local Authority level? from any industry/professional bodies Does your Local Authority have a > Lack of geospatial skills and resources [If yes then] Please explain why? for the development of skills in staff? For geospatial/Geographic within the Local Authority example recognition of professional status Information strategy? > Data accessibility (including licencing Does the provision of geospatial data (CGeog, RICS, CIWEM, etc.) > Yes restrictions) (across searches, pre-application & > Yes > No > Poor quality data application stages) generate revenue > No > Don’t know > Lack of consistency in geospatial data for your Local Authority? > Unsure standards and definitions [If Yes then] Is there a link between this > Interoperability of data (i.e. issues Yes – the authority generates a profit What, if any, challenges are there in terms strategy and other corporate strategies managing and manipulating in GI through charges for licensing data and of geospatial capability or capacity in your (e.g. Business intelligence Strategy, Data software due to format of data and performing searches Local Authority? Strategy, Digital Strategy etc.)? missing information) > Yes, the authority covers costs through > Yes (Please specify which, if known) > Inadequate IT infrastructure/hardware charges for licensing data and [If not mentioned] Is recruitment or > No > Network restrictions and/or lack of performing searches retention of individuals with geospatial > Don’t know appropriate geospatial information > No, the authority does not charge for skills an issue/challenge? software licensing data and performing searches > Yes – recruitment What are the primary areas where geospa- > Lack of corporate buy-in and strategy > Unsure > Yes – retention tial data/services are used in your planning for use of geospatial data and > Prefer not to say > No and housing work? information > Unsure > Development of local plans > Other (please specify) What software do you predominantly use > Review of planning applications in your Local Authority to view and/or [If recruitment or retention is an issue then] > Land charge searches Has your Local Authority added geospatial manage geospatial data? Why do you think this is the case? > Production of maps and plans data to the data.gov portal? > Salary, terms and conditions > To inform open access material > Yes What formats do you make geospatial data > Local jobs market provided on website for residents and > No available in? > Competition from other geospatial businesses > Unsure > PDF employees > Other (please specify) > Excel/CSV > Lack of geospatial skills pool in [If no then] Please explain why? > Vector GIS file formats local area Are geospatial tools (web mapping [If yes then] How many datasets have you > Raster GIS file formats > Limited development/progression systems) used by non-Geographic added? > CAD file formats opportunities Information specialists in your > 1-10 datasets > Other > Lack of reward and recognition of skills Local Authority? > 10-25 datasets > Other > Yes > 25+ datasets Is there a knowledge forum/skills sharing > No function in your Local Authority? > Don’t know > Yes > No > Unsure
114 SEC Newgate UK 115 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
[If recruitment or retention is an issue Does your Local Authority have a Stakeholder interview guide. then], What would help recruitment or dedicated Geographic Information team retention of individuals with specialist or are geospatial experts dispersed across 1. If we were to simplify the Planning and Housing journey down to four stages: geospatial skills within your different teams (e.g. IT; Data and Insight (i) identifying and acquiring land for housing, (ii) gaining planning permission housing, (iii) building homes, and (iv) marketing and selling homes: Local Authority? etc.)?
A. At what stages does your company typically operate? What geospatial skills do you believe > Geospatial expertise sits within one B. what other types of organisation (or professions) do you interface with during these stages are key to your organisation? Select all Geospatial Information (GI/GIS) team and what is the nature of the relationship? that apply. > Geospatial expertise is spread across multiple teams 2. What geospatial data is used by your company to support the business in > Data capture > There is no geospatial team or planning and housing work being undertaken? Types/forms of spatial data used, who uses > Data management geospatial expertise in the this and how is it used > Programming Local Authority 3. What are the key sources and datasets through which this data is currently accessed? Key > Data science > Don’t know issues that hinder work and developments that have helped support effective and efficient > Analysis use of spatial data (including any ‘best-in-class’ examples) in planning and housing > Application development [If some form of expertise/team then] 4. How is geospatial data currently managed (stored, processed and analysed) by > Webmaps Please could you explain the rationale for your company? > Other? Please specify the structure of where geospatial expertise sits, and any challenges/benefits to this. 5. What staff skills are needed to most effectively utilise geospatial data for Are there any notable geospatial skill gaps planning and housing? Include capability or capacity challenges, and use of services from any industry/professional bodies in your Local Authority? If so what are Is there a Geospatial/GI lead or data these gaps? coordinator in your Local Authority? 6. Are you aware of any current or forthcoming initiatives that relate to the collection, > Yes management or use of geospatial data that you believe could positively influence planning and housing in the UK? What, if any benefits are there to having > No in-house geospatial capabilities compared > Don’t know to outsourcing or working with shared- services across multiple Local Authorities? If yes, can we have contact details?
How can best practices in the use of geospatial data for planning and housing be most effectively shared amongst Local Authorities and other organisations?
What are some of the location-data related initiatives you are currently undertaking at [named Local Authority] to inform planning and housing?
What, if any, future location-date related initiatives are on the horizon at [named Local Authority] to inform planning and housing decisions?
116 SEC Newgate UK 117 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Annex 5. List of participating organisations.
118 SEC Newgate UK 119 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Participating stakeholders. Participating Local Authorities.
1Spatial Guinness Partnerships SGN Allerdale Borough Council Gedling Borough Council Accucities Home Builders Federation Skanska / Boklok Amber Valley Borough Council Gloucestershire County Council AgentOS Homes England South East Water Antrim & Newtownabbey Borough Council Gosport Borough Council Baker Estates Houzen SP Distribution Ltd and SP Babergh District Council Gravesham Borough Council Berkeley Group Hume Planning Manweb plc Bassetlaw District Council Halton Borough Council Bestarea4me HM Land Registry SSE Bath & North East Somerset Council Hambleton District Council Bovis Homes Hybrid Planning Stonebond Blaenau Gwent County Borough Council Harlow Council Bristol Water and Development Teal Legal Bolton Metropolitan Borough Council Harrogate Borough Council British Geological Surveys Knight Frank Terrafirma Borough Council of Kings Lynn Havant Borough Council British Property Federation Landmark TerraQuest & West Norfolk Hertfordshire County Council Built-ID LiveWest The Improvement Service Boston Borough Council Hinckley & Bosworth Borough Council Cadent Gas McAlpine The Partnership Bracknell Forest Council Huntingdonshire District Council Catesby Estates McCarthy and Stone The Planning Portal Brentwood Borough Council Ipswich Borough Council Chimni Metrikus TM Group Bristol City Council Isle of Wight Council Christine Williams MHCLG Town and Country Bromsgrove District Council Kingston upon Hull City Council Consulting Mott MacDonald Planning Association Broxtowe Borough Council Knowsley Metropolitan Borough Council CityZen Nimbus Maps UK Hydrographic Office Bury Metropolitan Borough Council Leicester City Council Classic Folios Nomitech UK Power Networks Cambridgeshire County Council Lewes District Council Coal Authority Open Systems Lab United Utilities Castle Point Borough Council Lichfield District Council Commonplace Optimis-Consulting Urban & Civic Causeway Coast & London Borough of Hackney Convey Law Orbit Urban Intelligence Glens Borough Council London Borough of Conveyancing Association Ordnance Survey Valuation Office Agency Central Bedfordshire Council Richmond upon Thames Crest Nicholson OpenReach Vinci Charnwood Borough Council Luton Borough Council Datscha OSP Architecture Vistry Partnership Chelmsford City Council Mid Suffolk District Council Digdat Placemaker.io VU.City City of London Corporation Mid Sussex District Council DLA Architecture Planning Portal Wales and West Utilities Copeland Borough Council Middlesbrough Council Elecosoft PropertyLogBook Welsh Water Corby Borough Council Mole Valley District Council Electricity North West Realyze Wessex Water Cyngor Gwynedd Monmouthshire County Council Energy Assets Pipelines Richard Slipper Western Power Cyngor Sir Ynys Mon Neath Port Talbot County Borough Council Limited Rob Duncan Planning Willmot Dixon Holdings Daventry District Council New Forest District Council ES Pipelines Consultancy Scottish Hydro Electric Denbighshire County Council Newark & Sherwood District Council ESRI Royal Institution of Power Distribution plc Derbyshire Dales District Council Newry Mourne & Down District Council Feilden Clegg Bradley Chartered Surveyors Yovoh Derry City & Strabane District Council North Devon District Council Studios Scottish Government Z Mapping Dover District Council North East Derbyshire District Council GeoPlace Search Acumen Durham County Council North Hertfordshire District Council Grainge Seeable East Hampshire District Council North Norfolk District Council Groundsure Severn Partnership East Lindsey District Council North Somerset Council GTC Pipelines SENSAT Eastleigh Borough Council North Tyneside Council Elmbridge Borough Council North Warwickshire Borough Council Exeter City Council North West Leicestershire District Council Flintshire County Council North Yorkshire County Council Forest of Dean District Council Oxford City Council
120 SEC Newgate UK 121 SEC Newgate UK Planning and Housing Landscape Review 2021 Planning and Housing Landscape Review 2021
Participating Local Authorities.
Oxfordshire County Council Torfaen County Borough Council Pendle Borough Council Tunbridge Wells Borough Council Powys County Council Uttlesford District Council Ribble Valley Borough Council Vale of Glamorgan County Rochdale Metropolitan Borough Council Borough Council Royal Borough of Kensington & Chelsea Vale of White Horse District Council Royal Borough of Windsor & Maidenhead Warrington Borough Council Rugby Borough Council Warwick District Council Runnymede Borough Council Warwickshire County Council Rushcliffe Borough Council Wellingborough Borough Council Rushmoor Borough Council West Lancashire Borough Council Salford City Council Wigan Metropolitan Borough Council South Cambridgeshire District Council Winchester City Council South Northamptonshire Council Wirral Metropolitan Borough Council South Staffordshire Council Worcester City Council Southend-on-Sea Borough Council Worcestershire County Council St Albans City & District Council Wychavon District Council St Helens Council Wyre Council Surrey Heath Borough Council Wyre Forest District Council Swindon Borough Council Telford & Wrekin Council Tendring District Council Test Valley Borough Council Three Rivers District Council Thurrock Council Torbay Council
122 SEC Newgate UK 123 SEC Newgate UK