Acceptance Testing for Road Surface Monitoring Vehicles in Finland

VTI rapport 622A www.vti.se/publications Published 2008

Acceptance testing for road surface monitoring vehicles in Finland

Leif Sjögren Thomas Lundberg Mats Wiklund

Publisher: Publication: VTI rapport 622A

Published: Project code: Dnr:

2008 80676 2007/0124-28

SE-581 95 Linköping Sweden Project: Kvalificering av vägytemätningar, Finland 2007

Author: Sponsor: Leif Sjögren, Thomas Lundberg and Mats Wiklund Finnish Road Administration

Title: Acceptance testing for road surface monitoring vehicles in Finland

Abstract (background, aim, method, result) max 200 words: VTI has carried out acceptance testing of companies that would like to do road surface monitoring in Finland. This has been done on commission of the Finnish Road Administration. This kind of acceptance testing has been done in Sweden by VTI in cooperation with the Swedish Road Administration several times (four times). With the experience of the tests in Sweden a test method adjusted for the Finnish needs have been set up. The purpose of the method is to accept or reject the participating companies for doing either object or network measurements or both. This is done by checking the validity and repeatability for the repeated condition measurements of the object part and the reproducibility, by using several equipments of the same type for the network part. The tests for the object part involve measurements at test sections including measuring with reference methods as well as repeated measurements on a route. For the reproducibility test, done at the network measuring acceptance, runs with different combinations of vehicles and drivers/operators are carried out. The tests give answers to questions like: • The technical skill to measure according to the procurement specifications. • The ability and type of organisation to take care of and process data under given circumstances like this test. • The ability to deliver data of right quality in time.

To be accepted as a contractor of network level measurements the company also has to be accepted for object measurements.

Keywords: Road surface monitoring, qualification, reference, condition, test, repeatability, reproducibility ISSN: Language: No. of pages: 0347-6030 English 41

Utgivare: Publikation: VTI rapport 622A

Utgivningsår: Projektnummer: Dnr:

2008 80676 2007/0124-28

581 95 Linköping Projektnamn: Kvalificering av vägytemätningar, Finland 2007

Författare: Uppdragsgivare: Leif Sjögren, Thomas Lundberg och Mats Wiklund Vägförvaltningenn i Finland

Titel: Kvalificeringstester för vägytemätning i Finland

Referat (bakgrund, syfte, metod, resultat) max 200 ord: VTI har på uppdrag av finska Vägförvaltningen utfört tester för att kvalificera företag som vill utföra vägytemätningar i Finland. VTI har utfört motsvarande tester i samarbete med det svenska Vägverket vid ett flertal tillfällen (fyra stycken). Med erfarenhet av dessa har en testmetod utarbetats som sedan använts i uppdraget åt Vägförvaltningen i Finland. Metoden innebär test av validitet och repeterbarhet för objektmätning och reproducerbarhet vid nätverksmätning. Tester för objekt innebär att man mäter utvalda teststräckor upprepade gånger, vilka också blivit referensmätta, vidare att man kontrollerar repeterbarheten för mätning med hjälp av en längre testslinga. Mätningarna på teststräckorna jämförs med referensen och på testslingan kontrolleras repeterbarheten. Vid kontroll av nätverksmätning kontrolleras mätningar av längre slingor (rutter) efter en rutin som möjliggör test av reproducerbarhet. Olika kombinationer av fordon och förare/operatörer jämförs. Testerna har utförts för att få svar på frågor som:

• Teknisk skicklighet att utföra mätningar enligt upphandlingsunderlaget • Förmågan att utföra ett mätuppdrag • Förmågan att leverera rätt data i tid.

För att bli godkänd som leverantör av nätverksmätning måste företaget först godkännas för mätning av objekt.

Nyckelord: vägytemätning, kvalificering, referens, tillstånd, test, repeterbarhet, reproducerbarhet ISSN: Språk: Antal sidor: 0347-6030 Engelska 41

Foreword This document reports methods and findings used to qualify road surface monitoring services to be done in Finland. The work has been lead by Leif Sjögren, VTI, on commission of the Finnish Road Administration (Tiehallinto). Tiehallinto also supports the publishing of this report. A reference group consisting of Harri Spoof, Vesa Männistö from Pöyry Infra Oy and Juho Meriläinen from Tiehallinto have assisted the work. Thomas Lundberg, VTI, has been responsible for the field tests. Thomas has together with Mats Wiklund, VTI, made most of the data analysis. Romuald Banek, VTI, operated the Primal (longitudinal profile reference equipment). Stig Englund, Peter Andrén and Nils Gunnar Göransson, VTI, operated the VTI Volvo TVP (transverse profile reference equipment). The company WSP made all Total station measurements and the Swedish Road Administration, division Production, delivered all road work security arrangements. The authors express their gratitude to all participants for the skilled support making the project successful.

Linköping, July 2008

Leif Sjögren

VTI rapport 622A Cover: Leif Sjögren, VTI

Quality review Review seminar was carried out on 25 June, 2008 where Anita Ihs, VTI, reviewed and commented on the report. Leif Sjögren and Thomas Lundberg have made alterations to the final manuscript of the report. The research director of the project manager, Gudrun Öberg, examined and approved the report for publication on 15 August, 2008.

VTI rapport 622A Table of content

1 Introduction ...... 9 2 Scope of this report...... 11 3 Test methods ...... 12 3.1 The validity test...... 13 3.2 The repeatability and reproducibility test...... 21 4 Data evaluation...... 28 5 Results per participant ...... 30 5.1 Test sections...... 30 5.2 Routes ...... 34 5.3 Subjective assessment of performance during the tests...... 35 6 Conclusions ...... 37 7 Recommendations...... 38 7.1 Quality test during the period of agreement...... 38 7.2 Test after a change of equipment ...... 38 7.3 Test before starting the season ...... 39 8 List of references ...... 41

VTI rapport 622A

VTI rapport 622A Acceptance testing for road surface monitoring vehicles in Finland by Leif Sjögren, Thomas Lundberg and Mats Wiklund VTI (Swedish National Road and Transport Research Institute) SE-581 95 Linköping Sweden

Summary VTI has carried out acceptance testing of companies that would like to do road surface monitoring in Finland. This has been done on commission of the Finnish Road Administration. This kind of acceptance testing has been done in Sweden by VTI in cooperation with the Swedish Road Administration several times (four times). With the experience of the tests in Sweden a test method adjusted for the Finnish needs have been composed. The purpose of the method is to accept or reject the participating companies for doing either object or network measurements or both. This is done by checking the validity and repeatability for the object part and the reproducibility for the network part. The tests for the object part involve measurements at test sections including measuring with reference methods as well as repeated measurements on a route. For the reproducibility test, done at the network measuring acceptance, runs with different combinations of vehicles and drivers/operators are carried out. The tests give answers to questions like: • The technical skill to measure according to the procurement specifications. • The ability and type of organisation to take care of and process data under given circumstances like this test. • The ability to deliver data of right quality in time. To be accepted as a contractor of network level measurements the company also has to be accepted for object measurements. Four companies did participate in this acceptance test, Destia, Andament, Road Consulting and Ramboll. The companies could choose to take part in either only acceptance for object measurements or both object- and network measurements. To take part in the complete program the company had to use two vehicles in the network part of the test. Only Destia took part of the network test. Three 1,000 metre sections with a good variation of ruts and IRI were used. The reference measurements of longitudinal profiles (used to calculate IRI, International Roughness Index) were done for the full length of the sections and partly for transverse profiles (used for calculation of rut depth). In addition to the test sections three routes were measured (approximately 80 km each). Two of the routes were used for the network acceptance and one for the object acceptance. As the reference for rut depth an equipment called VTI-TVP (Cross Profile Scanner) is used. VTI-TVP is a vehicle equipped with a laser sensor scanning the transverse profile. The scanning movement is done while the car is standing still. After a profile is collected the car moves half a metre and the procedure is repeated. 300 metres of the test sections were measured with the VTI-TVP. The VTI developed equipment called Primal was used to collect the longitudinal profiles. Primal is composed of two main parts, a small remote controlled trolley and a laser beam transmitter. The trolley is measuring the distance between the laser beam and the road profile while moving along the section. To keep the required precision the

VTI rapport 622A 5 measured sections can be up to 10 metres. The profiles from the Primal are connected with geodetic measurements (only height) by using a Total station at the end and start points of the Primal profiles.

Tested parameters The following parameters were tested for the acceptance of object measurement: • Maximum rut depth 1 • Rut depth left 1 • Rut depth right 1 • IRI right 1 • Height of ridge 1 • IRI4 right • Crossfall regression • Curvature • Gradient • Megatexture right • Macrotexture right 1 The parameter is tested against reference measurements from test sections as well as repeatability from repeated runs on one route. The following parameters were tested for the acceptance of network measurement: • Maximum rut depth • Rut depth left • Rut depth right • IRI right • Height of ridge • IRI4 right • Crossfall regression • Curvature • Gradient • Megatexture right • Macrotexture right.

Results One of the purposes with this test was to decide which of the participating companies had the sufficient quality within the organisation to accomplish object measurements in Finland. The second purpose was to decide whether the company participating in the network test had the sufficient quality within the organisation to accomplish network measurements of the governmental roads in Finland. The results from the tests were the acceptance of Destia and Ramboll (after a renewed test during the spring of 2008 Andament is also accepted) as an organisation that is allowed to make object measurements in Finland. Destia that also participated in the network part of the test was accepted for that purpose.

6 VTI rapport 622A Kvalificeringstester för vägytemätning i Finland av Leif Sjögren, Thomas Lundberg och Mats Wiklund VTI 581 95 Linköping

Sammanfattning VTI har på uppdrag av finska Vägförvaltningen utfört tester för att kvalificera företag som vill utföra vägytemätningar i Finland. VTI har utfört motsvarande tester i samarbete med det svenska Vägverket vid ett flertal tillfällen (fyra stycken). Med erfarenhet av dessa har en testmetod utarbetats som sedan använts i uppdraget åt Vägförvaltningen i Finland. Metoden innebär test av validitet och repeterbarhet för objektmätning och reproducerbarhet vid nätverksmätning. Tester för objekt innebär att man mäter utvalda teststräckor upprepade gånger, vilka också blivit referensmätta, vidare att man kontrollerar repeterbarheten för mätning med hjälp av en längre testslinga. Mätningarna på teststräckorna jämförs med referensen och på testslingan kontrolleras repeterbarheten. Vid kontroll av nätverksmätning kontrolleras mätningar av längre slingor (rutter) efter en rutin som möjliggör test av reproducerbarhet. Olika kombinationer av fordon och förare/operatörer jämförs. Testerna har utförts för att få svar på frågor som: • Teknisk skicklighet att utföra mätningar enligt upphandlingsunderlaget • Förmågan att utföra ett mätuppdrag • Förmågan att leverera rätt data i tid. För att bli godkänd som leverantör av nätverksmätning måste företaget först godkännas för mätning av objekt. Fyra företag deltog i testerna, Destia, Andament, Road Consulting och Ramböll. Deltagarna kunde välja att delta i kvalificering för nätverksmätning eller enbart för objektmätning. För deltagande i nätverksmätning krävs att man deltar med två mätbilar. Endast Destia deltog i den kompletta testen inkluderande både objekt- och nätverks- mätning. Tre ca 1 000 meter långa teststräckor med varierande jämnhet och spårdjup ingick. Referensmätning av längsgående vägprofil (används för att beräkna IRI (International Roughness Index)) utfördes på hela längden av teststräckorna och tvärprofiler (används för att beräkna spårdjup) referensmättes på delar av teststräckorna. Dessutom ingick tre längre slingor, ca 80 km var. Två slingor används endast för dem som deltar för godkännande av vägnätsmätning och en slinga för godkännande av objektmätning. Som referensmätare användes för spårdjup VTI TVP. VTI TVP är en bil utrustad med en lasersensor monterad på en balk som skannar vägens tvärprofil. Mätningen sker stillastående över den aktuella tvärsektionen. Då mätningen är klar flyttas bilen en halv meter framåt och proceduren upprepas. På detta sätt mättes ca 300 meter av teststräckorna. Den så kallade Primalen används för att mäta längsgående profiler som i sin tur används för att beräkna ojämnhetsmått från. Primalen består av två delar, en liten fjärrstyrd vagn som känner av vägprofilen samt en sändare som skickar ut en laserstråle parallellt med vägprofilen. Vagnen följer laserstrålen och mäter avståndet mellan vägprofilen och

VTI rapport 622A 7 laserstrålen. På detta sätt mäts 10 meter långa profiler . Dessa kopplas sedan samman med hjälp av geodetisk mätning (endast höjd) i ändpunkterna av profilerna.

Testade mått De mått som testades för objektmätning var: • Maximalt spårdjup (1 • Spårdjup vänster (1 • Spårdjup höger (1 • IRI höger (1 • Spårryggshöjd (1 • IRI4 höger • Regressionstvärfall • Kurvatur • Backighet • Megatextur höger • Makrotextur höger. (1 parameter testad mot såväl referensmätning på teststräcka som upprepad mätning på testslinga.

De mått som testades för nätverksmätning var: • Maximalt spårdjup • Spårdjup vänster • Spårdjup höger • IRI höger • Spårryggshöjd • IRI4 höger • Regressionstvärfall • Kurvatur • Backighet • Megatextur höger • Makrotextur höger.

Resultat Ett mål med testerna var att avgöra om företaget hade tillräcklig kvalité inom sin organisation för att få utföra objektmätning i Finland och ett annat mål var att testa om det företag som deltog i nätverksdelen av testen hade tillräcklig kvalité (med flera mätfordon) för att få utföra de årliga mätningarna av det statliga finska vägnätet (nätverksmätning). Det resultat som erhölls var att Destia och Ramböll godkändes som leverantörer av objektmätning (efter en förnyad test under våren 2008 har även Andament godkänts) och det företag (Destia) som deltog i testen för godkännande som leverantör av nätverksmätning godkändes.

8 VTI rapport 622A 1 Introduction Road evenness is an important road surface characteristic, having an influence on the functional characteristics of the road, such as accessibility, vehicle operating costs including fuel consumption, vehicle wear and also on road user effects such as riding comfort and driver fatigue. Poor road surface evenness can accelerate road deterioration by generating dynamic loads. To have an overview of and manage the road network the condition is monitored regularly. This is done by profilometers. The collected data normally support a PMS (pavement management system). In many cases the performance of contractors is controlled by measuring the achieved road condition with a profilometer. All this require knowledge of the quality to make the services and data assured.

Profiling devices The change from response type road evenness measuring systems to road profiling systems that can measure profile at highway speed has increased the need to develop practical and meaningful methods of validating pavement evenness measurements. Practical specifications for road profilers need to be established and parameters developed that can be used to make objective statements of road profiler performance. Today a large number of high-speed systems of various qualities exist. There is a need to test the accuracy and precision of the devices. The test focuses on the comparison of the profiles produced by the profilometers with true profiles. Regulations for calibrating and type-approving testers will soon be necessary in order to conform to quality assurance rules. Developing the technical aspects of such regulations will require a comprehensive knowledge of the performances of the available systems.

The use of unevenness information Some countries and regions are now utilizing profiling devices for monitoring and evaluating contractor compliance with smoothness specifications on pavement construction projects. These specifications often involve bonuses or penalties for the paving contractor and therefore may have a direct and significant financial impact on the project participants. As a result, verification/validation of the precision and accuracy of these profiling devices has become ever more critical. The major use of road condition monitoring results is to support PMS (Pavement Managements Systems). The PMS use the data to prioritize maintenance candidates, allocate maintenance budgets and verify actions that have been utilized. All those applications acquire certain accuracy. Some PMS uses trend analysis to predict conditions. The prediction is based on at least three measurement occasions from three consecutive years. A small error in any of those results can disturb the prediction seriously. The consequence is that also data that support PMS has to be of high accuracy.

Profiling principles Profiles are measured either along the road or transversely. There are different technical solutions considering the direction of measuring. Road profiling is used to assess

VTI rapport 622A 9 different effects from road surface condition. Profilometers do not necessary give the true geometric profile. Unevenness is defined to be 0.5 to 100 metres and this is also the aim for the profilometeres to cover. This has lead to development of two main technical methods used to perform profile measurements. The differences in the methods are to what height (level) they refer each reading to. There are two options; to use a reference plane integrated in, and that follows, the equipment during the measurement. The other method is to use a static reference plane/ point. The first method is called the moving reference plane (MPR) since it relates its reading to the integrated plane and the latter is called Stationary Reference Plane (SRP) since it relates its reading to the stationary point/ plane. Many methods often use a combination of the principles. In this work we define reference method as a way that all involved parties agrees to as the standard. One must remember that there is no available cost effective way of measuring the true road profile. Many high-speed profilometers do a very good job in creating profiles with high accuracy. Some profilometres, however, have problems in curves while others have problems with varying speed. This implies that there is a need for a test to check the profilometer’s dynamic behaviour (production environment) as well as testing the accuracy with the slow speed reference methods. The equipments used as references today are working at slow speed and road closure is needed. The MRP principle has to use previous values to build up a profile. This means that any error will accumulate and increase. Therefore, to support high precision requirements, adjustments have to be done with Rod & Level or Total station readings. One disadvantage with the SRP principle is the road curvature that defines the possible length of the stationary reference plane. If the reference plane is made from a laser beam, the precision of the laser beam deviation sets the limit as well. The laser plane reference can also be affected by optical noise disturbances in the air, e.g. different heat layers.

Quality tests High-speed profilometers parameters in speeds up to 90 km/h and some even more. In the process of verification/validation of the precision and accuracy of these profiling devices the speed is an important factor. The speed has influences both on lateral position and possible detectable wavelengths. A test method often involves the use of test sections that has to be measured both by the reference equipment and the tested equipment. Test sections with different levels of evenness are chosen for repeated runs. The high-speed profilometer in operation should follow the same line with none or little lateral deviation. In most cases a guideline is painted along the test section as a help to minimize deviation. One of the most important sources of error in a comparison is that the tested equipment and the reference did not measure the same line along the road. This is especially noticeable when laser equipment is used because they use a narrow laser ray. Investigations show that skilled or trained operators do a better job.

10 VTI rapport 622A 2 Scope of this report This report describes the results from an acceptance test of road surface monitoring devices done on commission of the Finnish Road Administration. First there is an introduction describing the need of reference methods. This is followed by a chapter on test methods and limits that are used. A chapter describing the statistical principles and algorithms is followed by some chapters on the results. Finally conclusions and recommendations are stated.

VTI rapport 622A 11 3 Test methods Objective measurements of the pavement condition in Finland are divided into two levels, network and object level. At the network level a contract between the Finnish Road Administration and the measurement company specifies a given amount of kilometres that are to be measured annually. The object level measurements involve measurements on specific maintenance objects and service contracts. The results are used to assess the contractor’s performance and to what degree the required standards are fulfilled. This in turn is used to set the level of penalty or bonus. VTI´s part was to assess the performance and ability of candidates who had applied to measure in Finland. This was established by looking at: • The technical ability to measure according to the procurement specifications. • How the personnel accomplished the assignment. • The organisation to take care of and process data under given circumstances. • The ability to deliver data of right quality in time. VTI have designed test methods to meet the above mentioned requirements and have experience from similar tests during the years. One part of the tests is designed to cover acceptance for network measurements. The other part of the test assessments was to determine which measurement companies have the ability to conduct object level measurements. To be accepted for measurements of the full network the companies had to pass the object level test as well as the network level test. The different parts are described in the Table 1.

Table 1 The different parts for the acceptance test.

Object level Network level acceptance acceptance Validity test at reference X X measured test sections Route measurement X X (part 1) Extended route measurement X (part 2)

The object level acceptance test is in turn also divided into two parts, a validity test and measurements at a route. There are different requirements to be fulfilled in order to be approved for the network and the object level; therefore the participating companies had to apply for taking part in either both tests or only the object level part. In the end, only Destia took part in the network test and all applicants including Ramböll, Andament and Road Consulting took part in the object level test.

12 VTI rapport 622A The table below shows how the companies participated.

Table 2 The extent of the companies participation and the terms of measurement vehicles and sections/routes.

Route A Route B Route C Validity test (network level) (network level) (object level) test sections E, F and G (object level) Destia vehicle A X X X X Destia vehicle B X X Ramböll vehicle C X X RoadConsulting vehicle D X X Andament vehicle E X X

3.1 The validity test The validity test has the purpose to show if the companies have the technical ability to measure according to the requirements of the Finnish Road Administration. This part was mandatory for all participating companies. VTI have long experience in conducting validity tests with the purpose to assess and decide technical ability. This has e.g. been done four times in Sweden on commission of the Swedish Road Administration (VV pub 65, 2000, VV pub 65, 2002, VV pub, in progress, 2004), in Germany on commission of BAST and in the European PIARC evenness experiment, called “the Filter test”, ( De Wit et al. 1999, Descornet, 1999, Descornet, 2002)).

3.1.1 Reference measurements The basic of the method is to compare the results from the participating vehicles with reference measurement. The reference systems used in the test are called the Primal and the VTI-TVP (cross-profile scanner). Both are equipments developed and built by VTI, originally for research purposes. The Primal is used to measure a “true” longitudinal profile and the measurement is combined with a geodesic measurement with a Total station.

Guide line (driving support) The test sections are prepared with a painted guide line, applied before the measurements start, showing the lateral position where the reference is measured. This is to support the participating companies where to measure. This is more described in chapter 3.1.2.

VTI rapport 622A 13 Total station (height measuring of points) The Total station is normally used for geodesic purposes to measure coordinates (X, Y and Z). A Total station is a type of advanced rod and level instrument, see Figure 3-1. The principle is that an instrument measures angels and distance to a prism. This is done by sending an infrared beam against a prism that then returns the beam to the instrument. The action radius is up to 300 meter if a mean error less than 1 mm is wanted. In this application the prism is placed along the test section every 10 metres and the height information from the instrument are calculated,

The Primal (short distance longitudinal profiles) The Primal measures a longitudinal profile every 10 metres along the section. The connection point to the next 10 metre section is measured with the Total station (height measurement as previously described). The height information from the Total station is used to connect two consecutive primal measured profiles. This is done until the whole test route is combined and a complete longitudinal profile with accurate long wavelengths is ready.

Figure 3-1 Measurement with Total station.

The Primal consists of a small remote-controlled trolley that moves parallel to the road profile being surveyed, see Figure 3–2. The trolley is controlled by a laser beam. The laser beam is sent out parallel to the road section. A receiver in the trolley connects to a measurement wheel that follows the road profile as the carriage travels along the beam. The vertical distance between the measurement wheel and the laser beam describes the road profile and is sent by wireless communication to a computer storing the data. A value every 40 mm is collected to represent the longitudinal profile. The Primal can be classified as a stationary reference plane method, SRP.

14 VTI rapport 622A

Figure 3–2 Measuring longitudinal profile using the Primal equipment.

The VTI-TVP (transverse profiles) Another reference instrument used in the project is the VTI-TVP. It is used to measure the transverse profile. The profile is collected by a laser sensor attached to a beam mounted on a vehicle. The vehicle is positioned with the beam across (transversely) the section to be surveyed. The laser sensor scans the road profile, running across the beam, every 4 mm on an up to 400 cm wide cross-section of the road, see Figure 3–3. Simultaneously, two stationary laser sensors at each end of the beam read the heights of the beam-ends to adjust for roll movement in the car. There is also an inclinometer that collects the crossfall. The transverse profile is determined every half metre in the direction of travel along the test section standing still. The TVP is referred to as a MRP method.

Figure 3–3 Measuring cross profile using the VTI-TVP.

The rut depth is defined and calculated in various ways depending on the specific tested equipment. Therefore there is a need for a common method to be able to make comparisons. In this case we have chosen to calculate rut depth from the VTI-TVP by simulating a model of the tested equipment on the VTI-TVP profile. The same measurement width and distance between measurement points as the tested equipments are used to select which points from the VTI-TVP profile to be used in the calculations. The lateral position of the vehicle used in the selection of measurement points is the theoretical position given by the guide line, see Figure 3–5 and Figure 3–6 (assuming that the vehicle followed the guide line without any deviation).

VTI rapport 622A 15 3.1.2 Test measurements The parameters tested in the validity test are presented in the table below.

Table 3 Parameters in the validity test program.

Parameter Unit Decimals Presentation length IRI right mm/m At least two 10 metres

Maximum rut depth mm At least one 10 metres

Rut depth right mm At least one 10 metres

Rut depth left mm At least one 10 metres

Height of ridge mm At least one 10 metres

Speed km/h None needed 10 metres

The longitudinal profile was measured at three different test sections selected with different levels of unevenness, IRI (International Roughness Index). The sections had a length of 1,000 metres each (a total length of 3,000 m). Only the first 100 metres of the test sections was measured for transversal unevenness due to the slow and time consuming measurements with the VTI-TVP (a total of 300 m), see the table below.

Table 4 Test sections and reference measurement.

Section Total length Longitudinal Transversal reference reference E – Fornåsa 1,000 m 0–1,000 m 0–100 m F – Rappestad 1,000 m 0–1,000 m 0–100 m G - Vikingstad 1,000 m 0–1,000 m 0–100 m

The sections had three different levels of ruts. This was considered as enough to assess the technical ability regarding transverse profile measurements. The validity test was carried out at three test sections in the vicinity of Linköping, Sweden. The location can be seen in the map below.

16 VTI rapport 622A 1015 Ljungsbro 1122

36 1136 1050 Maspelösa 1123 Klockrike Bergs slussar 1123 1050 1040 1050 1025 1122 E 36 0 50 Älvan 1015 1019 1044 1136 013 1015 1045 1025 1040 1015 1044 1136 1011 36 1014 1025 Sättuna 3 Björkeberg 1041 1039 1044 1041 1011 1136

1025 1031 Kränge 1035 4 4 4 1039 1030 4.05 1025 1030 Västerlösa 4.04 1030 1030 1030 1030 024 1025 4.05 1043 4.04 Malm s lätt 1027 1028 1043 4.04 1037 4.04 4.04 Rappestad

1027 F Jägarvallen V TI 1026 4 1032 709 709 1025 Vikingstad 1028 1037 1027 641 636 34

206 Distance calibration section, 1000 metres 636 Lin 636 636 708 4 609 632 636 G 637 632 641 638 636 Figure 3–4 The location of the test sections.

The participants had been given thorough instructions prior to the measurement program started. One important part of the information was to keep track of the individual driver’s ability at each run. To be able to reduce the influence of the driver a guide line was painted at the road, in the left wheel track. The instruction was to follow this guideline as close as possible. The guideline was painted in the left wheel track because at this position it is most easy for the driver to observe and follow it.

VTI rapport 622A 17

Figure 3–5 Test section G.

The exact instructions to the driver were to put the right measurement gauge 152 cm to the right of the guide line. 152 cm corresponds to a normal distance between the left and right wheel path. The Figure 3–6 shows a schematic draw of the lateral position.

Figure 3–6 Description of lateral position of measurement vehicle at test sections.

Another important instruction to the operators was that they had the possibility to do re- runs until they were satisfied. At every test section three different speeds were used 30, 50 and 70 km/h. Five repetitions were done at every speed. To eliminate deviations in distance measurements when comparing the tested vehicles with the reference a calibration and test of the distance was done. For those of the participants who had the possibility to start and stop the measurements triggered with a photocell a reflector was placed at the start and stop line. No data loss was accepted for the test sections. The test

18 VTI rapport 622A was supervised by VTI personnel and the measurement conditions were good, with no rain and moderate wind. The measurements were done during two days and were completed as planned. One of the tested vehicles had problems to complete the measurements during daytime because influence from the sunlight. This was solved by conducting the measurement in the evening. The operators of the vehicles had no time pressure to complete the measurements and was offered time to make extra measurements if needed.

Figure 3–7 The tested vehicles at test section G.

3.1.3 Acceptance limits The last date of data delivery was set to four weeks after the test was finished. The acceptance limits was given to the participants two weeks before the final date of delivery. There were three different tests, each with a set up of acceptance limits. • validity • repeatability • speed dependency.

Validity The result from the tested vehicle is compared with reference data. There are different limits for different levels, low and high values, of the tested parameter. Only the part of the test section that is measured with the reference instruments is taken into consideration in this comparison. In order to be approved at the test sections the results should be better than or equal to the following limits. The limits are valid for 10 metre section size. The limits are derived from experience of a number of equal tests done in Sweden, see (VV pub 65, 2000; VV pub 65, 2002; VV pub, in progress, 2004). In Sweden data for 20 metre are used, therefore the limit values are derived from the 20 metre limits and converted to 10 meter. Using 10 metre sections increase the importance to have accurate positioning.

VTI rapport 622A 19

Table 5 Acceptance limits for validity at the test sections.

Parameter Category Acceptance interval1) Limit IRI right Reference ≤2.00 Ref-0.25 72% mm/m mm/m≤TV≤Ref+0.25 mm/m IRI right Reference >2.00 Ref-(0.25+(Ref-2.00)×5%) 68% mm/m mm/m≤TV≤Ref+(0.25+(Ref- 2.00)×5%) mm/m Maximum rut depth Reference ≤7.5 mm Ref-1.0 mm≤TV≤Ref+1.0 77% mm Maximum rut depth Reference >7.5 mm Ref-(1.0+(Ref-7.5)×5%) 77% mm≤TV≤Ref+(1.0+(Ref- 7.5)×5%) mm Rut depth left Reference ≤7.5 mm Ref-1.0 mm≤TV≤Ref+1.0 77% mm Rut depth left Reference >7.5 mm Ref-(1.0+(Ref-7.5)×5%) 77% mm≤TV≤Ref+(1.0+(Ref- 7.5)×5%) mm Rut depth right Reference ≤7.5 mm Ref-1.0 mm≤TV≤Ref+1.0 72% mm Rut depth right Reference >7.5 mm Ref-(1.0+(Ref-7.5)×5%) 72% mm≤TV≤Ref+(1.0+(Ref- 7.5)×5%) mm Height of ridge Reference ≤7.5 mm Ref-1.0 mm≤TV≤Ref+1.0 77% mm Height of ridge Reference >7.5 mm Ref-(1.0+(Ref-7.5)×5%) 77% mm≤TV≤Ref+(1.0+(Ref- 7.5)×5%) mm 1) TV = value from measurement with tested vehicle, Ref = value from reference measurement.

Repeatability From the 15 repeated measurements at the test sections a standard deviation is calculated for every 10 metre section. All 3,000 metres of the test sections will be the basic data for this analysis. The 25:th percentile, the median and the 75:th percentile will be calculated from all 10 metre standard deviations. The acceptance limits are presented below.

20 VTI rapport 622A

Table 6 Acceptance limits for repeatability at the test sections.

percentile 25% Median Percentile 75% IRI right < 0.14 mm/m < 0.17 mm/m < 0.28 mm/m Rut depth max < 0.35 mm < 0.49 mm < 0.78 mm Rut depth left < 0.35 mm < 0.49 mm < 0.78 mm Rut depth right < 0.45 mm < 0.59 mm < 0.88 mm Height of ridge < 0.35 mm < 0.49 mm < 0.78 mm

Speed dependency In order to make sure that the speed of the tested vehicle doesn’t affect the measured parameters there is a limit of maximum accepted speed dependence. All 3000 metres of the test sections will be the basic data for this analysis. The average values for the three tested speeds are calculated and compared. The acceptance limits is presented below. There should be no greater difference between any combinations of the tested speeds than the limits below.

Table 7 Acceptance limits for speed dependence at the test sections.

IRI right ≤ 0.10 mm/m Rut depth max ≤ 0.25 mm Rut depth left ≤ 0.25 mm Rut depth right ≤ 0.35 mm Height of ridge ≤ 0.25 mm

3.2 The repeatability and reproducibility test The repeatability and reproducibility test was divided into two parts, one for the object level and one for the network level. The first part all participants should attend and in the second part only the company taking part of the full network program should carry through. A sample of a driving plan was sent out to the participants two weeks before the test in order to inform the participants of the principle with a driving plan and what it contains. At the meeting, prior to the test, the full driving plan was delivered together with a map. At this meeting the participants also had instructions of the definition and the location of the node points. The routes were divided into links from one node to another. The nodes were normally placed in a road crossing. If the nodes were not placed in a road crossing it could be seen in the driving plan. The first part of the test was carried out on route C (see figure below), which had the length of 76.85 km. The route had a varying characteristic, from small narrow roads to wide highly trafficked roads.

VTI rapport 622A 21 987 98432 50 958 962 979 989 963 962 960 959 958 983 994 Vadstena941 Fågelsta960 981 206 206 980 32 941 206 984 50 950 981 944 206 50 100 32 940 949 950 206 1006 1004 50 936 938 948 206 1002 938 950 50 956 955 50 944 Skänninge 932 935 206 945 Borghamn 950 95532 934 50 947 952 970 950 50 Spån Tåkern 944 953 954 969 953 32 945 950 968 952 954 4 930 Hogstad 942 4.03 50 930 930 942 Väderstad 929 32 918 509 593Mj ö 928 4 516 918 32 50 926 926

Hästholmen 509 507 513 918 511 32 925 515 50 506 4 509 515 515 513 514 Ödeshög 591 918 Strålsnäs Figure 3–8 Map of route C. 513

22 VTI rapport 622A

Table 8 Example of driving plan information for route C.

ROUTE C Stop Section Route ID Road From Road To Road Start measure measure length C 201 32 953.00 954.00 0 2179 2179 C 202 32 954.00 977.00 0 495 495 C 203 32 977.00 955.00 0 953 953 *C 204 32 955.00 0 0 1990 1990 C 205 206 32.00 955.00 0 2541 2541 C 206 206 955.00 980.00 0 1807 1807 C 207 206 980.00 987.00 0 2851 2851 C 208 206 987.00 960.00 0 69 69 C 209 206 960.00 958.00 0 2230 2230 C 210 206 958.00 950.00 0 1694 1694 C 211 206 950.00 50.00 0 2430 2430

From From GPS_lat GPS_long To GPS_lat To GPS_long 58.33922863 15.10572281 58.35847085 15.11101786 58.35847085 15.11101786 58.36288106 15.11162202 58.36288106 15.11162202 58.37109854 15.10718726 58.37109854 15.10718726 58.38871012 15.10309556 58.40194655 15.09582874 58.41068820 15.05757447 58.41068820 15.05757447 58.42227427 15.03692443 58.42227427 15.03692443 58.44117605 15.00601189 58.44117605 15.00601189 58.44142658 15.00491638 58.44142658 15.00491638 58.43990766 14.96816570 58.43990766 14.96816570 58.43896504 14.94179067 58.43896504 14.94179067 58.44765212 14.90667676

The C route was measured five complete runs using the same operator and driver. This was done as basis for the repeatability test. There were limits for the amount of data loss that was accepted. At least results from 95% of the routes should be delivered after the test. Since the participants managed the measurements by themselves and had no time pressure from VTI, they had the possibility to measure until they reached a good result. Two additional routes should be measured for the company participating in the full network program, routes A and B (see Figure 3–9 and Figure 3–10). Route A contained mainly major roads and route B contained secondary roads. The measurement program for these routes was: • Measure with two different vehicles. • The vehicles should have different operators and drivers. • Do one complete run for each vehicle and route with the original crew. • Approximately 20% of the routes should be re-measured with the operators and drivers switching place in the vehicles.

VTI rapport 622A 23 741 1035 1058 1060 796 4 763 1030 796 769 768 1030 757 769 4.05 Tallboda758 Linghem 761 1037 761 768 Östr vallen 35 Askeby 709 687 750 754 766 7 715 717 716 752 741 63634 35 Linköping 708 710 752 641 Bankekind Slaka 713 741 634 707 751 687 750 621 706 713 740 Björsäter 34702 712 750 Sturefors 748 748 741 621 706 699 747 748 700 35 Grebo 687 764 Skeda udde 745 741 631 699 610 34 616 St. Rängen 703 7 705 742 34 687 696 35 688 699 696 610 614 34 Bestorp 741 615 694 687 691 616 34 687 696 Berg 732 Brokind 689 614 691 691 690 Åtvidaberg 613 35 34 680 Järnlunden 689 731

614 603 683 34 685 35 588 588 588 Rimforsa 674 680 681 134 34 678 603 682 674 602 134

671 134 674 584 670 34 671 134 666

134 666 80 668 34 134 Åsunden 666 134 134 Kisa 664 662 Figure 3–9 Map of route A.

24 VTI rapport 622A 1077 1115 36 1113 1120 1074 1076 1074 36 1114 1116 50 1068 1115 Ös ters tad 1006 1050 1050 1015 113 1050 1068 1050 1121 32 1022 1001 36 1000 Korskrog 1120 50 986 1050 1025 1006 1000 1015 987 Ljungsbro 1122 994 996 1003 36 50 1050 Ma s p e lö s a 1123 1136 964 962 32 Bergs Klockrike 1123 1050 1013 1050 10251040 1050 1006 1050 36 962 Älvan 1050 1015 987 984 32 1019 1044 958 Fo rn å sa 1136 50 962 979 989 Varv 1013 963 1015 962 1025 1045 987 32 1016 1040 960 988 1006 1015 1044 962 958 983 1136 50 959 994 1015 1011 987 36 981 1014 1025 Få g960 el st a 1015 1013 Björkeberg 1041 958 987 1039 1041 32 1006 1010 1044 206 206 980 1011 206 1009 1011 1025 984 1006 1031 Kr änge 1035 4 981 1008 950 4 206 1008 1039 944 1030 1006 1010 1030 Västerlösa 32 1030 1030 949 950 1030 206 1024 1006 1004 1025 1043 4.044.04 Nor mlösa Mal m s l ät t 32 1027 948 1028 944 955 206 1002 1037 950 1004 Rappestad 1005 956 955 1010 1027 Jägarvallen 4 1032 944 Skänninge 1026 206 1004 1025Vikingstad 1007 1028 1037 945 1027 641 950 95532 206 636 34 206 947 Öjebro 206 636 636 636 952 970 636 632 950 974 632 641 971 Sjögestad 635 973 609 34 Spångsholm 4 636 944 977 969 953 954 634 969 630 953 32 969 973 627 636 596 632 945 950 968 977 626 Gälstad-Lundby 621 Figure 3–10 Map of route B.

Instructions for all participants The repeatability was tested for all companies participating in the test at route C. In production measurement in Finland a control program is used. The control program and limits for Network Measurements are also used as a first test for the network and object level measurements (see Table 9). (The control program is really used for reproducibility test at the ordinary network measurements in Finland.) For route C, where the vehicles drove five runs, ten combinations of tests can be evaluated (run 1 vs. 2, 1 vs. 3, 1 vs. 4 a.s.o.). Only repeatability will be tested in this process (route C). Additional control for the company participating in the full test The company participating in the full test (including both object and network measurements) the reproducibility was also tested according to the same control method used for the repeatability, Table 9. This test is done at the routes A and B. Possible test cases of reproducibility Car 1 against car 2 covering 100 % of the routes.

Test cases for control measurements: 20 % of data from car 1 with crew 1 against car 1 with crew 2 20 % of data from car 2 with crew 2 against car 2 with crew1 20 % of data from car 1 with crew 2 against car 2 with crew 1

VTI rapport 622A 25

Table 9 Production control program for network measurements used in Finland.

Parameter The 50th The 95th The correlation Reporting percentile of the percentile of the between interval difference difference production and between between control production and production and measurements control control must be at least measurements measurements must be smaller must be smaller or equal to or equal to IRI right 0.05/0.2 0.3/1.0 0.9 100/10 m IRI4 right 0.07 0.3 0.9 100 m Maximum rut 0.4/0.5 1.5/2.5 0.9 100/10 m depth Rut depth right 0.5/0.6 2.0/3.0 0.9 100/10 m Rut depth left 0.4/0.5 1.5/2.5 0.9 100/10 m Height of ridge 0.4 1.5 0.9 100 m Crossfall 0.3 1.0 0.95 50 m regression Curvature 1.0 3.0 0.9 50 m Gradient 0.5 1.0 0.95 50 m RMS 0.04 0.1 0.9 100 m megatexture right (50–500 mm) RMS 0.04 0.1 0.9 100 m macrotexture right (0.5–50 mm)

As a complement to the Finnish control program a test of the standard deviation on repeated and reproduced runs is also carried out. The repeatability is tested for all vehicles at route C and the reproducibility is tested at the A and B route. The limits for the standard deviation are given in Table 10 below.

26 VTI rapport 622A

Table 10 Limits for repeatability and reproducibility at the routes.

Report distance, m Parameter Reproducibility Repeatability 50 Crossfall regression 0.36 0.20 50 Curvature 1.8 1.5 50 Gradient 0.25 0.20 10 IRI right 0.38 0.31 100 IRI right 0.15 0.11 10 Maximum rut depth 0.92 0.75 100 Maximum rut depth 0.50 0.40 100 Rut depth left 0.50 0.40 100 Rut depth right 0.60 0.50 100 RMS megatexture 0.04 0.03 right 100 RMS macrotexture 0.05 0.04 right 100 IRI4 right 0.21 0.15 100 Height of ridge 0.50 0.40 10 Rut depth left 0.92 0.75 10 Rut depth right 1.00 0.83

VTI rapport 622A 27 4 Data evaluation Below is a general description on statistical principles used in the overall analysis. Repeatability is determined from measurements gathered on the routes A, B and C. Results from the routes A and B are used when determining the reproducibility as well. Repeatability and reproducibility are quantified in several ways. According to ISO Standard Handbook, Statistical methods for quality control (ISO 3534-1, part 1, 1993, ISO 3534-1, part 2, 1993), reproducibility and repeatability is determined as the standard deviation and the procedure for that is described in section 4.1.1. In addition the 95 and 50 percentiles of differences between measurements on the same section are determined according to section 4.1.2. Finally the correlation between repeated or reproduced measurements is determined according to section 4.1.3. In the description on how the different parameters are determined common notations are used as follow. A single measurement, e.g. IRI or rut, can be denoted yijk, where i is the road section (i = 1,…,l), j the measurement equipment (j = 1,…,mi) and k the repetition (k = 1,…,nij). Then there are l road sections (length 10, 50 or 100 meters) each measured with mi (e.g. mi = 2) equipments and nij repetitions (e.g. nij = 5). Note that when only one equipment is used then mi = 1 and the index j become redundant. The number of equipments mi may vary between road sections and the number of repetitions nij may vary between road sections and between equipments due to drop-outs. That explains the necessity of the indices.

4.1.1 Reproducibility and repeatability According to ISO Standard Handbook, Statistical methods for quality control, reproducibility and repeatability can be determined for each road section as follows. Consider road section i. Then the square of the reproducibility is given by

mi 2 ∑ ()− iijij ⋅⋅⋅ ()myyn i −1 j=1 where yij⋅ is the mean of all measurements with equipment j at the considered road section i and yi ⋅⋅ is the mean of all measurements at the considered road section i. The square of the repeatability is given by

mi nij 2 ∑∑()(− ijijk ⋅ []nmyy iji −1). j==11k The square of the reproducibility for all road sections is the mean square of the reproducibility over all road sections, i.e.

l mi 2 ∑∑ ()− iijij ⋅⋅⋅ []()mlyyn i −1 i==11j In the same way the square of the repeatability is given by the mean

28 VTI rapport 622A l mi nij 2 ∑∑∑()(− ijijk ⋅ []nlmyy iji −1) i===111j k

4.1.2 Percentiles of differences between measurements For each road section mean difference for reproducibility and repeatability is determined. The reproducibility mean difference on road section i is the mean of all differences between different equipments and calculated as

n n 2 mii−1 m 1 ijj′′i ′ ∑∑ ∑∑ − yy kjikji ′′′′′′ ()mm ii −1 j′=11′′ = jj ′+ nn jiji ′′′ k′= 11k ′′ = where the indices for the equipments, j′ and j′′ , cannot have the same value. In the case where mi = 2, that formula for reproducibility mean difference is reduced to

1 nii12n ∑∑ − yy 21 kiki ′′′ . nn ii 21 k′=11k ′′ =

The repeatability mean difference on road section is the mean of all differences within the same equipment and determined by

n −1 n mi 21 ij ij ∑∑∑− yy kijkij ′′′ . j=1 ()nnm ijiji −1 k′=11′′ =kk ′+

Then for each road section there is a repeatability mean difference and on some occasions a reproducibility mean difference. The 95 and 50 percentiles are the determined over all road sections in a route.

4.1.3 Correlation Since there often are more than two repetitions per road section the correlation cannot be determined according to standard procedure. Instead the measurements are fitted to an ANOVA model and the square root of the coefficient of determination, R2, is considered as the correlation coefficient. In fact the square root of the coefficient of determination, R2, can be considered as a generalisation of the absolute value of the correlation coefficient, i.e. it never gives negative values. Then the correlation for reproducibility is given by

l m i − yyn 2 ∑∑i==11j ()iijij ⋅⋅⋅ 1− l m i − yyn 2 ∑∑i==11j ()ijij ⋅⋅⋅⋅ and for repeatability by

l m n iij − yy 2 ∑∑∑i===111j k ( ijijk ⋅ ) 1− l m n . iij − yy 2 ∑∑∑i===111j i ()ijk ⋅⋅⋅

VTI rapport 622A 29 5 Results per participant 5.1 Test sections

The results for the test sections are divided into three parts, validity, repeatability and speed dependence. The limits for the different parts can be seen in Table 5, Table and Table 7.

5.1.1 Validity The test of validity at the test sections was analysed for the parts of a section that were measured with a reference, see Table 4. The limits for approval of a validity test have not been used (by VTI) for 10 metre sections in any test before. VTI have good experience of limits for 20 metre sections. The limits used in this test have been adjusted to fit 10 metre parameters. The limits can be seen in Table 5. The principle of the test is illustrated in the Figure 5–1. The result should be within the limits.

7 Lower limit 6 Upper limit

Tested Vehicle Tested 4

0 0246810 Reference

Figure 5–1 Principle for validity test.

30 VTI rapport 622A The results from comparing tested vehicle with the reference can be shown in the table below.

Table 11 Results from validity test, yes if within limit.

Parameter Vehicle A C D E IRI right low values Yes Yes No Yes IRI right low values Yes Yes No No Maximum rut depth low Yes Yes Yes Yes values Maximum rut depth high Yes Yes No No values Height of ridge low values Yes Yes No No Height of ridge high values Yes Yes No Yes

VTI rapport 622A 31 5.1.2 Repeatability The repeatability is calculated from the full 3000 metres of the test sections. That applies for all tested parameters. The repeatability is calculated as the standard deviation of the 15 repeated runs at 10 metres level. Among the 10 metre standard deviations (300 values) the 25:th percentile, median and the 75:th percentile are calculated. The achieved result should not exceed the limits in Table .

Table 12 Results from repeatability test, yes if the result is within limit.

Parameter Vehicle A C D E IRI right 25% percentile Yes Yes No Yes IRI right median Yes Yes No Yes IRI right 75% percentile Yes Yes Yes Yes Maximum rut depth 25% Yes Yes No Yes percentile Maximum rut depth median Yes Yes No Yes Maximum rut depth 75% Yes Yes No Yes percentile Rut left 25% percentile Yes Yes No Yes Rut left median Yes Yes No No Rut left 75% percentile Yes Yes No No Rut right 25% percentile Yes Yes No Yes Rut right median Yes Yes No No Rut right 75% percentile Yes Yes No No Height of ridge 25% percentile Yes Yes No Yes Height of ridge median Yes Yes No Yes Height of ridge 75% percentile Yes Yes No Yes

32 VTI rapport 622A 5.1.3 Speed dependency One of the big advantages with this type of measurements is that it can be done at normal traffic speed without disturbing the road-users. The results should not be influenced by the speed of the vehicle. This is analysed by calculating the average values for each parameter separately per measured speed. The maximum difference between the parameters at the speeds 30, 50 and 70 km/h are examined. The whole length of the test sections is included in the calculation (3,000 m). The acceptance limits are given in table 4.

Table 13 Results from test of speed dependence, yes if the result is within limit.

Parameter Vehicle A C D E IRI right Yes Yes No Yes Maximum rut depth Yes Yes Yes Yes Height of ridge Yes Yes No Yes

VTI rapport 622A 33 5.2 Routes The analysis is done according to chapters 3.2 and 4. The results are presented in the tables below.

5.2.1 Route C – all participants The table below shows whether the companies were accepted considering the limits in the Finnish control program and the test of repeatability.

Table 14 Acceptance of repeatability at object level (Yes if within limit).

Parameter Vehicle A Vehicle C Vehicle D Vehicle E IRI right 10 m Yes Yes No No Rut left 10 m Yes Yes No No Maximum rut Yes Yes No No depth 10 m Rut right 10 m Yes Yes No No Curvature 50 m Yes Yes No -1) Gradient 50 m Yes Yes No - Crossfall Yes Yes Yes Yes regression 50 m IRI right 100 m Yes Yes No No Rut left 100 m Yes Yes No No Maximum rut Yes Yes No No depth 100 m Rut left 100 m Yes Yes No No RMS Yes Yes No - makrotexture 100 m RMS Yes Yes No Yes megatexture 100 m Height of ridge Yes Yes No No 100 m IRI4 right 100 m Yes Yes No Yes 1) - not measured

34 VTI rapport 622A

5.2.2 Routes A and B – network measurement For the network participation only one company took part with two vehicles. The following tables show the results for vehicles A and B for the full network test at routes A and B.

Table 15 The results at 10 m presentation length for routes A and B, vehicle A and B (Yes if within limit.).

Routes A+B IRI right Yes Maximum Yes rut depth

Table 16 The results at 50 m presentation length for routes A and B, vehicle A and B (Yes if within limit.).

Routes A+B Curvature Yes Gradient Yes Crossfall Yes regression

Table 17 The results at 100 m presentation length for routes A and B, vehicle A and B (Yes if within limit.).

Routes A+B IRI right Yes Maximum rut Yes depth RMS Yes makrotexture RMS Yes megatexture Height of Yes ridge IRI4 right Yes

5.3 Subjective assessment of performance during the tests A subjective assessment regarding the experience in the way of acting with testing procedures, data delivery and contact with the representatives from the companies has been done, see table 12 below. The participants have different pre-conditions to succeed in a qualification test. They have different levels of experience, skills, quality approval programs, organisations and focuses in the companies. VTI´s experience in tests like this is that the main source of

VTI rapport 622A 35 error always is the human performance. The main source of deviations is the driver’s skill to keep the measurement vehicle in the correct and same position from run to run. It is obvious that the companies training programs for operators and drivers are of great importance. This is of even more importance considering that the technical standard of the measurement equipment, among the present different participants, almost are the same. It seems as the skill and training of drivers cannot be overestimated. For instance, it is crucial that the drivers record any obstacles that might ruin the measurement quality. However, they still have to let minor obstacles pass since otherwise the proportion of missing values might reach an unacceptable level. It needs a well-trained driver to maintain the proper balance in this case.

Table 18 Subjective assessment of performance during the tests, 5 equals a perfect behaviour and 1 represent a not acceptable behaviour.

Vehicle A Vehicle C Vehicle D Vehicle E Performance during the 5 5 3 3 qualification test Data delivery and quality of 3 4 3 4 data Contacts with 5 5 5 5 representatives

36 VTI rapport 622A 6 Conclusions The test shows in an objective way differences between the participating companies. The quality of what the company can achieve under the best circumstances can clearly be seen in the results. Once again, the most important link in the road measurement companies’ ability to achieve an impeccable result is to have a complete quality system regulating all the details. It should at least include the following: • Calibration procedures • Training program for operators and drivers • Testing procedures in field • Annual major check-up • In field checking procedures after calibration • Data quality check in field • Data quality check in office • Support capability in case of questions or problems • Take advantage of suggestions of improvement from the personnel. The results show that the participating companies can be divided into three groups, the first group consists of two companies with comparable quality in data and the second “group” a bit after the first and finally the third group a bit after the second. VTI believe there will be good chances for the second and third group to make improvements in order to raise there quality.

VTI rapport 622A 37 7 Recommendations VTI recommend the following tests to ensure that the quality, as tested in the qualification test, is preserved during the period of agreement. 1. For network and object level measurements Comparison with reference, test during the period, see chapter 7.1. 2. For network and object level measurements Test after a change of equipment, see chapter 7.2. 3. For network measurements Test before starting the season, see chapter 7.3.

7.1 Quality test during the period of agreement In Finland there are procurements of road network measurements every five years. In the process of selecting a supplier of data during this period, a quality control has been conducted for both network and object level measurements. In Sweden the Road Administration has had the possibility to do quality control of the supplier for network measurements during the period of agreement. VTI recommends this for the Finnish Road Administration as well. After half the period, two or three years, a comparison with the reference as done in the qualification test should be conducted. This test can be done in a smaller scale compared to the qualification test and it would also be possible to make the test in joint venture with the Swedish Road Administration. The test will make sure that the companies retain the quality as in the qualification test.

7.2 Test after a change of equipment If the supplier by any reason changes the equipment during the period of agreement the company shall describe why the change is necessary and what the consequences will be. The Road Administration should take under consideration whether a test has to be done or if the changes can be seen as a minor and not affect the result. If a test has to be done a vehicle equipped as it was during the approval procedure shall be compared to the modified vehicle. The test shall be done at roads of different quality with a good representation of the examined parameters. The total road length for the test shall not be smaller than 100 km and the distribution of the examined parameters should approximately be as follows. • Criteria for the road type. • Length of route, at least 100 km • Width of road >11 m appr. 30 km of route • Width of road 8-11 m appr. 30 km of route • Width of road <8 m appr. 30 km of route.

38 VTI rapport 622A Criteria for measured parameters (10 metre values). • IRI right<1.5 mm/m at least 30 km of route • IRI right >1.5 mm/m at least 20 km of route • IRI right >3 mm/m at least 5 km of route • Maximum rut depth <10 mm at least 30 km of route • Maximum rut depth >10 mm at least 20 km of route • Maximum rut depth >20 mm at least 2 km of route VTI suggest analysing the following parameters, correlation, skewness and deviation. All parameters contracted between the supplier and the Road Administration shall be analysed. The data are analysed on 100 metre average values. The correlation is used to check the linear concordance between the results. The skewness are checked by calculating the 10th, median and 90th percentile for the results from the investigated vehicles. Finally the standard deviation are calculated for the measured parameters and compared between the vehicles. Since extreme values can affect the results a great deal it have to be considered before the final analyses. VTI have done similar tests for suppliers in Sweden. The following limits for approval have been used.

Table 19 Limits of approval for test after a change in measurement vehicle.

Parameter Correlation Average Standarddev. 10th 90th percentile percentile IRI right ≥0.96 <0.04 <0.08 <0.06 <0.08 Maximum rut ≥0.96 <0.20 <0.08 <0.18 <0.25 depth Rut depth left ≥0.96 <0.20 <0.08 <0.18 <0.25 Rut depth ≥0.96 <0.20 <0.08 <0.18 <0.25 right Curvature ≥0.96 <0.25 <1.00 <1.20 <1.20 Gradient ≥0.96 <0.25 <0.10 <0.25 <0.25 Crossfall ≥0.96 <0.10 <0.05 <0.15 <0.15 regression Macrotexture ≥0.93 <0.05 <0.025 <0.05 <0.05

The test should be analysed and reported by an objective party. The supplier has not always managed to pass all limits so the limits should be reconsidered and compared with the limits in this procurement before taking in use in Finland.

7.3 Test before starting the season VTI also suggest that the supplier shows a comparison of all measurement vehicles to be used in the production before the first measurement of the year. This test ought to be done together with the training program of the drivers and operators. In this test the way

VTI rapport 622A 39 of testing in chapter 7.2 and limits in Table 19 can be used to show the functionality of the vehicles. The next step, which is of great importance, is to educate and train the drivers to make the same decisions and have a uniform driving pattern. This can be controlled by letting all drivers that will be a part of the measurements the coming season drive a route and compare the results with a reference measurement (calculated as an average of the results from all tested vehicles). In this test the normal production control method, as used in Finland, can be used.

40 VTI rapport 622A 8 List of references Descornet, G. (1999). Inventory of high-speed longitudinal and transverse road evenness measuring equipment in Europe. Technical note 1999/01, Belgian Road Research Centre, BRRC, Forum of European National Highway Research Laboratories. FEHRL, Bryssel, Descornet, G. (2002). FILTER Final Report, FEHRL report 2002/1, Bryssel , Forum of European National Highway Research Laboratories, Bryssel De Wit, & Kempkens, BE. & Sjögren, L. & Ducros, DM. The FILTER Experiment. Technical Note 1999/2, FEHRL, Bryssel International Standard, ISO 3534-1, (1993). Statistics – Vocabulary and symbols. Part 1: Probability and general statistical terms. International Standard, ISO 3534-2, (1993). Statistics – Vocabulary and symbols. Part 2: Statistical quality control. Lundberg, T. & Sjögren, L. (2004). Qualification of road surface monitoring services in Sweden, 1996–2000. VTI-Notat 38A-2004, VTI and Swedish National Road Administration . Sjögren, L, Lundberg, T. & Andrén, P. (2002). Nya mått; ett underlag för en utvecklingsstrategi inom området vägytemätningar. VTI Notat 23-2002, VTI, Linköping. (In Swedish.) Vägverket publikation 2000:65, Vägverket, Upphandling av vägytemätningar, RAPPORT 1996, Kvalificering av leverantörer, Utvärdering av jämförande mätningar. Geodesigruppen i Mellansverige AB, VTI and Swedish National Road Administration. 1996. (In Swedish.) Vägverket publikation 2000:65, Vägverket, Upphandling av vägytemätningar, RAPPORT Mätningar utförda 1997, Utvärdering av jämförbarhet mellan enskilda mätfordon och mätfordonstyper. Geodesigruppen i Mellansverige AB, VTI and Swedish National Road Administration 1997. (In Swedish.) Vägverket publikation 2002:65, Upphandling av vägytemätningar för perioden 2001–2004, Utvärderingsunderlag, Mätningar gjorda 2000. Vägverket, VTI, Geodesigruppen i Mellansverige AB, VTI and Swedish National Road Administration. 2000 (In Swedish.) Vägverket publikation In progress, Upphandling av vägytemätningar för perioden 2004–2007, Utvärderingsunderlag, Mätningar gjorda 2004. Vägverket, VTI, Geodesigruppen i Mellansverige AB, VTI and Swedish National Road Administration. 2004 (In Swedish.)

VTI rapport 622A 41

www.vti.se [email protected]

VTI är ett oberoende och internationellt framstående forskningsinstitut som arbetar med forskning och utveckling inom transportsektorn. Vi arbetar med samtliga trafikslag och kärnkompetensen finns inom områdena säkerhet, ekonomi, miljö, trafik- och transportanalys, beteende och samspel mellan människa-fordon-transportsystem samt inom vägkonstruktion, drift och underhåll. VTI är världsledande inom ett flertal områden, till exempel simulatorteknik. VTI har tjänster som sträcker sig från förstudier, oberoende kvalificerade utredningar och expertutlåtanden till projektledning samt forskning och utveckling. Vår tekniska utrustning består bland annat av körsimulatorer för väg- och järnvägstrafik, väglaboratorium, däckprovnings- anläggning, krockbanor och mycket mer. Vi kan även erbjuda ett brett utbud av kurser och seminarier inom transportområdet.

VTI is an independent, internationally outstanding research institute which is engaged on research and development in the transport sector. Our work covers all modes, and our core competence is in the fields of safety, economy, environment, traffic and transport analysis, behaviour and the man-vehicle-transport system interaction, and in road design, operation and maintenance. VTI is a world leader in several areas, for instance in simulator technology. VTI provides services ranging from preliminary studies, highlevel independent investigations and expert statements to project management, research and development. Our technical equipment includes driving simulators for road and rail traffic, a road laboratory, a tyre testing facility, crash tracks and a lot more. We can also offer a broad selection of courses and seminars in the field of transport.

HUVUDKONTOR/HEAD OFFICE LINKÖPING BORLÄNGE STOCKHOLM GÖTEBORG POST/MAIL SE-581 95 LINKÖPING POST/MAIL BOX 760 POST/MAIL BOX 55685 POST/MAIL BOX 8077 TEL +46(0)13 20 40 00 SE-781 27 BORLÄNGE SE-102 15 STOCKHOLM SE-402 78 GÖTEBORG www.vti.se TEL +46 (0)243 446 860 TEL +46 (0)8 555 770 20 TEL +46 (0)31 750 26 00