Technology & Standards Committee Evian Meeting

TECHNOLOGY & STANDARDS COMMITTEE EVIAN MEETING Commercial Technology Forum May 2004 Chairman: A.G.DE BOOS (Australia) Report No: CTF 02

The 2003 Australian Wool Innovation on-farm fibre measurement instrument evaluation trial - Part 2: Performance in objective classing and ranking for animal selection

Peter Baxter, Jim Marler

SGS Wool Testing Services PO Box 15062, Wellington, New Zealand Australian Wool Testing Authority Ltd PO Box 190, Guildford, NSW 2161, Australia

SUMMARY

This report summarises the results of the 2nd phase of a substantial trial carried out by Australian Wool Innovation Ltd. (AWI) in which the performance of the two common on-farm fibre diameter measurement technologies (OFDA2000 using midside samples and Sirolan Fleecescan using sampling of the whole skirted fleece) were compared with traditional midside sampling followed by laboratory fleece measurement, and with the outcomes of IWTO Certification of lots prepared using these technologies. In this phase, only Mean Fibre Diameter measurements were considered. The specific processes evaluated in this phase were the measurement-assisted classing of single mob wool clips, and the ranking of individual sheep. The evaluation was carried out on one superfine and one fine-wool property in Victoria, and a medium-wool property in South Australia.

The work illustrated that these two specific on-farm sampling and measurement technologies (i.e. OFDA2000 measurement on midside samples and Fleecescan measurements on the skirted fleece) produced very similar outcomes with slightly lesser precision than laboratory fleece testing carried out on midside samples in accordance with AS/NZS 4492. There was a strong relationship between the two on- farm technologies and their ability to measure Mean Fibre Diameter compared with certificate testing, and when used for fleece classing, they both produced lines of wool of different diameters in the expected order (i.e. the line that was expected to be finest was the finest, etc). Biases were observed between the expected classed line diameters and the certified test results (from –1.1 µm to +0.9 µm), and these varied from property to property. The phenomenon sometimes called "Micron creep" was similarly observed for both technologies and would also be expected to exist if laboratory measurements were to be used for fleece classing. From both the fleece classing and sheep selection results it can be concluded that the precisions of the two on-farm technologies for mean fibre diameter are near equal.

Finally, it was concluded that the larger the range in diameter within a flock, and the more precise the measurements, the more likely it is that classed lot measurements and animal selections using different instruments or systems will be consistent.

INTRODUCTION BACKGROUND

Since the late 1990s, both OFDA2000 (measurement based on imaging technology) and Sirolan Fleecescan™/Sirolan Laserscan™ (measurement based on laser technology) instruments have been regularly used in Australia to measure Mean Fibre Diameter (MFD), but also other wool fibre traits, on samples taken from fleeces on-farm; in a race pre-shearing and in shearing sheds at shearing time.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 1 of 39 Commercial Technology Forum Report: 02 In September 2001, Australian Wool Innovation Ltd. (AWI) initiated a series of research projects to gain a greater understanding of the issues involved with the development and application of the On-Farm Fibre Measurement (OFFM) technologies and systems. Nine research projects were initiated with respect to OFFM covering: market research, a world-wide search for new technologies, an assessment of potential enhancements to existing technologies, scoping of a Quality Assurance (QA) program, scoping of a wool grower extension program, a benefit cost analysis, an assessment of the potential for electronic identification, an assessment of existing and future decision support systems and a comparison of existing technologies.

The market research commissioned by AWI (TQA 2002), which was completed in June 2002, indicated an increasing need by wool producers for an independent and objective assessment of the commercial application of the two current OFFM technologies.

At that time, there had been little independent published information on the performance of the two instruments with respect to their use by woolgrowers for clip preparation, sheep breeding and/or flock management. There was also a scarcity of published data that used recognised and industry accepted statistical methods to determine the precision limits of each instrument and/or to compare their outcomes and their application methods.

By June 2002, AWI had established a draft protocol for an extensive trial that would address the above issues. AWI also established an OFFM Expert Advisory Group (EAG) to provide assistance and guidance with the trial design, the implementation of the trial, and the analysis and interpretation of the trial results. Details of membership of the EAG, project management and consultancies are given in the Acknowledgements. OBJECTIVES OF THE OFFM INSTRUMENT EVALUATION PROJECT

The key objectives of the instrument evaluation project (trial) were to quantify:

1. The precision/repeatability and accuracy of both instruments, with respect to an entire fleece; for the measured characteristics, principally, MFD; but including: Standard Deviation of Fibre Diameter (SDD), Coefficient of Variation of Fibre Diameter (CVD), Mean Fibre Curvature (MFC) and Comfort Factor (CF).

2. The ability of both instruments to class a single mob wool clip into lines of distinctive MFD categories (minimum category of one micrometre (µm)); and

3. The ability of both instruments to rank individual sheep on the basis of MFD.

The above objectives relate to the instruments being a part of an OFFM system operated in an on-farm environment. Note, for the purposes of this document an OFFM system, which comprises the measurement instrument, any associated apparatus and application procedures, will be referred to as an “instrument”.

The trial was specifically directed towards providing knowledge that could be used by wool producers (or their sheep and wool customers) to make informed decisions with respect to the use of these OFFM instruments for clip preparation, sheep breeding and/or flock management.

The trial provided an opportunity to benchmark one instrument against the other; and against the commercially accepted method of fleece measurement using on-farm midside sampling and off-farm laboratory measurement; and against IWTO Certified results for on-farm prepared sale lots.

Objective 1 of this project (phase 1) is described in the companion Part 1 paper (Marler & Baxter, 2004). Objectives 2 and 3 (phase 2) are described herein. SCOPE OF TRIAL DESIGN

The trial was limited to providing information to wool producers specifically in relation to the classing and the ranking of the measures defined above. The trial did not assess:

• The other wool fibre measurements that may be provided by either instrument;

• The performance of either instrument in an in-store environment; or

• The two instruments in relation to issues such as ease of use, robustness, Occupational Health and Safety, after sales support, quality assurance, pricing, etc.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 2 of 39 Commercial Technology Forum Report: 02 OBJECTIVES 2 AND 3

The objectives of Phase 2 of the project, reported herein, were to compare the performance of two OFFM instruments (OFDA2000 in conjunction with midside sampling and Fleecescan applied to skirted fleeces):

• in terms of classing of individual fleeces for the preparation of lines of wool (wool classing), and

• for the ranking the individual fleeces for the purposes of sheep selection.

Comparisons were also made with midside sample measurements conducted at a commercial fleece testing laboratory using both OFDA100 (LabOFDA) and Sirolan-Laserscan (LabLSN) instruments.

Phase 2 involved three properties, with approximately 800 sheep randomly chosen from a single mob from each property. At each property, an OFDA2000 instrument was used in a race prior to shearing and a Fleecescan instrument was operated in the shed in conjunction with shearing. Two properties were located in Victoria (one superfine and one fine-wool) and one in South Australia (medium wool).

TRIAL PROTOCOL AND PROCEDURES COMMON PROTOCOLS

The following summarises trial protocols that are common to both Phase 1 and Phase 2.

The on-farm instruments evaluated in this trial were the OFDA2000 and the Sirolan Fleecescan™/Sirolan Laserscan™ (hereafter called the Fleecescan); which are both used to measure wool fibre characteristics on-farm. The on-farm sampling and measurement environments were at a race in the shed prior to shearing and in the shearing shed in conjunction with shearing, respectively. Note, OFDA2000 instruments are often operated outside the shearing shed; however, for reasons of controlling the trial methodologies, the OFDA2000 testing was conducted inside the shearing shed.

The measurements from the on-farm instruments were also compared with measurements derived from laboratory testing using the OFDA100 and the Sirolan Laserscan™ (hereafter called the Lab OFDA and Lab LSN) instruments.

Other aspects of the trial methodology were:

• Each sheep was uniquely identified; with each fleece sampled, tested and shorn linked to the unique sheep identification.

• Commercial operators of the two instruments were engaged to provide the equipment, systems and operating personnel needed to carry out the trial in each location. Commercial rates were paid for the supply of these resources.

• The most recent standard operating procedures for the two instruments were used, with the instruments being operated to reflect normal commercial OFFM practice.

• An independent supervisor oversaw each trial on all ten properties. PHASE 2 PROTOCOL

Phase 2 involved the following protocol:

• At each property approximately 800 sheep were randomly allocated to either OFDA2000 or Fleecescan fleece classing.

• One OFDA2000 and one Fleecescan, operated using standard commercial protocols, were used on each trial property. The trial supervisor attended all properties.

• Prior to measurement, each instrument was checked by the operator using the recommended operating procedures.

• Midside samples were taken from the left-hand side of all sheep.

• Normal commercial practice was employed; however, there was one key variation:

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 3 of 39 Commercial Technology Forum Report: 02 • After sampling one tuft for OFDA2000 measurement, a midside sample was taken from each sheep for laboratory measurement; and as a result, each fleece had approximately 1% to 5% of its wool removed prior to skirting and measurement by Fleecescan.

• For Property 1(DO) the OFDA2000 and midside samples were taken whilst the sheep were standing. For Properties 2 and 3 (MS and JM), a VE machine was used to “hold” the sheep whilst the sampling was undertaken.

. Fleeces were classed into one micron bin lines on Properties 1 and 2, and two micron bin lines on Property 3, based on the MFD measurements from the respective instruments. No attempt was made to optimise the number of bins or the bin size to target diameter price points in the market.

• If a fleece was classed out for quality reasons (e.g. coloured or tender), its identification was recorded and its test result removed from the on-farm instrument's dataset and subsequently from its bin line. Such fleeces were placed in an appropriate cast line. All bin (micron) lines were then baled. RANDOMISATION

The sheep were randomised prior to sampling and measurement. Due to different yard and shed layouts, plus inclement weather at the Property 3, different randomising procedures were used on the three properties.

Property 1 - “Challicum Park” (DO)

The 800 sheep were initially run through a race and drafted alternately “sheep by sheep” into two mobs of 400. The sheep were ear-tagged with unique numbers.

Table 1 shows the respective tag numbers (sheep) allocated for Fleecescan and OFDA2000 classing.

Table 1: Property1 (DO) – Tag numbers for sheep classed by Fleecescan and OFDA2000

Fleecescan Classed Sheep OFDA2000 Classed Sheep Tag No. 1 to 400 401 to 800

Property-2 “Mt Sturgeon” (MS)

It was not possible to separately draft and tag the sheep prior to testing, so groups of 100 or 200 sheep were split off as they came through the yards. The sheep were ear-tagged with unique numbers. Testing by the two instruments was undertaken according to the groups of tagged sheep shown in Table 2.

Table 2: Property 2 (MS) – Tag numbers for sheep classed by Fleecescan and OFDA2000

Fleecescan Classed Sheep No. Sheep OFDA2000 Classed Sheep No. Sheep Tag No. 811 to 910 100 911 to 1010 100 Tag No. 1011 to 1210 200 1212 to 1311 200 Tag No. 1312 to 1411 100 1412 to 1611 100

Property 3 - “Carlyle” (JM)

Persistent rain and a small shearing shed made randomisation of the sheep impossible. In addition, there were only 720 dry sheep in the shed. Consequently, the first 360 sheep were classed by Fleecescan and the second 320 classed by OFDA2000. All sheep were given an ear-tag with a unique number. This may have introduced a slight bias between the two data sets, as sheep may be different at the beginning of a mob compared to the end of the mob.

Approximate tag numbers for the sheep measured by each instrument are shown in table 3.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 4 of 39 Commercial Technology Forum Report: 02

Table 3: Property 3 (JM) – Tag numbers for sheep classed by Fleecescan and OFDA2000

Fleecescan Classed Sheep OFDA2000 Classed Sheep Tag No. 1700 to 2100 2100 to 2500

Examination of the effectiveness of randomisation between the two classed groups by comparison of the combined certificate MFD values for the Fleecescan and OFDA2000 (midside) classed lines

To assess whether the randomisation methods used on the three properties resulted in a biased allocation of sheep, the combined MFD was calculated for all the lines classified by the OFDA2000 (midside) and by the Fleecescan. Table 4 shows the MFD differences between the combined Certification results for each classing system for each of the properties.

Table 4: Difference in combined certified MFD between Fleecescan and OFDA2000 classed lines for each property

Difference in Combined Certified MFD (OFDA2000-classed minus Fleecescan-classed) Property No. Certification by Lab Certification by Lab Average Certification by LSN OFDA100 Lab LSN & OFDA100 1 (DO) 0.07 0.10 0.09 2 (MS) 0.06 0.12 0.09 3 (JM) 0.74 0.58 0.66

Whilst there is very little difference in the Certified test results for Properties 1 and 2, for Property 3 the group of sheep classed by OFDA2000 is, on average, approximately 0.7 µm coarser that the group classed by Fleecescan. Therefore caution is required when comparing the results for OFDA2000 versus Fleecescan classing for this property. OFDA2000 MEASUREMENTS

The grease correction factor (GCF) for OFDA2000 (midside) was determined using the standard commercial procedure. Based on greasy and clean measurements made on the first 30 sheep, one GCF was calculated for each property for sampling using the midside site.

The OFDA2000 result was based on one test per sheep. The measurements of MFD are made as the technology scans the length of the micro-staple. For Merino wools in the range 16.5 – 24.0 µm, it is estimated that between 600 and 3000 fibre segments are measured for diameter by the OFDA2000 during the measurement process, depending on staple length. FLEECESCAN

At shearing, the ear-tag was recorded on paper which then remained with the fleece for the entire process. After shearing, each fleece was skirted and rolled, transferred to and measured once by Fleecescan. The Fleecescan was set to stop measuring when 600 fibre snippets had been counted. LABORATORY LASERSCAN AND OFDA100

For laboratory testing, a sample was taken from the left midside of each animal using an electric handpiece, after sampling for the OFDA2000 measurement.

The midside sample was measured once using Lab LSN (1000 snippets) and once using Lab OFDA100 (one slide). This testing regime was in accordance Australian/New Zealand Standards, viz. AS/NZS 4492.4:2000 (AS/NZS 2000a) and AS/NZS 4492.5:2000 (AS/NZS 2000b).

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 5 of 39 Commercial Technology Forum Report: 02

PHASE 2 TRIAL PROPERTIES

Table 5 details the properties, wool type, Mean Fibre Diameter and sheep numbers for Phase 2.

Table 5: Summary of properties and sheep/wool used in Phase 2 trials

Prop. Date Property Sheep/Fleece Details Approx. No. Sheep Analysed No. Details LSN Cert. Fleece Sheep MFD Classing Ranking 1 25 Jun “Challicum MF4, adult fine-wool Merino 19.1 627 720 (DO) 2003 Park”, ewes, full wool, 1% VM, 97 Beaufort, VIC mm midside 2 16 Jul “Mt Sturgeon”, MF4/3, 10 month superfine 16.6 620 785 (MS) 2003 Dunkeld, VIC Merino hoggets, first shearing, 1.0% VM, 75 mm midside

3 (JM) 14 Sep “Carlyle”, MF5/4, mixed age medium 23.5 683 685 2003 Angaston, SA wool Merino wethers, full wool, 1.5% VM, 100 mm midside

PHASE 2 STATISTICAL ANALYSES

For Phase 2, only MFD measured to one decimal place (µm) was analysed.

Fleece Classing

The data were edited to include only those fleeces for which all four measurements of MFD were available (i.e. OFDA2000 (midside), Fleecescan, Lab OFDA100 and Lab LSN). The lot means were computed from these fleece values only, so that all means for different methods were based on the same fleeces. As a result, some fleeces that contributed to the certificate results were not included in the predictions. The effect of this anomaly on the outcome was considered to be minor. The comparisons between predicted lot means and certificate results were calculated using an Excel spreadsheet.

The likely spread of MFD across fleeces in the trial was determined after the first 100 sheep had been measured by the OFDA2000 on midside samples. The same spread of MFD, as measured by the OFDA2000 (midside), was used for the Fleecescan binning.

The bin ranges (µm) chosen are shown in Table 6. One decimal point was used at “Challicum Park” whilst two decimal points were used at “Mt Sturgeon” and “Carlyle”.

Table 6: Summary of bin ranges used for Phase 2 fleece classing

Bin “Challicum Park” (DO) “Mt Sturgeon” (MS) “Carlyle” (JM) 1 <18.0 <15.95 <20.95 2 18.0 to 18.9 15.95 to 16.94 20.95 to 22.94 3 19.0 to 19.9 16.95 to 17.94 22.95 to 24.94 4 20.0 to 20.9 >17.94 >24.94 5 ≥21.0

Sheep Selection

The rankings were made using a Fortran program, written by Dr. John James, which calculated the number of co-selected fleeces for 20% and 80% selection rates based on low MFD. These two cut-offs are used as examples of possible selection criteria for rams and for breeding ewes respectively. These co-selected numbers were then expressed as percentages of the number of sheep selected by the specific system for each of the 20% and 80% cut-offs. All fleeces with four measurements were used for these computations, including those not forming part of the classed lots. In addition, correlations were

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 6 of 39 Commercial Technology Forum Report: 02 calculated for each pair of measurements using the statistical program ISUW (Interactive Statistical Unit for Windows).

Analyses using IWTO-0 Appendix B procedures were made using an Excel spreadsheet. All fleeces with four measurements were included in these analyses. Comparisons were made between OFDA2000 and Fleecescan, and between each of these on-farm methods and the two laboratory methods (Lab OFDA100 and Lab LSN).

ANALYSES AND RESULTS COMPARISON OF FLEECE CLASSING RESULTS

Figure 1 presents for the three properties the relationship between the on-farm Fleecescan and OFDA2000 (midside) results for each bin line and the certified test results for each bin. The line of best fit (Y=X) is also presented. Figure 1: For three properties, comparison of on-farm MFD to Certificate Average MFD for all bin lines

27 Y=X 25 JM 23 JM

DO DO 19 Fleecescan

Certificate Average MFD MS OFDA2000 17 MS

15 15 17 19 21 23 25 27 MFD measured On-Farm by OFDA2000 or Fleecescan

Figure 1 shows a strong relationship between the different measurement technologies and their ability to measure MFD compared to Certificate Testing.

In other words, when used to class fleeces on-farm into classed lines of 1 µm bandwidths, both OFDA2000 (midside) and Fleecescan were able to produce lines of wool of different diameters in the direction to be expected (i.e. the line that was expected to be the finest was the finest, and so forth).

Tables 7, 8 and 9 present the fleece classing results for “Challicum Park” (DO), “Mt Sturgeon” (MS) and “Carlyle” (JM) respectively. Columns with titles including "(m)" signify that the results were obtained on midside samples (as opposed to a random sampling of all fibres in the skirted fleece for the Fleecescan). For each classing method, the results are shown both in terms of the actual averages of the measurements, and as the differences from the average of the two certified results on the lots.

Appendices 1, 2 and 3 show IWTO-0 Appendix B analyses for “Challicum Park” (DO), “Mt Sturgeon” (MS) and “Carlyle” (JM), respectively, in which each measurement system pair is compared.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 7 of 39 Commercial Technology Forum Report: 02

Table 7: Fleece Classing for Property 1 (DO) OFDA2000 Classing Fleece Measurement Technologies Certificate Test Results Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) LabLSN LabOFDA100 Avg 1 300 203 17.11 18.37 17.42 17.52 17.90 18.10 18.00 2 386 267 18.44 19.62 18.64 18.81 19.20 19.40 19.30 3 269 186 19.40 20.33 19.49 19.69 19.80 20.10 19.95 4 95 66 20.42 21.11 20.38 20.60 21.00 21.20 21.10 5 71 49 21.59 21.82 21.42 21.86 21.40 21.70 21.55 Combined 1121 771 19.16 19.37 19.27

Differences from Certified Averages Fleece Measurement Technologies Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) 1 300 203 -0.89 0.37 -0.58 -0.48 2 386 267 -0.86 0.32 -0.66 -0.49 3 269 186 -0.55 0.38 -0.46 -0.26 4 95 66 -0.68 0.01 -0.72 -0.50 5 71 49 0.04 0.27 -0.13 0.31 Combined 1121 771 -0.59 0.27 -0.51 -0.28

Fleecescan Classing Fleece Measurement Technologies Certificate Test Results Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) LabLSN LabOFDA100 Avg 1 136 93 16.45 17.31 16.64 16.88 17.20 17.40 17.30 2 232 159 17.46 18.51 17.75 17.94 18.50 18.60 18.55 3 368 255 18.15 19.44 18.42 18.66 19.00 19.20 19.10 4 248 172 19.07 20.42 19.21 19.55 20.00 20.20 20.10 5 210 146 19.90 21.54 20.33 20.69 20.60 21.00 20.80 Combined 1194 825 19.09 19.27 19.18

Differences from Certified Averages Fleece Measurement Technologies Line Gsy Nett Wt Sch Dry OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) 1 136 93 -0.85 0.01 -0.66 -0.42 2 232 159 -1.09 -0.04 -0.80 -0.61 3 368 255 -0.95 0.34 -0.68 -0.44 4 248 172 -1.03 0.32 -0.89 -0.55 5 210 146 -0.90 0.74 -0.47 -0.11 Combined 1194 825 -0.96 0.27 -0.70 -0.43

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 8 of 39 Commercial Technology Forum Report: 02

Table 8: Fleece Classing for Property 2 (MS)

OFDA2000 Classing Fleece Measurement Technologies Certificate Test Results Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) LabLSN LabOFDA100 Avg 1 80 58 15.51 15.60 15.22 15.43 15.60 15.60 15.60 2 174 127 16.50 16.33 16.04 16.13 16.20 16.40 16.30 3 165 121 17.39 17.10 16.80 16.95 17.00 17.10 17.05 4 84 61 18.50 18.14 17.85 18.06 18.20 18.00 18.10 Combined 503 367 16.62 16.72 16.67

Differences from Certified Averages Fleece Measurement Technologies Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) 1 80 58 -0.09 0.00 -0.38 -0.17 2 174 127 0.20 0.03 -0.26 -0.17 3 165 121 0.34 0.05 -0.25 -0.10 4 84 61 0.40 0.04 -0.25 -0.04 Combined 503 367 0.21 0.03 -0.28 -0.12

Fleecescan Classing Fleece Measurement Technologies Certificate Test Results Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) LabLSN LabOFDA100 Avg 1 114 84 15.90 15.39 15.37 15.51 15.50 15.60 15.55 2 192 142 16.69 16.49 16.18 16.28 16.60 16.60 16.60 3 170 123 17.30 17.36 16.82 16.91 17.10 17.10 17.10 4 42 31 18.46 18.40 17.79 18.01 17.80 18.30 18.05 Combined 518 380 16.56 16.60 16.58

Differences from Certified Averages Fleece Measurement Technologies Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) 1 114 84 0.35 -0.16 -0.18 -0.04 2 192 142 0.09 -0.11 -0.42 -0.32 3 170 123 0.20 0.26 -0.28 -0.19 4 42 31 0.41 0.35 -0.26 -0.04 Combined 518 380 0.26 0.08 -0.29 -0.15

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 9 of 39 Commercial Technology Forum Report: 02

Table 9: Fleece Classing for Property 3(JM)

OFDA2000 Classing Fleece Measurement Technologies Certificate Test Results Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) LabLSN LabOFDA100 Avg 1 103 73 20.02 20.74 19.60 19.96 20.70 21.00 20.85 2 349 248 22.14 22.87 21.86 22.08 22.40 22.60 22.50 3 513 365 24.00 24.67 23.67 24.00 24.20 24.20 24.20 4 486 351 26.26 26.62 25.93 26.25 26.00 26.40 26.20 Combined 1451 1037 23.89 24.09 23.99

Differences from Certified Averages Fleece Measurement Technologies Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) 1 103 73 -0.83 -0.11 -1.25 -0.89 2 349 248 -0.36 0.37 -0.64 -0.42 3 513 365 -0.20 0.47 -0.53 -0.20 4 486 351 0.06 0.42 -0.27 0.05 Combined 1451 1037 -0.33 0.29 -0.67 -0.37

Fleecescan Classing Fleece Measurement Technologies Certificate Test Results Line Gsy Nett Wt Sch Dry Wt OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) LabLSN LabOFDA100 Avg 1 142 98 19.64 19.99 19.16 19.32 19.70 20.10 19.90 2 254 177 21.61 22.04 21.26 21.48 21.80 22.10 21.95 3 473 331 23.21 23.94 22.89 23.22 23.20 23.60 23.40 4 514 360 25.57 26.59 25.36 25.79 25.60 25.80 25.70 Combined 1383 966 23.15 23.51 23.33

Differences from Certified Averages Fleece Measurement Technologies Line Gsy Nett Wt Sch Dry OFDA2000(m) FLCSCN LabLSN(m) LabOFDA(m) 1 142 98 -0.26 0.09 -0.74 -0.58 2 254 177 -0.34 0.09 -0.69 -0.47 3 473 331 -0.19 0.54 -0.51 -0.18 4 514 360 -0.13 0.89 -0.34 0.09 Combined 1383 966 -0.23 0.40 -0.57 -0.29

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 10 of 39 Commercial Technology Forum Report: 02

Figures 2, 3 and 4 present for the three properties the relationship between the classing decisions made using the on-farm OFDA2000 and Fleecescan instruments and their difference from the average Certified Test results for MFD.

Figure 2: Property 1 (DO) - Fleecescan & OFDA2000 classing: Differences versus Certificate MFD

e 1.2 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0

Difference from Certificate Averag Certificate from Difference -1.2 17 18 19 20 21 22 Certificate Average MFD

OFDA2000 Flcscn Linear (Flcscn) Linear (OFDA2000)

Figure 3: Property 2 (MS) - Fleecescan & OFDA2000 classing: Differences versus Certificate MFD

e 1.2 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0

Difference from Certificate Averag Certificate from Difference -1.2 15 16 17 18 19 Certificate Average MFD

OFDA2000 Flcscn Linear (Flcscn) Linear (OFDA2000)

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 11 of 39 Commercial Technology Forum Report: 02

Figure 4: Property 3 (JM) - Fleecescan & OFDA2000 classing: Differences versus Certificate MFD

e 1.2 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0

Difference from Certificate Averag Certificate from Difference -1.2 19 20 21 22 23 24 25 26 27 Certificate Average MFD

OFDA2000 Flcscn Linear (Flcscn) Linear (OFDA2000)

The data in Figures 2, 3 and 4 illustrate classing decisions made using the data for each of the three properties. The trend lines all exhibit a slope and in a number of cases an offset.

The data supports the frequently observed phenomenon of “micron creep” (sometimes also called "micron shrinkage"). “Micron creep” is related to the measurement uncertainty. The finest and coarsest classed lines are affected by individual fleeces being binned in them that, for a perfect measurement system, with no error, would normally have been classed into a neighbouring bin. The magnitude of the deviation will be larger the higher the Confidence Limit of the measurement system.

“Micron creep” is only related to situations at the extremes where the measurement data has been used to make selection decisions. That is, for OFDA2000(m) measurements during OFDA2000 Classing, and Fleecescan measurements during Fleecescan Classing. Measurements independent of any classing decisions include the following, which are not expected to be significantly affected:

• all the Laboratory (Lab-LSN(m) and Lab-OFDA(m)) measurements;

• the Fleecescan measurements when the fleeces are being classed on OFDA2000(m); and

• the OFDA2000(m) measurements when the fleeces are being classed on Fleecescan.

As the slopes in Figs 2, 3 and 4 appear very similar, this would support the conclusion in Phase 1 that the precision of Fleecescan and OFDA2000 midside sampling are near equal (Atkins & Semple, 2003). The graphs also support the conclusion that there were biases between the OFFM systems and the Certified Test results, and that these varied from property to property.

For Property 1 (DO), Figure 5 illustrates the relationship between the on-farm OFDA2000 classing decisions and the difference of OFDA2000(m), Fleecescan, Lab-LSN(m) and Lab-OFDA(m) results from the average Certified Test results for MFD. Figure 6 presents the comparable graph for Fleecescan classing.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 12 of 39 Commercial Technology Forum Report: 02

Figure 5: Property 1 (DO) - OFDA2000 classing. Fleecescan, OFDA2000(m), Lab-LSN(m) and Lab- OFDA(m) results: Differences versus Certificate MFD

1.2 e 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0 Difference from Certificate Averag Certificate from Difference -1.2 17 18 19 20 21 22 Certificate Average MFD Linear (Flcscn) Linear (OFDA2000) Linear (LabLSN(m)) Linear (LabOFDA(m))

Figure 6: Property 1 (DO) – Fleecescan classing. Fleecescan, OFDA2000(m), Lab-LSN(m) and Lab- OFDA(m) results: Differences versus Certificate MFD

e 1.2 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0

Difference from Certificate Averag Certificate from Difference -1.2 17 18 19 20 21 22 Certificate Average MFD Linear (Flcscn) Linear (OFDA2000) Linear (LabLSN(m)) Linear (LabOFDA(m))

For Property 1 (DO) the following trends were observed in Figures 5 and 6: ▪ The laboratory-measured midside was biased fine compared to the Certified Test results by 0.48 µm. (derived from the average of Lab-LSN(m) (-0.51, -0.70) and Lab-OFDA(m) (-0.28, -0.43)).

▪ The OFDA2000(m) was biased fine compared to the Certified results by 0.78 µm (-0.48 µm due to the sample site and -0.30 µm due to the instrument).

▪ The Fleecescan was biased coarse compared to the Certified data by 0.27 µm. For Property 2 (MS), Figure 7 illustrates the relationship between the on-farm OFDA2000 classing decisions and the difference of OFDA2000(m), Fleecescan, Lab-LSN(m) and Lab-OFDA(m) results from the average Certified Test results for MFD. Figure 8 presents the comparable graph for Fleecescan classing.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 13 of 39 Commercial Technology Forum Report: 02 Figure 7: Property 2 (MS) - OFDA2000 classing. Fleecescan, OFDA2000(m), Lab-LSN(m) and Lab- OFDA(m) results: Differences versus Certificate MFD

1.2 e 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0 Difference from Certificate Averag Certificate from Difference -1.2 15 16 17 18 19 Certificate Average MFD Linear (Flcscn) Linear (OFDA2000) Linear (LabLSN(m)) Linear (LabOFDA(m))

Figure 8: Property 2 (MS) – Fleecescan classing. Fleecescan, OFDA2000(m), Lab-LSN(m) and Lab- OFDA(m) results: Differences versus Certificate MFD

e 1.2 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0

Difference from Certificate Averag Certificate from Difference -1.2 15 16 17 18 19 Certificate Average MFD Linear (Flcscn) Linear (OFDA2000) Linear (LabLSN(m)) Linear (LabOFDA(m))

For Property 2 (MS) the following trends were observed in Figures 7 and 8: ▪ The laboratory-measured midside was biased fine compared to the Certified Test results by 0.21 µm.

▪ The OFDA2000 was biased coarse compared to the Certified Test results by 0.24 µm (-0.21 µm due to the sample site and +0.45 µm due to the instrument)

▪ The Fleecescan was biased coarse compared to the Certified Test results by 0.06 µm. For Property 3 (JM), Figure 9 illustrates the relationship between the on-farm OFDA2000 classing decisions and the difference of OFDA2000(m), Fleecescan, Lab-LSN(m) and Lab-OFDA(m) results from the average Certified Test results for MFD. Figure 10 presents the comparable graph for Fleecescan classing.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 14 of 39 Commercial Technology Forum Report: 02 Figure 9: Property 3 (MS) - OFDA2000 classing. Fleecescan, OFDA2000(m), Lab-LSN(m) and Lab- OFDA(m) results: Differences versus Certificate MFD

1.2 e 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0 Difference from Certificate Averag Certificate from Difference -1.2 19 20 21 22 23 24 25 26 27 Certificate Average MFD Linear (Flcscn) Linear (OFDA2000) Linear (LabLSN(m)) Linear (LabOFDA(m))

Figure 10: Property 3 (JM) – Fleecescan classing. Fleecescan, OFDA2000(m), Lab-LSN(m) and Lab- OFDA(m) results: Differences versus Certificate MFD

e 1.2 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 -1.0

Difference from Certificate Averag Certificate from Difference -1.2 19 20 21 22 23 24 25 26 27 Certificate Average MFD Linear (Flcscn) Linear (OFDA2000) Linear (LabLSN(m)) Linear (LabOFDA(m))

For Property 3 (JM) the following trends were observed in Figures 9 and 10: ▪ The laboratory-measured midside was biased fine compared to the Certified Test results by 0.48 µm.

▪ The OFDA2000(m) was biased fine compared to the Certified Test results by 0.28µm (-0.48 µm due to the sample site and +0.20 µm due to the instrument).

▪ The Fleecescan was biased coarse compared to the Certified Test results by 0.35 µm.

▪ It is clear from Fig 9 and Fig 10 that the biases for property JM were not simple offsets, as was observed for the first two properties, and that the biases were dependent on the measured MFD.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 15 of 39 Commercial Technology Forum Report: 02 CONCLUSIONS FOR FLEECE CLASSING RESULTS

Evidence of “Micron Creep” exists for all three properties for both measurement technologies used On Farm. There can be no doubt that it would also exist for Laboratory measurements if they had been used for classing the fleeces.

Despite the midside sampling site being recognised as the best site to take samples to represent the fleece, this should be considered to be a generalisation as this site will not always give an exact correspondence with the skirted fleece. This finding would not change any recommendation to use the midside sampling site but does have an impact on the potential differences that one could expect to see between OFFM performed on individual fleeces and the Certificate test results derived from the baled wool.

COMPARISON OF SHEEP SELECTION RESULTS

Table 10 presents for the three properties and four test instruments/methods: the mean, standard deviation, minimum and maximum values and range in MFD.

Table 10: Summary statistics: MFD on 3 properties and 4 instruments for the sheep used for classing

Property Test System Mean Std Dev Minimum Maximum Range Lab OFDA100 18.45 1.44 15.3 24.7 9.4 1 (DO) Lab LSN 18.64 1.41 15.2 24.7 9.5 OFDA2000 18.42 1.34 14.5 23.8 9.3 Fleecescan 19.56 1.34 16.2 24.1 7.9 Lab OFDA100 16.37 1.00 13.6 19.7 6.1 2 (MS) Lab LSN 16.22 0.96 13.2 19.5 6.3 OFDA2000 16.76 0.96 14.2 20.5 6.3 Fleecescan 16.56 0.98 13.4 19.9 6.5 Lab OFDA100 23.40 2.51 16.3 31.2 14.9 3 (JM) Lab LSN 23.09 2.44 16.5 30.5 14.0 OFDA2000 23.40 2.41 16.9 31.9 15.0 Fleecescan 24.15 2.37 17.1 31.2 14.1

Tables 11, 13 and 15 show, for the three properties, the instrument correlation coefficients for MFD.

Tables 12, 14 and 16 show, for the three properties, the number and percentage of co-selected sheep when one instrument is used as the criterion for selecting at both 20% and 80% cut-offs for MFD.

Table 11: Property 1 (DO) - Instrument correlation coefficients for MFD

OFDA2000 Fleecescan Lab OFDA100 Fleecescan 0.82 Lab OFDA100 0.90 0.83 Lab LSN 0.89 0.81 0.94

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 16 of 39 Commercial Technology Forum Report: 02

Table 12: Property 1 (DO) - Ranking for sheep selection at 20% and 80% cut-offs

Variate Number at 20% Number at 80% PC at 20% PC at 80% Criterion is OFDA2000 OFDA2000 156 625 FLCSCN 110 570 70.5 91.2 LAB OFDA100 112 584 72.0 93.4 LAB LSN 116 587 74.4 93.9 Criterion is Fleecescan OFDA2000 110 570 70.5 91.2 FLCSCN 156 625 LAB OFDA100 108 575 69.2 92.0 LAB LSN 113 572 72.4 83.9 Criterion is Lab OFDA100 OFDA2000 112 584 72.0 93.4 FLCSCN 108 575 69.2 92.0 LAB OFDA100 156 625 LAB LSN 126 593 80.8 94.9 Criterion is Lab LSN OFDA2000 116 587 74.4 93.9 FLCSCN 113 572 72.4 83.9 LAB OFDA100 126 593 80.8 94.9 LAB LSN 156 625

Table 13: Property 2 (MS) - Instrument correlation coefficients for MFD

OFDA2000 Fleecescan Lab OFDA100 Fleecescan 0.77 Lab OFDA100 0.84 0.76 Lab LSN 0.83 0.77 0.91

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 17 of 39 Commercial Technology Forum Report: 02

Table 14: Property 2 (MS) - Ranking for sheep selection at 20% and 80% cut-offs

Variate Number at 20% Number at 80% PC at 20% PC at 80% 4Criterion is OFDA2000 OFDA2000 157 628 FLCSCN 103 572 65.6 91.1 LAB OFDA100 95 584 60.5 93.0 LAB LSN 106 577 67.5 91.9 Criterion is Fleecescan OFDA2000 103 572 65.6 91.9 FLCSCN 157 628 LAB OFDA100 93 574 59.2 91.4 LAB LSN 101 569 64.3 90.6 Criterion is Lab OFDA100 OFDA2000 95 584 60.5 93.2 FLCSCN 93 574 59.2 91.4 LAB OFDA100 157 628 LAB LSN 122 596 77.7 94.9 Criterion is Lab LSN OFDA2000 106 577 67.5 91.9 FLCSCN 101 569 64.3 90.6 LAB OFDA100 122 596 77.7 94.9 LAB LSN 157 628

Table 15: Property 3 (JM) - Instrument correlation coefficients for MFD

OFDA2000 Fleecescan Lab OFDA100 Fleecescan 0.90 Lab OFDA100 0.96 0.91 Lab LSN 0.96 0.91 0.99

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 18 of 39 Commercial Technology Forum Report: 02

Table 16: Property 3 (JM) - Ranking for sheep selection at 20% and 80% cut-offs

Variate Number at 20% Number at 80% PC at 20% PC at 80% Criterion is OFDA2000 OFDA2000 137 548 FLCSCN 109 511 79.6 93.2 LAB OFDA100 113 527 82.5 96.2 LAB LSN 120 531 87.6 96.9 Criterion is Fleecescan OFDA2000 109 511 79.6 93.2 FLCSCN 137 548 LAB OFDA100 116 511 84.7 93.2 LAB LSN 115 514 83.9 93.8 Criterion is Lab OFDA100 OFDA2000 113 527 82.5 96.2 FLCSCN 116 511 84.7 93.2 LAB OFDA100 137 548 LAB LSN 124 533 90.5 97.3 Criterion is Lab LSN OFDA2000 120 531 87.6 96.9 FLCSCN 115 514 83.9 93.8 LAB OFDA100 124 533 90.5 97.3 LAB LSN 137 548

CONCLUSIONS FOR SHEEP SELECTION RESULTS

Whilst the OFDA2000 showed slightly higher correlation coefficients with the Lab OFDA100 and Lab LSN than the Fleecescan, this is to be expected since the OFDA2000, Lab OFDA100 and Lab LSN were all using samples obtained from the midside (they are comparing like with like), whereas the Fleecescan uses a random selection of fibres obtained from the skirted fleece.

For all three properties the highest correlation between the measurements was between Lab-OFDA(m) and Lab-LSN(m), as would be expected given the slightly better precision of the laboratory measurements shown in Phase 1 of the project.

The percentages of co-selected sheep vary with the ratios of the measurement precision of the two measurement systems to the range of MFD values in the selected group. Thus, for example, the percentage of co-selected sheep is higher in all cases for the 80% of sheep selected with the lowest MFD than it is for the 20% of sheep selected with the lowest MFD. This is to be expected since the ratio of the range to the measurement precision of MFD values in the 80% selection situation is significantly higher than for the 20% situation. In order to improve the agreement between measurement systems in the selection of the "top" 20% of a flock, it would be necessary to improve the precision of measurement so that the ratio of the range to the precision increases. This confirms the observation made in Phase 1 that growers using the technologies for ram selection should compare ways of improving precision of measurement against the benefits to be obtained.

Similarly, the percentages in any category of comparison are higher for Property 3 than for Property 2. The former had a wider range of MFD values than the latter (approximately 15 µm compared to 6 µm - see Table 10). The results for Property 1 fell somewhere between the corresponding values for the other

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 19 of 39 Commercial Technology Forum Report: 02 two properties, as did the range of MFD values (approximately 9 µm). The percentages of co-selected sheep were highest when comparing the two laboratory midside measurements, and lowest when comparing the two on-farm technologies, with the corresponding comparisons between an on-farm technology and a laboratory measurement falling somewhere between. These relationships mirror those of the correlation coefficients.

It can therefore be concluded that the greater the range in diameter within the flock, and the more precise the measurement, the more likely it is that animal selections made using different instruments will be consistent.

CONCLUSIONS AND RECOMMENDATIONS

The following conclusions were drawn based on the results presented for the three properties:

▪ Laboratory measurements on midside samples were slightly more precise than those made on-farm.

▪ The greater the range in diameter within the flock, and the more precise the measurements, the more likely it is that measurement assisted classed lot measurements and animal selections made using different instruments will be consistent.

▪ There was a strong relationship between the two on-farm measurement technologies and their ability to measure MFD compared to Certificate Testing.

▪ When used for fleece classing, both the OFDA2000 (when measuring midside samples) and the Fleecescan (when measuring skirted fleeces) produced lines of wool of different diameters in the direction to be expected (i.e. the line that was expected to be the finest was the finest, and so on).

▪ From fleece classing and sheep selection results it can be concluded that the precisions of Fleecescan and OFDA2000 midside sampling are near equal.

▪ Biases were observed between the OFFM systems and the Certified Test results, and these varied from property to property, ranging overall on individual lots from - 1.1 µm to +0.9 µm. A portion of these biases could be attributed to the midside sampling site (-0.5 µm to -0.2 µm based on the averages of the combined Lab results on the three properties), and the remainder to the individual OFFM instruments themselves (OFDA2000(m) -0.3 µm to +0.5 µm, and Fleecescan +0.1 µm to +0.4 µm).

▪ “Micron Creep” was observed for both measurement technologies used on farm. It would also exist for Laboratory measurements if they were to be used for classing the fleeces.

There is no reason to suppose that these general conclusions obtained on 3 properties are not widely applicable. Clearly, however, as has been demonstrated, the magnitude of the effects on individual properties, and with different operators and instruments, will vary, depending on the circumstances prevailing at the time.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 20 of 39 Commercial Technology Forum Report: 02

ACKNOWLEDGEMENTS

This substantial trial was totally funded by Australian Wool Innovation on behalf of the wool producers of Australia. This report is based on the AWI Final Milestone Report on project EC 397, which details the following acknowledgements:

This has been a large-scale trial, which would not have been possible without the help and support of a large number of individuals and companies. These people and their organisations are listed below.

AWI established an Expert Advisory Group whose role was to establish the trial protocol; monitor the conduct of the trials, assist with and review the analyses and to prepare the Final Report to AWI. This Group’s contribution has been significant. In particular, Jim Marler and Peter Baxter, with input from Ralph Behrendt, undertook an enormous amount of additional work to complete the protocol, analysis and draft of the final report. Their contribution and that of their companies for allowing them the time to do so is specifically acknowledged.

Expert Advisory Group Members

Mr Peter Baxter SGS Wool Testing Services Wellington, New Zealand Dr Ralph Behrendt Department of Primary Industries Hamilton, VIC Dr Kerry Hansford Teckel Consulting Pty Ltd Melbourne, VIC Dr Bill Humphries CSIRO Textile and Fibre Technology Geelong, VIC Dr John James Consultant Sydney, NSW Mr Jim Marler AWTA Ltd Sydney, NSW Dr Paul Swan AWI Ltd Sydney, NSW Mr George Waldthausen (Chair) AWI Ltd Sydney, NSW

Woolgrowers Jack Donaldson Angus Jackson “Chatsworth House”, Lake Bolac, VIC “Corea Lane”, Glenthompson, VIC Bill Blackwell Austin Eagle "Corea", Dunkeld, VIC “Glenara North”, Horsham, VIC Alan MacInnes Ken Baldry “Bernifay”, Natimuk, VIC “Wallendbeen East”, Cootamundra, NSW Bill & Vicki Webb David Oddie “Marbarrup”, Kojunup WA “Challicum Park”, Beaufort, VIC Bevan McKnight Jim Mitchell “Mt Sturgeon”, Dunkeld, VIC “Carlyle”, Angaston, SA

Instrument Owner/Operators Janelle Pearson Joyce and Leigh Gordon Landmark, Bendigo, VIC Bullawyn Pastoral Co, Dunkeld, VIC Bill Crawford and Megan Jackson Colin Parker “Sierra Park”, Victoria Valley, VIC Dunkeld, VIC Russell Pitcher Sarah Lannan RD Pitcher, Skipton, VIC Landmark, Goulburn, NSW Paul Cocking Paul Vallely

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 21 of 39 Commercial Technology Forum Report: 02

Riverina Wool Testers Pty Ltd Southern Tablelands Fibre Testing Wagga Wagga, NSW Crookwell, NSW Paul Cousins Sydney East Cousins Merino Services Pty Ltd, Burra, SA Multiplex Constructions Pty Ltd, Dongra, WA Anita Eyres Andy Paton Doreenup Wool Testing, Kojonup, WA Mobile Microns, Deniliquin, NSW Ian Bradtke

CH Bradtke & Son, Peterborough, SA

Service Providers Jock Simmons Rod Agar and John Billing, Aust. Cashmere Growers Assoc. Kellyville, NSW AWTA Ltd., Melbourne, VIC Bill Johnstone Richard Manning IWG, Fremantle, WA IWG, Tamworth, NSW John Cheshire and Andrew Lindsay Eric Reiher AWTA Ltd, Sydney, NSW AWTA Ltd, Newcastle, NSW David Cother Ross Bawden and Cam Cuthbertson AWEX, Melbourne, VIC Landmark, Brooklyn, VIC Rob Mahoney Bruno DeMattia Skipton, VIC Melbourne, VIC

Additional Trial Staff

Steve Harvey Linda Venables Malvern, VIC Rippolea, VIC Jeff Wilson, Peter Conrick, Wallan, VIC Turretfield, SA Don Wight, Cheryl Pope, Adelaide, SA Orange, NSW

Project Management

Program Manager: Mr George Waldthausen, AWI

Project Manager: Mr Gary Macfarlane, GMAC Consulting Pty Ltd.

Trial Manager: Mr Russell Pattinson, Miracle Dog Pty Ltd.

Project Consultants

Statistical Analysis: Dr John James

Final Milestone Report Preparation: Dr Kerry Hansford, Teckel Consulting Pty Ltd

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 22 of 39 Commercial Technology Forum Report: 02

REFERENCES

• Marler, J and Baxter, P (2004) The 2003 Australian Wool Innovation on-farm fibre measurement instrument evaluation trial - Part 2: Performance in objective classing and ranking for animal selection. IWTO CTF, Evian, Paper CTF 01.

BIBLIOGRAPHY

1. Andrews, R.N., Land, J.T.J. and Dodds, K.G. (1997) Classing of adult Merino fleeces using fibre diameters predicted from hogget measurements. Wool Tech. Sheep Breed. 45(1): 35-50.

2. AS/NZS (2000a) Australian Standard/New Zealand Standard 4492.4:2000: Wool – Fleece Testing and Measurement – Measurement of mean fibre diameter and determination of fibre diameter distribution using the Sirolan-Laserscan measuring system.

3. AS/NZS (2000b) Australian Standard/New Zealand Standard 4492.5:2000: Wool – Fleece Testing and Measurement – Measurement of mean fibre diameter and determination of fibre diameter distribution using the OFDA measuring system.

4. Atkins, K.D. and Semple, S.J. (2003) The economic benefits of on-farm fibre diameter testing in commercial Merino flocks: (1) Objective Clip Preparation. Wool Tech. Sheep Breed. 51(1): 1.

5. Baxter, P. (2000) Precision of measurement of diameter, and diameter length profile, of greasy wool staples on-farm, using the OFDA2000 instrument. 10th Intl. Wool Text. Res. Conf., Aachen, Paper RW02.

6. Baxter, P. (2001) On-farm classing of animals and fleeces with the OFDA2000. Wool Tech. Sheep Breed. 49(2): 133-155.

7. Baxter, P. and Cottle, D.J. (1998) The use of midside fleece fibre diameter distribution measurements in sheep selection. Wool Tech. Sheep Breed. 46(2): 154-171.

8. Baxter, P. and Johnston, W. (2002). OFDA2000 proficiency trials. IWTO T & S Committee, Nice, December 2002, Report CTF 01.

9. Behrendt, R., Konstantinov, K., Brien, F., Ferguson, M. and Gloag, C. (2002) A comparison of estimates of mean fibre diameter, variation in fibre diameter and fibre curvature between OFDA2000 and conventional laboratory-based fibre testing. Wool Tech. Sheep Breed. 50(4): 780-786.

10. Brien, F.D, Ferguson, M.B. and Konstantinov, K. (2001) A comparison of fleece testing methods for the establishment of a ram breeding nucleus in a wool flock and for clip preparation. Proc. Assoc. Advmt. Anim. Breed. Genet. 14: 277.

11. Cottle, D.J., Almeida, C.D., Baxter, B.P. and Petrie, D.J. (1996) Precision of OFDA fibre diameter measurements on midside wool samples. Wool Tech. Sheep Breed. 44(4): 295-303.

12. Fish, V.E., Mahar T.J. and Crook, B.J. (2002) Sampling variation over a fleece for mean fibre diameter, standard deviation of fibre diameter and mean fibre curvature. Paper 32, Wool Industry Science and Technology Conference, October 2002, Hamilton, Victoria, Australia. (Also Wool Tech. Sheep Breed. 50(4): 798-804).

13. Gillies, R.I. and Stadler, W. (1997) A four year study of the ongoing effectiveness of flock ranking following single testing for mean fibre diameter. Wool Tech. Sheep Breed. 45(1): 27-34.

14. Hansford, K.A., Marler, J.W. and McLachlan, I.M. (2002) Using OFDA2000 and Fleecescan to prepare lots for sale and sheep selection: a case study, Paper 35, Wool Industry Science and Technology Conference, October 2002, Hamilton, Victoria, Australia. (Also Wool Tech. Sheep Breed. 50(4): 812- 818).

15. IWTO (2001) IWTO-0-01 – Introduction to IWTO Specifications. Procedures for development, review, progression or relegation of IWTO Test Methods and Draft Test Methods.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 23 of 39 Commercial Technology Forum Report: 02 16. IWTO (2002) IWTO-31-02 – Calculations of IWTO Combined Certificates for deliveries of raw wool.

17. Knowles, D.G. (2002) An Evaluation of three measurement systems used in commercial fleece testing. IWTO T & S Committee, Barcelona, May 2002, Report CTF 11.

18. Marler, J.W. and Crowe, D.W. (2002) The impact of test result precision on genetic, culling and classing decisions taken on farm. Paper 37, Wool Industry Science and Technology Conference, October 2002, Hamilton, Victoria, Australia. (Also Wool Tech. Sheep Breed. 50(4): 840 – 846).

19. Marler, J.W., Hansford, K.A. and McLachlan, I.M. (2002) The precision of OFDA2000 and Fleecescan for estimating the diameter characteristics of fleeces: A case study. Paper 36, Wool Industry Science and Technology Conference, October 2002, Hamilton, Victoria, Australia. (Also Wool Tech. Sheep Breed. 50(4): 832-839).

20. Morgan, P.D. (1990) Fleece measurement inter-laboratory trials – An analysis of the factors influencing the precision of test results. Wool Tech. Sheep Breed. 38(1): 21-23.

21. Petersen, A.D. and Gherardi, S.G. (2002) Comparison of the Sirolan Fleecescan and OFDA2000 for on-farm testing of fibre diameter. Proc. Aust. Soc. Anim. Prod. 24: 173-176.

22. Peterson, A.D. and Gherardi, S.G. (2001) The ability of the OFDA2000 to measure fleeces and sale lots on farm. Wool Tech. Sheep Breed. 19(2): 110-132.

23. Stadler, W. and Gillies, R.I. (1994) A case study for the use of midside samples to predict the mean fibre diameter of classed lines. Wool Tech. Sheep Breed. 42(4): 319-326.

24. TQA Research Pty Ltd (2002) On-farm fibre measurement – market research. Report to Australian Wool Innovation Ltd., June 2002.

25. Turner, H.N. (1956) Measurement as an aid to selection in breeding sheep for wool production. Anim. Breed. Abstracts 24(2): 87-110.

26. Vizard, A.L. and Williams, S.H. (1993) A model to estimate the economic value of using individual fleece diameter measurements to class wool. Agric. Systems, 41: 475.

27. Vizard, A.L. (2001) The value of in-shed testing to commercial wool producers. AWTA Ltd Newsletter, September 2001.

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 24 of 39 Commercial Technology Forum Report: 02

APPENDIX 1 - IWTO-0 ANALYSES FOR PROPERTY 1 (DO)

Fleecescan / Lab LSN

Graph of Difference versus Average 6.0 Property DO V alidation 4.0 O verall Relative Bias & Paired t-test.

Overall Bias Paired 2.0 FLSN LabLS t-test 782 782 782 19.5531 18.6253 -0.9278 0.0 1.3340 1.4014 0.8394 0.0477 0.0501 0.0300 409.8881 371.6501 -30.9111 0.0000 0.0000 0.0000 -2.0 ***

-4.0 (B) Test for Correlation.

Num ber 782 DF 780 -6.0 15.0 17.0 19.0 21.0 23.0 25.0 R0.8128 Average t-value 38.9668 p-value 0.0000 Significance *** Graph of Treatment versus Control

t "Bias". 25

Significance SE of Slope t-Value p-value Rsq 23 * 0.0219 2.3071 0.0213 0.6606 * 0.0230 2.3654 0.0183 STEYX 21 0.7776

19 e ndent "Bias".

Avg. "Bias" -1.16 17 -0.91 -0.65 -0.40 -0.15 15 0.11 15 17 19 21 23 25

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 25 of 39 Commercial Technology Forum Report: 02

Fleecescan / Lab OFDA100

Graph of Difference versus Average 6.0 Property DO

Validation 4.0

(A) Test for Overall Relative Bias & Paired t-test.

2.0 Overall Bias Paired FLSN LabLS t-test Number 782 782 782 Average 19.5531 18.6253 -0.9278 0.0 SD 1.3340 1.4014 0.8394 SE 0.0477 0.0501 0.0300

t value 409.8881 371.6501 -30.9111 -2.0 p value 0.0000 0.0000 0.0000 Significance ***

-4.0 (B) Test for Correlation.

Number 782 -6.0 15.0 17.0 19.0 21.0 23.0 25.0 DF 780 Average R 0.8128 t-value 38.9668 p-value 0.0000 Graph of Treatment versus Control Significance ***

25 (C) Test for Level Dependent "Bias".

Statistical Significance 23 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0506 * 0.0219 2.3071 0.0213 0.6606 DVA 0.0544 * 0.0230 2.3654 0.0183 21 Intercept(GM) -1.9163 STEYX Intercept(DVA) -1.9662 0.7776

Magnitude of the Level Dependent "Bias".

Nominal Calculated Avg. "Bias" 17 15 13.84 -1.16 20 19.09 -0.91 25 24.35 -0.65 30 29.60 -0.40 15 35 34.85 -0.15 15 17 19 21 23 25 40 40.11 0.11

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 26 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Fleecescan

Graph of Difference versus Average 6.0 Property DO

Validation 4.0

(A) Test for Overall Relative Bias & Paired t-test.

2.0 Overall Bias Paired OFDA2000 FLSN t-test Number 782 782 782 Average 18.4079 19.5531 1.1452 0.0 SD 1.3352 1.3340 0.8108 SE 0.0477 0.0477 0.0290

t value 385.5450 409.8881 39.4964 -2.0 p value 0.0000 0.0000 0.0000 Significance ***

-4.0 (B) Test for Correlation.

Number 782 -6.0 15.0 17.0 19.0 21.0 23.0 25.0 DF 780 Average R 0.8154 t-value 39.3445 p-value 0.0000 Graph of Treatment versus Control Significance ***

25 (C) Test for Level Dependent "Bias".

Statistical Significance 23 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 0.9991 NS 0.0207 0.0421 0.9664 0.6649 DVA -0.0010 NS 0.0228 0.0421 0.9664 21 Intercept(GM) 1.1613 STEYX Intercept(DVA) 1.1634 0.7733

Magnitude of the Level Dependent "Bias".

Nominal Calculated Avg. "Bias" 17 15 16.15 1.15 20 21.14 1.14 25 26.14 1.14 30 31.14 1.14 15 35 36.13 1.13 15 17 19 21 23 25 40 41.13 1.13

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 27 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Lab LSN

Graph of Difference versus Average 6.0 Property DO

Validation 4.0

(A) Test for Overall Relative Bias & Paired t-test.

2.0 Overall Bias Paired OFDA2000 LabLS t-test Number 782 782 782 Average 18.4079 18.6253 0.2174 0.0 SD 1.3352 1.4014 0.6491 SE 0.0477 0.0501 0.0232

t value 385.5450 371.6501 9.3649 -2.0 p value 0.0000 0.0000 0.0000 Significance ***

-4.0 (B) Test for Correlation.

Number 782 -6.0 15.0 17.0 19.0 21.0 23.0 25.0 DF 780 Average R 0.8886 t-value 54.0973 p-value 0.0000 Graph of Treatment versus Control Significance ***

25 (C) Test for Level Dependent "Bias".

Statistical Significance 23 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0496 ** 0.0172 2.8791 0.0041 0.7896 DVA 0.0513 ** 0.0174 2.9506 0.0033 21 Intercept(GM) -0.6963 STEYX Intercept(DVA) -0.7324 0.6129

Magnitude of the Level Dependent "Bias".

Nominal Calculated Avg. "Bias" 17 15 15.05 0.05 20 20.30 0.30 25 25.54 0.54 30 30.79 0.79 15 35 36.04 1.04 15 17 19 21 23 25 40 41.29 1.29

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 28 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Lab OFDA100

Graph of Difference versus Average 6.0 Property DO

Validation 4.0

(A) Test for Overall Relative Bias & Paired t-test.

2.0 Overall Bias Paired OFDA2000 LabOFDA t-test Number 782 782 782 Average 18.4079 18.8532 0.4453 0.0 SD 1.3352 1.4304 0.6129 SE 0.0477 0.0512 0.0219

t value 385.5450 368.5808 20.3174 -2.0 p value 0.0000 0.0000 0.0000 Significance ***

-4.0 (B) Test for Correlation.

Number 782 -6.0 15.0 17.0 19.0 21.0 23.0 25.0 DF 780 Average R0.9040 t-value 59.0686 p-value 0.0000 Graph of Treatment versus Control Significance ***

25 (C) Test for Level Dependent "Bias".

Statistical Significance 23 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0713 *** 0.0164 4.3502 0.0000 0.8173 DVA 0.0723 *** 0.0161 4.5053 0.0000 21 Intercept(GM) -0.8677 STEYX Intercept(DVA) -0.9024 0.5711

Magnitude of the Level Dependent "Bias".

Nominal Calculated Avg. "Bias" 17 15 15.20 0.20 20 20.56 0.56 25 25.92 0.92 30 31.27 1.27 15 35 36.63 1.63 15 17 19 21 23 25 40 41.99 1.99

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 29 of 39 Commercial Technology Forum Report: 02

APPENDIX 2 - IWTO-0 ANALYSES FOR PROPERTY 2 (MS)

Fleecescan / Lab LSN

Graph of Difference versus Average 3.0 Property MS Validation 2.0

(A) Test for Overall Relative Bias & Paired t-test. 1.0

Overall Bias Paired

FLSN LabLS t-test 0.0 Number 785 785 785 Average 16.5643 16.2198 -0.3445

SD 0.9842 0.9638 0.6549 -1.0 SE 0.0351 0.0344 0.0234 t value 471.5463 471.4986 -14.7389

p value 0.0000 0.0000 0.0000 -2.0 Significance ***

-3.0 (B) Test for Correlation.

Number 785 -4.0 12.0 14.0 16.0 18.0 20.0 22.0 DF 783 Average R 0.7742 t-value 34.2221 p-value 0.0000 Graph of Treatment versus Control Significance ***

22 (C) Test for Level Dependent "Bias".

Statistical Significance 20 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 0.9793 NS 0.0222 0.9344 0.3504 0.5993 DVA -0.0236 NS 0.0255 0.9247 0.3554 18 Intercept(GM) -0.0016 STEYX Intercept(DVA) 0.0420 0.6234

Magnitude of the Level Dependent "Bias".

Nominal Calculated Avg. "Bias" 14 15 14.69 -0.31 20 19.58 -0.42 25 24.48 -0.52 30 29.38 -0.62 12 35 34.27 -0.73 12 14 16 18 20 22 40 39.17 -0.83

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 30 of 39 Commercial Technology Forum Report: 02

Fleecescan / Lab OFDA100

Graph of Difference versus Average 3.0 Property MS

Validation 2.0

(A) Test for Overall Relative Bias & Paired t-test. 1.0 Overall Bias Paired FLSN LabOFDA t-test Number 785 785 785 0.0 Average 16.5643 16.3635 -0.2008 SD 0.9842 1.0012 0.6856 SE 0.0351 0.0357 0.0245 -1.0 t value 471.5463 457.9313 -8.2056 p value 0.0000 0.0000 0.0000 Significance *** -2.0

-3.0 (B) Test for Correlation.

Number 785 -4.0 DF 783 12.0 14.0 16.0 18.0 20.0 22.0 Average R0.7616 t-value 32.8889 p-value 0.0000 Significance *** Graph of Treatment versus Control

22 (C) Test for Level Dependent "Bias".

Statistical Significance 20 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0172 NS 0.0236 0.7322 0.4642 0.5801 DVA 0.0194 NS 0.0263 0.7385 0.4604 Intercept(GM) -0.4865 STEYX 18 Intercept(DVA) -0.5204 0.6382

16 Magnitude of the Level Dependent "Bias".

Nominal Calculated Avg. "Bias" 14 15 14.77 -0.23 20 19.86 -0.14 25 24.94 -0.06 30 30.03 0.03 12 35 35.12 0.12 12 14 16 18 20 22 40 40.20 0.20

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 31 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Fleecescan

Graph of Difference versus Average 4.0 Property MS Validation 3.0

(A) Test for Overall Relative Bias & Paired t-test. 2.0

Overall Bias Paired OFDA2000 FLSN t-test 1.0 Number 785 785 785 Average 16.7587 16.5643 -0.1944 0.0 SD 0.9609 0.9842 0.6610 SE 0.0343 0.0351 0.0236 t value 488.6454 471.5463 -8.2404 -1.0 p value 0.0000 0.0000 0.0000 Significance *** -2.0

(B) Test for Correlation. -3.0

Number 785 -4.0 DF 783 12.0 14.0 16.0 18.0 20.0 22.0 24.0 Average R 0.7693 t-value 33.6898 p-value 0.0000 Significance *** Graph of Treatment versus Control 24

Regression Slope Significance SE of Slope t-Value p-value Rsq 20 GM 1.0242 NS 0.0234 1.0365 0.3003 0.5918 DVA 0.0271 NS 0.0258 1.0490 0.2945 Intercept(GM) -0.6006 STEYX Intercept(DVA) -0.6455 0.6143 18

16 Magnitude of the Level Dependent "Bias".

Nominal Calculated Avg. "Bias" 14 15 14.76 -0.24 20 19.88 -0.12 25 25.01 0.01 30 30.13 0.13 12 35 35.25 0.25 12 14 16 18 20 22 24 40 40.37 0.37

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 32 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Lab LSN

Graph of Difference versus Average 2.0 Property MS Validation 1.0 (A) Test for Overall Relative Bias & Paired t-test.

Overall Bias Paired 0.0 OFDA2000 LabLS t-test Number 785 785 785 Average 16.7587 16.2198 -0.5389 -1.0 SD 0.9609 0.9638 0.5529 SE 0.0343 0.0344 0.0197 t value 488.6454 471.4986 -27.3083 p value 0.0000 0.0000 0.0000 -2.0 Significance ***

-3.0 (B) Test for Correlation.

Number 785 -4.0 DF 783 12.0 14.0 16.0 18.0 20.0 22.0 Average R 0.8349 t-value 42.4538 p-value 0.0000 Significance *** Graph of Treatment versus Control

22 (C) Test for Level Dependent "Bias".

Statistical Significance 20 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0030 NS 0.0197 0.1541 0.8776 0.6971 DVA 0.0033 NS 0.0214 0.1543 0.8774 Intercept(GM) -0.5899 STEYX 18 Intercept(DVA) -0.5935 0.5292

16 Magnitude of the Level Dependent "Bias".

Nominal Calculated Avg. "Bias" 14 15 14.46 -0.54 20 19.47 -0.53 25 24.49 -0.51 30 29.50 -0.50 12 35 34.52 -0.48 12 14 16 18 20 22 40 39.53 -0.47

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 33 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Lab OFDA

Graph of Difference versus Average 3.0 Property MS Validation 2.0 (A) Test for Overall Relative Bias & Paired t-test.

Overall Bias Paired 1.0 OFDA2000 LabOFDA t-test Number 785 785 785

Average 16.7587 16.3635 -0.3952 0.0 SD 0.9609 1.0012 0.5637 SE 0.0343 0.0357 0.0201 t value 488.6454 457.9313 -19.6428 p value 0.0000 0.0000 0.0000 -1.0 Significance ***

-2.0 (B) Test for Correlation.

Number 785 -3.0 DF 783 12.0 13.0 14.0 15.0 16.0 17.0 18.0 19.0 20.0 21.0 22.0 Average R0.8357 t-value 42.5780 p-value 0.0000 Significance *** Graph of Treatment versus Control 22

20 Statistical Significance

19 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0419 * 0.0204 2.0493 0.0408 0.6984 DVA 0.0447 * 0.0214 2.0922 0.0367 18 Intercept(GM) -1.0975 STEYX Intercept(DVA) -1.1358 0.5281 17

Magnitude of the Level Dependent "Bias". 15

Nominal Calculated Avg. "Bias" 14 15 14.53 -0.47 20 19.74 -0.26 13 25 24.95 -0.05 30 30.16 0.16 12 35 35.37 0.37 12 13 14 15 16 17 18 19 20 21 22 40 40.58 0.58

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 34 of 39 Commercial Technology Forum Report: 02

APPENDIX 3 - IWTO-0 ANALYSES FOR PROPERTY 3 (JM)

Fleecescan / Lab LSN

Graph of Difference versus Average 5.0 Property JM Validation 3.0 (A) Test for Overall Relative Bias & Paired t-test.

Overall Bias Paired 1.0 FLSN LabLS t-test Number 685 685 685

Average 24.1521 23.1835 -0.9686 -1.0 SD 2.3746 2.3886 0.9886 SE 0.0907 0.0913 0.0378 t value 266.1954 254.0314 -25.6425 p value 0.0000 0.0000 0.0000 -3.0 Significance ***

-5.0 (B) Test for Correlation.

Number 685 -7.0 DF 683 15.0 17.0 19.0 21.0 23.0 25.0 27.0 29.0 31.0 33.0 35.0 Average R0.9139 t-value 58.8240 p-value 0.0000 Significance *** Graph of Treatment versus Control 35

31 Statistical Significance

29 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0059 NS 0.0156 0.3751 0.7077 0.8352 DVA 0.0061 NS 0.0162 0.3762 0.7069 27 Intercept(GM) -1.1101 STEYX Intercept(DVA) -1.1131 0.9648 25

Magnitude of the Level Dependent "Bias". 21

Nominal Calculated Avg. "Bias" 19 15 13.98 -1.02 20 19.01 -0.99 17 25 24.04 -0.96 30 29.07 -0.93 15 35 34.10 -0.90 15 17 19 21 23 25 27 29 31 33 35 40 39.12 -0.88

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 35 of 39 Commercial Technology Forum Report: 02

Fleecescan / Lab OFDA100

Graph of Difference versus Average 5.0 Property JM

Validation 3.0

(A) Test for Overall Relative Bias & Paired t-test.

1.0 Overall Bias Paired FLSN LabOFDA t-test Number 685 685 685 Average 24.1521 23.4940 -0.6580 -1.0 SD 2.3746 2.4601 1.0196 SE 0.0907 0.0940 0.0390 t value 266.1954 249.9518 -16.8920 -3.0 p value 0.0000 0.0000 0.0000 Significance ***

-5.0 (B) Test for Correlation.

Number 685 -7.0 15.0 17.0 19.0 21.0 23.0 25.0 27.0 29.0 31.0 33.0 35.0 DF 683 Average R 0.9117 t-value 57.9738 p-value 0.0000 Graph of Treatment versus Control Significance *** 35

33 (C) Test for Level Dependent "Bias".

31 Statistical Significance

29 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0360 * 0.0163 2.2080 0.0276 0.8311 27 DVA 0.0370 * 0.0164 2.2477 0.0249 Intercept(GM) -1.5268 STEYX 25 Intercept(DVA) -1.5387 0.9766

Magnitude of the Level Dependent "Bias". 21

19 Nominal Calculated Avg. "Bias" 15 14.01 -0.99 20 19.19 -0.81 17 25 24.37 -0.63 30 29.55 -0.45 15 35 34.73 -0.27 15 17 19 21 23 25 27 29 31 33 35 40 39.91 -0.09

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 36 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Fleecescan

Graph of Difference versus Average

Property JM 7.0 Validation

(A) Test for Overall Relative Bias & Paired t-test. 5.0

Overall Bias Paired OFDA2000 FLSN t-test 3.0 Number 685 685 685 Average 23.4927 24.1521 0.6594 SD 2.3589 2.3746 1.0735 1.0 SE 0.0901 0.0907 0.0410 t value 260.6522 266.1954 16.0747

p value 0.0000 0.0000 0.0000 -1.0 Significance ***

-3.0 (B) Test for Correlation.

Number 685 -5.0 DF 683 15.0 17.0 19.0 21.0 23.0 25.0 27.0 29.0 31.0 33.0 35.0 Average R 0.8971 t-value 53.0789 p-value 0.0000 Significance *** Graph of Treatment versus Control 35

33 (C) Test for Level Dependent "Bias".

31 Statistical Significance

29 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0067 NS 0.0170 0.3913 0.6957 0.8049 DVA 0.0070 NS 0.0178 0.3926 0.6947 27 Intercept(GM) 0.5029 STEYX Intercept(DVA) 0.4927 1.0428 25

Magnitude of the Level Dependent "Bias". 21

19 Nominal Calculated Avg. "Bias" 15 15.60 0.60 20 20.64 0.64 17 25 25.67 0.67 30 30.70 0.70 15 35 35.74 0.74 15 17 19 21 23 25 27 29 31 33 35 40 40.77 0.77

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 37 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Lab LSN

Graph of Difference versus Average 7.0 Property JM Validation 5.0 (A) Test for Overall Relative Bias & Paired t-test.

Overall Bias Paired 3.0 OFDA2000 LabLS t-test Number 685 685 685 Average 23.4927 23.1835 -0.3092 1.0 SD 2.3589 2.3886 0.6710 SE 0.0901 0.0913 0.0256 t value 260.6522 254.0314 -12.0609 p value 0.0000 0.0000 0.0000 -1.0 Significance ***

-3.0 (B) Test for Correlation.

Number 685 -5.0 DF 683 15.0 17.0 19.0 21.0 23.0 25.0 27.0 29.0 31.0 33.0 35.0 Average R 0.9601 t-value 89.7560 p-value 0.0000 Significance *** Graph of Treatment versus Control 35

33 (C) Test for Level Dependent "Bias".

31 Statistical Significance

29 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0126 NS 0.0108 1.1594 0.2467 0.9218 DVA 0.0127 NS 0.0109 1.1667 0.2437 27 Intercept(GM) -0.6042 STEYX Intercept(DVA) -0.6064 0.6599 25

Magnitude of the Level Dependent "Bias". 21

19 Nominal Calculated Avg. "Bias" 15 14.58 -0.42 20 19.65 -0.35 17 25 24.71 -0.29 30 29.77 -0.23 15 35 34.84 -0.16 15 17 19 21 23 25 27 29 31 33 35 40 39.90 -0.10

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 38 of 39 Commercial Technology Forum Report: 02

OFDA2000 / Lab OFDA100

Graph of Difference versus Average

Property JM 7.0 Validation

(A) Test for Overall Relative Bias & Paired t-test. 5.0

Overall Bias Paired OFDA2000 LabOFDA t-test 3.0 Number 685 685 685 Average 23.4927 23.4940 0.0013 SD 2.3589 2.4601 0.7223 1.0 SE 0.0901 0.0940 0.0276 t value 260.6522 249.9518 0.0476

p value 0.0000 0.0000 0.9620 -1.0 Significance NS

-3.0 (B) Test for Correlation.

Number 685 -5.0 DF 683 15.0 17.0 19.0 21.0 23.0 25.0 27.0 29.0 31.0 33.0 35.0 Average R 0.9559 t-value 85.0950 p-value 0.0000 Significance *** Graph of Treatment versus Control 35

33 (C) Test for Level Dependent "Bias".

31 Statistical Significance

29 Regression Slope Significance SE of Slope t-Value p-value Rsq GM 1.0429 *** 0.0117 3.6592 0.0003 0.9138 DVA 0.0429 *** 0.0115 3.7376 0.0002 27 Intercept(GM) -1.0058 STEYX Intercept(DVA) -1.0069 0.6931 25

Magnitude of the Level Dependent "Bias". 21

19 Nominal Calculated Avg. "Bias" 15 14.64 -0.36 20 19.85 -0.15 17 25 25.07 0.07 30 30.28 0.28 15 35 35.49 0.49 15 17 19 21 23 25 27 29 31 33 35 40 40.71 0.71

The 2003 Australian Wool Innovation on-farm fibre measurement instrument \…:- Page 39 of 39