source: https://doi.org/10.7892/boris.85526 | downloaded: 25.9.2021 al., 2001),thecalculationofadditional parameters formodeling image variant interiororient extended mathematical models over thewholeperiodofimag It cannotbeassumed thatcamera parameters remain stable and shear (C distortion (B The accuracy ofobjectreconstructionwastestedforsixhighqua The accuracy ABSTRACT: KEY WORDS: for geometric instabilitiesandtoreveal the potential of accuracy software. Calibrationwasperformedwithasta in thecubetoevaluatelengthmeasurement error(LME). Imag 2000 mm x2000mm x1600mm (lengthxwidthheight to VDI/VDE2634,aGermanstandardforev fixation ofadigitalcamera backandlens wereevaluated.All st a as 24 mmwell Nikonlens, aCanonEOS5Dwithnormal as A principal point( the wholeperiodofimage acquisition. Principal distance ( assume aconstantinteriororient Conventional mathematicalm ofnon-photogrammetriccameras. geometry have beenmadetomodelorcompensatefortheinstable 1995; Maas, 1999; Shortisetal., al., et (Gruen ofthe thegeometriclimited stability by regular camerasaccomplishedwith is remarkable, butoften photogrammetricthat applications,theaccuracy can be werenotdesignedfor Schneider, 1995).Althoughthey forse photogrammetric surveys digital cameras providestandardtoolsfor quality High lens. ev only were the standardsetofparameters.Theother camerasandtheAlpa cameras’ tripodmountrevealedsimilarLMEof0.052and0.059mm, theextraloadof the unaffected by ringf reduced in cases where a ringflash wasscrewedintothefilterth maximuma parameters theAlpa12WAwith absoluteLMEof0.029mm.best wassignificantly performed Geometric accuracy parameters wasachievedwith0.047mm usi d PERFORMANCE EVALUATIONOFSEVERALHIGH-QUALITYDIGITALCAMERAS 3 SwissFederalResearchInstituteforForest,Snowa ), decentring of lenses by tangential ), decentringoflensesand by asymmetric c a University ofthe Federal Armed Forces,85577Neubiberg, Germany – InstituteofGeologicalSciences,University 1 1 , C , B Oldenburg/Ostfriesland/Wilhelmshaven, OfenerStrasse 16/19, 26121Oldenburg, Germany – b x Geometric stability, camera calibration, accuracy assessment, cameradigital Geometriccalibration,accuracy stability, 2 2 Institute of Applied Photogrammetry and Geoinformatics, University of Applied Sciences Sciences Applied of Photogrammetry University Geoinformatics, Applied and of Institute ' ) areestimated withinself-calibratingsystems. ) and global sensor propertiessuch asaffinity 0 , y 1. ' 0

), radial-symmetric lensdistortion( ), radial-symmetric INTRODUCTION D. H. Rieke-Zapp H. D. ation (Maas,1999;Tecklenburg et (werner. ation for one setofimagesover odels for cameracalibration odels 2006). Differentinvestigations veral years now(Peipe and veral years e acquisition. As examples, include parameterization of [email protected] lash. SubsequentevaluationoftheNikonD2 ng theCanonEOS5Dandastabilized35mm lens.Forcalibrationwithimage variant aluation ofoptical3-Dmeasuringsystems. a, Switzerland - [email protected] [email protected] Switzerland ndard set of parameters aswellwith ,W. Tecklenburg Commission V, WGV/1 Commission V, [email protected] A ). Sevenscalebarswithuptoten 1 nd LandscapeResearch,Zuercherstrasse111,8903Birmensdorf, , A c cameras were investigated onatest cubethatwas designed accor 2 ), , Bern, Baltzerstrasse1+3, b –[email protected]) read of the lens. Only theCanon read ofthelens.Only lity digital cameras. Nikon D80, D200, D2X and D3 with the sam the with D3 and digitalcameras. NikonD80,D200,D2X lity 7 , J. Peipe

es were imported into a PC and analyzed with AICON 3D Studio 3D AICON with es wereimportedintoaPCandanalyzed thecameras. Thesmallest LMEforcalibrationwithstandard parameterization models. All camerasmodels.parameterizationAll wereinvestigated ona include bothmechanicalstabilizationand investigations reasons forgeometri identify be accomplishedcan withdifferent camera setups and to Six cameras wereevaluatedinorderto test the that accuracy support image-variantcalculations. Studio (AICON,2007)orAXIOS3DAX.Ori(AXIOS,2008) somesoftwareproductslikeAICON3D set inpractice.Only an image variantsetup is notacceptedas astandard parameter components,using theparameterizationinstabilities ofcamera inthe usage andtheflexibility of manufacturer's warranty voidthe Whereasa mechanical stabilizationwilltypically the ringflashofflens. to the filter threadofthelensinordertounloadweight components is investigated,e.g.aringflashthatnotmounted the usageofotherhardware addition In investigations. fixation ofopticallenses,as camera (Shortisetal.,2001;Ri compensate for instabilities, fixingthesensorinside e.g. by stabilizationmechanical canbeused to Alternatively gravitational effects(Haigetal.,2006). the influence ofsensordistortion(Tecklenburgetal.,2001)or abilized 35mm CanonlensandanAlpa12WAwithspecial respectively, as for the Canon camerawhencalibratingwith asfortheCanon respectively, c , H. Hastedt H. , an image variant set ofparameters toacc d The measuring volume was approximately approximately was Themeasuringvolume , T.Luhmann X andD3withringflashmountedtothe [email protected] aluated withtheringflashmountedtot calibrated distancesonthem wereplaced 3012 Bern,-Switzerland– EOS 5Dwithstabilizedlenswas eke-Zapp & Nearing, 2005) or eke-Zapp &Nearing,2005) c instability as well.The c instability it is presentedwithinthese it b

ount ding he e

The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Vol. XXXVII. Part B5. Beijing 2008

test cube that was designed according to VDI/VDE 2634, a 2). The focal lengths of the lenses were chosen to provide a German standard for evaluation of optical 3-D measurement similar field of view for all cameras, but for the systems (VDI/VDE, 2002). (Table 1). The same AiS Nikkor 2.8/24 mm Nikon lens was used on all Nikon cameras to exclude the effect of different In this paper we use ΔL for length measurement error of one lenses to the results for this group. The digital sensor of the D3 given distance in the test cube to separate these values strictly is much larger than for the other Nikon models resulting in a from the maximum absolute length measurement error denoted wider angle of view and therefore a slightly different as LME. perspective than for the other cameras. The sensor sizes of the cameras range between 16 x 24 and 36 x 48 mm² meaning that the sensor inside the Leaf Aptus 75 digital camera back is more 2. MATERIALS AND METHODS than four times as large as the sensor of the . The Nikon D2X has the smallest size of all cameras (Table 1). 2.1 Evaluated Cameras All images were recorded as raw data and converted to TIFF for analysis in the software supplied with the digital camera device. Six different cameras of three different manufacturers were While Nikon and Canon cameras are digital single lens reflex evaluated (Table 1). All cameras were used with a ringflash cameras, the Alpa has no mirror in the optical path. An external screwed into the filter thread of the lens. Additionally the Nikon is used to frame the images with the Alpa (Figure 2). D2X and D3 were also tested with the ringflash mounted to the cameras’ tripod mount. The Canon EOS 5D was evaluated with a standard EF 2/35 mm lens as well as with a similar lens where the inner lens tube was fixed with epoxy (Figure 1).

Camera Alpa Canon Nikon 12 EOS D80 D3 D2X WA 5D D200 Focal length 47 35 24 24 24 (mm) Diagonal field 65° 63° 84° 61° 61° of view Sensor (mm2) 36x48 24x36 16x24 Pixel (y) 4992 2912 2832 2848 2592 Pixel (x) 6666 4368 4256 4288 3872 Pixel size 7.2 8.2 8.5 5.5 6.1 (µm) Stabilization back lens -/- -/- -/- method & lens epoxy

Table 1. Specifications of evaluated cameras. Figure 2. Alpa 12 WA with digital back and lens fixed with screws to the camera body.

2.2 Calibration procedure

The different camera setups were investigated on a test cube (Figure 3) that was designed according to VDI/VDE 2634 (VDI/VDE, 2002). The measuring volume was approximately 2000 mm x 2000 mm x 1600 mm (length x width x height). Seven scale bars with up to ten calibrated distances on them were placed in the cube to evaluate the maximum absolute length measurement error (LME). In total, 58 calibrated distances were available, all calibrated to an accuracy of 0.010 mm and better. 185 retro-reflective targets were attached to the cube. A single system scale was placed in the centre of the cube. Images were acquired in the same configuration for each camera setup. Approximately 120 images were taken from 12 positions around the cube at three different heights (Figure 4). All images were taken with a ringflash mounted to the camera or the filter thread of the lens. Several images of each setup were taken with the camera rotated about the principal axis to minimize correlation of parameters of interior orientation. Figure 1. Canon EOS 5D with EF 2/35 mm lens where the Images were imported into a PC and analyzed with AICON 3D focusing tube was fixed with epoxy (indicated by Studio software (version 7.5; AICON, 2007). Two calibrations the whitish ring around the focusing tube). were calculated for each setup. In the first calibration, here

denoted as standard procedure, the interior orientation of the In case of the Alpa 12 WA the digital back, a Leaf Aptus 75, cameras with the position of the projection centre in image and the lens were fixed with screws to the camera body (Figure

8 The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Vol. XXXVII. Part B5. Beijing 2008

space (c, x'0, y'0) was calibrated along with additional 0.330 to 0.047 mm – an improvement by a factor of seven parameters for lens distortion (A1, A2, A3, B1, B2) as well as (Table 2). affinity and shear (C1, C2). In a second setup the same parameters were used for calibration, but the parameters of interior orientation were calculated separately for each image thus accounting for geometric instability of the principal point and/or the camera constant (Tecklenburg et al., 2001; Hastedt et al., 2002; Rieke-Zapp et al., 2005).

Figure 5. Mounting of the ringflash to the cameras’ tripod mount to relieve the filter thread of the lens off the extra load.

Figure 3. Testfield according to VDI/VDE 2634 with seven measuring lines and retro-reflective target points. Camera LME (mm)

Alpa 12 WA 0.124 Canon EOS 5D – standard lens 0.330 Canon EOS 5D – fixed lens tube 0.047 Nikon D80 0.191 0.208 Nikon D2X – ringflash fixed to lens 0.166 Nikon D2X – ringflash fixed to camera† 0.059 Nikon D3 – ringflash fixed to lens 0.213 Nikon D3 – ringflash fixed to camera 0.052 † only JPEG images available

Table 2. Maximum absolute length measurement error (LME) for standard calibration with AICON 3D Studio.

Figure 4. Bundle design containing 120 images, top and front

view. Camera ΔL min. ΔLmax.

(mm) (mm)

3. RESULTS AND DISCUSSION Canon EOS 5D – standard -0.330 +0.303 lens 3.1 Standard calibration Canon EOS 5D – fixed lens -0.047 +0.047 tube Results of calibration with the standard parameter set and Nikon D3 – ringflash fixed -0.129 0.213 without parameterization of geometric instabilities showed to lens good results only for the three setups where the ringflash was Nikon D3 – ringflash fixed -0.041 +0.052 either not mounted to the lens (Nikon D2X, D3; Figure 5) or the to tube was fixed with epoxy (EOS 5D) (Figure 1, Table 2). Loading the filter thread of the lenses with the weight of the Table 3. Interval of length measurement error ΔL for standard ringflash had strong negative effects on the accomplished calibration with AICON 3D Studio. accuracy. Working with a ringflash in the filter thread of the lens was considered as a common practice for close range In case of the Nikon cameras unloading the lens off the photogrammetric applications (Haig et al., 2006). Fixing the ringflash improves the LME by a factor of 3 to 4 (Figure 5). As lens tube of the EOS 5D setup has improved the -LME from the lens tube was not fixed in the Nikon 24 mm lens, slight

9 The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Vol. XXXVII. Part B5. Beijing 2008

movements of the lens tube caused by gravity were still Results of the other cameras were probably also strongly possible even without the ringflash in place. Figure 6 shows a affected by loading the lenses with the ringflash. comparison for the Nikon D2X ΔL results where the standard calibration method with the externally mounted ringflash is A comparison of different Nikon models from consumer (D80) plotted versus an image variant parameterization for ringflash over semi-professional (D200) to professional (D2X, D3) models mounted to the lens. It illustrates the improvement in object was only possible for calibrations with the ringflash mounted accuracy with a standard parameterization using simple to the lens. For this setup no significant difference was visible mechanical components, besides the improvement in accuracy for the different camera models (Table 2). Any existing compared to the standard calibration with the lens mounted difference in camera stability was probably hidden by the ringflash. adverse effects of the ringflash.

3.2 Calibration with image variant interior orientation

0.250 Calculation of calibration parameters with image variant

0.200 interior orientation compensated for geometric instability of the principal point and/or the camera constant (Tecklenburg et al., 0.150 2001). For all cameras, but the EOS 5D with the lens where the focusing tube was fixed with epoxy, results improved 0.100 significantly from the standard calibration (Tables 3 and 4). The best LME resulted to 0.029 mm and was accomplished with the 0.050 Alpa 12 WA camera. In case of the EOS 5D, parameterization 0.000 of geometric instabilities by an image variant interior 0 500 1000 1500 2000 2500 orientation yielded almost the same results as fixing the lens -0.050 tube with epoxy and working with the standard set of parameters (Tables 2, 3). For the Nikon camera series only the -0.100 Nikon D3 showed a significant gain in accuracy compared to Length measurement error (mm) error Length measurement the other cameras. The resulting LME for the Nikon D3 slightly -0.150 improved when fixing the ringflash not to the lens, indicating -0.200 that the calibration with the image variant interior orientation did not completely compensate for the adverse effects of the -0.250 ringflash. Calibrated distance (mm) Ringflash fixed to lens Ringflash fixed to tripod mount It was not clear why the maximum absolute LME for the EOS 5D with epoxy fixing of the lens was deteriorated when image

variant interior orientation was applied (Figure 7). For the Figure 5. Length measurement errors ΔL of the Nikon D3 with standard calibration all ΔL ranged between +0.047 and -0.047 ringflash fixed to the lens and fixed to the tripod mount of the camera. mm while for the image variant calibration the values ranged between -0.066 and +0.038 mm (Figure 7, Table 5). The ΔL results for standard calibration were well distributed around zero from maximum to minimum without any gross outliers.

0.100 Checking the results for the image variant calibration revealed a larger amplitude of ΔL. A similar effect was visible for the 0.080 calibration of the same camera without fixation of the lens tube. For standard calibration the ΔL ranged between +0.330 0.060

) and -0.303 mm, but showed much more skew for the image 0.040 variant calibration with ΔL ranging between +0.047 and -0.022 mm. Although the LME improved significantly in the latter 0.020 case, the ΔL revealed larger skew. A similar trend was also 0.000 visible for other cameras where the LME improved 0 500 1000 1500 2000 2500 significantly with image variant calibration. Although most ΔL -0.020 values were smaller than for the standard calibration, the -0.040 extreme values became larger with the extreme drifting stronger in positive or negative direction. Generally the ΔL was not Length measurement error (mm measurement Length -0.060 correlated with the distance of the measuring line. The largest

-0.080 absolute deviations were in most cases observed for shorter distances up to 700 mm (Figures 5, 7, 8). Minimum and -0.100 maximum ΔL for the Alpa and the Nikon D3 with image Calibrated distance (mm) variant calibration had almost the same absolute value. ΔL image variant parameters standard parameters values ranged between +0.029 and -0.028 mm for the Alpa, and between +0.046 and -0.035 mm and +0.039 and -0.028 mm for

the Nikon D3 with and without ringflash mounted to the lens, Figure 6. Length measurement errors ΔL of the Nikon D2Xwith ringflash fixed to the lens and image variant respectively (Table 5). parameterization versus ringflash fixed to the tripod mount of the camera and standard parameterization.

10 The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Vol. XXXVII. Part B5. Beijing 2008

Camera LME (mm) 0.070 Alpa 12 WA 0.029 Canon EOS 5D – standard lens 0.046 0.050 Canon EOS 5D – fixed lens tube 0.066 Nikon D80 0.093 Nikon D200 0.081 0.030 Nikon D2X – ringflash fixed to lens 0.083 Nikon D2X – ringflash fixed to camera -/- 0.010 Nikon D3 – ringflash fixed to lens 0.046 0 500 1000 1500 2000 2500 Nikon D3 – ringflash fixed to camera 0.039 -0.010

Table 4. Maximum absolute length measurement error LME for -0.030 calibration with image variant interior orientation (mm) error measurement Length using AICON 3D Studio software. -0.050

Camera ΔL Min ΔL max -0.070 Calibrated distance (mm) (mm) (mm) Alpa 12 WA -0.028 +0.029 Standard parameters Image variant parameters Canon EOS 5D – -0.022 +0.047 standard lens Figure 7. Length measurement errors ΔL of the Canon EOS 5D Canon EOS 5D – fixed -0.066 +0.038 epoxy fixing resulting from standard calibrations lens tube and from image variant calibration.

Nikon D3 – ringflash -0 .025 +0.046

fixed to lens Nikon D3 – ringflash -0.028 +0.039 0.04 fixed to camera 0.03 Table 5: Interval of length measurement error ΔL for image

variant interior orientation using AICON 3D Studio 0.02 software.

If the distribution of ΔL is plotted against the calibrated 0.01 distances of the measuring lines (Figure 8), single distances sticking out of the dataset can be detected. Although the values 0 have the appearance of statistical outliers, there was no justified 0 500 1000 1500 2000 2500 explanation found from looking at the adjustment results, the -0.01 images, etc. that would give reason for elimination of these values as outliers. The values must therefore be treated as real. (mm) error Lengthmeasurement -0.02 Theoretically a couple of values may therefore exist in a measuring volume that deviate significantly from the given -0.03 values of all ΔL. As the difference between these extreme values and some averaging value can be rather significant, it is -0.04 important to report the LME for a measuring volume witch is Calibrated distance (mm) the maximum absolute ΔL.

Internal precision of the adjustments indicated a coordinate Figure 8. Length measurement error ΔL of the Alpa 12 WA precision of 0.010 mm and better for all cameras. Error calibrated with image variant interior orientation. propagation leads to a theoretical LME that can be estimated by equation (1) (Luhmann et al., 2006): 4. CONCLUSION

Calibration and accuracy evaluation of different camera setups LME 23 RMS XYZ 18 ⋅=⋅⋅= RMS XYZ (1) on the test cube reveals not only different levels of accuracy for different camera models, but also reasons for geometric instabilities of digital cameras that are not designed for A RMS value of 0.01 mm yields a theoretical LMS of 0.042 photogrammetry. Mounting a ringflash to the lens has the mm, assuming a significance level of 99% (about 3 sigma). The largest negative effect on accuracy in object space. This measured results lie in the same range, proving the theoretical indicates that the ringflash should not be mounted to the lens results. and that the focusing tube of the lens is the geometrically weakest point in the processing chain. Mounting a ringflash next to the lens is therefore advisable. At the same time a fixation of the lens tube, as being done for the Canon EOS 5D in one setup, should fix the major cause of geometric instability. In case of the EOS 5D with fixation of the lens tube, the ringflash is mounted to the lens and the camera still yields the

11 The International Archives of the PhotogrPhotogramammetry,metry, Remote Sensing and Spatial InformaInformationtion Sciences. Vol. XXXVII. Part B5. BeijinBeijingg 2008

best overall LME with a standard calibration. Fixation of the Rieke-Zapp, D., Nearing, M., 2005. Digital close range Canon lens does not affect any camera features like photogrammetry for generation of digital elevation models from measuring, open aperture metering or data retrieval for EXIF- soil surfaces. Photogrammetric Record, 20(109), pp. 69-87. files, besides focusing. Shortis, M. R., Bellman, C. J., Robson, S, Johnston, G. J., Parameterization of instable camera geometry by means of Johnson, G. W., 2006. Stability of zoom and fixed lenses used image variant interior orientation helps to uncover the potential with digital SLR cameras. International Archives accuracy of cameras. Further testing will be required to check Photogrammetry and Remote Sensing, 36(5), pp. 285-290. how much of the accuracy potential may be unleashed by mechanical stabilization of cameras, or just by unloading the Shortis, M. R., Ogleby, C. L., Robson, S., Karalis, E. M., Beyer, weight of the ringflash off the lens. Since most software H. A., 2001. Calibration modelling and stability testing for the products do not allow working with calibration results other DC200 series digital still camera. Proceedings, than the standard set of parameters, parameterization should not Videometrics and Optical Methods for 3D Shape Measurement, be understood as a universal solution for fixing the geometric SPIE Vol. 4309, pp 148-153. stability of cameras. In case of the EOS 5D as little as 10 g of AICON, 2007. AICON 3D Studio – Handbuch. Software epoxy for lens fixation had a greater effect in geometric manual on CD-ROM. stability than additional parameterization. For some cameras parameterization results in better maximum absolute LME AXIOS, 2008. values. It has to be tested if this effect is also visible for an http://www.axios3d.de/downloads/handbuecher/AX.Ori.Con1.8 extended parameterization set in non-optimal configurations, %20Handbuch%20V1.pdf (accessed 1 May 2008). witch can be predicted in normal measuring environments using mechanical stabilized camera Gruen, A., Maas, H.-G., Keller, A., 1995. Kodak DCS 200 – a camera for high accuracy measurements? SPIE Proceedings Videometrics IV, Vol. 2598. REFERENCES Rieke-Zapp, D., Oldani, A., Peipe, J., 2005. Eine neue, Haig, C., Heipke, C., Wiggenhagen, M., 2006. Lens inclination hochauflösende Mittelformatkamera für die digitale due to instable fixings detected and verified with VDI/VDE Nahbereichsphotogrammetrie. Publikationen der DGPF, Band 2634 Part 1. International Archives of Photogrammetry, Remote 14, Seyfried, E. (ed.), Berlin, pp. 263-270. Sensing and Spatial Information Sciences, Vol. 6, Part 5. Maas, H.-G., 1999. Ein Ansatz zur Selbstkalibrierung von Hastedt, H., Luhmann, T., Tecklenburg, W., 2002. Image- Kameras mit instabiler innerer Orientierung. Publikationen der variant interior orientation and sensor modelling of high-quality DGPF, Band 7, Munich, pp. 47-53. digital cameras. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 34(5), pp. Tecklenburg, W., Luhmann, T., Hastedt, H., 2001. Camera 27-32. modelling with image-variant parameters and finite elements. Optical 3-D Measurement Techniques V, Gruen, A., Kahmen, H. Luhmann, T., Hastedt, H., Tecklenburg, W., 2006. Modelling (Eds.), pp. 328-335. of for high precision photogrammetry. International Archives of Photogrammetry, Remote Sensing and VDI/VDE, 2002. VDI/VDE 2634 Part 1, Optical 3D measuring Spatial Information Sciences, Vol. 36(5), pp. 173-178. systems – imaging systems with point-by-point probing. Beuth Verlag, Berlin. Peipe, J. , Schneider, C.-T., 1995. High resolution still video camera for industrial photogrammetry. Photogrammetric Record 15 (85), pp. 135-139.

12