JPEG 2000 Image Codecs Comparison Project head: Dmitriy Vatolin Measuring: Alexey Moskvin Refinement, translation: Oleg Petrov Verification: Artem Titarenko Tested codecs: • JASPER 1.701.0 • ACDSee 7.0 • Leadtools JPEG 2000 Photoshop plug-in 1.0 • Morgan JPEG 2000 toolbox 1.2 rev 0.0 • Lurawave 2.1.10.04 • Kdu_compress 4.5.2 • JPEG 2000 Compressor (Anything 3D) 1.00.000 • Elecard Wavelet 3.0 Beta • Photoshop CS2 ‘native’ plug-in 1.6 September 2005 CS MSU Graphics&Media Lab Video Group http://www.compression.ru/video JPEG 2000 IMAGE CODECS COMPARISON CS MSU GRAPHICS&MEDIA LAB MOSCOW, SEPTEMBER 2005 VIDEO GROUP Table of contents Table of contents ............................................................................................................................ 2 Overview......................................................................................................................................... 3 Codecs ........................................................................................................................................................ 3 Codecs’ settings.......................................................................................................................................... 3 Images used for test.................................................................................................................................... 4 Goals and rules of testing............................................................................................................... 5 JPEG 2000 codecs testing goal.................................................................................................................. 5 Rules of the testing ..................................................................................................................................... 5 Images used in the testing.............................................................................................................. 6 Barbara ....................................................................................................................................................... 6 Lenna .......................................................................................................................................................... 7 Lighthouse................................................................................................................................................... 8 House.......................................................................................................................................................... 9 Codecs used in the testing ........................................................................................................... 10 JPEG from Adobe Photoshop version 7.0 ................................................................................................ 10 JASPER 1.701.0 ....................................................................................................................................... 10 ACDSee 7.0 .............................................................................................................................................. 10 Leadtools JPEG 2000 Photoshop plugin 1.0............................................................................................ 11 Morgan JPEG 2000 toolbox 1.2 rev. 0.0................................................................................................... 11 Lurawave 2.1.10.04................................................................................................................................... 11 Kdu_compress 4.5.2 ................................................................................................................................. 12 JPEG 2000 Compressor (Anything 3D) 1.00.000.....................................................................................12 Elecard Wavelet 3.0 Beta ......................................................................................................................... 12 Photoshop CS2 ‘native’ plugin, ver. 1.6.................................................................................................... 13 Y-PSNR/Compressed file size, Delta-Y-PSNR/Compressed file size diagrams .......................... 14 Barbara image........................................................................................................................................... 14 Lenna image ............................................................................................................................................. 16 Lighthouse image...................................................................................................................................... 17 House image ............................................................................................................................................. 18 Visual comparison ........................................................................................................................ 19 JPEG and JPEG 2000 visual comparison ................................................................................................ 19 JPEG 2000 codecs comparison ............................................................................................................... 20 Visual comparison conclusions................................................................................................................. 24 Informal codecs comparison......................................................................................................... 25 Informal comparison rules......................................................................................................................... 25 Informal comparison results...................................................................................................................... 25 General conclusions ..................................................................................................................... 26 Gratitude....................................................................................................................................... 27 2 JPEG 2000 IMAGE CODECS COMPARISON CS MSU GRAPHICS&MEDIA LAB MOSCOW, SEPTEMBER 2005 VIDEO GROUP Overview Codecs Codec Manufacturer Version JPEG (not JPEG 2000) Adobe Systems Inc. 7.0 JASPER Michael Adams 1.701.0 ACDSee ACD Systems 7.0 Leadtools JPEG 2000 Photoshop plugin Leadtools Technologies 1.0 Morgan JPEG 2000 toolbox Morgan Multimedia 1.2 rev 0.0 Lurawave LuraTech 2.1.10.04 Kdu_compress Kakadu Software 4.5.2 JPEG 2000 Compressor (Anything 3D) Anything 3D Corp 1.00.000 Elecard Wavelet Elecard Inc. 3.0 Beta Photoshop CS2 ‘native’ plugin Adobe Systems Inc. 1.6 Codecs’ settings Codec Parameter Values Jpeg (not JPEG 2000 standard) quality 0, 1, 2, 3, 6, 9 JASPER rate 0.01, 0.024, 0.04, 0.06, 0.09, 0.107 ACDSee compression ratio 100, 43, 25, 17, 12, 9 Leadtools JPEG 2000 Photoshop plugin compress. ratio 100, 43, 25, 17, 12, 9 Morgan JPEG 2000 toolbox quality 3, 7, 12, 18, 26, 31 Lurawave quality 10, 30, 50, 70, 90, 100 Kdu_compress bps 0.24, 0.56, 0.96, 1.44, 2.16, 2.56 JPEG 2000 Compressor (Anything 3D) quality 5, 10, 20, 30, 40, 53 Elecard Wavelet compress factor 1, 2, 4, 6, 9, 12 Photoshop CS2 ‘native’ plugin file size (kb) 7, 18, 31, 47, 68, 82 Other codecs’ settings were left with their default values. You can see them on screenshots of codecs’ interfaces. 3 JPEG 2000 IMAGE CODECS COMPARISON CS MSU GRAPHICS&MEDIA LAB MOSCOW, SEPTEMBER 2005 VIDEO GROUP Images used for test Image Uncompressed file size Resolution Barbara 786486 bytes 512x512 Lenna 786486 bytes 512x512 Lighthouse 786486 bytes 512x512 House 786486 bytes 512x512 4 JPEG 2000 IMAGE CODECS COMPARISON CS MSU GRAPHICS&MEDIA LAB MOSCOW, SEPTEMBER 2005 VIDEO GROUP Goals and rules of testing JPEG 2000 codecs testing goal JPEG 2000 is a new image compression format. It was developed to replace JPEG and has a number of advantages: higher compression rates are available, improved lossless mode, progressive visualization, scaling, error correction, etc. Images in this format are not yet popular, but it has all chances to become a substitute for JPEG. The main goal of this testing was the comparison of compression quality of JPEG 2000 codecs: is there any significant difference between implementation of this standard? Only compression quality was compared. Codecs have been tested on standard test images, all codecs settings were set to defaults except for compressed image quality. Rules of the testing • PSNR was calculated using MSU Video Quality Measurement Tool. www.compression.ru/video/quality_measure/video_measurement_tool_en.html • Compressed image quality was chosen to get approximately same size of output file for all codecs. • All codecs’ parameters (except for picture quality) were set to defaults (default settings are settings specified in codec after its installation). • For Photoshop CS2 parameter "save meta data" was switched off. 5 JPEG 2000 IMAGE CODECS COMPARISON CS MSU GRAPHICS&MEDIA LAB MOSCOW, SEPTEMBER 2005 VIDEO GROUP Images used in the testing Barbara Barbara.bmp (50% size) Name Barbara Resolution 512x512 Features Black and white image. Main feature – stripes on table- cloth, on scarf and on pants where moire and other artifacts often appear. 6 JPEG 2000 IMAGE CODECS COMPARISON CS MSU GRAPHICS&MEDIA LAB MOSCOW, SEPTEMBER 2005 VIDEO GROUP Lenna Lenna.bmp (50% size) Name Lenna Resolution 512x512 Features Classical test image.