Pub. No.: US 2007/0097230 A1 Parulski Et Al
Total Page:16
File Type:pdf, Size:1020Kb
US 200700.97230A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2007/0097230 A1 Parulski et al. (43) Pub. Date: May 3, 2007 (54) IMAGE FILE FOR STORING DIGITAL Related U.S. Application Data IMAGES AND ANCILLARY DATA VALUES USING MULTIPLE ENCOOING METHODS (63) Continuation of application No. 09/950,199, filed on Sep. 10, 2001, which is a continuation of application No. 09/028,682, filed on Feb. 24, 1998, now Pat. No. (76) Inventors: Kenneth A. Parulski, Rochester, NY 6,310,647. (US); Joseph Ward, Hilton, NY (US); George E. Lathrop, Dansville, NY Publication Classification (US); J. Scott Houchin, Rochester, NY (51) Int. Cl. (US); Eddie Jennings, Rochester, NY H04N 5/76 (2006.01) (US); Brett Vansprewenburg, (52) U.S. Cl. .......................................................... 348/2312 Henrietta, NY (US) (57) ABSTRACT An image format for storing digital images within a baseline Correspondence Address: DCT compatible bitstream comprises entropy coded image Pamela R. Crocker data, a first application marker storing a first data value using Patent Legal Staff a first encoding method to convey a first information value Eastman Kodak Company related to the image, and a second application marker storing 343 State Street a second data value using a second encoding method to Rochester, NY 14650-2201 (US) convey the same said first information value related to the image. More specifically, the first application marker uses TIFF tags within an Exif application marker and the second (21) Appl. No.: 11/564,867 application marker uses a FlashPix compatible structured storage stream, while the entropy coded data includes restart markers to define tile boundaries within the entropy coded (22) Filed: Nov. 30, 2006 image data. DOS/FAT MAGE IMAGE | | IMAGE MASEa DIRECTORY FILES IFILE all IFILEIN 42 4.O s -- DIGITAL ST Lt. CAMERA MEMORY REMOVABLE 26 CARD MEMORY INTERFACE 8 2O CCD IMAGE A/D SENSOR CONVERTER lens6 USER 32 BUTTON COLOR LCD MAGE DISPLAY HOST HOST fr14 COMPUTER is r12 COMPUTER - 2 A? FLASHPIX -NON FLASHPIX OSPLAY ENABLED ENABLED MONITOR APPLICATIONS APPLICATIONS PC - KEYBOARD PC + KEYBOARD MEMORY CARD MEMORYREADER CARD ill------- - 5O READER L-----Fi f------- - Patent Application Publication May 3, 2007 US 2007/0097230 A1 |----F----–––––––––––––- 22O2 èJELÀ:E/\NOO OBJVO„NAJOWEJW 8.EQW738 O9 US 2007/0097230 A1 May 3, 2007 IMAGE FILE FOR STORING DIGITAL MAGES tion, version 1.0, (Eastman Kodak Company, Sep. 11, 1996), AND ANCILLARY DATA VALUES USING which is available from Eastman Kodak Co. or at the MULTIPLE ENCOOING METHODS Eastman Kodak Co. Web site at www.kodak.com/go/flash pix, and is incorporated herein by reference. CROSS REFERENCE TO RELATED 0006 Unfortunately, because FlashPix is a relatively new APPLICATIONS format, many computer applications are not yet capable of 0001. This is a continuation of application Ser. No. reading FlashPix image files. On the other hand, most 09/950,199, filed Sep. 10, 2001 which is a continuation of applications are able to open images stored in “JPEG U.S. application Ser. No. 09/028,682, now U.S. Pat. No. interchange format” (JIF) files defined by the Baseline DCT 6,310,647 issued Oct. 30, 2001. (JPEG) version of ISO/IEC 10918-1, which is incorporated herein by reference. This standard allows “application mark FIELD OF THE INVENTION ers' to be included in the JIF bitstream. The data inside an application marker is ignored by applications that are not 0002 The invention relates generally to the field of familiar with the marker. A number of image file formats digital photography, and in particular to image file formats have been developed which use a single application marker developed for use with digital cameras and their applica segment to store ancillary data and a reduced-resolution tions. “thumbnail’ image. These image formats include JFIF, defined in “JPEG File Interchange Format Version 1.02 Sep. BACKGROUND OF THE INVENTION 1, 1992 C-Cube Microsystems”, the JPEG compressed ver 0003 Electronic still cameras typically capture, digitize, sion of Exif (Exchangeable image format) described in and store images on a removable memory device. Such as a “Digital Still Camera Image File Format Proposal (Exif) PCMCIA or Compact Flash card. The images are stored on Version 1.0 Mar. 24, 1995 JEIDA/Electronic Still Camera the card in separate image files. Many different image file Working Group” and SPIFF, defined in “ITU-T Rec. T84, formats may be used. To increase the number of images Annex F Still Picture Interchange File Format, 1995”, stored per card, image compression is typically used to which are each incorporated herein by reference. reduce the file size. The most popular compression standard 0007 For example, Exif allows some camera-related is the JPEG (Joint Photographic Expert Group) baseline ancillary data, Such as the date and time, lens finumber, etc. DCT (discrete cosine transform) method, which compresses to be recorded using TIFF (Tag image file format) tags the image components (for example a luminance component within an application marker 1 (APP 1) segment in the JIF Y and two color difference components Cb and Cr) using bitstream. (TIFF is defined in the TIFF Revision 6.0, Jun. 3, 8x8 pixel blocks. 1992, by Adobe Corp. and available on the Web at http:// 0004. It is desirable for digital cameras to produce images www. Adobe.com, and incorporated herein by reference.) that can be easily transferred into other digital devices (e.g. Exif images can be opened by any computer application computers) for editing, display, transmission, archival Stor software that incorporates a JPEG reader. However, the age, and printing. This requires a standard image data ancillary data in the Exif file can only be accessed by format, not just standards for the physical and electrical applications designed specifically for Exif. When an Exif file compatibility of the removable memory card. The format is converted to a FlashPix file (e.g. by the Microsoft Picture.It should be Supported by popular application software, so that application), the information recorded using the TIFF tags is the user does not need to worry about whether the image typically ignored by the reader, since the FlashPix conver format is compatible with the various image-capable appli sion programs are typically not familiar with the structure of cations on their computer. the Exif application marker and therefore ignore it. Thus, the ancillary information is lost. If the FlashPix application was 0005. The “FlashPix” image format (defined in FlashPix familiar with the Exif application marker, it would need to Format Specification, version 1.0, (Eastman Kodak Com read each individual TIFF tag, decode the information pany, Sep. 11, 1996)) has been developed to serve as both an values from each tag (for example, one specific tag encodes “interchange' format between devices (e.g. cameras) and the camera f/number as a rational number value) and then applications (e.g. computer picture editing packages), and as re-encode the values using the encoding method specified by a “native' format for image editing that allows the images to FlashPix (which encodes the camera f/number as a real be easily and rapidly edited. This is accomplished using a number value, rather than a rational number value, for hierarchical, tiled image representation within a "structured example) Each resolution level of a FlashPix image is storage file. A FlashPix file contains the complete image “tiled into 64x64 pixel images, and stored as a group, or plus a hierarchy of several lower-resolution copies within 'stream” of these Small image sections. the same file. Images at each resolution also are divided into rectangular tiles (e.g., squares), which enable the application 0008. However, the baseline DCT JPEG standard does to minimize the amount of image data processed to access, not allow the image data to be stored in tiles. Instead, the display or print a portion of the scene content. FlashPix data is stored as a single image record, by encoding all of the allows optional “ancillary” data to be stored in the same image blocks from left to right and top to bottom into a structured storage file, along with the image data. This single data record. Therefore, to convert an Exif or other JIF ancillary data can include digital audio recordings and compatible file format to a FlashPix image, the full resolu parameters such as the time and date the photo was taken, tion image is normally decompressed, tiled, and then recom the camera Zoom position and focus distance, the scene pressed. This process takes time, and may add compression illumination level, camera calibration data, image copyright artifacts. owner, etc. For further information about the FlashPix image 0009 What is needed is an image file format that is format see the aforementioned FlashPix Format Specifica completely compatible with the Baseline DCT (JPEG) ver US 2007/0097230 A1 May 3, 2007 sion of ISO/IEC 10918-1, so that it can be opened by all aspects of the present description may be implemented in existing “JPEG' enabled software applications, yet can be software. Unless otherwise specified, all software imple quickly and easily converted to the FlashPix format, so that mentation is conventional and within the ordinary skill in the new applications can take advantage of the tiling and programming arts. ancillary information capabilities offered by FlashPix. 0023 The invention is an image file format developed to SUMMARY OF THE INVENTION be compatible with or easily transcodable to multiple image 0010. The present invention is directed to overcoming formats. The format follows the Baseline DCT (“JPEG') one or more of the problems set forth above. Briefly sum version of ISO/IEC 10918-1, so that it can be opened by marized, according to one aspect of the present invention, existing “JPEG' enabled software applications such as there is provided a single digital image file, comprising: Microsoft Word for Windows, Adobe Photoshop, etc.