Europäisches Patentamt *EP001408452A2* (19) European Patent Office

Office européen des brevets (11) EP 1 408 452 A2

(12) EUROPEAN PATENT APPLICATION

(43) Date of publication: (51) Int Cl.7: G06T 11/60 14.04.2004 Bulletin 2004/16

(21) Application number: 03255844.7

(22) Date of filing: 18.09.2003

(84) Designated Contracting States: (72) Inventor: Matsumoto, Kentaro AT BE BG CH CY CZ DE DK EE ES FI FR GB GR Tokyo (JP) HU IE IT LI LU MC NL PT RO SE SI SK TR Designated Extension States: (74) Representative: AL LT LV MK Beresford, Keith Denis Lewis et al BERESFORD & Co. (30) Priority: 30.09.2002 JP 2002286343 16 High Holborn 30.09.2002 JP 2002286344 London WC1V 6BX (GB)

(71) Applicant: CANON KABUSHIKI KAISHA Tokyo (JP)

(54) Image editing method, image editing apparatus, program for implementing image editing method, and recording medium recording program

(57) To provide an image editing technique that en- ables a user to perform movement and magnification of an image with a single operation, and to perform trim- ming while grasping image composition in printing, the image editing method includes a step of instructing to move an arbitrary point of an image displayed in an im- age display area among image data; a step of calculat- ing an image movement amount and a magnification ra- tio in response to the instruction to move the arbitrary point; and a step displaying a predetermined area of the image data in the image display area on the basis of the image movement amount and the magnification ratio, which are calculated in the calculating step. EP 1 408 452 A2

Printed by Jouve, 75001 PARIS (FR) 1 EP 1 408 452 A2 2

Description [0005] When a trimming operation is performed in the manner shown in FIG. 6, the user reduces and moves BACKGROUND OF THE INVENTION the trimming frame while viewing the whole image, so that it is easy for the user to understand which part of Field of the Invention 5 the original image is intended to be clipped. However, there is a shortcoming that it is difficult for the user to [0001] The present invention relates to an image ed- grasp an impression that would be given by post-trim- iting technique, and in particular to a technique with ming image composition when the image is actually which when a still image or a moving image photo- printed in a print area. graphed with a digital still , a digital video cam- 10 [0006] In contrast to this, with the techniques dis- era, or the like is to be displayed and/or printed, com- closed in Japanese Patent Application Laid-Open No. position of the image may be adjusted while displaying 2000-83222 and Japanese Patent Application Laid- the image. Open No. 2000-217024, it is easy to grasp composition of an image to be actually printed. However, trimming is Related Background Art 15 performed by first magnifying an image and then moving the magnified image to change the position thereof, so [0002] Commonly used is a function with which image that it is required to perform two steps, i.e., a magnifica- data photographed with a is fetched and tion operation and a moving operation. is displayed on a display device, an arbitrary area of the [0007] Also, the technique disclosed in Japanese Pat- image is designated as a trimming area using a pointing 20 ent Application Laid-Open No. 11-341272 relates to cre- device such as a mouse or a remote controller, and the ation of a certificate and is aimed at obtain- designated trimming area is printed. FIG. 6 shows an ing the size and position of a face best-suited to the size example of a very commonly performed trimming proc- of paper on which the face is to be printed. Therefore, ess. In this , a trimming frame 602 is displayed the points to be designated by the user are preset at the so that it is superimposed on a pre-trimming image 601, 25 top of a head and the tip of a jaw, for instance, and there- and a user designates his/her desired part of the image fore the application purpose of this technique differs 601 by reducing/magnifying, rotating, and moving the from general view angle correction of snapshots. trimming frame 602. In this manner, a post-trimming im- [0008] Further, with each of the conventional tech- age 603 having composition desired by the user is finally niques described above, a user determines a trimming obtained. 30 position and size while viewing the overall composition, [0003] As another conventional technique of obtain- so that the appearance of a post-trimming image com- ing such a post-trimming image in a different manner, position greatly depends on the experience and ability for instance, a technique disclosed in Japanese Patent of the user. Also, such the determination of composition Application Laid-Open No. 2000-83222 is known in itself is burdensome for some users, so that even if it is which a television set is connected to a 35 possible to obtain beyond recognition editing apparatus which stores certain image editing through trimming of images, they often print the images software, and image data is displayed so as to be fitted without using the trimming function. in the display area of a screen of the television set. Then, [0009] When a main object (a person, in many cases) the image data is magnified to a size exceeding the dis- exists in the center area of an image like in the example play area of the television set and the magnified image 40 shown in FIG. 6, for instance, it is possible to obtain com- data is moved in a direction corresponding to an instruc- position with a sense of spreading by increasing a front tion from the outside and is changed so as to be dis- space in a sight direction of the person. On the other played in the display area. Japanese Patent Application hand, in the case of an example shown in FIG. 13 in Laid-Open No. 2000-217024 discloses a technique in which a trimming frame 1802 is set on a pre-trimming which the same method is applied to a digital camera 45 image 1801 and a post-trimming image 1803 is gener- and which is characterized in that the digital camera is ated, a front space in a sight direction of the person is equipped with a cross key for performing a magnification narrowed and this results in composition giving a rest- operation and a cross key for designating a position. less feeling. [0004] As still another conventional technique, a tech- [0010] In a like manner, when a moving subject is pho- nique disclosed in Japanese Patent Application Laid- 50 tographed like in an example shown in FIG. 15A, it is Open No. 11-341272 is known with which image data difficult to take a photograph having desired composi- obtained by photographing a face of a person is dis- tion. In the illustrated example, a go-cart is photo- played, predetermined two points of the image data are graphed in the center area of the photograph. However, designated with a designation means, an image magni- by increasing a front space in a traveling direction, it is fication/reduction ratio giving a face size and position 55 possible to obtain composition with a sense of motion. best-suited to the size of output paper is obtained based Such an image is a good example of an image with on the designated two points, and a resultant image is which it is possible to obtain a photograph beyond rec- printed at a given position. ognition through trimming. Even in this case, however,

2 3 EP 1 408 452 A2 4 it is difficult for a user, in particular for a beginner, to de- FIG. 8 shows an image coordinate system and a termine a position where the go-cart (main object in this display memory coordinate system; case) should be positioned through trimming in order to FIG. 9 shows an image coordinate system and a obtain a generally favorable composition. display memory coordinate system according to the [0011] The present invention has been made in order 5 second embodiment; to alleviate one of the aforementioned problems of the FIG. 10 is a flowchart of a process performed with conventional techniques. an image editing method according to a fifth embod- [0012] A concern of the present invention is to provide iment; an image editing technique that enables a user to per- FIGS. 11A, 11B, and 11C illustrate a grid based on form movement and magnification of an image with 10 a golden section; ease by the less number of operations performed by the FIG. 12 shows a grid displayed according to the fifth user. embodiment; [0013] Further, another concern of the present inven- FIG. 13 shows an example of a trimming process; tion is to provide an image editing technique with which FIG. 14 is a flowchart of a process performed in a at the time of trimming an image photographed with a 15 fourth embodiment to display a grid; digital camera or the like, it is possible to determine com- FIGS. 15A and 15B show an example of a trimming position of the image with ease. process according to the fourth embodiment; [0014] In one aspect an image editing method accord- FIGS. 16A, 16B, and 16C each show an example ing to the present invention, comprising the steps of: of a grid displayed according to the fourth embodi- 20 ment in order to indicate the suited position of a instructing to move an arbitrary point of an image main object; displayed in an image display area among image FIGS. 17A and 17B each show an example in which data; trimming is performed using the grid according to calculating an image movement amount and a mag- the fourth embodiment; nification ratio in response to an instruction to move 25 FIG. 18 is a flowchart of a grid display process ac- the arbitrary point; and cording to a sixth embodiment; and displaying a predetermined area of the image data FIGS. 19A, 19B, 19C, and 19D each show an ex- in the image display area on the basis of the image ample of a grid displayed according to the sixth em- movement amount and the magnification ratio, bodiment. which are calculated in the calculating step. 30 DESCRIPTION OF THE PREFERRED [0015] Other features of the present invention will be- EMBODIMENTS come apparent from the following description of pre- ferred embodiments to be made with reference to the [0017] Preferred embodiments of the present inven- accompanying . 35 tion will now be described with reference to the accom- panying drawings. BRIEF DESCRIPTION OF THE DRAWINGS First Embodiment [0016] 40 [0018] FIG. 1 shows an example of a hardware con- FIG. 1 shows an example of the hardware construc- struction of an image editing apparatus according to first tion of an image editing apparatus according to first to sixth embodiments of the present invention. In this to third embodiments of the present invention; drawing, reference numeral 101 denotes a CPU (central FIG. 2 is a flowchart of a process performed with an processing unit) that executes computer software pro- image editing method according to the first embod- 45 grams; numeral 102, a ROM (read-only memory) in iment; which programs are stored; numeral 103, a RAM (ran- FIG. 3 is a flowchart of a process performed with an dom-access memory) that is used at the time of execu- image editing method according to the third embod- tion of the programs; numeral 104, a hard disk drive iment; (HDD) in which the programs are stored; numeral 105, FIG. 4 shows an image coordinate system and a 50 a storage device that stores programs and data on a display memory coordinate system; medium such as a flexible disk or an MO (magneto-op- FIG. 5 shows the image coordinate system and the tical disk); numeral 106, a display device for displaying display memory coordinate system; execution results and execution states of the programs; FIG. 6 shows an example of a trimming process per- numeral 107, a memory card interface into which a formed with a conventional technique; 55 memory card is inserted and which writes and reads da- FIG. 7 is a flowchart of a process performed with an ta into and from the inserted memory card; numeral 108, image editing method according to the second em- a mouse and a keyboard; numeral 109, a printer; and bodiment; numeral 110, a bus.

3 5 EP 1 408 452 A2 6

[0019] In this embodiment, two coordinate systems dinate system. Also, no difference occurs in the image that are a display memory coordinate system for dis- outer edge 504 between before and after the movement playing an image on the display 106 and an image co- and only the trimming frame is moved leftward from the ordinate system for expressing a position on image data pre-movement trimming frame 505 to the post-move- are used to determine an area to be clipped from the 5 ment trimming frame 507. image data after movement of the mouse 108 and a [0022] A user is capable of performing trimming to ob- magnification ratio at the time of writing for displaying tain an appropriate composition by, for instance, chang- on the display 106. Thereafter, writing into a display ing the position of a main object displayed on the display. memory area is performed according to the determined The user first moves a mouse pointer onto the point (x0, clipping area and magnification ratio. 10 y0) on the display coordinate system, at which the main object is positioned, and then drags the main object from Description of Display Memory Coordinate System the point (x0, y0) to the point (x1, y1) on the display co- ordinate system. In this manner, the user moves the [0020] The display memory coordinate system is main object from the center to the right-hand side. When shown in FIG. 5 (see reference numeral 503). In this 15 the mouse pointer is moved through a dragging opera- drawing, a point of x=y=0 is set as an origin, an x-axis tion, the main object is moved so as to follow the mouse extends in the rightward direction on a paper plane of pointer. As a result, the mouse positions 506 and 508 this drawing, and a y-axis extends in the downward di- on the image coordinate system before and after the rection thereon. An image is written into a display area movement both indicate the same position of the main having a width " cWidth" and a height "cHeight", with the 20 object. The rightward movement of the main object from origin (0, 0) being set as an upper left-hand point of the (x0, y0) to (x1, y1) on the display coordinate system is image. Also, designation of a coordinate on this display instructed, so that the trimming frame is moved leftward memory coordinate system is performed with the from the pre-movement position 505 to the post-move- mouse. When an arbitrary point of the displayed image ment position 507 without causing any difference be- is dragged with the mouse, a coordinate designated with 25 tween the points 506 and 508 of the main object on the the mouse is changed from a pre-movement point (x0, image coordinate system. The magnification ratio is de- y0) to a post-movement point (x1, y1) (see reference termined so that the trimming frames 505 and 507 be- numeral 510). This mouse dragging is an operation in come appropriate to the size of the display area of the which the mouse is moved while keeping the left button display. The trimming frames 505 and 507 have the of the mouse pressed down. Here, the left button is 30 same size and images before and after the movement pressed down at the pre-movement point (x0, y0) and have the same magnification ratio. Also, displaying on is released at the post-movement point (x1,y1 ). the display is performed so that the upper left-hand co- ordinates of the trimming frames 505 and 507 coincide Description of Image Coordinate System with the point (0, 0) on the display coordinate system. 35 [0023] Next, description will be made of a display co- [0021] The image coordinate system that is another ordinate system 403, an image coordinate system 401 coordinate system used in this embodiment is also before dragging movement and an image coordinate shown in FIG. 5 (see reference numerals 501 and 502). system 402 after the dragging movement shown in FIG. Reference numeral 501 denotes a state in which move- 4. On the image coordinate system 501 before the ment through the mouse dragging is not yet performed, 40 movement in FIG. 5, the trimming frame 505 exists in- while reference numeral 502 denotes a post-movement side the image outer edge 504. On the image coordinate state. In FIG. 5, reference numeral 504 denotes an outer system 401 before the movement in FIG. 4, however, a edge of an image; numerals 505 and 507, each a trim- left end of a trimming frame 405 contacts a left end of ming frame showing a trimming area; and numerals 506 an image outer edge 404. and 508, each a coordinate designated with the mouse. 45 [0024] FIG. 4 shows a case where a dragging opera- The image coordinate system is normalized so that the tion with the mouse is performed so that movement from length of the image outer edge 504 on the x-axis be- (x0, y0) to (x1, y1) is performed on the display coordi- comes one. The mouse coordinate 506 on the image nate system as in FIG. 5. If it is intended to move the coordinate system corresponds to the pre-movement pre-movement trimming frame 405 leftward as in FIG. point (x0, y0) on the display coordinate system, while 50 5, this results in a situation where the trimming frame the post-movement mouse coordinate 508 corresponds 405 extends out from the image outer edge 404 and an to the post-movement point (x1, y1) on the display co- area having no image data enters into the trimming ordinate system. Also, even after an arbitrary point of frame 405. In view of this problem, as shown in FIG. 4, the image is designated on the display and is grasped the size of a post-movement trimming frame 407 is re- and moved (dragged), the point designated with the 55 duced from that of the pre-movement trimming frame mouse on the image coordinate system is not changed 405 so that a left end of the trimming frame 407 coin- and therefore the pre-movement point 506 and the post- cides with the left end of the image outer edge 404. movement point 508 are the same on the image coor- Mouse positions 406 and 408 before and after the move-

4 7 EP 1 408 452 A2 8 ment indicate the same main object. The image inside will be described later. the trimming frames 405 and 407 is magnified to the size [0032] In step S206, an image in the new clipping of the display. Consequently, the magnification ratio of frame 407/507 designated by x', y', w', and h' obtained a displayed image in the post-movement trimming frame in step S205 is read out and is written onto the display 407 becomes larger than that of a displayed image in 5 memory coordinate system at the obtained magnifica- the pre-movement trimming frame 405. That is, through tion ratio. As a result, an image is displayed on the dis- this trimming operation, the main object on the display play. is moved rightward and is magnified. As a result, it be- [0033] In step S207, it is judged whether the mouse comes possible to perform a moving process and a dragging is completed. If the mouse dragging is com- magnification process through a single dragging opera- 10 pleted, the process is ended; if not, the process returns tion. to step S201 and the same operations are repeated. [0025] As described above, when dragging is per- When the process is ended, a post-trimming image is formed and it is instructed to move the trimming frame printed or saved. The clipping frame is an image print 405 so that an end of the image outer edge 404 in a area showing an image area to be printed. When the direction opposite to a moving direction is exceeded, the 15 user instructs to print the image displayed in the clipping image is magnified based on an exceeding amount to frame, the image inside the clipping frame is printed. display the magnified image. Also, regardless of the [0034] By performing the image editing process de- magnification ratio, displaying is performed so that the scribed above, a main object is moved and/or magnified image at the pre-movement point designated by drag- so as to follow the mouse pointer and is successively ging is moved to the post-movement point. In more de- 20 displayed during a dragging operation. As a result, it be- tail, an image movement amount and magnification ratio comes possible to perform trimming while grasping are calculated so that the image at the designated pre- composition at the time of printing. movement point is moved to the post-movement point [0035] Next, a method used in step S205 to calculate without generating any margin in the trimming frame. the position (x', y'), width w', and height h' of the new Then, the image is displayed based on the calculated 25 clipping frame will be described. Note that for ease of image movement amount and magnification ratio. explanation, in the following description, a case where [0026] FIG. 2 is a flowchart showing a process per- the mouse is horizontally moved from the left to the right, formed with an image editing method according to the that is, moved in the forward direction of the x-axis will first embodiment of the present invention. Hereinafter, be described. However, even if the mouse is moved in the first embodiment of the present invention will be de- 30 a reverse direction, a top-to-bottom direction, or an in- scribed by following this flowchart. When a dragging op- clined direction, the calculation is possible with the same eration with the mouse is performed, the following proc- method. ess is started. [0036] The method of obtaining the position, width, [0027] In step S201, the position (Ix, Iy), width Iw, and and height of the new clipping frame will be considered height Ih of the clipping frame (trimming frame) on the 35 based on two cases of an initial state, one of which is a image coordinate system at that point in time are ob- case of x=0 where the clipping frame 405 contacts the tained. That is, as shown in FIGS. 4 and 5, the position image outer edge 404 as indicated by 401 in FIG. 4 and of an upper left-hand point of the image outer edge the other of which is a case of x≠0 where the clipping 404/504 is set as (0, 0). Then, the position of an upper frame 505 does not contact the image outer edge 504 left-hand point of the clipping frame 405/505 on the im- 40 as indicated by 501 in FIG. 5. age coordinate system is substituted into (Ix, Iy) and the [0037] In the case of x=0 shown in FIG. 4, the position, width and height of the clipping frame 405/505 thereon width, and height of the new clipping frame are operated are substituted into (Iw, Ih). from the following equations. [0028] In step S202, the coordinate of the pre-move- ment position of the mouse on the display memory co- 45 x'=0 (because the clipping frame contacts the left- ordinate system is fetched and is substituted into (x0, y0). end side of the image) (1) [0029] In step S203, a waiting operation is performed for a given length of time preset in order to capture movement of the mouse. 50 w'=wϫx0/x1 (2) [0030] In step S204, the coordinate of the post-move- ment position of the mouse on the display memory co- ordinate system is fetched and is substituted into (x1, h'=hϫw'/w (3) y1). [0031] In step S205, as shown in FIGS. 4 and 5, the 55 position (x', y'), width w', and height h' of the new clipping y'=y+hϫy0/cHeight-h'xy1/cHeight (4) frame 407/507 are operated and a magnification ratio is also operated. A method of calculating x', y', w', and h'

5 9 EP 1 408 452 A2 10

[0038] On the other hand, in the case of x≠0 shown ordinate system is fetched and is substituted into (x0, in FIG. 5, the position, width, and height of the new clip- y0) . ping frame are operated from the following equations. [0044] In step S703, a waiting operation is performed for a given length of time preset in order to capture 5 movement of the mouse. w' =w (5) [0045] In step S704, the coordinate of the post-move- ment position of the mouse on the display memory co- ordinate system is fetched and is substituted into (x1, x'=x-(x1-x0)ϫw/cWidth (6) y1). 10 [0046] In step S705, the position (x', y'), width w', and height h' of the new clipping frame are operated and a y'=y magnification ratio is also operated. A method of calcu- lating x', y', w', and h' is basically the same as that of the first embodiment. Detailed description thereof will be h'=h 15 made later. [0047] In step S706, an image in the new clipping [0039] As described above, when it is instructed to frame designated by x', y', w', and h' obtained in step move an arbitrary point of an image displayed in the im- S705 is read out and is written onto the display memory age display area among image data, an image move- coordinate system at the obtained magnification ratio. ment amount and magnification ratio are calculated in 20 As a result, an image is displayed on the display. response to the moving instruction. Then, a predeter- [0048] In step S707, it is judged whether or not the mined area of the image data is displayed in the image mouse dragging is completed. If the mouse dragging is display area based on the calculated image movement completed, the process is ended; if not, the process re- amount and magnification ratio. turns to step S703. The step, to which the process re- [0040] According to this embodiment, when an arbi- 25 turns, is a clear difference from the first embodiment. In trary part of an image is designated with a mouse, a pen, the first embodiment, the process returns to the first step or the like and is grasped and dragged while displaying S201. only a print area in a trimming frame, the image is moved [0049] In step S705 of the second embodiment (see to a preferred position and is also magnified as neces- FIG. 7), a new clipping frame is always calculated using sary. For instance, when a human object is photo- 30 the initial clipping frame information "Ix, Iy, Iw, and Ih" graphed in the center area of an image and it is intended and mouse position (x0, y0) obtained in steps S701 and to bring the human object near to a right-hand end S702 when the moving instruction was started. In con- through trimming, it has conventionally been required to trast, in step S205 of the first embodiment (see FIG. 2), first magnify the image and then move the magnified im- a new clipping frame is calculated using the latest clip- age. According to this embodiment, however, merely by 35 ping frame information "Ix, Iy, Iw, and Ih" and mouse po- dragging a part of the human object to a position at sition (x0, y0) obtained in steps S201 and S202 during which it is desired to be arranged, the human object is the dragging (movement instruction). moved and is also magnified as necessary. As a result, [0050] As shown in FIG. 4, the first embodiment and it becomes possible to obtain an image having prefera- the second embodiment are the same in that when drag- ble composition through a single operation. Second Em- 40 ging from the display coordinate (x0, y0) to (x1,y1 ) is bodiment performed, the clipping frame 405 is changed into the [0041] FIG. 7 is a flowchart showing a process per- clipping frame 407. However, when a dragging opera- formed with an image editing method according to a sec- tion is performed afterward in order to return to the dis- ond embodiment of the present invention. Hereinafter, play coordinate (x0, y0) from (x1, .y1 ), the second em- the second embodiment of the present invention will be 45 bodiment differs from the first embodiment. described by following this flowchart. When a dragging [0051] As shown in FIG. 9, in the first embodiment, operation with the mouse is performed, the following when dragging from the display coordinate (x1, y1) to process is started. (x0, y0) is performed (see reference numeral 910), a [0042] In step S701, the position (Ix, Iy), width Iw, and trimming frame 905 is changed into a trimming frame height Ih of the clipping frame (trimming frame) on the 50 907. That is, only the leftward movement of the dragged image coordinate system at that point in time are ob- main object is performed without changing the magnifi- tained. In the same manner as in the first embodiment, cation ratio (image size). the position of the upper left-hand point of the clipping [0052] In contrast, in the second embodiment, the frame on the image coordinate system is substituted into trimming frame 407 shown in FIG. 4 returns to the orig- (Ix, Iy) and the width and height of the clipping frame 55 inal trimming frame 405. That is, if dragging is performed thereon are substituted into (Iw, Ih) . on the display coordinate system from (x0, y0) to (x1, [0043] In step S702, the coordinate of the pre-move- y1) and then from (x1, y1) to (x0, y0), the trimming frame ment position of the mouse on the display memory co- changes from the trimming frame 405 to the trimming

6 11 EP 1 408 452 A2 12 frame 407 and then from the trimming frame 407 to the od of calculating x', y', w', and h' will be described later. trimming frame 405. That is, reversibility is attained in However, the magnification ratio is not calculated. the second embodiment, while such reversibility does [0062] In step S308, an image in the new clipping not exist in the first embodiment. frame designated by x', y', w', and h' obtained in step [0053] According to the second embodiment de- 5 S307 is read out and written onto the display memory scribed above, when an arbitrary part of an image is des- coordinate system. A difference from the first embodi- ignated with a mouse, a pen, or the like and is grasped ment is that the image is displayed on the display without and dragged while displaying only a print area in a trim- being magnified at this point in time. This displaying will ming frame, the image is moved to a preferred position be described later with reference to FIG. 8. and is also magnified as necessary. In addition, when 10 [0063] In step S309, it is judged whether or not the the moving direction of the mouse is reversed during a mouse dragging is completed. If the mouse dragging is series of dragging operations, the image is reduced completed, the process proceeds to step S310; if not, while regarding a state at the start of the dragging as a the process returns to step S303. limit. As a result, when the image becomes too large [0064] In step S310, the position (x', y'), width w', and because the mouse is moved more than necessary, it is 15 height h' of the new clipping frame are operated and a possible to move the mouse in a reserve direction to magnification ratio is also operated. A method used to thereby return the magnified image to its original image calculate x', y', w', and h' is the same as that used in the size. first and second embodiments. At this time, the clipping area information (Isx, Isy, Isw, Ish) and the mouse posi- Third Embodiment 20 tion information (sx0, sy0) obtained under an initial state in step S301 and S302 are used as an original clipping [0054] FIG. 3 is a flowchart showing a process per- area. formed with an image editing method according to a [0065] In step S311, an image in the new clipping third embodiment of the present invention. Hereinafter, frame designated by x', y', w', and h' obtained in step the third embodiment of the present invention will be de- 25 S310 is read out and is written onto the display memory scribed by following this flowchart. When a dragging op- coordinate system at the obtained magnification ratio. eration with the mouse is performed, the following proc- This display method is the same as that shown in FIGS. ess is started. 4 and 5. [0055] In step S301, the position, width, and height of [0066] FIG. 8 shows a display method used in step the clipping frame (trimming frame) on the image coor- 30 S308 described above. A case where a user moves a dinate system under an initial state are obtained. The mouse pointer from a display coordinate (x0, y0) to position of the upper left-hand point of the clipping frame (x1,y1 ) while performing dragging on a display coordi- on the image coordinate system is set as (Isx, Isy) and nate system 803 will be described. At this time, the user the width and height of the clipping frame thereon are performs a dragging operation by keeping the left button set as (Isw, Ish). 35 of the mouse pressed down. A pre-movement image co- [0056] In step S302, the coordinate (sx0, sy0) of the ordinate system 801 shows a trimming frame 805 and pre-movement position of the mouse on the display a mouse position 806 obtained in steps S303 and S304. memory coordinate system is fetched. A post-movement image coordinate system 802 indi- [0057] In step S303, the position, width, and height of cates a trimming frame 807 and a mouse position 808 the clipping frame on the image coordinate system at 40 obtained in steps S306 and S307. That is, in step S308 that point in time are obtained. That is, the position of in which the dragging operation is not yet completed, the upper left-hand point of the clipping frame on the only image movement is performed based on the mouse image coordinate system is substituted into (Ix, Iy) and movement and magnification (reduction) is not per- the width and height of the clipping frame thereon are formed. The post-movement trimming frame 807 ex- substituted into (Iw, Ih). 45 tends out from an image outer edge 804 and contains [0058] In step S304, the coordinate of the pre-move- an area having no image data. This area without any ment position of the mouse on the display memory co- image data is displayed on the display as white data, for ordinate system is fetched and is substituted into (x0, instance. Then, after the dragging operation is complet- y0). ed, the process proceeds to step S311 in which the im- [0059] In step S305, a waiting operation is performed 50 age is moved and magnified in accordance with the for a predetermined length of time preset in order to dragging as in the first and second embodiments. grasp movement of the mouse. [0067] Next, a method used in step S307 to calculate [0060] In step S306, the coordinate of the pre-move- the post-movement image coordinate system 802 will ment position of the mouse on the display memory co- be described. In more detail, a method of calculating the ordinate system is fetched and is substituted into (x1, 55 position (x', y'), width w', and height h' of the trimming y1). frame 807 will be described. Note that for ease of expla- [0061] In step S307, the position (x', y'), width w', and nation, in this embodiment, a case where the mouse is height h' of the new clipping frame are operated. A meth- horizontally moved from the left to the right, that is,

7 13 EP 1 408 452 A2 14 moved in the forward direction of the x-axis will be de- present invention is limited by these embodiments. That scribed. However, even if the mouse is moved in a re- is, it is possible to carry out the present invention in var- verse direction, a top-to-bottom direction, or an inclined ious other forms without departing from the technical direction, the calculation is possible with the same meth- idea or major features of the present invention. od. 5 [0072] As described above, when it is instructed to move an arbitrary point of an image in an image display area, the image is moved to a designated position and x'=x0-x1 is also magnified as necessary. For instance, when it is intended to bring a human object photographed in a 10 center area of an image near to a right-hand end, it is y'=y possible to obtain an image having preferable compo- sition by performing desired movement and magnifica- tion through a single human object moving operation. w'=w Also, while it is instructed to move the human object, 15 image data is successively displayed based on a calcu- lated image movement amount and/or magnification ra- h'=h tio, so that it becomes possible for a user to perform trimming while grasping post-editing composition. [0068] As described above, while it is instructed to move an image through dragging, image data is dis- 20 Fourth Embodiment played based on a calculated image movement amount without being changed in image size. When the image [0073] Next, a fourth embodiment of the present in- moving through dragging is completed and a dropping vention whose arrangement is the same as Fig. 1 will operation is performed, the image data is displayed be described. FIG. 14 is a flowchart showing a process based on a calculated magnification ratio as well as im- 25 performed in this embodiment to display a grid on an age movement amount. image that is a target of trimming. In step S1901, it is [0069] According to this embodiment, when an arbi- judged whether or not trimming is started. If a result of trary part of an image is designated with a mouse, a pen, this judgment is affirmative, a trimming mode is set, so or the like and is grasped and dragged while displaying that the process proceeds to step S1902. On the other only a print area in a trimming frame, the image is moved 30 hand, if the judgment result is , the process re- without being changed in image size during continuation turns to step S1901. In step S1902, a grid 1005 (see of the dragging and is magnified as necessary when a FIG. 15B) indicating a suited position of a main object dropping operation is performed at a preferred position. in an image is displayed on the screen. This grid 1005 As a result, it becomes possible to realize an easy-to- is displayed on the image that is the trimming target, and understand operation where an image is first moved and 35 is a mark suggesting a suited (composition) with then is magnified. regard to the position of the main object in the image. [0070] Each of the embodiments described above [0074] Following this, the process proceeds to step may be realized through execution of a program by a S1903 in which it is judged whether or not the trimming computer. Also, a means for supplying the program to is completed. If a result of this judgment is affirmative, the computer, such as a computer-readable recording 40 the process proceeds to step S1904 in which the grid medium like a CD-R on which the program has been 1005 is hidden; if not, the process returns to step S1903. recorded or a transmission medium like the Internet for [0075] How a user interface changes will be described transmitting the program, is applicable as a modification by following the flowchart shown in FIG. 14 with refer- of the present invention. Further, a program product, ence to FIGS. 15A and 15B. FIG. 15A shows a screen such as a computer-readable recording medium on 45 displayed immediately before printing is executed, with which the program has been recorded, is applicable as a pre-trimming image 1001 being displayed thereon. another modification of the present invention. The pro- Here, when a trimming button 1002 is pushed, a trim- gram, recording medium, transmission medium, and ming window shown in FIG. 15B is opened in which an program product described above are contained in the image 1003 is displayed. In this example, the pushing scope of the present invention. As the recording medi- 50 of the trimming button 1002 corresponds to the affirma- um, it is possible to use a flexible disk, a hard disk, an tive result "YES" of the trimming start judgment in step optical disk, a magneto-optical disk, a CD-ROM, a mag- S1901. In the trimming window shown in FIG. 15B, a netic tape, a non-volatile memory card, or a ROM, for trimming frame 1004 is displayed, and when one of the instance. four corners or four sides of the trimming frame 1004 is [0071] It should be noted here that each embodiment 55 dragged with the mouse, the size and/or position of the described above is merely a concrete example, in which trimming frame 1004 are/is changed. Reference numer- the present invention is carried out, and therefore it al 1005 denotes a grid that is displayed in the trimming should not be construed that the technical scope of the frame 1004 in order to indicate a suited position of the

8 15 EP 1 408 452 A2 16 main object. When the trimming is completed, the user pushes an OK button 1007. This pushing of the OK but- EC=X={( 5)-1}/2=0.618··· ton 1007 corresponds to step S1903. By changing the size and/or position of the trimming frame 1004, the size Also, the side AD becomes as follows. and/or position of the image in the trimming frame 1004 5 that is the target of the trimming are changed. [0076] In this embodiment, the trimming is performed AD=x+1=[{ ( 5)-1}/2]+1 using the window shown in FIG. 15B dedicated to the trimming, so that there arises no problem even if the grid ={( 5)+1}/2=1.618··· 1005 is displayed in this window at all times. The grid 10 1005 is changed along with changing of the position In this case, "x" and "(x+1)" are in a mutually reciprocal and/or size of the trimming frame 1004, although a rel- relation and are both called the golden ratio. ative position in the trimming frame 1004 is not changed. [0081] When the composition of a photograph is de- Also, a button for selecting displaying/non-displaying of termined, it is possible to use this golden ratio. In FIG. the grid may be provided in the window shown in FIG. 15 11C, a straight line is drawn between interior-division 15B and switching between displaying and non-display- points of the vertical sides at the golden ratio (0.618:1), ing of the grid may be performed in accordance with the another straight line is drawn between interior-division on/off of this button. points of the horizontal sides at the golden ratio (0.618: [0077] After the trimming, the user pushes a print but- 1), and an intersection between these lines is set as a ton 1006 shown in FIG. 15A to thereby instruct to print 20 golden section point 301. When vertically and horizon- the image in the trimming frame 1004. The image data, tally symmetrical points are considered, four golden whose printing has been instructed, is outputted to the section points are obtained in total. printer 109 (see FIG. 1), which then prints the image da- [0082] Meanwhile, in the photograph world, although ta. not so strict as the golden section described above, a [0078] It is preferable that the grid 1005 described 25 division rule for obtaining an image felt by humans as above is a grid in which the image within the trimming beautiful is called the golden section. Golden section frame 1004 is divided under a "golden section" rule. It points (grid points) are obtained with a three-division is generally said that if a main object is positioned at any method shown in FIG. 16A or a diagonal method shown one of the intersections of this grid 1005, a suited com- in FIG. 16B, and are used as a guide for creating pref- position is obtained. This golden section will be de- 30 erable composition. scribed below. A "golden ratio" based on the golden sec- [0083] FIG. 16A shows a grid based on the three-di- tion means a "harmonic and beautiful ratio" considered vision method with which each of the vertical sides and by ancient people. the horizontal sides of a rectangle is divided equally into [0079] A division method, with which a condition of three, straight lines are drawn between the division "AB:BP=BP:AP" is satisfied as shown in FIG. 11A, is 35 points, and four intersections thereof are each set as a called the golden section and a rectangle where the ra- grid point. On the other hand, FIG. 16B shows a grid dio of a long side to a short side is "AB:BP=BP:AP (1: based on the diagonal method with which a diagonal line 0.618)" is well known for instance. Generally, it is also is drawn in a rectangle, perpendicular lines are drawn said that a shape having this ratio gives the most com- from two remaining vertexes of the rectangle to the di- fortable feeling to humans. 40 agonal line, and intersections between the diagonal line [0080] Next, how the golden ratio is obtained with pre- and the perpendicular lines are each set as a grid point. cision will be described with reference to FIG. 11B. First, Also, as a modification of the grid shown in FIG. 16B, there will be considered a "rectangle where when a four grid points may be provided by drawing two diago- square is clipped from the rectangle, a remaining rec- nal lines in a rectangle and drawing perpendicular lines tangle becomes similar to the original rectangle". That 45 to each diagonal line from remaining vertexes not exist- is, the following equation is satisfied. ing on each diagonal line. Further, in the case of the P (panorama) type of an APS (Advanced Photo System) camera, there may be used a method with which a rec- 1:(x+1)=x:1 tangle is horizontally divided equally into four or five. If 50 a rectangle is vertically divided into three and is horizon- Therefore, the following equation is satisfied. tally divided into four as shown in FIG. 16C, six grid points are obtained. As described above, the grid points

2 indicate suited positions of a main object with reference X +x-1=0 to the aspect ratio of an image, and each grid point exists 55 at a screen division ratio called the golden ratio. When this equation is solved, the side EC becomes as [0084] FIG. 17A shows an example in which trimming follows. is performed using the grid shown in FIG. 16A, while FIG. 17B shows an example in which trimming is per-

9 17 EP 1 408 452 A2 18 formed using the grid shown in FIG. 16B. It is possible for displaying on the display 106 are determined, and for a user to create an image having appropriate com- writing into a display memory area is finally performed. position by positioning a human object that is the main [0091] The display memory coordinate system, the object at any one of the grid points through trimming. image coordinate system, the movement of the trimming Note that only the grid points may be displayed or other 5 frame, and the frame magnification/reduction process marks may be displayed which suggest appropriate po- at the time of movement of the trimming frame are the sitions of the main object in the image. same as those described in the first embodiment with [0085] According to this embodiment, appropriate po- reference to FIGS. 4 and 5, and therefore the description sitions of a main object are indicated by a grid or the like thereof is omitted in this embodiment. on a screen on which trimming is performed. As a result, 10 [0092] FIG. 10 is a flowchart of a process performed it becomes possible even for an inexperienced user to with an image editing (trimming) method according to obtain an image having appropriate composition. the fifth embodiment of the present invention. Hereinaf- ter, the fifth embodiment of the present invention will be Fifth Embodiment described by following the flowchart. When a dragging 15 operation with the mouse is performed, the following [0086] Next, a fifth embodiment of the present inven- process is started. tion will be described. In the fourth embodiment de- [0093] In step S1200, the grid 1702 (see FIG. 12) is scribed above, the size and/or position of the trimming displayed. frame 1004 (see FIG. 15B) are/is adjusted. In this fifth [0094] In step S1201, the position (Ix, Iy), width Iw, embodiment, however, there will be described a case 20 and height Ih of the clipping frame (trimming frame) on where an image to be obtained finally is displayed and the image coordinate system at that point in time are a trimming area is determined by changing the size and/ obtained. That is, as shown in FIGS. 4 and 5, the posi- or position of the displayed image. In this case, the trim- tion of an upper left-hand point of the image outer edge ming frame and the grid are fixedly displayed. 404/504 is set as (0, 0), the position of an upper left- [0087] In this embodiment, a grid is displayed on the 25 hand point of the clipping frame 405/505 on the image image 1001 shown in FIG. 15A, an example of which is coordinate system is substituted into (Ix, Iy), and the shown in FIG. 12. In FIG. 12, a grid 1702 is displayed width and height of the clipping frame 405/505 are sub- on an image 1701. The size and position of this grid stituted into (Iw, Ih). 1702 are fixed and the image 1701 is magnified and/or [0095] In step S1202, the position coordinate of the moved so that a main object is positioned at a grid point. 30 mouse before movement on the display memory coor- In this manner, trimming is performed and an image hav- dinate system is started is fetched and is substituted into ing appropriate composition is obtained. Note that the (x0, y0). display area frame of the image 1701 and the size and [0096] In step S1203, a waiting operation is per- position of the grid 1702 are fixed. formed for a given length of time preset in order to grasp [0088] During a trimming operation in this case, an 35 the movement of the mouse. original image in a predetermined display area is mag- [0097] In step S1204, the position coordinate of the nified and moved to thereby display a desired part of the mouse after the movement on the display memory co- original image in the display area in a desired size and ordinate system is fetched and is substituted into (x1, print it. y1). [0089] An image editing method for performing mag- 40 [0098] In step S1205, as shown in FIGS. 4 and 5, the nification and/or movement of an image through a single position (x', y'), width w', and height h' of the new clipping operation will be described below. When it is intended frame 407/507 are operated and a magnification ratio is to move a given part of an original image that is not yet also operated. A method of calculating x', y', w', and h' trimmed, it is necessary to perform a magnification proc- will be described later. ess in order to prevent a situation where a margin is gen- 45 [0099] In step S1206, an image within the new clip- erated. The following is a description of a technique of ping frame 407/507 designated by x', y', w', and h' ob- specifying an image clipping area by obtaining a mag- tained in step S1205 is read out and is written onto the nification ratio required to move a selected part. By com- display memory coordinate system at the obtained mag- bining this method with the grid displaying described nification ratio. As a result, an image is displayed on the above, it becomes possible to easily arrange a main ob- 50 display. ject at the most suited position in a photograph. [0100] In step S1207, it is judged whether or not the [0090] In this embodiment, two coordinate systems mouse dragging is completed. If the mouse dragging is are used which are the display memory coordinate sys- completed, the process is ended; if not, the process re- tem for displaying an image on the display 106 and the turns to step S1201 and the same operations are re- image coordinate system for expressing a position on 55 peated. image data. With those coordinate systems, an area that [0101] In step S1208, the grid 1702 (see FIG. 12) is should be clipped from the image data after the mouse hidden. 108 is moved, a magnification ratio at the time of writing [0102] When the process is ended, a post-trimming

10 19 EP 1 408 452 A2 20 image is printed or saved. The clipping frame is an im- y'=y age print area indicating an image area to be printed. When a user instructs to print the image displayed in the clipping frame, the image inside the clipping frame is h'=h printed. 5 [0103] By performing the image editing process de- scribed above, the main object is moved and/or magni- [0108] A process for magnifying/reducing the image fied so as to follow the mouse pointer and is successive- 1701 in FIG. 12 is performed through a combination of ly displayed during a dragging operation, so that it be- a CTRL key of the keyword and the rotation of a wheel comes possible to perform trimming while grasping 10 of the mouse, and the movement and/or magnification composition at the time of printing. process described above is performed through a com- [0104] Next, a method used in step S1205 to calculate bination of pressing the CTRL key of the keyboard 108 the position (x', y'), width w', and height h' of the new and dragging by using the mouse 108. That is, by per- clipping frame will be described. Note that for ease of forming the mouse dragging while keeping the CTRL explanation, in the following description, a case where 15 key pressed down, the movement and/or magnification the mouse is horizontally moved from the left to the right, process described above is performed. Also, it is as- that is, moved in the forward direction of the x-axis will sumed that the CTRL key is not used at the time of other be described. However, even if the mouse is moved in operations. a reverse direction, a top-to-bottom direction, or an in- [0109] If a process in this embodiment is described clined direction, the calculation is possible with the same 20 using the flowchart shown in FIG. 14 related to the fourth method. embodiment, it is judged in steps S1901 and S1903 [0105] The method of obtaining the position, width, whether or not trimming is started or completed with ref- and height of the new clipping frame will be considered erence to whether the CTRL key is pressed down. That based on two cases of an initial state, one of which is a is, while it is detected that the CTRL key is pressed case of x=0 where a clipping frame 405 contacts an im- 25 down, it is judged that a trimming operation is performed age outer edge 404 as indicated by 401 in FIG. 4 and (trimming mode is set) and therefore the grid is dis- the other of which is a case of x≠0 where a clipping frame played. 505 does not contact an image outer edge 504 as indi- [0110] Also, at the time of trimming, magnification and cated by 501 in FIG. 5. movement of an image may be concurrently performed [0106] In the case of x=0 shown in FIG. 4, the position, 30 in the manner described above. Alternatively, the move- width, and height of the new clipping frame are operated ment and the magnification may be separately per- from the following equations. formed. It is preferable that the grid is displayed when the position or size of an image is changed through trim- ming. x'=0 (because the clipping frame contacts a left-end 35 [0111] According to this embodiment, when an arbi- trary part of an image is designated with a mouse, a pen, side of the image) (1) or the like and is grasped and dragged while displaying only a print area in a trimming frame, the image is moved to a preferred position and is also magnified as neces- w'=wϫx0/x1 (2) 40 sary. For instance, when a human object is photo- graphed in a center area of an image and it is intended to bring the human object near to a left-hand end h'=hϫw'/w (3) through trimming, merely by dragging a part of the hu- man object to a position at which it is desired to be ar- 45 ranged, the human object is moved and is also magni- y'=y+hϫy0/cHeight-h'ϫy1/cHeight (4) fied as necessary. As a result, it becomes possible to obtain an image having preferable composition through [0107] On the other hand, in the case of x≠0 shown a single operation. Also, it is possible to move the main in FIG. 5, the position, width, and height of the new clip- object to a preferable position while viewing an image ping frame are operated from the following equations. 50 to be finally printed, so that an easy-to-perform opera- tion is realized which can be done by intuition. Further, appropriate positions of the main object are displayed w'=w (5) using the grid as a guide, so that it becomes possible even for a beginner to obtain a photograph having favo- 55 rable composition with ease. x'=x-(x1-x0)ϫw/cWidth (6)

11 21 EP 1 408 452 A2 22

Sixth Embodiment a possibility that the user may be disturbed by a situation where many grid points are simultaneously displayed. [0112] In a sixth embodiment of the present invention, In view of this problem, only one grid point is displayed the grid display method of the fifth embodiment used in at a time, thereby realizing a simple display screen. step S1902 in FIG. 14 is improved. In the fifth embodi- 5 [0118] It should be noted here that the and size ment, one of the grids shown in FIGS. 16A to 16C is of the closest grid may be changed from those of other displayed in step S1902. In this sixth embodiment, how- grids, for instance. In this case, an effect is provided in ever, the grid to be displayed is changed in accordance that easy-to-view and convenient displaying is per- with the position at which the mouse pointer currently formed. exits. In this embodiment, the display screen, in which 10 [0119] According to this embodiment, when a user the mouse pointer is capable of moving, is vertically and drags a main object with a mouse while keeping the horizontally divided equally into two, with each part be- CTRL key pressed down, only a nearby main object ing referred to as an "upper left-hand area", an "upper point (grid point) that can give appropriate composition right-hand area", a "lower left-hand area", and a "lower is displayed on a screen in accordance with an operation right-hand area". The mouse pointer indicates the posi- 15 for moving the main object. As a result, it becomes pos- tion of the mouse and moves along with the movement sible even for an inexperienced user to perform a trim- of the mouse. ming process with ease. [0113] FIG. 18 is a flowchart showing a grid display [0120] Each of the embodiments described above process according to the sixth embodiment. In step may be realized through execution by a computer (or S1301, it is judged whether or not the mouse pointer is 20 the CPU 101 in the computer) of a program stored in a positioned in the upper left-hand area, and if a result of storage medium such as the ROM 102, the RAM 103, this judgment is affirmative, the process proceeds to or the HDD 104. Also, a means for supplying the pro- step S1305. In step S1305, as shown in FIG. 19A, only gram to the computer, such as a computer-readable re- a grid intersecting in the upper left-hand area is dis- cording medium like a CD-ROM recording this program played. If it is judged in step S1301 that the mouse point- 25 or a transmission medium such as the Internet for trans- er does not exist in the upper left-hand area, the process mitting the program, is applicable as a modification of proceeds to step S1302. the present invention. Further, a program product, such [0114] In step S1302, it is judged whether or not the as a computer-readable recording medium on which the mouse pointer is positioned in the upper right-hand ar- program has been recorded, is applicable as another ea, and if a result of this judgment is affirmative, the 30 modification of the present invention. The program, re- process proceeds to step S1306. In step S1306, as cording medium, transmission medium, and program shown in FIG. 19B, only a grid intersecting in the upper product described above are contained in the scope of right-hand area is displayed. If it is judged in step S1302 the present invention. As the recording medium, it is that the mouse pointer does not exist in the upper right- possible to use a flexible disk, a hard disk, an optical hand area, the process proceeds to step S1303. 35 disk, a magneto-optical disk, a CD-ROM, a magnetic [0115] In step S1303, it is judged whether or not the tape, a non-volatile memory card, or a ROM, for in- mouse pointer is positioned in the lower left-hand area, stance. and if a result of this judgment is affirmative, the process [0121] It should be noted here that each of the em- proceeds to step S1307. In step S1307, as shown in bodiments described above is merely a concrete exam- FIG. 19C, only a grid intersecting in the lower left-hand 40 ple, in which the present invention is carried out, and area is displayed. If it is judged in step S1303 that the therefore it should not be construed that the technical mouse pointer does not exist in the lower left-hand area, scope of the present invention is limited by those em- the process proceeds to step S1304. bodiments. That is, it is possible to carry out the present [0116] In step S1304, as shown in FIG. 19D, only a invention in various other forms without departing from grid intersecting in the lower right-hand area is dis- 45 the technical idea or major features of the present in- played. vention. [0117] When the four grids shown in FIGS. 19A to 19D [0122] As described above, according to the present are combined with each other, the grid shown in FIG. invention, at the time of trimming an image, an appro- 16A is obtained. When the main object is grasped and priate position of a main object in an image is indicated moved along with the mouse pointer, only one grid point, 50 by a grid or the like. As a result, it becomes possible out of four grid candidate points, that is closest to the even for an inexperienced user to obtain an image hav- mouse pointer is displayed. As described in the second ing suited composition through trimming. embodiment, the main object is moved so as to follow [0123] The present invention is not limited to the em- the mouse pointer. In this embodiment, only the grid bodiments described above and it is possible to make point closest to the mouse pointer is displayed, so that 55 various modifications and changes without departing it is possible for a user to grasp one optimum grid point, from the scope defined in the appended claims. among the multiple grid candidate points, that is close to the current position of the main object. Also, there is

12 23 EP 1 408 452 A2 24

Claims step to move the arbitrary point, the displaying step displays the predetermined area of the image data 1. An image editing method comprising the steps of: in the image display area based on the image move- ment amount, which is calculated in the calculation instructing to move an arbitrary point of an im- 5 step, without changing image size, and age displayed in an image display area among when it is ended that the instructing step in- image data; structs the movement of the arbitrary point, the dis- calculating an image movement amount and a playing step displays the predetermined area of the magnification ratio in response to the instruc- image data in the image display area based on the tion to move the arbitrary point; and 10 image movement amount and the magnification ra- displaying a predetermined area of the image tio, which are calculated in the calculating step. data in the image display area on the basis of image movement amount and the magnifica- 9. An image editing method according to claim 1, tion ratio, which are calculated in the calculat- wherein the calculating step calculates the ing step. 15 magnification ratio based on a post-movement point designated during the instruction in the in- 2. An image editing method according to claim 1, structing step. wherein the image display area is an image print area indicating an image area to be printed. 10. An image editing method according to claim 1, 20 wherein the calculating step calculates the 3. An image editing method according to claim 2, fur- magnification ratio based on a post-movement ther comprising: point designated at a start of the instruction in the instructing step. a step of instructing to print the image displayed in the image display area. 25 11. An image editing apparatus comprising:

4. An image editing method according to claim 1, means for instructing to move an arbitrary point wherein when it is instructed to move the ar- of an image displayed in an image display area bitrary point so that an end of the image data in a among image data; direction opposite to a moving direction is exceed- 30 means for calculating an image movement ed, the image is magnified based on an exceeding amount and a magnification ratio in response amount and the magnified image is displayed. to the instruction to move the arbitrary point; and 5. An image editing method according to claim 1, means for displaying a predetermined area of wherein the predetermined area of the image 35 the image data in the image display area on the data is displayed in the displaying step so that the basis of the image movement amount and the arbitrary point, whose movement is instructed in the magnification ratio, which are calculated by the instructing step, is moved to a post-movement point calculating means. regardless of the magnification ratio. 40 12. A program for causing a computer to execute an 6. An image editing method according to claim 1, image editing method, comprising: wherein the calculating step calculates the im- age movement amount and the magnification ratio instructing to move an arbitrary point of an im- so that the arbitrary point, whose movement is in- age displayed in an image display area among structed in the instructing step, is moved to the post- 45 image data; movement point without generating any margin in calculating an image movement amount and a the image display area. magnification ratio in response to the instruc- tion to move the arbitrary point; and 7. An image editing method according to claim 1, displaying a predetermined area of the image wherein while it is instructed in the instructing 50 data in the image display area on the basis of step to move the arbitrary point, the displaying step the image movement amount and the magnifi- displays the predetermined area of the image data cation ratio, which are calculated in the calcu- in the image display area based on the image move- lating step. ment amount and the magnification ratio, which are calculated in the calculating step. 55 13. A computer-readable recording medium on which a program for causing a computer to execute an im- 8. An image editing method according to claim 1, age editing method is recorded, the method com- wherein while it is instructed in the instructing prising:

13 25 EP 1 408 452 A2 26

instructing to move an arbitrary point of an im- to switch between displaying and non-displaying of age displayed in an image display area among the grid. image data; calculating an image movement amount and a 22. An image editing method according to claim 14, magnification ratio in response to the instruc- 5 wherein the trimming step performs the trim- tion to move the arbitrary point; and ming process by changing at least one of a size and displaying a predetermined area of the image a position of the image. data in the image display area on the basis of the image movement amount and the magnifi- 23. An image editing method according to claim 14, cation ratio, which are calculated in the calcu- 10 wherein the trimming step is arranged to lating step. change at least one of a size and a position of a trimming frame which is displayed on the image to 14. An image editing method comprising the steps of: indicate a trimming image area in accordance with a trimming instruction, and display the trimming performing a trimming process on image data 15 frame changed in at least one of the size and the in a trimming mode; and position, and displaying a grid on an image to be subjected the grid displaying step displays the grid in the to the trimming process when the trimming trimming frame changed in at least one of the size mode is set. and the position. 20 15. An image editing method according to claim 14, 24. An image editing method according to claim 14, wherein the trimming step performs the trim- wherein the grid displaying step displays fix- ming process in accordance with a trimming oper- edly a trimming image area and the grid in the trim- ation, and ming image area, and while it is detected that the trimming operation 25 the trimming step is arranged to change an is performed, the grid displaying step displays the image in the trimming image area in at least one of grid on the image. a size and a position in accordance with a trimming instruction and display the image changed in at 16. An image editing method according to claim 14, least one of the size and the position. wherein grid displaying step displays the grid 30 which suggests appropriate framing of a main ob- 25. An image editing method according to claim 14, ject in the image. wherein the trimming includes:

17. An image editing method according to claim 16, a step of instructing to move an arbitrary point wherein the grid displaying step displays the 35 of an image displayed in an image display area grid which divides the image based on a golden sec- among image data; tion. a step of calculating an image movement amount and a magnification ratio in response 18. An image editing method according to claim 17, to the instruction to move the arbitrary point; wherein the grid displaying step displays the 40 and grid which vertically and horizontally divides the im- a step of displaying a predetermined area of the age into equal parts. image data in a trimming image display area on the basis of the image movement amount and 19. An image editing method according to claim 18, the magnification ratio, which are calculated in wherein the grid displaying step displays the 45 the calculating step. grid which vertically and horizontally divides the im- age into at least one of three, four, and five equal 26. An image editing method according to claim 25, parts. wherein the grid displaying step displays a grid that is closest to a point instructed in the in- 20. An image editing method according to claim 17, 50 structing step, out of a plurality of grid candidates, wherein the grid displaying step displays the in a form that is different from that of other grids. grid which is obtained by drawing a diagonal line in a rectangular image and drawing perpendicular 27. An image editing method according to claim 14, fur- lines from remaining vertexes of the image to the ther comprising: diagonal line. 55 a step of instructing to print the image on which 21. An image editing method according to claim 14, the trimming process is performed. wherein the grid displaying step is arranged

14 27 EP 1 408 452 A2 28

28. An image editing method comprising the steps of:

performing a trimming process on image data in a trimming mode; and displaying, on an image to be subjected to the 5 trimming process, a mark suggesting appropri- ate framing of a main object in the image, when the trimming mode is set.

29. An image editing apparatus comprising: 10

means for performing a trimming process on image data in a trimming mode; and means for displaying a grid on an image to be subjected to the trimming process, when the 15 trimming mode is set.

30. An image editing apparatus comprising:

means for performing a trimming process on 20 image data in a trimming mode; and means for displaying, on an image to be sub- jected to the trimming process, a mark suggest- ing suited framing of a main object in the image, when the trimming mode is set. 25

31. A program for causing a computer to execute an image editing method, comprising:

a trimming module for performing a trimming 30 process on image data in a trimming mode; and a processing module for displaying a grid on an image to be subjected to the trimming process, when the trimming mode is set. 35 32. A program for causing a computer to execute an image editing method, comprising:

a trimming module for performing a trimming process on image data in a trimming mode; and 40 a processing module for displaying, on an im- age to be subjected to the trimming process, a mark suggesting suited framing of a main ob- ject in the image, when the trimming mode is set. 45

50

55

15 EP 1 408 452 A2

16 EP 1 408 452 A2

17 EP 1 408 452 A2

18 EP 1 408 452 A2

19 EP 1 408 452 A2

20 EP 1 408 452 A2

21 EP 1 408 452 A2

22 EP 1 408 452 A2

23 EP 1 408 452 A2

24 EP 1 408 452 A2

25 EP 1 408 452 A2

26 EP 1 408 452 A2

27 EP 1 408 452 A2

28 EP 1 408 452 A2

29 EP 1 408 452 A2

30 EP 1 408 452 A2

31 EP 1 408 452 A2

32 EP 1 408 452 A2

33 EP 1 408 452 A2

34 EP 1 408 452 A2

35