US005742279A United States Patent 1191 [11] Patent Number: 5,742,279 Yamamoto et al. [45] Date of Patent: Apr. 21, 1998

[54] INPUT/DISPLAY INTEGRATED 5,446,669 8/1995 Birk . INFORMATION PROCFSSING DEVICE 5,455,898 10/1995 Mahoney et al. . [75] Inventors: Hiroshi Yamamoto, Katano; Yasuharu FOREIGN PATENT DOCUNIENTS Shimeki, Suita; Kazuhiro Kayashima, 568161 11/1993 European Pat. OE. . Hirakata; Susumu Maruno, Osaka; 93/20536 10/1993 WIPO . Makoto Fujimoto, Ibaraki; Yoshihiro Kojima, Kobe, all of Japan Primary Examiner'—Regina Liang Attorney, Agent, or Firm-Beveridge, DeGrandi, Weilacher [73] Assignee: Matsushita Electrical Co., Ltd., & Young, L.L.P. Osaka, Japan [57] ABSTRACT [21] Appl. No.: 337,372 An input/display integrated information processing device [22] Filed: Nov. 8, 1994 has: image display circuit for displaying document and image information; image input circuit through which infor [30] Foreign Application Priority Data mation of an image such as a picture, a photograph, docu ments drawn or written on a sheet presented by the user can Nov. 8, 1993 [JP] Japan ...... 5-278617 be an input; a visual coincidence structure for integrally Apr. 12, 1994 [JP] Japan ...... 6-073201 combining a display screen of the image display circuit with Jul. 29, 1994 [JP] Japan ...... 6-178079 Aug. 3, 1994 [JP] Japan 6-182288 an input screen of the image input circuit so as to establish Aug. 12, 1994 [JP] Japan ...... 6-190465 visual coincidence of screens as viewed from the user; contact information detection circuit for, when a ?nger of the [51] 1m. (:1.6 ...... G09G 5/00 user, the sheet presented by the user, or the like makes [52] Us. (:1...... 345/173; 345/175 contact with the contact information detection circuit, [58] Field of Search ...... 178/18, 20, 19; detecting information of a contact position, the contact 348/589, 600, 601; 358/505, 509, 512-514, information detection circuit being disposed on the whole of 448, 450; 345/ 173-179 the input screen of the image input circuit or the display screen of the image display circuit; image extraction circuit [56] References Cited for automatically extracting only a required portion from U.S. PATENT DOCUMENTS image information input through the image input circuit; image information storage circuit for storing the image 4,555,590 11/1985 Kishi et al...... 178/18 information; image synthesize circuit for combining the 4,763,356 8/1988 Day, Jr. et al. 178/18 X image with an image which is already displayed and stored; 4,989,040 l/199l Matsuo et a1. 178/18 X and image information control circuit for controlling input! 5,019,865 5/1991 Tanaka et a1...... 178/18 X output operations of the image information. 5,223,677 6/1993 Kapp et a1. . 5,239,373 8/1993 Tang et al. . 5,340,978 8/1994 Rostoker et a1. . 8 Claims, 21 Drawing Sheets

DOCUMENT NO. 1

£000 1 i3 DOCUMENT NO. 2

SENSOR . ' SCREEN \ IMAGE " SYN’I‘EIESIZE MEANS 7 _

IMAGE INFORMATION CONTROL MEANS 8

IMAGE INFORMATION S‘TORAGE MEANS J6

US. Patent Apr. 21, 1998 Sheet 3 0f 21 5,742,279

‘Ill’qm0k

im2m QEFUMELME,EEHJ FmmEw.ma?a

U.S. Patent Apr. 21, 1998 Sheet 5 0f 21 5,742,279

MC

KEMQEENXIK *EEEBE:teuwexaa MQQM..v.Q

(nA

I Mmum? . mtexacxma US. Patent Apr. 21, 1998 Sheet 6 of 21 5,742,279

ww m@

Ill 2m;

E

22EIv a Em?

mm

U.S. Patent Apr. 21, 1998 Sheet 9 0f 21 5,742,279

ANS PZWEEIOE / ZOHwvFEXM

AmV A: US. Patent Apr. 21, 1998 Sheet 10 0f 21 5,742,279 wmmvmmx? HEQMMQUEé

CVEmmi.zoHHSmw< -mm?mOH Amv

US. Patent Apr. 21, 1998 Sheet 19 of 21 5,742,279

112mm" £8321EEEwzEk hilt-EU

...... vESzwOSzH. \//

Ag 23 nHvmWH..Mw.H