St . State-Snapshot Storage Process RP12
Total Page:16
File Type:pdf, Size:1020Kb
USOO8878833B2 (12) United States Patent (10) Patent No.: US 8,878,833 B2 De Laet (45) Date of Patent: Nov. 4, 2014 (54) SYSTEMS, METHODS, AND APPARATUS FOR 6,985,149 B2 1/2006 Peercy RECORDING OF GRAPHICAL DISPLAY 7.203,946 B2 4/2007 Johnson 7,450,129 B2 * 1 1/2008 Ruge ............................. 345,522 7,769,900 B1* 8/2010 Chalfin et al. TO9,247 (75) Inventor: Rick De Laet, Snellville, GA (US) 2002/0032751 A1* 3/2002 Bharadwaj .................... TO9.218 2002, 00832.17 A1 6, 2002 Ward (73) Assignee: Barco, Inc., Duluth, GA (US) 2002/O126144 A1 9, 2002 Chenede 2003/0001854 A1 1/2003 Jade (*) Notice: Subject to any disclaimer, the term of this 2003/0212742 A1* 11/2003 Hochmuth et al. ........... TO9.204 2004/0010622 A1 1, 2004 O'Neill patent 1s ised O lusted under 35 2004/006 1703 A1* 4/2004 Chik et al. .................... 345/467 U.S.C. 154(b) by 1197 days. 2004/0179007 A1 9, 2004 Bower 2005/0012754 A1 1/2005 Inuzuka et al. ............... 345/555 (21) Appl. No.: 11/838,791 2005/0081158 A1* 4/2005 Hwang .......... T15,740 2005/025,695.0 A1* 11/2005 Suzuki .......................... 709,223 (22) Filed: Aug. 14, 2007 2005/027.8455 A1 12/2005 Ichieda 2006/0090123 A1 4/2006 Denoue (65) Prior Publication Data (Continued) US 2008/OO42923 A1 Feb. 21, 2008 FOREIGN PATENT DOCUMENTS Related U.S. Application Data EP 1020841 A1 T 2000 (60) Provisional application No. 60/837,911, filed on Aug. EP 132O240 A2 6, 2003 16, 2006. OTHER PUBLICATIONS (51) Int. Cl. International Search Report for International Application No. PCT/ G06T I/00 (2006.01) IB2007/002362 (3 pp.), 2007. G05B 5/02 (2006.01) G06F 3/4 (2006.01) (Continued) (52) U.S.CPC Cl.606F 3/14 (2013.01); Gosh 1502 (2013.01); Primary Evominer Daniel Hajnik G06F 3/454 (2013.01) (74) Attorney, Agent, or Firm - Hartman Patents PLLC USPC .......................................................... 345/418 57 ABSTRACT (58) Field of Classification Search (57) None Embodiments include systems, methods, and apparatus con See application file for complete search history. figured to record (A) protocol requests that specify display operations on a screen image and (B) information copied (56) References Cited from a display buffer storing the screen image. Such embodi ments may also be configured to record states relating to an U.S. PATENT DOCUMENTS appearance of an output of the display operations. In some of 5,893,053 A * 4, 1999 Trueblood .................... 7O2,187 these embodiments, the copied information is stored in the 6,314,470 B1 1 1/2001 Ward form of pseudo-protocol requests. 6,724,385 B2 * 4/2004 Takatsuka et al. ............ 345/427 6,874,149 B1 3/2005 Bermudez 19 Claims, 30 Drawing Sheets - - - - - - - - - - - - - st . state-snapshot storage process RP12 SSP 1 display See S30 cent 40 display SP2O device 6 US 8,878,833 B2 Page 2 (56) References Cited BarcoView, LLC. Barco PCI Products on the HP-UX 10.20 X11R6 DDX Layer, P/N 072375 E. 2003. 13 pp. U.S. PATENT DOCUMENTS BarcoView. VisonaTM Display Server, Ref. ATC 04-006. Dec. 2004. 2 pp. 2006, O159080 A1 7/2006 MaZZaferri Challen, R. Recording Video Without Video Recording for ATC 2006, O159432 A1 7/2006 MaZZaferri Event Analysis. Journal of Air Traffic Control, Jan.-Mar. 2000, pp. 2006/O161555 A1 7/2006 MaZZaferri 11-13. 2006, O161671 A1 7/2006 Ryman 2006, O161959 A1 7/2006 Ryman How To: Record Videos of Your Desktop. Last accessed Aug. 14. 2006/0170706 A1* 8, 2006 Hoffman et al. .............. 345,629 2007 at http://wolphination.com/linux/2006/06/30/how-to-record 2007/010681.0 A1 5/2007 Ryman videos-of-your-desktop. 32 pp. 2007/0211065 A1* 9, 2007 Feth et al. ..................... 345,522 VirtualGL-09-20040825 RPM for i386. Last accessed Aug. 14, 2007 at http://rpmfind.net/linux/RPM/sourceforge?vivi. virtualgl/ OTHER PUBLICATIONS VirtualGL-09-20040825. i386.html. 2 pp. Remote 3D and You. Last accessed Aug. 1, 2006 at http://virtualgl. Written Opinion of the International Searching Authority for Inter Sourceforge.net/background.htm. 6 pp. national Application No. PCT/IB2007/002362 (6 pp.), 2007. 8.7 Transferring Images between Client and Server. Last accessed Hughes, DW. U.S. Appl. No. 60/735,962. Media Fusion Remote Aug. 14, 2007 at http://tronche.com/gui/X/Xlib/graphics/images. Access. filed Nov. 14, 2005. 42 pp. html. 1 p. BarcoView, LLC. VPCI5605 User's Manual, P/N 072322B, Oct. X-Software X-POSE-X-RECORD Info. Last accessed Aug. 14, 2007 2000. 32 pp. at http://www.x-software.com/en/Products/X-POSE-X-RECORD/ BarcoView, LLC. PVS Series User's Manual, P/N 072397C. Mar. info.html. 4 pp. 2001. 68 pp. X-POSE-X-RECORDManual. Last accessed Aug. 14, 2007 at http:// Barco Inc., Display Systems. X Windows X11R6 Specification, PN www.x-Software.com/en/ProductS/X-POSE-X-RECORD, Manualf 072169H. Jun. 1998. 22 pp. X-POSE-X-RECORD-en.pdf. 92 pp. BarcoView, LLC. PCI Series User's Manual, P/N 072228Q. Oct. 2000. 70 pp. * cited by examiner U.S. Patent Nov. 4, 2014 Sheet 1 of 30 US 8,878,833 B2 so??de16 U.S. Patent Nov. 4, 2014 Sheet 2 of 30 US 8,878,833 B2 ú0||03uuOO a23----------~~ U.S. Patent Nov. 4, 2014 Sheet 3 of 30 US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 4 of 30 US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 5 Of 30 US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 6 of 30 US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 7 Of 30 US 8,878,833 B2 30?dsKuouuauu J."SO|- U.S. Patent US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 10 of 30 US 8,878,833 B2 0$|8 U.S. Patent Nov. 4, 2014 Sheet 11 of 30 US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 12 of 30 US 8,878,833 B2 õFluelo U.S. Patent Nov. 4, 2014 Sheet 14 of 30 US 8,878,833 B2 0$.SS U.S. Patent US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 16 of 30 US 8,878,833 B2 Ž??S —<^ ~~~~) U.S. Patent US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 19 Of 30 US 8,878,833 B2 |uue1604d |Z\,dS U.S. Patent Nov. 4, 2014 Sheet 20 of 30 US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 21 of 30 US 8,878,833 B2 t 8) w A. Q. es U.S. Patent Nov. 4, 2014 Sheet 22 of 30 US 8,878,833 B2 e S .. s U.S. Patent Nov. 4, 2014 Sheet 23 of 30 US 8,878,833 B2 |?TTeoepie?u U.S. Patent Nov. 4, 2014 Sheet 24 of 30 US 8,878,833 B2 shqalebeueiu? ZZ"SOH-] U.S. Patent Nov. 4, 2014 Sheet 27 Of 30 US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 28 of 30 US 8,878,833 B2 U.S. Patent Nov. 4, 2014 Sheet 29 Of 30 US 8,878,833 B2 OOOOOOOOOOOOOOOOOOOOOOOOOOOOM -oooooooo. OOOOOOOOOOOOOOOOO S.ser 3t 5 | | 8 O C EN s .. se a CD Sw & sr s s s U.S. Patent Nov. 4, 2014 Sheet 30 of 30 US 8,878,833 B2 809‘SOH-] US 8,878,833 B2 1. 2 SYSTEMS, METHODS, AND APPARATUS FOR FIG. 1B shows a diagram of a display server 10 in com RECORDING OF GRAPHICAL DISPLAY munication with multiple clients. FIG. 1C shows a block diagram of a system including an RELATED APPLICATIONS implementation 12 of display server 10. FIG. 2A shows a block diagram of a system including an This application claims benefit of U.S. Provisional Pat. implementation 14 of display server 10. Appl. No. 60/837,911, entitled “SYSTEMS, METHODS, FIG. 2B shows an example of a socket driver supporting AND APPARATUS FOR RECORDING OF GRAPHICAL communication between two user processes. DISPLAY.” filed Aug. 16, 2006. FIG. 3 shows two views of an IsonatM display station 10 (BarcoView, Kortrijk, Belgium and Duluth, Ga.). FIELD FIG. 4 shows a block diagram of a system including an implementation DS10 of display server 10. This disclosure relates to graphical display systems. FIG. 5 is a diagram showing a relation between a dispatch table of a process and Subroutines stored in a memory space of BACKGROUND 15 the process. FIG. 6 is a diagram illustrating a dispatch loop of an X Graphical display systems may be used in real-time appli SeVe. cations, such as process control or traffic management, in FIG. 7 is a diagram showing a modification of the arrange which a graphical display is being continually, regularly, or ment of FIG. 6. intermittently updated. FIG. 8 is a diagram showing a relation between an exten Flight recorders are used in aircraft to record critical data sion dispatch table and a mini-dispatch table that corresponds and events for analysis in an air catastrophe or emergency to one of the extensions. situation. Such recording capability is also a requirement for FIG. 9 shows a block diagram of a system including an major air traffic control (ATC) center upgrade systems. While 25 implementation DS20 of display server DS10. it is possible simply to record the position and altitude of each FIG.