United States Patent (19) 11 Patent Number: 5,904,729 Ruzicka (45) Date of Patent: May 18, 1999
Total Page:16
File Type:pdf, Size:1020Kb
USOO5904729A United States Patent (19) 11 Patent Number: 5,904,729 Ruzicka (45) Date of Patent: May 18, 1999 54 AUTOMATED DIRECTOR LIGHT SYSTEM 57 ABSTRACT FOR AERIAL REFUELING OPERATIONS A method and apparatus for generating visual information 75 Inventor: Dennis E. Ruzicka, Enumclaw, Wash. for an operator in a first aircraft and a pilot in a Second aircraft regarding the Second aircraft's position relative to a 73 Assignee: The Boeing Company, Seattle, Wash. first aircraft. A 3-D camera System (72) generates a real time 3-D video image of the Second aircraft. A Selecting device 21 Appl. No.: 08/810,417 (82) provides selection of a stored geometric model based on the Second aircraft type. A display monitor (83) displays the 22 Filed: Mar. 4, 1997 generated real time 3-D video image and the Selected geometric model. A matching device (84) matches the (51) Int. Cl. ............................................... B64D 39/00 displayed geometric model to the displayed real time 3-D 52 U.S. Cl. .................. 701/300; 24.4/135 A; 24.4/135 R Video image. A processor (84) determines the position of the 58 Field of Search ................. 704/3, 300; 24.4/135 R, Second aircraft relative to Stored Zone information according 244/135 A, 161; 348/113, 116, 117; 340/958 to the matched geometric model and generates control Signals according to the determined Second aircraft position. 56) References Cited Director lights (88) mounted on the outside of the first U.S. PATENT DOCUMENTS aircraft display position information visible to the pilot of the Second aircraft according to the generated control Sig 5,810,292 9/1998 Garcia, Jr. et al. ................. 244/135 R nals. The monitor also displays the position of the Second Primary Examiner-Gary Chin aircraft relative to a boom. Attorney, Agent, or Firm-Christensen O'Connor Johnson & Kindness PLLC 9 Claims, 18 Drawing Sheets 72 74 CAMERA SYSTEM B00 OPERATOR INTERFACE 90 LEFT CCD CAMERAS INTERFACE DEVICE MONITOR 80 WIDEO IMACE PROCESSOR IMACE CENERATOR MEMORY 84 PROCESSOR 85 ZONE BOUNDARY LOCIC FILE DIRECTING LIGHT SYSTEM 78 SWITCHINC, UNIT 86 LICHT ARRAYS U.S. Patent May 18, 1999 Sheet 1 of 18 5,904,729 6-INCH LONCITUDINAL, BLACK STRIPE DOWN INDICATOR FORWARD INDICATOR UP INDICATOR KC-135 52. 7 (PRIOR ART) U.S. Patent May 18, 1999 Sheet 2 of 18 5,904,729 PILOT DIRECTOR LICHT (ELEVATION) PILOT DIRECTOR LICHT (TELESCOPE) PILOT DIRECTOR LIGHTS - B00M 572. 2 (PRIOR ART) U.S. Patent May 18, 1999 Sheet 3 of 18 5,904,729 74 72 CAMERA SYSTEM B00M OPERATOR INTERFACE 90 LEFT CCD CAMERAS INTERFACE DEVICE RIGHT CCD CAMERA MONITOR 80 WIDEO IMACE PROCESSOR IMACE CENERATOR Bf MEMORY 84 PROCESSOR 85 ZONE BOUNDARY LOCIC FILE DIRECTING LIGHT SYSTEM 78 SWITCHING UNIT 86 LIGHT ARRAYS 88 U.S. Patent May 18, 1999 Sheet 4 of 18 5,904,729 U.S. Patent May 18, 1999 Sheet 5 of 18 5,904,729 U.S. Patent May 18, 1999 Sheet 6 of 18 5,904,729 104 94 ff f 17 U.S. Patent May 18, 1999 Sheet 7 of 18 5,904,729 U.S. Patent May 18, 1999 Sheet 8 of 18 5,904,729 U.S. Patent May 18, 1999 Sheet 9 of 18 5,904,729 DONDOCG DD << S U.S. Patent May 18, 1999 Sheet 10 0f 18 5,904,729 CENERATE A REAL-TIME f56 3-D IMACE OF THE RECEIWINC AIRCRAFT RETRIEVE CEOMETRIC MODEL L/ MATCH CEOMETRIC MODEL 160 TO 3-D AIRCRAFT IMACE AND TRACK AIRCRAFT IMACE DETERMINE RECEIWINC AIRCRAFT f62 RECEPTACLE POSITION RELATIVE TO OPTIMUM CONTACT POINT ACCORDING TO DISPLAYED CEOMETRIC MODEL AND STORE) REFUELINC ZONE INFORMATION CONTROL DIRECTOR LIGHTS AND f64 B00M OPERATOR DISPLAY ACCORDING TO DETERMINED RECEPTACLE POSITION 52. 77 U.S. Patent May 18, 1999 Sheet 11 of 18 5,904,729 142 48 f46 150 U.S. Patent May 18, 1999 Sheet 12 of 18 5,904,729 142 U.S. Patent May 18, 1999 Sheet 13 0f 18 5,904,729 0s C CD CD B f 2RR Z O (7) s7 PRR acB, 7 4-N P CB ON C RR SIDE WIEW OF CB RANCE ZONES 52. 74 U.S. Patent May 18, 1999 Sheet 14 of 18 5,904,729 çZ<%- H/"Zhy U.S. Patent May 18, 1999 Sheet 15 0f 18 5,904,729 U.S. Patent May 18, 1999 Sheet 16 of 18 5,904,729 U.S. Patent May 18, 1999 Sheet 17 0f 18 5,904,729 U.S. Patent May 18, 1999 Sheet 18 of 18 5,904,729 90 g - 5,904,729 1 2 AUTOMATED DIRECTOR LIGHT SYSTEM the block occurs for a few Seconds or more, a disconnect FOR AERIAL REFUELING OPERATIONS procedure may initiate or the System may continue present ing the last determined receiver aircraft position. In the latter FIELD OF THE INVENTION case, the light arrays would therefore display the last deter mined receiver aircraft position information, which could be This invention relates to air-to-air refueling director light dangerously inaccurate. Also, reflectors must be mounted on Systems and, more particularly, an improved director light thousands of receiving aircraft and optical Sensor Systems System for generating more accurate refueling Zone and mounted onto the tanker aircraft fleet. This and the mainte approach information. nance required could be prohibitively expensive as com BACKGROUND OF THE INVENTION pared to just maintaining the old System. Accordingly, there is a need for a light System that Aerial refueling tanker airplanes use aerial refueling presents accurate and consistent receiving aircraft and booms for transferring fuel to various types of receiving receiving aircraft receiving nozzle pre-contact position aircraft. The present U.S. Air Force operational tanker fleet information to the pilot of a receiving aircraft at all times (KC-135 and KC-10) utilizes director light systems that 15 during refueling. The approach information provided by the provide direction queuing to receiver pilots after contact has light System to the receiving aircraft pilot should be Suffi been made between the refueling boom nozzle and the cient to allow the pilot to gradually work the receiving receiving aircraft's receptacle. Operation of the director aircraft to a desired position for coupling with the refueling light System is automatic in the contact mode. The director boom. The present invention is directed to providing Such a light system includes two light arrays, as shown in FIGS. 1 refueling light System. and 2. The two light arrays include longitudinally positioned lights that display present contact position relative to the SUMMARY OF THE INVENTION optimum contact position. The display presents longitudinal In accordance with this invention a method and apparatus and Vertical information important to the pilot of the receiv for generating visual information for an operator in a first ing aircraft. The reference for the presented information is 25 aircraft and a pilot in a Second aircraft regarding the Second the refueling aircraft. The light arrayS may be operated aircraft's position relative to a first aircraft are provided. The manually by the boom operator using visual cues or by a apparatus includes a 3-D camera System that generates a real determination of the present contact position. The present time 3-D video image of the Second aircraft. A first memory contact position is determined according to refueling boom Stores at least one geometric model of at least one aircraft. elevation position and telescopic length Sensing of the A Selecting device provides Selection of a Stored geometric refueling boom when the refueling nozzle and the receiving model according to the Second aircraft type. A display device aircraft's receptacle are coupled. FIGS. 1 and 2 illustrate the displays the generated real time 3-D video image and the director light systems presently used a KC-135s and Selected geometric model. A matching device matches the KC-10s, respectively. The light assemblies for both the displayed geometric model to the displayed real time 3-D KC-135 and KC-10 are positioned on the lower fuselage just 35 Video image. A Second memory Stores predefined Zone forward of the wings leading edge. The row of lights on the information. A processor determines Second aircraft position port Side of the aircraft indicates aircraft elevation relative to relative to the Stored Zone information according to the optimum fueling position. The row of lights on the Starboard matched geometric model and generates control signals Side of the fuselage indicates refueling boom telescoping according to the determined Second aircraft position. Direc position or the aircraft's fore and aft position relative to the 40 optimum refueling point. These Systems are effective tools tor lights mounted on the outside of the first aircraft display for generating accurate contact position information. Also, position information visible to the pilot of the second aircraft they are relatively simple light arrays which are easy for according to the generated control Signals. pilots to understand. This ease in understanding helps lessen In accordance with other aspects of this invention, the the receiving pilot's task load, which is already quite large 45 Zone information includes a predefined elevation plane, a with management of complicated Systems internal to the fore/aft plane and an azimuth plane referenced from a aircraft. However, this System only presents contact position predefined point relative to the first aircraft. The control information. Getting to the contact position can be half the Signals include elevation, range and azimuth Signals deter battle for receiving aircraft pilots, especially, if that pilot is mined according to the determined Second aircraft position greatly fatigued or stressed as a result of a difficult Sortie, 50 relative to the predefined elevation plane, fore/aft plane and bad weather, or an emergency of Some Sort.