Methods Apparatus, Including Computer Program Prod Brooklyn NY (Us) Ucts, for a Light Painting Live View
Total Page:16
File Type:pdf, Size:1020Kb
US 20150042832A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2015/0042832 A1 Warnberg et al. (43) Pub. Date: Feb. 12, 2015 (54) LIGHTPAINTING LIVE VIEW (52) US. Cl. CPC ....... .. H04N 5/2621 (2013.01); H04N 5/23293 (71) ApplicantszRyan Harrison Warnberg, Brooklyn, (201301) NY (U S); Michelle Kirstin McSwain, USPC ...................................... .. 348/2181; 348/239 Brooklyn, NY (U S) (57) ABSTRACT (72) Inventors' §¥anwgir?sig?emaigtgi? geosovligi?” Methods apparatus, including computer program prod Brooklyn NY (Us) ucts, for a light painting live View. A method includes, in a ’ device comprising at least a processor, a memory, a display (21) APPL NO; 13/964,155 and a camera device having an on-screen view?nder, access ing the camera, capturing individual frames of footage, each (22) Filed; Aug_ 12, 2013 of the captured frames being displayed through the on-screen view?nder in cumulative succession, rendering the captured Publication Classi?cation frames on a graphical processing unit (GPU), sending the captured frames through a shader program, generating at least (51) Int. Cl. two images, a ?rst image saved to the memory and a second H04N 5/262 (2006.01) image displayed on the display, and rendering the ?rst image H04N 5/232 (2006.01) into the second image to generate a ?nal image. 100 Access the camera 105 Render the captured frames on a GPU m Send captured frames through a shader program 115 Save one image to memory 120 Display one image on display 125 Render one image into the other image m Convert the image that is rendered into the memory to a JPEG ?le ? Patent Application Publication Feb. 12, 2015 Sheet 1 of 2 US 2015/0042832 A1 Processor ? Memory Q 0/ S Q Process m GPU i Display Q Camera ? FIG. 1 Patent Application Publication Feb. 12, 2015 Sheet 2 of 2 US 2015/0042832 A1 10 Access the camera 105 Render the captured frames on a GPU m Send captured frames through a shader program 115 Save one image to memory 120 Display one image on display 125 Render one image into the other image 130 Convert the image that is rendered into the memory to a J PEG ?le & FIG. 2 US 2015/0042832 A1 Feb. 12, 2015 LIGHTPAINTING LIVE VIEW on- screen view?nder in cumulative succession, rendering the captured frames on a graphical processing unit (GPU), send CROSS REFERENCE TO RELATED ing the captured frames through a shader program, generating APPLICATIONS at least two images, a ?rst image saved to the memory and a [0001] This application claims the bene?t of US. Provi second image displayed on the display, and rendering the ?rst sional Application No. 61/693,795, ?led Aug. 28, 2012. The image into the second image to generate a ?nal image. disclosure of the prior application is considered part of and is [0010] These and other features and advantages will be incorporated by reference in the disclosure of this application. apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood BACKGROUND OF THE INVENTION that both the foregoing general description and the following detailed description are explanatory only and are not restric [0002] The present invention generally relates to devices tive of aspects as claimed. having a camera feature, and more particularly to a light painting live view. BRIEF DESCRIPTION OF THE DRAWINGS [0003] Like cameras, smartphones, such as the Apple iPhone®, Samsung Galaxy®, Blackberry Q10® and the like, [0011] The invention will be more fully understood by ref and tablet computers running, for example, Google’s erence to the detailed description, in conjunction with the Android® operating system (/S) and Apple’s iOS® O/S, following ?gures, wherein: include among their features, built-in cameras for taking pho [0012] FIG. 1 is a block diagram of an exemplary smart tos. Applications executing in the smartphones and tablet phone. computers enable control of the built-in cameras, including [0013] FIG. 2 is a ?ow diagram of an exemplary light light painting. painting live view process. [0004] In general, light painting is a photographic tech nique, often performed at night or in a dark area, where a DETAILED DESCRIPTION photographer can introduce different lighting elements dur ing a single long exposure photograph. light painting enables [0014] The subject innovation is now described with refer the capture of light trails, light graf?ti tags, and so forth. ence to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following SUMMARY OF THE INVENTION description, for purposes of explanation, numerous speci?c details are set forth in order to provide a thorough understand [0005] The following presents a simpli?ed summary of the ing of the present invention. It may be evident, however, that innovation in order to provide a basic understanding of some the present invention may be practiced without these speci?c aspects of the invention. This summary is not an extensive details. In other instances, well-known structures and devices overview of the invention. It is intended to neither identify key are shown in block diagram form in order to facilitate describ or critical elements of the invention nor delineate the scope of ing the present invention. the invention. Its sole purpose is to present some concepts of [0015] As used in this application, the terms “component,” the invention in a simpli?ed form as a prelude to the more “system,” “platform,” and the like can refer to a computer detailed description that is presented later. related entity or an entity related to an operational machine [0006] The present invention provides methods and appa with one or more speci?c functionalities. The entities dis ratus, including computer program products, for a light paint closed herein can be either hardware, a combination of hard ing live view. ware and software, software, or software in execution. For [0007] In general, in one aspect, the invention features a example, a component may be, but is not limited to being, a method including, in a device including at least a processor, a process running on a processor, a processor, an object, an memory, a display and a camera device having an on-screen executable, a thread of execution, a program, and/or a com view?nder, accessing the camera, capturing individual puter. By way of illustration, both an application running on frames of footage, each of the captured frames being dis a server and the server can be a component. One or more played through the on-screen view?nder in cumulative suc components may reside within a process and/or thread of cession, rendering the captured frames on a graphical pro execution and a component may be localized on one com cessing unit (GPU), sending the captured frames through a puter and/or distributed between two or more computers. shader program, generating at least two images, a ?rst image Also, these components can execute from various computer saved to the memory and a second image displayed on the readable media having various data structures stored thereon. display, and rendering the ?rst image into the second image to The components may communicate via local and/or remote generate a ?nal image processes such as in accordance with a signal having one or [0008] In another aspect, the invention features a method more data packets (e.g., data from one component interacting including, in a device including at least a processor, a with another component in a local system, distributed system, memory, a display and a camera device, executing a light and/or across a network such as the Internet with other sys painting live view process in conjunction with the camera to tems via the signal). provide a long exposure camera that displays a creation of an [0016] In addition, the term “or” is intended to mean an exposure in real time. inclusive “or” rather than an exclusive “or.” That is, unless [0009] In still another aspect, the invention features an speci?ed otherwise, or clear from context, “X employs A or apparatus including a processor, a memory, a display, and a B” is intended to mean any of the natural inclusive permuta camera device, the memory including a light painting live tions. That is, ifX employs A, X employs B, or X employs view process, the light painting live view process including bothA and B, then “X employs A or B” is satis?ed under any accessing the camera, capturing individual frames of footage, of the foregoing instances. Moreover, articles “a” and “an” as each of the captured frames being displayed through the used in the subject speci?cation and annexed drawings should US 2015/0042832 A1 Feb. 12, 2015 generally be construed to mean “one or more” unless speci [0026] As shown om FIG. 2, the light painting live view ?ed otherwise or clear from context to be directed to a singu process 100 accesses (105) the camera, which captures indi lar form. vidual frames of footage, each of the captured frames dis [0017] As shown in FIG. 1, an exemplary device 10 played on a view?nder in cumulative succession. includes at least a processor 15, a memory 20, a display unit [0027] While frames are being captured by the camera, the 25, a camera 30 and a graphical processing unit (GPU) 35. light painting live view process 100 renders (110) the cap Example devices 10 include DSLR cameras, smartphones, tured frames on a graphical processing unit (GPU), which is tablet computers, personal data assistants, digital televisions, a user-facing camera “view?nder” feature of the light paint computers, laptops, devices with an integrated digital camera ing live view process 100.