Emo$onally Looking Eyes 2012 Winter vacaon internship Gahye Park Introduc$on • Overview – Review – Goal • Progress summary • Progress – Weekly progress & Difficules • Conclusion Overview - Review • Volume Rendering – Rendering data set like a group of 2D slice images ac quired by a CT, MRI, or MicroCT scanner • Volume ray cas$ng – Ray cas$ng, Sampling, Shading, Composing Overview - Review • Exis$ng eyeball rendering – Eyeball • Ar$ficial 3D model – Iris • Paste texture • Overlapped semi-transparent layers – Ar$ficial data – Lack of depth informaon Overview - Goal • Rendering emo$onally looking eyes – Real anatomical data – Include human $ssue informaon → Natural liveliness Progress Summary • Find eyeball or similar 3rd • Learn voreen (video, programming tutorials) • Render data similar to eyeball by • Find volume data and render it by voreen week voreen(VOlume REndering ENgine) • Learn voreen(slides tutorial) th • Get scanned eyeball data 4 • Find dicom data for segmentaon • Extract and refine eyeball data week • Extract eyes and check this briefly using Seg3D and voreen • 30, 2/1 : hci 2013 5th • Refine and finish extrac:ng 2 ct results • Adjust OTF(Opacity Transfer Func$on) week table • Parcipate HCI conference 1st • Finish adJus:ng o table • Adjust OTF table and shader week • Learn volume rendering tutorial for shader coding 2nd • Adjust OTF table and shader week • vacaon • Lunar new year & Vacaon rd • vacaon 3 • Vacaon week • Analyze results and improvement 4th • Consider expected effect • Analyze exis:ng shader code week • Complete the project • Prepare progress the presentaon Progress (Jan. 3rd week) • Find volume data set – The Volume Library head data set Descripon Picture MRI Head 14M 256x256x256 MRI Woman 7.7M 256x256x109 CT Visible Male 2.8M 128x256x256 Progress (Jan. 3rd week) • Refine and render the data by voreen Clip glslRaycaster Adjust OTF Table → singleVolumeRaycaster Voreen(VOlume REndering ENgine) • Framework – Core library : Processors, ports, proper$es – Qt library : GUI components Progress (Jan. 3rd week) • Difficules – no separated eyeball data → segmentaon method is required – low resoluon → find other data Progress (Jan. 4th week) • DICOM(Digital Imaging and Communicaons in Medi cine) sample image sets – Available for segmentaon (image series) – Higher resolu$on – 2 ct samples and 2 mr samples Progress (Jan. 4th week) • Extract eyes and check briefly using Seg3D and voreen Progress (Jan. 4th week) • Difficules – MR data is sparse → use ct data Progress (Jan. 5th week) • Refine and finish extrac$ng 2 ct results – segment again • Adjust OTF Table Progress (Jan. 5th week) • Difficules – Segment and Adjust o table manually – Insufficient in adjus$ng glsl raycaster OTF Table Progress (Feb. 1st week) • Learn local volume illuminaon tutorial – Prepare to shader coding – part of euro graphics 2006 – ambient + diffuse + specular – Volume illuminaon types • Alenuaon and single/mul$ple scaering Progress (Feb. 1st week) • Volume lighng : normalized gradient vector – Es$mate by finite differences • Forward, backward, central difference – Gradient-based illuminaon • Pre-computed Gradients : Use an addi$onal texture • On-the-fly Gradient Es$maon • On-the-fly Direc$onal Derivave : Approximate dot product Progress (Feb. 4th week) • Analyze exis$ng shader code – glsl raycaster Processor • Support ray cas$ng based on GLSL(shading language for OpenGL) • Have Shader property – Vertex shader, fragment shader, geometry shader – Shader code : .frag file Progress (Feb. 4th week) • Analyze exis$ng shader code Progress (Feb. 4th week) Progress (Feb. 4th week) Conclusion • Compleon – Adjust glsl raycaster OTF Table – Modify Shader code – Complement Eye ball CT data by combining MRI dat a • Impression Thank you .