<<

Chester F. Carlson Center for Imaging Science 2009 Annual Report

Table of Contents

Foreword...... 5

Academics...... 7 Imaging Science Undergraduate Program...... 7 Digital Cinema Program...... 11 Imaging Science Graduate Program...... 13 Color Science Graduate Program...... 17 Astrophysical Sciences and Technology Graduate Program...... 21

Research...... 25 Digital Imaging and Remote Sensing Lab...... 25 Laboratory for Imaging Algorithms and Systems...... 31 Munsell Color Science Laboratory...... 39 Rochester Imaging Detector Laboratory...... 45 Printing Research and Imaging System Modeling Lab...... 49 Multidisciplinary Vision Research Laboratory...... 53 Biomedical Imaging Laboratory...... 57 Magnetic Resonance Imaging Laboratory...... 63 Optics...... 65 Nanoimaging Research Laboratory...... 67 Laboratory for Space Alert Technologies Astronomical Imaging...... 69 Historical Manuscript Restoration...... 71

Outreach...... 73 The RIT Insight Lab for Science Outreach and Learning Research...... 73 Prospective Student Outreach Programs...... 77

Alumni...... 81 Featured Alumnus—Mahdi Nezamabadi and Mahnaz Mohammadi...... 81

3

Forward

university | NEWS ❯❯

September 19, 2008 By Susan Gawlowicz As director of the Center for Imaging Science, Baum has Challenges of female scientists explored in new sought ways to increase the representation of girls in sci- essay collection ence and women in academia. She started a series of annual programs with the Girl Scouts of Genesee Valley through No one talks about it much, but if you’re a female scientist, the center. Baum is also working with Margaret Bailey, Kate you’re faced with it every day: the challenge of being a serious Gleason Endowed Chair and associate professor of mechani- scientist and an ideal mother. Those who haven’t made the cal engineering, who won a National Science Foundation grant choice must decide what they can live with: foregoing mother- to increase the participation and advancement of women in hood for a career in science or a career in science instead of academic science and engineering careers. motherhood, or finding a way to meld the two. Baum, when at the Space Telescope Science Institute before Motherhood, the Elephant in the Laboratory: Women Scientists coming to RIT, headed the engineering division supporting the Speak Out, edited by Emily Monosson and published by ILR Hubble ground systems and supervised 140 engineers, . Press, is a collection of 34 essays by mother-scientists who scientists and support staff. share their stories and insights on achieving balance and . Dear Readers, defining success. In addition, Baum led the team working on a new instrument to be placed on Hubble called the Space Telescope Imaging Once again we have the pleasure of reporting out to you on RIT scientist Stefi Baum contributed her insights in the essay, Spectrograph. Baum and her husband took the family to Cape the myriad activities and achievements of our faculty, staff, and “The Accidental Astronomer,” detailing the career and family Canaveral, Florida, to watch the launch of the shuttle carrying students this past year in the Chester F. Carlson Center for choices she made at the outset of her career in the 1980s. the instrument Baum helped develop. Imaging Science. And it has been another great year for us, full Baum is the director of RIT’s Chester F. Carlson Center for Im- of new discoveries reported out in the literature and the press, aging Science and co-chair of the new Astrophysical Sciences new innovations resulting in new patents and new business and Technology graduate program. She has balanced a suc- initiatives, student awards, graduations, and career successes, cessful career inside and outside academia with the domestic new research directions, and new collaborations both within demands of being the mother of four children. and outside of RIT. We are proud of the strong interdisciplinary In her essay, Baum reflects on timing her pregnancies “so as community of researchers, learners, and teachers we have built not to be visibly pregnant” during her early job interviews; giving in our Center. Each student we graduate is another force whose birth to her first child in a small village in Holland while on a joint energy and ideas will help to build the future. Challenging times? post-doctoral fellowship with her husband at the Netherlands Yes. But as you will see as you leaf through these pages, we Foundation for Radio Astronomy; and returning to work only have risen to the challenge. We hope you enjoying sharing in our one week after having had her first son. accomplishments. “Critical to being able to juggle a scientific career and a young Best, family was having the perfect collaborator—a husband who

shared all aspects with me from scientific discovery to baby trips to the doctor,” Baum says. Her husband, Chris O’Dea, is also an astronomer and a professor of physics at RIT. Stefi Baum, Director

5 Professor Roger Easton gives a presentation about his document restoration work in India at a weekly meeting of the student chapter of the Society of Imaging Science and Technology.

6 Academics

Imaging Science with the answer, “Joe Pow spoke to me.” All of us at the . Incoming Class Profile (Fall 2009) Center cannot express how appreciative we all are for his Undergraduate Program tireless efforts. We are very fortunate to have accepted 9 new students to RIT and the undergraduate program in Imaging Science this Program Coordinator’s Comments It has been another great year at the Center and I hope that year. Also, two internal transfers from other RIT programs have By Carl Savaggio everyone reading this report can in someway stay involved grown our family in the Center. Our complementary program in with these great students that we have. Whether it is provid- the College of Imaging Arts and Sciences, Digital Cinema, has So as I finish up my third year as the coordinator of the . ing an internship possibility, whether it is visiting campus and brought 15 new incoming students to RIT so our classrooms undergraduate program in Imaging Science, I am very talking at our seminar series or to the Friday afternoon meeting will continue to be filled with the next generation of scientists to pleased to say that I like where the program is currently and of the student chapter of IS&T, or through the sponsorship of continue to grow the field of imaging, both still and video. where it is heading in the future. While the amount of spon- a high school senior’s application to our program—it is very sored research continues to grow in the Center, so does the rewarding to be a part of the Center. Awards/Recognition involvement of our undergraduate student body. You know a new trend is becoming a cultural norm when you do not Curriculum Changes While the undergraduate program in Imaging Science is a small one when compared to other programs in the College speak of it any longer. It is unusual to hear someone say that The faculty and the students had a retreat this past spring to of Science, the performance of the students that make up this we are in the “internet era” any longer, it is just where we now see what is working, what is not, and what is missing. What program is exceptional. This level of quality has gained rec- are. That is becoming true in the culture at the Center with we decided to do was to form three sub-committees of . ognition for many of these young people within the University, regard to the “undergraduate research” era—most of our faculty and students to look at three areas were we thought in the local community, and at National level. The following undergraduate students participate in our laboratories, or with we could improve our educational mission. The first was awards have been bestowed on our students in Imaging Sci- outside companies and agencies, on numerous research tasked to take a fresh look at the mathematics and statistics ence during the 2008-2009 academic year: projects and is now just a natural part of their time with us at portion of our curriculum and extend our internal offerings. . the Center. This is exactly what RIT’s newest president would The second was to look at the systems portion of our . Chester F. Carlson Center for Imaging Science—Carlson like to see across the Institute, and it is great to say that we curriculum and make certain that it is relevant to the needs . Scholarship are already there. of our industry today. The third was to look at incorporating Ann Nunziata (2009). This fact has strengthened the already powerful market . some of today’s newest and most exciting technologies, Caroline Houston (2009). appeal of our graduating students and opportunities are still three-dimensional imaging and digital video processing into Christopher Tomkins-Tinch (2009, 2008, 2007). plentiful for them, even during the current economic struggles our curriculum. These are major endeavors and will take some Joel Witwer (2009, 2008). that our nation is enduring. During the career fairs, at our time to implement in the best manner possible, however, . Karla Hatfield (2009, 2008). weekly meeting of the student chapter of IS&T, and through they are exciting modifications and evolutions that we are . Mark Giglio (2009, 2008, 2007). interactions with our numerous sponsors, the industry that all excited to make happen. Meghan Dorn (2009). centers itself around imaging is still coming to the Center . Monica Cook (2009, 2008). and looking to hire our graduates. Student Body Peter Leung (2009). Philip Salvaggio (2009) We continue to struggle to attract the numbers of students At approximately 50 students, the undergraduate popula- that the industry would like to see us put out each year, but tion in Imaging Science continues to be a wonderful collec- Chester F. Carlson Center for Imaging Science—Fitz we do all we can to make those numbers grow. Taking every tion of aspiring scientists, lab-savvy students, and systems Scholarship opportunity afforded to him, our Associate Director, Joe Pow engineers. We expect this group to grow by the addition of Allison Bright (2009) continues to personally encourage the right students to join undergraduate students this coming year from other colleges Chester F. Carlson Center for Imaging Science—Jerry us each year. Whether that is through visits to high schools, and departments at RIT as well as other universities in the Hughes Scholarship College and Careers days at RIT, or personal communica- region. We will be continuing to try and bring the field to which tions, the majority of our incoming class always respond to we have all dedicated our careers to the next generation. David Kelbe (2009) the question “How did you hear about Imaging Science?” .

7 RIT College of Science—John Wiley Jones Scholarship frozen power plant cooling lake, Proceedings of the Vision Paul Romanczyk (2009) SPIE, SPIE Defense and Security, Thermosense XXXI, Jon Purington Infrared Sensors and Systems, 7299, 10, Orlando, RIT College of Liberal Arts—Kearse Student Honor Florida, United States, April (2009) Color Science (Munsell Color Science Laboratory) Award in Psychology Mark Giglio. Rebecca Brown (2009) • Snyder, D.; Kerekes, J.; Fairweather, I; Crabtree, R.; Ann Nunziata Shive, J.; Hager, S., Development of a web-based ap- RIT Nathaniel Rochester Scholarship plication to evaluate target finding algorithms, Proceed- Remote Sensing (DIRS) Jon Purington ings of the 2008 IEEE International Geoscience and John Parkes. Erin Schmidtmann. American Society for Photogrammetry and Remote Sens- Remote Sensing Symposium (IGARSS), Vol.. 2, pp. Eugenie Song. ing—Central New York Region Student of the Year Award 915-918, Boston, MA, 2008 David Snyder Philip Salvaggio (2009) • Kerekes, J.; Pogorzala, D.; Parkes, J.; Shaw,A.; Rahn, Biomedical Imaging Laboratory United States Geospatial-Information Foundation D.; Hyperspectral Target detection using multiple plat- Robert Harrigan. —United States Geospatial-Information Foundation form cuing, Proceedings of the First IEEE Workshop on Hyperspectral Image and Signal Processing: Evolution Dien Nguyen. Scholarship Natalie Tacconi James Albano (2008). in Remote Sensing (WHISPERS), 26-28 August, 2009, Philip Salvaggio (2008) Grenoble, France. Astronomical Imaging (INSIGHT) • Baum, K., Helguera, M., Schmidt, E., Rafferty, K., Krol, Meghan Dorn. Student Publications A., Evaluation of genetic algorithm-generated multivariate Karla Hatfield color tables for the visualization of multimodal medical While RIT as a whole is making a concentrated effort to fused data sets, Proceedings of IEEE NSS-MIC, 2008. Rochester Imaging Detector Laboratory (RIDL) increase research and scholarship at the undergraduate level, Nicolas Cox the students in the Center just continue to do what they have • Helguera, M., Baum, K.G., Schmidt, E., Rafferty, K., Krol, A., Evaluation of novel genetic algorithm gener- been doing since the Center was formed in 1989. This year, Study Abroad this is evidenced by the following publications and presenta- ated schemes for pet/mri image fusion, Computers in Christina Kucerak / tions made by our undergraduates. Biology and Medicine, under review. February 2009. Graduates • Kastner, J.H.; Thorndike, S.L.; Romanczyk, P.A.; Bu- Internships chanan, C.L.; Catherine, B.J.; Sahai, R.; Egan, M., The In 2008-2009, the following students have graduated with a LMC's Top 250: Classification of the Most Luminous Monica Cook / Optimax Systems, Incorporated Bachelor of Science degree from the undergraduate program Compact 8 micron Sources in the Large Magellanic Nicholas Cox / Areté Associates in Imaging Science Cloud, Astrophysical Journal (2008) Mark Giglio / QD Vision • Juliet Bernstein • Messinger, D.W.; Salvaggio, C.; Sinisgalli, N.M., • Rebecca Brown J.D. Parkes / ITT SSD Detection of gaseous effluents from airborne LWIR • Meredith Curtis hyperspectral imagery using physics-based signatures, Christopher Tomkins-Tinch / Oak Ridge National • Coleen Davis Spectral Sensing Research for Water Monitoring Ap- Laboratory • Christopher DeAngelis plications and Frontier Science and Frontier Science, Allison Bright / ITT • Christina Kucerak and Technology for Chemical, Biological and Radiologi- • Claire MacDonald cal Defense, 1st Edition, Dwight Woolard and Janet Erin Schmidtmann / ITT SSD • David Nilosek Jensen, Scientific Publishing Company, 48, Jon Purington / ITT SSD • Jeffrey Patel Selected Topics in Electronics and Systems, Hacken- • Kimberly Rafferty sack, New Jersey, United States (2008) Josh Zollweg / Naval Research Laboratory • Paul Romanczyk • David Snyder • Arsenovic, M.V.; Salvaggio, C.; Garrett, A.J.; Bartlett, Undergraduate Research Experiences B.D.; Faulring, J.W.; Kremens, R.L.; Salvaggio, P.S., • Eugenie Song Use of remote sensing data to enhance the perfor- Within the Center mance of a hydrodynamic simulation of a partially (by Laboratory)

8 Capstone Experiences ABSTRACT a cyan ink sample was found to have a high reflectance when measured in red light, and when modeled with the During the 2008-2009 academic year, the fourth year stu- In this study an absolute calibration of the micro-gonio- Fresnel equations it was found to have a complex index dents participated in a formal capstone experience through photometer is demonstrated. The objective of this study of refraction. The conclusion of this study was that the the traditional senior project to prepare them for a specialty is to develop a method and analytical protocol that can micro-goniophotometer can be calibrated to the Fresnel within imaging science or for graduate school in the com- be used for calibration of a micro-goniophotometer. reflectance of a material, using polyvinyl chloride as a ing year. The following senior projects were carried out and There are many reasons to do this, such as being able reference. completed as of 31 May 2009: to measure material properties of printed images to help further the study of printed image gloss. The micro- goniophotometer is a device that measures this gloss, STUDENT STUDENT or specular reflection. It does this through the use of Jeffrey Patel David Snyder Fresnel’s laws and two polarizers. This is done by polar- izing the incident light and reflected light. ADVISER(S) ADVISER(S) Dr. Roxanne Canosa (Computer Science) Three experiments were conducted for the calibration of Dr. Robert MacIntyre (Imaging Science) the micro-goniophotometer. The first experimental proce- TITLE dure that happened was finding a reference material that TITLE Object recognition of ambiguous shapes will satisfy the parameters of the micro-goniophotometer. How to use OSLO in optical design The cylinder of the micro-goniophotometer system can ABSTRACT vary in diameter. By changing the diameter at which the sample under measurement is curved, it changes the ADVISER(S) Using psychophysical theories, a method of completing angular resolution in the horizontal direction. A reference Professor Robert MacIntyre (Imaging Science) and labeling partially occluded or ambiguous shapes material needs to be found that can be used across is presented. The human visual system prefers simple many cylinder diameters and still not have much trouble ABSTRACT shapes over complicated ones. Given an occluded with the integration of its measured BRDF curve. The “OSLO” is the name of a commonly used optical software figure, if alternative interpretations of the figure are sug- second experiment that has been conducted is to simply package, standing for Optics Software for Layout and gested and a metric used to determine the complexity get a good measurement of many different materials with Optimization. This software allows the student to model of each interpretation, the least complex shape could be varying Fresnel reflectance factors. Using the reference optical components and observe and analyze key ideas selected as the correct interpretation. This information method of calibration, the measured Fresnel reflectance and problems in optical design. Because of the large ca- could also be be used to retrieve a label for the shape value for each sample will be measured many times. pabilities of the software it takes a considerable amount of from a database of known shapes, thus performing The average and RMS deviation of the reflectance value time for a student to learn the full potential of the software. basic shape recognition. With a highly restricted input will be found from that, and matched with the known For this reason it was advantageous to rigorously review set of data this process has been shown to be promis- Fresnel reflectance factor of the different materials. The the current tutorials and improve upon them. New tutorials ing. Simple geometric shapes are able to be detected third experiment that was conducted was to do these were also be added to further the student’s capabilities when partially occluded and correctly labeled using a same measurements over a range of incident light and assist in his/her learning efficiency. Assessments predefined database. Likewise successful completion angles to see if the data will follow the predicted Fresnel were given to students in an optical design class to study shapes in real imagery has also been demonstrated. reflectance curve for incident light angle. their comprehension of the software. After the assess ments had been given the tutorials were reviewed for new STUDENT The results show that the micro-goniophotometer can improvements. Once the tutorials have been optimized, David Nilosek measure the Fresnel reflectance of materials within 2σ of the system using polyvinyl chloride as the reference students should have an understanding of to use OSLO and an understanding of optical design. The tutorials have ADVISOR(S) material. It was also shown in the third experiment that the been placed onto RIT’s MyCourses website and man- Dr. Jon Arney (Imaging Science) micro-goniophotometer agrees with Fresnel’s theory with regard to incident light angle. Two anomalies were found aged by Professor MacIntyre. The OSLO tutorials can be assessed by anyone in the Institute by contacting Profes- TITLE during the course of this study. The first was that the sur- sor MacIntyre at [email protected]. Absolute calibration of a micro-goniophotometer face texture of a material has an effect of the measured Fresnel reflectance of the material, which disagrees with the facet theory of gloss. The second anomaly was that

9 STUDENT TITLE Post-Graduation Plans Meredith Curtis Search for a psychometric link between properties of gloss to radiometric measurements • Juliet Bernstein will be attending graduate school at the Graphics and Imaging Laboratory (GRAIL) of the ADVISER(S) University of Washington's Department of Computer Dr. Carl Salvaggio (Imaging Science) and Dr. Thomas ABSTRACT Science and Engineering Prettyman (Los Alamos National Laboratory) Gloss has different properties that have yet to be fully understood. One of these properties is bronzing. From • Rebecca Brown will be heading to our Nation’s capital this project it was found that bronzing can be observed to join ITT TITLE and scaled independently of the color of the sample. But • Meredith Curtis will be starting her career as an imaging Application of image reconstruction techniques to at the present time there is not an instrument as accurate scientist at the National Geospatial-Intelligence Agency neutron spectroscopy data as the human visual system to observe bronzing. (NGA) • Coleen Davis and Christopher DeAngelis will be joining ABSTRACT STUDENT a long list of other imaging scientist graduates at ITT Data sets collected by the Mars Odyssey Neutron Spec- Dien Nguyen Space Systems Division right here in Rochester trometer contain artifacts from spatial blurring and noise, which are limiting factors in the interpretation of surface • Christina Kucerak will be working with ITT Space Sys- physical properties. The spatial response of the spectrom- ADVISER(S) tems Division in the Greater Washington, DC area eter is about 10 degrees (full width half maximum) of arc Dr. Maria Helguera (Imaging Science) • Claire MacDonald will be attending the University of length, making comparisons to and synthesis with higher Delaware to pursue a degree in Oceanographic Re- resolution optical data sets and geological maps chal- TITLE mote Sensing lenging. In addition, blurring artifacts can cause significant Development of a novel 3-d optical molecular system incor- errors in the derived surface properties. Properties con- • David Nilosek, David Snyder, and Paul Romanczyk will porating structured illumination technology strained by neutron spectroscopy include the abundance have each decided to continue on right here at RIT to of water equivalent hydrogen (WEH), the column abun- pursue their doctoral degrees in Imaging Science - we dance of CO2 in the seasonal caps, and the abundance ABSTRACT are very glad to have you stay on with us! of elements such as Fe and Cl, which have large cross A currently available 2-D high-resolution, optical molecular • Kimberly Rafferty will taking some time to do what we all sections for thermal neutron absorption. Computer codes imaging system was modified by the addition of a structured wish we could have done after college, travel the globe, were developed to reconstruct maps of the Martian surface illumination source, Optigrid™, to investigate the feasibility of before making that decision of what to do next … with reduced blurring and noise, which can be subjected providing depth resolution along the optical axis. The modifi- to geochemical interpretation with greater reliability. Penalty • Eugenie Song will be heading back from where she cation of the system involved the insertion of the Optigrid™ came, Seattle, Washington, to attend graduate school function and iterative deconvolution techniques (Jansson’s and a lens in the path between the light source and the im- method) were implemented and compared using simulated in the & Space Sciences program at the Univer- age plane, as well as control and signal processing software. sity of Washington and measured data sets. These techniques were applied The primary challenge of the design, which was to project to global reconstruction of the Mars neutron spectroscopy the Optigrid™ onto the imaging surface at an angle, was data set. Both techniques were effective in removing noise resolved applying the Scheimpflug principle. The illumina- Closing Remarks without introducing unrealistic oscillations in the recon- tion system implements modulation of the light source and The Center has continued all of the traditions that have made structed maps. Results of the study are presented along provides a framework for capturing depth resolved mages. with implications to Mars science. it such a special place for so long, the place that all our alumni remember. The Fall Picnic, the Winter Games, the STUDENT The system is capable of in-focus projection of the Opti- Scavenger Hunt, and a new one, “The First (and sometimes Coleen Davis grid™ at different spatial frequencies, and supports the use Second) Years dinner out with the faculty—they chose the of different lenses. A calibration process was developed place and we all get to spend some relaxing time. We hope for the system to achieve consistent phase shifts of the that all these traditions and the great academic experience ADVISER(S) Optigrid™. Post-processing extracted depth information Dr. Jon Arney (Imaging Science) that everyone has continue to grow our long line of fantastic using depth modulation analysis using a phantom block with alumni for many years to come. fluorescent sheets at different depths.

10 Digital Cinema Program derlust. A year ago, Kelbe was studying at University of Dunedin in involving RIT professor Jan van Aardt, director of the Laboratory New Zealand. Now, he’s planning a trip to South with the help for Imaging Algorithms and Systems in the Chester F. Carlson The Digital Cinema program, jointly offered by RIT’s School of of the staff in RIT’s Study Abroad office, where he works part-time. Center for Imaging Science. During his stay, Kelbe will work with Film and Animation (SOFA) and the Chester F. Carlson Center Dubbed “a natural kiwi” last year by his friends in New Zealand, van Aardt and his colleagues to do research and gather data for for Imaging Science (CIS), hit a milestone this coming year, wel- his senior project, which he will start at RIT this summer. coming it’s 4th freshmen class to campus. With every year level Kelbe quickly graduated from sightseeing road trips to off-trail excur- now represented, the program continues to expand its reach in sions and alpine mountaineering. During his time there, he doubled “Even though imaging science is a small, specialized and unique both the SOFA and CIS communities. Especially exciting are the as a photo correspondent for Glimpse, a nonprofit organization major here at RIT, I was able to find similar fields of study in thesis projects proposed in the spring of 2009 by the entering affiliated with the National Geographic Society. He was one of only Dunedin, New Zealand, and now in Cape Town, South Africa,” seniors. Ringing true to the spirit of the Digital Cinema experience 12 students picked as a correspondent from among thousands of Kelbe says. “For a guy who loves to travel, that’s reassuring!” and it’s heavy emphasis on imaging science, the projects vary applicants. from technical/creative collaborations to applied engineering to Glimpse provides a forum for young people to share international Release Date: Aug. 27, 2009 imaging and motion picture research. Example projects include experiences and gave Kelbe an excuse to explore the culture and advanced color correction in support of SOFA BFA senior proj- quirkiness of New Zealand. He documented the time he spent fish- Contact: Susan Gawlowicz. ects, digital imaging workflow support, and image archiving sys- ing with a descendant of a Maori chief, hanging out with a traditional 585-475-5061 or [email protected] tems. Returning senior, Chris Clark, will be investigating state-of- sheep farmer, and trying to keep up with senior citizens competing the art image encoding as an extension of an internship he was in a 24-hour orienteering race. He even wrote a food critique of Oneida Resident Wins BAE Systems Fellowship to awarded with the Academy of Motion Picture Arts and Sciences McDonald’s Kiwiburger, which he liked. (Kelbe’s photo essays can Study at RIT in Hollywood during the summer of 2009. These projects are just be viewed at www.Glimpse.org.) Kimberly (Manser) Kolb will pursue her master’s in imag- the start of what will continue to be a growing focus on advanced Photography is a passion for Kelbe, who says he would one day ing science study in Digital Cinema, maintaining RIT’s strong traditions in both like to design cameras. His interest in remote sensing led him the imaging arts and sciences. Kimberly (Manser) Kolb, a resident of Oneida, N.Y., won a to volunteer at University of Dunedin analyzing satellite images In addition to growing enrollment and emerging undergradu- fellowship from BAE Systems to pursue a master’s degree in of the glaciers he “skied on during the weekends.” His analysis ate research, Digital Cinema also welcomed two new adjunct imaging science this fall at Rochester Institute of Technology. contributed to the Global Land Ice Measurements from Space faculty during the year. Kyle Alvut joined from Kodak’s Image project, an international effort to monitor glaciers. Kolb, the daughter of Patricia Manser of Oneida and the late Systems Lab where he is Chief Colorist and Lab Manager in the James Manser, graduated from RIT in 2008 with a B.S. in “Working on the project did open my eyes up to the fact that Entertainment Imaging research group. At RIT, Kyle teaches color microelectronic engineering. She will begin work on her M.S. there are opportunities everywhere,” Kelbe says. correction courses for both BFA and BS students in SOFA. Ed degree at RIT’s Chester F. Carlson Center for Imaging Science Back at RIT, Kelbe began thinking about where to go next and Giorgianni is a retired Senior Research Fellow from Kodak where in September. he spent a 38-year career researching numerous imaging sys- discovered an opportunity to study at the University of Cape tems. Ed previously taught in CIS in the 1990s and returns again Town in South Africa in 2010. The spring semester there starts BAE Systems is the world’s second-largest defense company. now to teach Digital Cinema and Imaging Science undergradu- before RIT’s winter quarter ends, giving Kelbe a few months to This new, two-year fellowship program at RIT includes tuition, ates advanced concepts in digital color management. travel around before starting classes. travel support and a stipend. “I would really like to climb Mt. Kilimanjaro, and then couch surf “The BAE Systems Fellowship will allow me to broaden my university | NEWS ❯❯ my way down to Cape Town. Couch surfing is a worldwide net- scope,” Kolb says. “Getting a degree in imaging science will al- work connecting travelers with members of the local community low me to enter into things like solar cells and satellites, with job Release Date: May 21, 2009 who offer free accommodation and advice,” he explains. “South opportunities geared for the future.” Africa is really beautiful and I’d love to see as much as possible.” Kolb will focus her graduate work in the application and design Contact: Susan Gawlowicz|. Kelbe looks forward to contributing photo essays again to of imaging detectors. Her background in semiconductor fabrica- 585-475-5061 or [email protected] Glimpse whether as a paid correspondent or a volunteer. tion will enhance her research in this area. RIT student combines interest in remote “I really believe in Glimpse’s mission of helping young Americans “With a masters in imaging science, I can pursue what interests sensing with passion for globe-trotting experience real life abroad, and I look forward to helping them me—semiconductor physics and imaging/detector science— out with that in whatever way I can,” he says. and I will have an edge on others in the field because of my David Kelbe wants to build cameras, climb mountains and have five-year semiconductor physics background,” Kolb says. great adventures in faraway places. Part of the reason Kelbe picked South Africa was the chance to work on a remote-sensing project at Kruger National Park The second-year imaging science major has an unquenchable wan-

11 12 Imaging Science Graduate Program Faculty Graduate Program The Center for Imaging Science Graduate Faculty continues to grow. There are now 50 members of the CIS Graduate Program Coordinator’s Comments Faculty. The Center has 21 tenure track Faculty with a primary By Anthony Vodacek appointment or shared appointment in the Center, 16 Gradu- ate Program Faculty with their primary appointment in other RIT As research and scholarship across RIT becomes more Departments and Colleges, seven Affiliate Faculty with positions prominent, there are transitions in administrative policies and in industry or at government laboratories, five Research Profes- procedures that are impacting how the graduate program sors (at various ranks), and one CIS Fellow. Outside of the operates. The policies and procedures that have been in place tenure track Faculty from the Center, these Graduate Program within the Center are often used as a template for Institute poli- Faculty are associated with 14 different Centers, Departments, cies and procedures. Some, but not all, of the communication Programs, or Laboratories internal or external to RIT. is becoming centralized under the Dean of Graduate Studies. As with any change, the Center is attempting to be proactive rather than reactive relative to changes in policy and resource allocations. The Dean of Graduate Studies has been success- Curriculum Development ful as an advocate for the graduate students and their unique The primary activity on the curriculum front over the past year quality of life needs separate from the general undergraduate has been the ongoing definition of a concentration track in population. These include increased access to the Student Life optics. The impetus for the new track came from the addition of Center and a health care option. several Graduate Program Faculty members with specific inter- The Center has always garnered funding from a variety of est in optics, both geometrical optics and physical optics. industrial partners and government agencies. One important example this year was the development and granting of a BAE Systems Fellowship for an M.S. student. BAE is providing a Graduate Student Body generous stipend, tuition, travel expenses, summer employ- Continuing Students ment at a BAE Systems laboratory, and the prospect of a permanent job after graduation. This type of fellowship allows In 2008-2009 there were 93 continuing graduate students pur- a graduate student to focus on industry directed research and suing advanced degrees in Imaging Science. These students transition from classroom work to the laboratory earlier than the are come from at least eight countries. There were 30 resident traditional Center funded graduate assistant who has teach- M.S. students, 15 online M.S. students, and 48 Imaging Sci- ing assistant duties in their first year. The fellowship was widely ence Ph.D. students. advertised and an award made, with that student now enrolled in the M.S. program. Incoming Class Profile (Fall 2009) There were 28 new students admitted into the Imaging Sci- ence graduate program for the 2009-2010 academic year. The admitted incoming class was 15 Ph.D. students, 9 M.S. students, including both full and part time, and 4 online M.S. students. Sixteen of the incoming students are fully funding with tuition and stipend in their first year. The remainder are partially funded or funded by their employers. Industry or government funded graduate students are from the US Air Force, Canadian National Forces, and United Technologies. The new interna- tional graduate student body is from Canada, China, India, Iran, Thailand, Romania, and Japan.

13 Student Publications and Presentations of the SPIE, SPIE, Sensors and Systems for Space • Zelinski, M.E., Schott, J.R. Segmented aperture Applications II, 6958, 69580K, Orlando, Florida, United space telescope modeling used for remote sensing Publication and presentation is emphasized in any graduate States, March (2008) and image utility analysis, Proceedings of SPIE, SPIE, research program and our students take advantage of the • Vodacek, A., Li, Y., Garrett, A.J. Remote sensing data Sensors and Systems for Space Applications III, 7330, many opportunities to present their work. Imaging Science 733009, Orlando, Florida, United States, April (2009) graduate students published journal articles, conference assimilation in environmental models, Proceedings of papers, and attended a wide variety of conferences, gain- AIPR '08, IEEE, Applied Imagery Pattern Recognition • Schlamm, A., Messinger, D.W., Basener, B., Effect of ing valuable communications and networking experiences. Workshop, 2008, Washington, District of Columbia, manmade pixels on the inherent dimension of natural A number of Imaging Science graduate students presented United States, October (2008) material distributions, Proceedings of SPIE, Defense at the highly successful RIT Graduate Student Symposium • Walli, K.C., Nilosek, D.R., Schott, J.R., Salvaggio, and Security Symposium, Algorithms and Technologies sponsored by the Dean of Graduate Studies during the C. Airborne synthetic scene generation (AeroSynth), for Multispectral, Hyperspectral, and Ultraspectral Imag- summer of 2009. The following is a partial list of publications Proceedings of the ASPRS, ASPRS/MAPPS 2009 ery XV, 7334, Orlando, Florida, United States (2009) and conference proceedings authored or co-authored by our Fall Conference, - From Elevation to • Kwong, J., Messinger, D.W., Middleton, W.D. graduate students in the 2008-2009 year. Information, Digital Elevation Data Fusion Innovations, Hyperspectral Clustering and Unmixing for Studying Selected Journal Articles with Student Authors San Antonio, Texas, United States, November (2009) the of State Formation and Complex Societ- ies, Proceedings of SPIE, SPIE Optics and Photonics, • Foster, M.S., Schott, J.R., Messinger, D.W. Spin-Im- • Bartlett, B.D., Devaraj, C., Gartley, M.G., Salvaggio, C., Schott, J.R. Spectro-polarimetric BRDF determina- Imaging Spectrometry XIV, 7457, San Diego, California, age Target Detection Algorithm Applied to Low Density United States (2009) 3D Point Clouds, Journal of Applied Remote Sensing, tion of objects using in-scene calibration materials for 2, 023539 (2008) polarimetric imagers, Proceedings of SPIE, SPIE Optics • Kerekes, J.P.; Presnar, M.D.; Fourspring, K.D.; and Photonics, Polarization Science and Remote Ninkov, Z., Sensor Modeling and Demonstration of • Bartlett, B.D.; Schott, J.R., Atmospheric compensa- Sensing IV, Calibration, Compensation, and Optimiza- a Multi-Object Spectrometer for Performance Driven tion in the presence of clouds: an adaptive empirical tion, 7461, San Diego, California, United States, pp. Sensing, SPIE, Proceedings of Algorithms and Technol- line method (AELM) approach, Journal of Applied 74610T1-74610T11, August (2009) ogies for Multispectral, Hyperspectral, and Ultraspectral Remote Sensing, 3, 033507 (2009) • Montanaro, M., Salvaggio, C., Brown, S.D., Messinger, Imagery XV, 7334, DOI: 10.1117/12.819265 (2009) • Casey, J.T., Kerekes, J.P. Misregistration Impacts on D.W., Garrett, A.J., Bollinger, J.S. Radiometric modeling Hyperspectral Target Detection, Journal of Applied of mechanical draft cooling towers to assist in the extrac- Remote Sensing. 3, 033513 (2008) tion of their absolute temperature from remote thermal • Schlamm, A., Messinger, D.W., Basener, B., Geomet- imagery, Proceedings of the SPIE, SPIE Defense and Se- ric estimation of the inherent dimensionality of single curity, Thermosense XXXI, Infrared Sensors and Systems, and multi-material clusters in hyperspectral imagery, 7299, 8, Orlando, Florida, United States, April (2009) Journal of Applied Remote Sensing. 3, 033527 (2009) • Arsenovic, M.V., Salvaggio, C., Garrett, A.J., Bartlett, Selected Conference Papers with Graduate Student Authors B.D., Faulring, J.W., Kremens, R.L., Salvaggio, P.S. Use (student author underlined) of remote sensing data to enhance the performance of a hydrodynamic simulation of a partially frozen power plant • Faulring, J.W., Casterline, M.V., Salvaggio, C., cooling lake, Proceedings of the SPIE, SPIE Defense Kremens, R.L., Salvaggio, P.S., Deployment of an and Security, Thermosense XXXI, Infrared Sensors and Autonomous Sensor Network for Remote Sensing Systems, 7299, 10, Orlando, Florida, United States, Applications, International Society for Computers and April (2009) Their Applications, ISCA First International Conference on Sensor Networks and Applications (SNA-2009), • Higbee, S., Messinger, D.W., Tra, Y., Voelkel, J., Chilton, San Francisco, California, United States, November. L. A Bayesian Approach to Identification of Gaseous (2009) Effluents in Passive LWIR Imagery, Proceedings of SPIE, Defense and Security Symposium, Algorithms and Tech- • Daniel, B.J., Bolcar, M.R., Schott, J.R., Fienup, J.R. nologies for Multispectral, Hyperspectral, and Ultraspec- Phase Retrieval in Sparse Aperture Systems with tral Imagery XV, 7334, Orlando, Florida, United States, Phase Diversity: A Trade Space Study, Proceedings April (2009)

14 Graduates In May 2009, the following students graduated with an M.S. in • Yang Xue, Uniform Color Spaces Based On Imaging Science. CIECAM02 and IPT Color Difference Equations, The 2008-2009 academic year saw the granting of 10 Ph.D. Adviser: Roy Berns degrees and 18 M.S. degrees. In May 2009, the following • Sherif Azary, Adviser: Roger Gaborski students graduated with a Ph.D. in Imaging Science. • Josef Bishoff, Target Detection Using Oblique Hy- • Michael Zelinski, A Segmented Aperture Space Telescope Modeling Tool and Its Application to Remote • Anatoly Bourov, A Systematic Approach to Deter- perspectral Imagery : A Domain Trade Study, Adviser: David Messinger Sensing as Understood Through Image Quality and mining the Limits of Nanolithography at Extreme NA, Image Utility, Adviser: John Schott Advisor: Bruce Smith • Dan Byrnes, Scanning Tunneling Optical Resonance • Brian Daniel, A Systems Study of Sparse Aperture Microscopy: Development of a Novel Characterization The following are the post-graduation plans for some of the Sensors in Remote Sensing Applications with Explicit Technique, Adviser: Ryne Raffaelle students who graduated in May 2009. Phase Retrieval, Adviser: John R. Schott • Linpeng Chen, Interpixel Capacitive Coupling, Adviser: • Anatoly Bourov, Shanghai Semiconductor Company Stefi Baum • Lai Di, Independent Component Analysis (ICA) Applied • Brian Daniel, Naval Research Labs to Ultrasound Image Processing and Characterization, • Alexander Cherekos, Project: Gas Detection Using Adviser: Naval Rao Projective K-Means Method, Adviser: Carl Salvaggio • Rodney Heckaman, CIS Staff, Color Science • , USAF • Rodney Heckaman, Brilliance, Contrast, Colorfulness, • Marc Cousoulis Scott Klempner and the Perceived Volume of Device Color Gamut, • , The Mind Research Network • Ranxi Huang, Semi-automated Techniques for the Andrew Michael Adviser: Mark Fairchild Retrieval of Dermatological Condition in Color Skin Im- • Mahnaz Mohammadi, DuPont • Scott Klempner, Statistical Modeling of Radiometric age, Adviser: John Kerekes • Matthew Montanaro, NASA Goddard Error Propagation in Support of Hyperspectral Imag- • Sang Yun , Project: A 3-D Volume Resolution ing Inversion and Optimized Ground Sensor Network • Marcus Stefanou, USAF Phantom for MRI, Adviser: Joseph Hornak Design, Adviser: John R. Schott • Sherif Azary, Xerox • Francis Padula, Historic Thermal Calibration of • Andrew Michael, Imaging Schizophrenia: Data Fusion TM Through an Improved Physics Based • Josef Bishoff, Candadian National Forces Approaches to Characterize and Classify, Adviser: Stefi Approach, Adviser: John Schott Baum • Daniel Byrnes, Veeco Instruments • Kristen Powers, Adviser: Carl Salvaggio • Mahnaz Mohammadi, Developing an Imaging Bi- • Linpeng Cheny, Omnivision Tech Spectrometer for Fluorescent Materials, Adviser: Roy • George Privon, Modeling the Infrared Emission from • Marc Cousoulis, Lockheed Martin Berns Cygnus A, Adviser: Stefi Baum • Sang Yun Moon, Rainbow Research Optics • Matthew Monanaro, Radiometric Modeling of Me- • Anthony Rizzuto, A Low-Signal-to-Noise-Ratio chanical Draft Cooling Towers to Assist in the Extraction Sensor Framework Incorporating Improved Nighttime • Francis Padula, Integrity Applications of Their Absolute Temperature From Remote Thermal Capabilities in DIRSIG, Adviser: Emmett Ientilucci • George Privon, PhD student at the University of Virginia Imagery, Adviser: Carl Salvaggio • Cynthia Scigaj Dobbs, Project: Modeling and Simu- • Anthony Rizzuto, USAF • Susan Munn, 3D Head Motion, Point of Regard and lation of Hyperspectral Imaging Instrument, Adviser: • Cynthia Scigaj Dobbs, Aerospace Corporation Encoded Gaze Fixations in Real Scenes: Next-Gener- Carl Salvaggio • , Canadian National Forces ation Portable Video-Based Monocular Eye Tracking, • Stephanie Shubert, Project: Effect of Anisotropy on Matthew Turk Adviser: Jeff Pelz the High-frequency Ultrasound Backscatter from a • Jason Walp, Infoprint Simulated Nerve Fiber, Adviser: Maria Helguera • Marcus Stefanou, Spectral Image Utility for Target • Michael Zelinski, Lawrence Livermore Lab Detection Applications, Adviser: John Kerekes • Matthew Turk, A Homography-Based Multi-Camera Person-Tracking Algorithm, Adviser: Eli Saber

• Jason Walp, Adviser: Mitchell Rosen

15 16 Color Science Graduate M.S. Incoming Class Profile (Fall 2009) & Ph.D. Programs One new student entered the Ph.D. program in fall 2009 while two others deferred their admission to 2010. Two additional Graduate Coordinator’s Comments students began the M.S. program in fall 2009. This brings By Mark D. Fairchild the total number of current Color Science Ph.D. students to nine, four of which have passed their qualifying examinations Overview over the past two years. Our first students will be completing their dissertation proposals and candidacy examinations this RIT offers M.S. and Ph.D. Degrees in Color Science. The academic year and we are likely to see the first Color Sci- M.S. program dates back to 1986 while the doctoral program ence Ph.D. awarded sometime in 2011. The M.S. program commenced with its first group of students in the fall of 2007. also currently has nine active students. In fall, 2010 we again The curriculum consists of required courses in color science, expect 3-4 new students to join the graduate programs electives, an M.S. level research project, and a research dis- sertation for Ph.D. candidates. These are the only graduate programs in the country devoted to this multidisciplinary sci- 2009 Graduates ence. Color science broadly encompasses physics, chemis- Three students completed their Color Science M.S. degrees try, anatomy, physiology, psychology, imaging science, math- in the 2008-2009 academic year (or nearly completed their ematics & statistics, and computer science. The programs degrees and are putting the final touches on their theses) . are designed for students whose undergraduate majors are and moved on to new careers. They include: in these and related disciplines pertaining to the quantitative description of color. Students have taken a variety of industrial Shizhe Shen—Employed by OmniVision in California and academic research and/or development positions upon Stefan Luka—Employed by Disney in California completion of their studies. Mark Updegraff—Employed by ITT in Rochester Student Publications and Presentations The Color Science graduate programs strongly emphasize dissemination of scientific advancements in the field and . particularly encourage students to be the primary authors . on journal publications and conference proceedings and presentations. In the past year, about 50 papers and presen- tations were published by participants in the Color Science programs with over 40% of those including student authors.

17 18 Meet the tangiBook In recent work, Professor Jim Ferwerda and Benjamin Darling (Color Science Ph.D. student) have developed the tangiBook, a tangible interface that allows natural interaction with virtual surfaces. The tangiBook is based on an off-the-shelf laptop computer that incorporates an accelerometer and a webcam as standard equipment. Custom software allows the orienta- tion of the laptop screen and the position of the observer to be tracked in real-time. Using this information, realistic images of surfaces with complex textures and material properties illuminated by environment-mapped lighting are rendered to the screen at interactive rates. Tiltixng the laptop or moving in front of the screen produces realistic changes in surface light- ing and material appearance. Thus the tangiBook allows virtual surfaces to be observed and manipulated as naturally as real ones, with the added benefit that the material properties of the surfaces can be changed in real-time. We are currently inves- tigating the utility of the tangiBook in three application areas: material perception research; computer-aided appearance design; and enhanced access to collections in digital libraries and museums.

19 20 Astrophysical Sciences and as possible after entering the program. To this end, both MS Chiaberge, M., Tremblay, G. R., Capetti, A., Macchetto, F. D., and PhD students are required to complete a “Master Level” Tozzi, P., Sparks, W. B., ‘Low-Power Radio Galaxies in the Dis- Technology Graduate Program research project during their first two years. tant Universe: A Search for FR I at 1 < z < 2 in the COSMOS Field’, Astrophys. J. 696, 1003 (2009). Program Director’s Comments Graduate Students Chiaberge, M., Capetti, A., Macchetto, F. D., Rosati, P., Tozzi, By Andrew Robinson There are five continuing students, all studying for the PhD. P., Tremblay, G. R., ‘Three Candidate Clusters of Galaxies at The new PhD and Masters program in Astrophysical Sciences Two students, who entered the program with research Masters Redshift ~1.8: The “Missing Link” Between Protoclusters and and Technology (AST) focuses on the underlying physics of degrees, have been granted accelerated advancement to PhD Local Clusters?’, Astrophys. J. Letters, in press (2009). candidacy. Two others will be taking their PhD qualifying exam phenomena beyond the Earth, and on the development of Zhu, Qingfeng, Davies, Ben, Figer, Donald F., Trombley, in June 2010, after completing the core curriculum. Finally, the technologies, instruments, data analysis, and modelling Christine, ‘A Near-Infrared Study of the Stellar Cluster: Rudolfo Montez, who transferred into AST from the Imaging techniques that will enable the next major strides in the field. The [DBS2003] 45’, Astrophys. J. 702, 929 (2009) multidisciplinary emphasis of this program, jointly offered by the Science PhD program, is expected to defend his PhD . Published conference papers (student names in bold). Department of Physics, the School of Mathematical Sciences, dissertation in spring 2010. and the Chester F. Carlson Center for Imaging . Antonini F., Capuzzo-Dolcetta R., Merritt D., 'An instability in triaxial Science, distinguishes it from conventional astrophysics gradu- Incoming Class Profile stellar systems', 2008, Astronomische Nachrichten, 329, 900 ate programs at other universities. Four students (2 PhD and 2 MS) entered the program in . Montez, R. and Kastner, J. H., ‘X-ray Observations of Symbiotic Mi- The program received approval from New York State in . fall 2009. ras’, at Conference on Asymmetrical Planetary Nebulae IV, June 18- summer 2008 and commenced in Fall of the same year, with 22, 2008, La Palma, Canary Islands, Spain, proceedings published the first intake of students. There are 15 graduate faculty, includ- Student Publications and Presentations online at http://www.iac.es/proyecto/apn4/pages/proceedings.php. ing four based in the Center. The CIS faculty members are en- AST Graduate students have contributed to the publications listed Selected presentations at meetings/conferences gaged in mentoring or advising four of the seven PhD students below and have presented their work at a number of conferences. enrolled as of fall 2009. In addition, an Associate Research Fabio Antonini, ‘Tidal disruption of Binary stars by a super Papers in refereed journals (student names in bold). Scientist in the Center is employed part-time by the program to massive BH’, at the Spring meeting of the Astronomy Society of provide computer support to students and faculty. Antonini F., Capuzzo-Dolcetta R., Merritt D., 'A counterpart to New York, RIT, 2009 April 18. the radial-orbit instability in triaxial stellar systems', Monthly No- Faculty research interests encompass a wide range of topics in Fabio Antonini, ‘Tidal Disruption of Binary Stars by a Super tices of the Royal Astronomical Society. tmp.1180 (2009). astrophysics and related areas, including theoretical cosmology Massive Black Hole’, at the 12th Eastern Gravity Meeting, . and gravitational astrophysics, computational astrophysics and Montez, R, Kastner, J H, Balick, B, and Frank, A, ‘Serendipitous RIT 2009, June, 15-16. general relativity, stellar, galactic and extragalactic astrophysics, XMM-Newton Detection of X-Ray Emission from the Bipolar Christine Trombley, ‘Investigation of Infrared Selected Can- observational techniques and detector technology. The program Planetary Nebula Hb 5.’ Astrophys. J. 694, 1481 (2009). didate Star Clusters’, at the Spring meeting of the Astronomy offers student research opportunities in the Center for Com- Böttcher, M., Principe, D., ‘The Optical Variability of the Quasar Society of New York, RIT, 2009 April 18. putational Relativity and Gravitation (CCRG) and the Rochester 3C279: The Signature of a Decelerating Jet?’, Astrophys. J. 692, Imaging Detector Laboratory (RIDL). Rudolfo Montez, Kastner, J. H., ‘Serendipitous X-ray Survey of 1374 (2009). Planetary Nebulae’, at Legacies of the Macquarie/AAO/Stras- Curriculum Floyd, David J. E., Axon, David, Baum, Stefi, Capetti, Alessandro, bourg Hα Planetary Nebula project, February 16-18th 2009, Chiaberge, Marco, Macchetto, Duccio, Madrid, Juan, Miley, George, Sydney, Australia The curriculum is designed to offer students flexibility to explore their O'Dea, Christopher P., Perlman, Eric, Quillen, Alice, Sparks, William, Marcello Ponce, ‘Electromagnetic counterpart from interests amongst the various research areas and also allows for the Tremblay, Grant, ‘HST NIR Snapshot Survey of 3CR Radio Source possibility of promotion from the Masters to the PhD programs. Gravitational Waves’, at the Spring meeting of the Astronomy Counterparts II: An and Inventory of the Host Galaxies, Mergers Society of New York, RIT, 2009 April 18 The core curriculum of six courses (24 credits) provides a and Companions’ Astrophys. J. Suppl. Ser. 177, 148 (2008). Marcello Ponce, ‘Electromagnetic interactions with matter broad grounding in contemporary astrophysics. A range of Tremblay, G. R., Chiaberge, M., Sparks, W. B., Baum, S. A., Allen, elective courses, offered by AST and other RIT graduate pro- mediated by Gravitational Waves’, at the 12th Eastern Gravity M. G., Axon, D. J., Capetti, A., Floyd, D. J. E., Macchetto, F. D., Meeting, RIT, Rochester NY: June 15-16, 2009. grams (including Imaging Science) can be tailored to prepare Miley, G. K., Noel-Storr, J., O'Dea, C. P., Perlman, E. S., Quillen, students for research in specific topics. A. C., ‘HST/ACS Emission Line Snapshots of nearby 3CR Radio Grant Tremblay, ‘Tracers of AGN Feedback in Radio Galaxies’, A key goal is to have students engaged in research as soon Galaxies I: The Data’, Astrophys. J. Suppl. Ser. 183, 278 (2009). at the Spring meeting of the Astronomy Society of New York, RIT, 2009 April 18

21 university  NEWS ❯❯ Kastner hopes to compare the molecular profile in the gas Release Date: March 25, 2009 | remnants surrounding the single star with the gas composi- tion surrounding the dual-star system. Contact: Susan Gawlowicz. Release Date: Jan. 15, 2009 Kastner encourages other scientists to look closely at the 585-475-5061 or [email protected] Contact: Susan Gawlowicz twin-star system to see if planets are forming around them. RIT Scientist Fine-tunes 585-475-5061 or [email protected] “We really don’t have any idea right now about what kinds New calibration expands Hubble’s capability of planets form around double stars or even if planets can Astronomer finds evidence of exosolar planets form around double stars,” Kastner says. “It’s theoretically A scientist at Rochester Institute of Technology has expanded Life on a planet ruled by two suns might be a little compli- possible, but I’m not aware of a single observation yet of a the Hubble Space Telescope’s capability without the need for cated. Two sunrises, two sunsets. Twice the radiation field. planet orbiting a double star. I hope someone will go looking new instruments or billions of dollars. soon, if they haven’t already.” In a paper published in Astronomy and Astrophysics, Dan Batcheldor and his team improved the calibration of Hub- astronomer Joel Kastner and his team suggest that planets ble’s Near-Infrared Camera and Multi-Object Spectrometer to enable high-precision polarimetry. Scientists like Batcheldor might easily form around certain types of twin, or binary, star Release Date: Feb. 27, 2009 systems. A disk of molecules discovered orbiting a pair of use this observational technique to read scattered light when investigating active galactic nuclei and for identifying proto- twin young suns in the constellation Sagittarius strongly sug- Contact: Will Dube. planets around very young stars. gests that many such binary systems also host planets. (585) 475-2816 or [email protected] The findings of the nine-orbit calibration plan, funded by the “We think the molecular gas orbiting these two stars almost RIT Presents: The Next Generation of Imaging literally represents ‘smoking gun’ evidence of recent or pos- Space Telescope Science Institute, were published in the Detectors sibly ongoing ‘giant’ planet formation around the binary star February issue of Publications of the Astronomical Society of the Pacific. system,” says Kastner, professor at the Chester F. Carlson National research symposium focuses on technology Center for Imaging Science. developments in quantum-limited imaging “Polarimetry is really quite a powerful tool in astronomy be- cause it can essentially see around corners by the way light Kastner used the 30-meter radiotelescope operated by the The development of quantum-limited imaging detectors is reflecting,” says Batcheldor, associate research scientist in Institut de Radio Astronomie Millimetrique to study radio that could have major implications for biomedical imaging, RIT’s Chester F. Carlson Center for Imaging Science. “When molecular spectra emitted from the vicinity of the two stars, astrophysics, defense and Earth systems science will be you do polarimetry what you are essentially looking through is which lie about 210 light-years away from our . the focus of Rochester Institute of Technology’s fifth annual a set of polaroid sunglasses. What a polaroid does is it makes The scientists found in large abundance raw materials for IT Collaboratory Research Symposium. planet formation around the nearby stars, including cir- you see only light aligned in a certain way.” The two-day event, directed by Don Figer professor of cumstellar carbon monoxide and hydrogen cyanide, in the Scientists use polarimetry to see around clouds of dust and imaging science at RIT, will feature technical research noxious gas cloud. gas obscuring the centers of active galactic nuclei (where su- sessions and presentations on critical application needs in permassive black holes live) and the potential planet-forming “In this case the stars are so close together, and the medicine, defense and astronomy. Participants will include disks around young stars. The scattering material acts like profile of the gas in terms of the types of molecules that key scientists from academia, government and industry, a mirror, allowing scientists to look into the center of these are there is so much like the types of gaseous disks that including Massachusetts Institute of Technology, Raytheon astronomical objects. we see around single stars, that it’s a real link between Space and Airborne Systems and Teledyne. planets forming around single stars and planets forming “Most of the light that comes from an object is unpolarized,” The IT Collaboratory was established in 2001 by the New around double stars,” he says. Batcheldor explains. “And you’ve got to filter out all that light York State Office of Science, Technology and Academic just to see polarized light itself. And so now Hubble can do Planets that have just formed around young stars might Research as one of the state’s Strategically Targeted this even if only one percent of the light is polarized.” leave leftover gas, a potential clue for astronomers who Academic Research Centers. The research collaboration hunt planets. between RIT, the University of Buffalo and Alfred University Batcheldor did not initially set out to fine tune the telescope. Recently, direct imaging of planets orbiting single stars irrefutably focuses on technology and applications in nanomaterial Limitations caused by the previous calibration stalled his confirmed the existence of exosolar planets—those that orbit science, microsystems, photonics and remote sensing. investigation of active galactic nuclei and needed to be fixed before he could continue his research. stars other than our sun. In the spring, Kastner hopes to use the Institut de Radio Astronomie Millimetrique to look for gas left over from the formation of the planets orbiting single stars.

22 Recalibrating the Near-Infrared Camera and Multi-Object David Rodriguez in a press conference at the American As- that the case of V4046 Sagittarii well illustrates how planets Spectrometer was what Batcheldor describes as something tronomical Society meeting in Pasadena, Calif., provide an may easily form around certain types of binary stars. of a “nightmare.” His team devised a program that could unusually vivid snapshot of the process of formation of giant “We thought the molecular gas around these two stars choreograph three different filtered observations of a single planets, comets, and Pluto-like bodies. The results also con- almost literally represented ‘smoking gun’ evidence of recent star at different orientations and switch between cameras firm that such objects may just as easily form around double or possibly ongoing ‘giant,’ -like planet formation within 45-minute fly-bys. “Essentially, we made Hubble chop stars as around single stars like our Sun. around the binary star system, Kastner says. “The SMA im- all over the sky very quickly to get these observations,” he “It’s a case of seeing is believing,” says Joel Kastner of ages showing an orbiting disk certainly support that idea.” says. Rochester Institute of Technology, the lead scientist on the The evidence for a molecular disk orbiting these twin young Scientists at the Space Telescope Science Institute verified study. “We had the first evidence for this rotating disk in ra- suns in the constellation Sagittarius suggested to the scien- the calibration plan would work and gathered the observa- dio telescope observations of V4046 Sagittarii that we made tists that many such binary systems should also host as-yet tions over 12 months. last summer. But at that point, all we had were molecular undetected planets. “We’ve been able to take an existing camera and carefully spectra, and there are different ways to interpret the spectra. “The most successful technique used so far for discovery plan some observations, which have allowed us to enable a Once we saw the image data from the SMA, there was no of extrasolar planets—that of measurement of precision new type of science to be done without having to go up to doubt that we have a rotating disk here.” radial velocities—is exceedingly difficult for close binary the telescope to put a new instrument in,” Batcheldor says. The other contributors to the SMA study of V4046 Sagittarii stars such as V4046 Sagittarii. So these radio observations “So for a very small cost, we’ve been able to expand the led by RIT’s Kastner and UCLA’s Rodriguez are Ben Zucker- are probing a new region of discovery space for extrasolar science that the Hubble Space Telescope can do.” man of UCLA and David Wilner of Harvard-Smithsonian planets,” says Rodriguez. The improved polarimetric capability of Hubble is indepen- Center for Astrophysics. Wilner is one of the world’s experts “At a distance of only 240 light-years from the solar sys- dent of the final servicing mission of the telescope sched- on radiointerferometry, the technique used in this study to tem, the V4046 Sagittarii binary is at least two times closer uled to take place in May. This effort will install two new form images using the SMA’s multiple radio antennas at to Earth than almost all known planet-forming star systems, cameras, fix two existing cameras and replace the gyro- Mauna Kea Observatory in Hawaii. which gives us a good shot at imaging any planets that scopes that determine the orientation of the telescope. According to Rodriguez, the images clearly demonstrate have already formed and are now orbiting the stars,” he that the molecular disk orbiting the V4046 Sagittarii binary Batcheldor’s team included RIT physics professors David continued. Axon and Andrew Robinson, as well as Glenn Schneider system extends from within the approximate radius of Kastner and collaborators had previously used the 30-me- and Gary Schmidt from the University of Arizona, Dean Neptune’s orbit out to about 10 times that orbit. This region ter radiotelescope operated by the Institut de Radio Hines from Space Science Institute, Bill Sparks from the corresponds to the zone where the solar system’s giant Astronomie Millimetrique (IRAM) to study radio molecular Space Telescope Science Institute and Clive Tadhunter from planets, as well as its Pluto-like Kuiper Belt objects, may spectra emitted from the vicinity of the twin stars. The the University of Sheffield. have formed. scientists used these data to identify the raw materials for “We believe that V4046 Sagittarii provides one of the clear- planet formation around V4046 Sagittarii—circumstellar est examples yet discovered of a Keplerian, planet-forming carbon monoxide and hydrogen cyanide—in the noxious Release Date: June 10, 2009 disk orbiting a young star system,” Wilner says. “This circumstellar molecular gas cloud. particular system is made that much more remarkable by the Contact: Susan Gawlowicz. fact that it consists of a pair of roughly solar-mass stars that “In this case the stars are so close together, and the profile 585-475-5061 or [email protected] are approximately 12 million years old and are separated by of the gas—in terms of the types of molecules that are there—is so much like the types of gaseous disks that Radio Telescope Images Reveal Planet-forming Disk a mere 5 solar diameters.” we see around single stars, that we now have a direct link Orbiting Twin Suns “This could be the oldest known orbiting protoplanetary between planets forming around single stars and planets molecular disk and it shows that, at least for some stars, forming around double stars,” Kastner says. RIT professor Joel Kastner leads study formation of Jovian-mass planets may continue well after Astronomers are announcing today that a sequence of im- the few million years, which astronomers have deduced is ages collected with the Smithsonian’s Submillimeter Array characteristic of the formation time for most such planets,” (SMA) radio telescope system clearly reveals the presence Zuckerman says. of a rotating, molecular disk orbiting the young binary star Findings of the SMA imaging study build on previous work system V4046 Sagittarii. The SMA images of V4046 Sagit- published in the December 2008 issue of Astronomy and tarii, which are being presented by UCLA graduate student Astrophysics in which Kastner and his team first suggested

23 Three RGB frames from the Common Sensor Payload project. Each image has been autoscaled by its own image statistics. The orbiting motion of the aircraft can be inferred by the displacement of the static scene content as time increases from (a) t=0s, through (b) t=10s, and to (c) t=30s.}

24 Research

Digital Imaging and Remote Sensing Laboratory (DIRS) Research Program Highlights: The DIRS laboratory continues to pursue research into Overview: remote sensing system along three broad themes: simula- tion and modeling of remote sensing systems, algorithm The Digital Imaging and Remote Sensing Laboratory had development for information extraction from imagery, and ex- a very successful 2008 - 2009 Academic Year graduating periments and measurements to support ongoing research several students and continuing to build on existing research efforts. The lab is supported by a wide range of research programs while developing new areas of research as well. sponsors from government and industry including the Air The Lab consists of six full time faculty, twelve full time re- Force Research Laboratory, the National Geospatial-Intelli- search staff, and over 35 students at the BS, MS, and Ph.D. gence Agency, the Army Research Laboratory, NASA, NSF, levels. In January 2009, Dr. John Schott stepped down as the US Geological Survey, ITT Industries, Lockheed Martin, DIRS participation in the IEEE International Geoscience and Remote Director of the Laboratory after over 20 years of successful DigitalGlobe, and the US Department of Energy. Sensing Symposium in summer 2008.} leadership. Dr. David Messinger assumed the duties of Lab Modeling Support for the Common Sensor Payload: Director while John focuses on his students and his personal research, most notably his support for the NASA Landsat The US Army Common Sensor Payload (CSP) program program. At the 2009 RIT Commencement, Dr. Schott was tasked the Night Vision and Electronic Sensors Directorate recognized for his history of scholarly excellence by the RIT (NVESD) to calibrate and modify existing sensor perfor- Board of Trustees with the 2009 Trustee Scholarship Award. mance models to better support the CSP mission. These This award, established in 2005, is the premier recogni- performance models predict the ability of soldiers to perform tion for faculty contributions to scholarship, research, and a specified military discrimination task using an EO/IR sensor creative work. system. The DIRS lab was subsequently tasked to develop a set of synthetic imagery for use in human perception As taken from the official RIT announcement: testing. This imagery was to be used by NVESD to empiri- Schott has broad research and development experience cally measure the ability of persons to perform CSP-specific in advanced technology for solving problems related to military discriminations. The imagery simulated a color visible imaging science and remote sensing. He has served as the sensor operating at 30 frames per second and represented principal investigator on numerous research programs for a CSP on an appropriate aircraft and performing realistic both governmental and private sectors, including serving as mission scenarios. Dr. John Schott, shown here with several of his current Ph.D. students, a principal investigator for NASA’s Science Team. received the 2009 RIT Trustees Scholarship Award.} Schott also serves as a member of the Intelligence Science Board, which advises the intelligence community and the director of National Intelligence. Schott’s research has led to more than 100 technical publications, including a recent reference book on remote sensing, as well as co-inventor status on two patents. In addition,he has been awarded more than $10 million in sponsored grants and projects over the last decade.

25 SAR Simulation Research: Publications During This Period: [9] A. Schlamm, D. W. Messinger, and B. Basener, “Geo- metric estimation of the inherent dimensionality of single During 2008 we have initiated a focused effort that aims to [1] J. Bishoff, “Target detection using oblique hyperspec- and multi-material clusters in hyperspectral imagery,” integrate first principles radio frequency (RF) radiometry into tral imagery; a domain trade study,” MS dissertation, Journal of Applied Remote Sensing 3, 4 2009. the DIRSIG software model to support simulation of Synthetic Rochester Institute of Technology, College of Science, Aperture Radar (SAR) collections. The scope of the project Center for Imaging Science, Rochester, New York, [10] J. C. Makarewicz, T. W. Lewis, I. Bosch, M. R. Noll, is to outfit DIRSIG with adequate RF optical properties, atmo- United States, 8 2008. N. Herendeen, R. D. Simon, J. Zollweg, and A. spheric models, antenna transmission and receive capabili- [2] F. Padula, “Historic thermal calibration of the landsat 5 Vodacek, “The impact of agricultural best manage- ties, and required post-processing tools that enable the tm through an improved physics based approach,” MS ment practices on downstream systems: Soil loss and user to simulate SAR collections over existing scene models dissertation, Rochester Institute of Technology, College nutrient chemistry and flux to conesus lake, New York, (such as Megascene 1 and 2). The new SAR capability is of Science, Center for Imaging Science, Rochester, USA,” Journal of Great Lakes Research In press, not merely an image processing trick, but truly simulates the New York, United States, 10 2008. 2009. transmission and reception of bundles of RF photons as they [11] J. Mandel, L. S. Bennethum, J. D. Beezley, J. L. propogate between the antenna and scene elements. Le- [3] M. Turk, “A homography-based multiple-camera person-tracking algorithm,” MS dissertation, Rochester Coen, C. C. Douglas, M. Kim, and A. Vodacek, “A veraging the flexible platform motion and pointing capability wildland fire model with data assimilation,” Mathemat- of DIRSIG, the user can configure spotlight mode, stripmap Institute of Technology, College of Science, Center for Imaging Science, Rochester, New York, United States, ics and Computers in Simulation 79, pp. 584–606, mode, and even SAR-GMTI type collections {FIGURES: 12 2008. spotlight_example.jpg and stripmap_example.jpg, CAPTION: 8 2008. Examples of DIRSIG simulated SAR imagery collected in (a) [4] M. Stefanou, Spectral image utility for target detection [12] J. P. Kerekes, K. E. Strackerjan, and C. Salvaggio, stripmap and (b) spotlight mode.}. The raw outputs for SAR applications. Ph.D. dissertation, Rochester Institute of “Spectral reectance and emissivity of man-made collections are the in phase “I” and quadrature signals “Q” Technology, College of Science, Center for Imaging surfaces contaminated with environmental effects,” digitized at the A/D converter level which may be optionally Science, Rochester, New York, United States, 8 2008. Optical Engineering 47, pp. 106201/1–106201/10, mixed with a reference signal to remove the carrier frequen- 10 2008. [5] S. Klempner, Statistical modeling of radiometric error cy. Post-processing tools, specific to the collection modality propagation in support of hyperspectral imaging inver- [13] M. S. Foster, J. R. Schott, and D. W. Messinger, of interest, will be available in both compiled C++ programs sion and optimized ground sensor network design. “Spin-image target detection algorithm applied to low and IDL engineering code to form simulated exploitation Ph.D. dissertation, Rochester Institute of Technology, density 3d point clouds,” Journal of Applied Remote products. The added benefit to the community is a single College of Science, Center for Imaging Science, Roch- Sensing 2, 9 2008. simulation tool permitting analysis of remotely sensed phe- ester, New York, United States, 10 2008. [14] S. R. Lach, J. P. Kerekes, and X. Fan, “Fusion of nomenology across multiple passive and active modalities multiple image types for the creation of radiometrically- and wavelength regions. [6] B. Daniel, A System Study of Sparse Aperture Sensors in Remote Sensing Applications with Explicit Phase accurate synthetic scenes,” SPIE Journal of Applied Retrieval. Ph.D. dissertation, Rochester Institute of Remote Sensing , 7 2008. Technology, College of Science, Center for Imaging [15] M. S. Stefanou and J. P. Kerekes, “A method for as- Science, Rochester, New York, United States, 1 2009. sessing spectral image utility,” IEEE Transactions on [7] M. Montanaro, Radiometric modeling of mechanical Geoscience and Remote Sensing , 7 2008. draft cooling towers to assist in the extraction of their [16] Y. Li, A. Vodacek, R. L. Kremens, A. J. Garrett, I. absolute temperature from remote thermal imagery. Bosch, J. C. Makarewicz, and T. W. Lewis, “Circula- Ph.D. dissertation, Rochester Institute of Technology, tion and stream plume modeling in conesus lake.,” College of Science, Center for Imaging Science, Roch- Environmental Modeling and Assessment. 13, pp. ester, New York, United States, 5 2009. 175–289, 2008. [8] Z. Wang, A. Vodacek, and J. L. Coen, “Generation of [17] J. P. Kerekes, “Receiver operating characteris- synthetic infrared remote-sensing scenes of wildland tic curve confidence intervals and regions,” IEEE fire,” International Journal of Wildland Fire 18, pp. Geoscience and Remote Sensing Letters 5(2), pp. 302–309, 5 2009. 251–255, 2008.

26 [18] M. Montanaro, C. Salvaggio, S. D. Brown, D. W. [24] D. W. Messinger, C. Salvaggio, and N. M. Sinisgalli, pears in multiple wavelengths, from the visible light to the near and Messinger, A. J. Garrett, and J. S. Bollinger, “Radio- Spectral Sensing Research for Water Monitoring short infrared parts of the spectrum beyond what the eye can see. metric modeling of mechanical draft cooling towers to Applications and Frontier Science and Frontier Sci- (This mode can tell the difference between two blue cars passing.) assist in the extraction of their absolute temperature ence, and Technology for Chemical, Biological and The third imagery mode, polarization, cuts through glare and gives from remote thermal imagery,” in Proceedings of the Radiological Defense, vol. 48 of Selected Topics in information about surface roughness. It provides details that distin- SPIE, SPIE Defense and Security, Thermosense XXXI, Electronics and Systems, ch. Detection of gaseous guish between objects of similar color and shape. (This mode can Infrared Sensors and Systems, 7299, SPIE, (Orlando, effluents from airborne LWIR hyperspectral imagery lock onto the unique material properties of the blue car in question.) Florida, United States), 4 2009. using physics-based signatures. World Scientific “These are all complementary pieces of information and the [19] M. V. Arsenovic, C. Salvaggio, A. J. Garrett, B. D. Publishing Company, Hackensack, New Jersey, idea is that if the object you are tracking goes into an area Bartlett, J. W. Faulring, R. L. Kremens, and P. S. United States, 1st ed., 12 2008. where you lose one piece of information, the other information Salvaggio, “Use of remote sensing data to enhance might help,” Kerekes says. the performance of a hydrodynamic simulation of a university | NEWS ❯❯ As the lead scientist on the project, Kerekes assembled a compre- partially frozen power plant cooling lake,” in Proceed- hensive team with RIT collaborators and other scientists to envision ings of the SPIE, SPIE Defense and Security, Ther- Release Date: Feb. 12, 2009 the system from end to end: all the way from the design of the mosense XXXI, Infrared Sensors and Systems, 7299, optical and microelectronic devices to the synchronizing algorithms SPIE, (Orlando, Florida, United States), 4 2009. Contact: Susan Gawlowicz. 585-475-5061 or [email protected] that tie everything together. Improved Sensor Technology Could Someday Keep Tabs Zoran Ninkov, professor of imaging science at RIT, is working on [20] S. Higbee, D. W. Messinger, Y. Tra, J. Voelkel, and on Terrorists by Remote Control the overall optical system. Ninkov is modifying one of his own L. Chilton, “A bayesian approach to identifcation of astronomical optical sensors for this downward-looking pur- gaseous efuents in passive lwir imagery,” in Proceed- RIT professor John Kerekes leads $1 million project pose. Alan Raisanen, associate director of RIT’s Semiconductor ings of SPIE, Defense and Security Symposium, Scientists at Rochester Institute of Technology are designing a and Microsystems Fabrication Laboratory, is designing tunable Algorithms and Technologies for Multispectral, Hyper- new kind of optical sensor to fly in unmanned air vehicles, or microelectronics devices to collect specific wavelengths. Ohio- spectral, and Ultraspectral Imagery XV, 7334, SPIE, surveillance drones, tracking suspects on foot or traveling in based Numerica Inc., a large subcontractor on the project, is (Orlando, Florida, United States), 4 2009. vehicles identified as a threat. creating the advanced algorithms necessary for tracking a target and picking the right imaging mode based on the scenario. [21] T. Doster, D. Ross, D. W. Messinger, and B. Basener, “The Air Force has clearly recognized the change in the threat “Anomaly clustering in hyperspectral images,” in that we have,” says John Kerekes, associate professor in According to Kerekes, motivation for this project came from Paul Proceedings of SPIE, Defense and Security Sympo- RIT’s Chester F. Carlson Center for Imaging Science. “I think McManamon, former chief scientist at the Air Force Research sium, Algorithms and Technologies for Multispectral, we all understand that our military has a paradigm shift. We’re Laboratory’s Sensors Directorate in Dayton, Ohio, partly as a Hyperspectral, and Ultraspectral Imagery XV, 7334, no longer fighting tanks in the open desert; we’re fighting ter- means of eliminating data overload. SPIE, (Orlando, Florida, United States), 4 2009. rorists in small groups, asymmetric threats.” “The idea is to lead to more efficient sensing both from the point [22] B. Basener and D. W. Messinger, “Enhanced detec- Kerekes won a $1 million Discovery Challenge Thrust grant of view of collecting the data necessary and being able to adapt tion and visualization of anomalies in spectral imagery,” from the Air Force Office of Scientific Research to design ef- to these different modalities based on the conditions in the in Proceedings of SPIE, Defense and Security Sympo- ficient sensors using multiple imaging techniques to track an scene or the task at hand,” says Kerekes. sium, Algorithms and Technologies for Multispectral, individual or a vehicle. The catch phrase is ‘performance-driven sensing,’” he continues. Hyperspectral, and Ultraspectral Imagery XV, 7334, “The idea behind that is you let the task at hand and the desire to SPIE, (Orlando, Florida, United States), April 2009. The sensor will collect only the data it needs. It will assess a situation and choose the best sensing mode (black and white optimize the performance drive what information is collected.” [23] A. Schlamm, D. W. Messinger, and B. Basener, imaging, hyperspectral or polarization) for the purpose. Develop- Kerekes and his team are testing their preliminary models using “Effect of manmade pixels on the inherent dimension ing two strands of information—one about the target, the other generic scenarios played out in a simulated world akin to Second of natural material distributions,” in Proceedings of about the background environment—will be key to maintaining a Life. The computer program, known as Digital Imaging and Remote SPIE, Defense and Security Symposium, Algorithms connection and for piercing through camouflage effects. Sensing Image Generation model (http://dirsig.cis.rit.edu/), is driven and Technologies for Multispectral, Hyperspectral, by computer graphic codes that predict simulated sensor data and Ultraspectral Imagery XV, 7334, SPIE, (Orlando, This is how it will work: The sensor will collect a black and white and provide a platform for testing scenarios based on imaging Florida, United States), 2009. image of a target, say a car, and will record the shape of the object. A hyperspectral image will plot the object’s color as it ap- problems, such as Kerekes’ new sensor technology.

27 Release Date: Nov. 16, 2009 communication between the North American, European and African collaborators. Contact: Susan Gawlowicz “Most scientists are fairly in agreement that the lake is pretty 585-475-5061 or [email protected] stable; it’s not as if its going to come bursting out tomorrow,” Vodacek says. “But in such a tectonically and volcanically Volatile Gas Could Turn Rwandan Lake into a active area, you can’t tell what’s going to happen.” Freshwater Time Bomb One of the problems with Lake Kivu is that the 1,600-foot RIT professor organizes workshop in Rwanda to deep lake never breathes. The tropical helps stag- grapple with the problem of Lake Kivu nate the layers of the lake, which never mix or turn over. In A dangerous level of carbon dioxide and methane gas contrast, fluctuating temperatures in colder help haunts Lake Kivu, the freshwater lake system bordering circulate lake water and prevent gas build up. Lake Kivu Rwanda and the Democratic Republic of Congo. is different from both temperate and other tropical lakes because warm saline springs, arising from ground water Scientists can’t say for sure if the volatile mixture at the percolating through the hot fractured lava and ash, further bottom of the lake will remain still for another 1,000 years stabilize the lake. Scientists at the workshop will consider or someday explode without warning. In a region prone to how these spring inputs may vary over time under changing volcanic and seismic activity, the fragility of Lake Kivu is a climates and volcanic activity. serious matter. Compounding the precarious situation is the presence of approximately 2 million people, many of them A number of catalysts could destabilize the gas resting at refugees, living along the north end of the lake. the bottom of Lake Kivu. It could be an earthquake, a volca- nic explosion, a landslide or even the methane mining that An international group of researchers will meet Jan. 13-15 in has recently united Rwandan and Congolese interests. Gisenyi, Rwanda, to grapple with the problem of Lake Kivu. A grant from the National Science Foundation won by Roch- Close calls occurred in 2008 when an earthquake oc- ester Institute of Technology will fund the travel and lodging curred near the lake and in 2002 when a volcanic eruption for 18 scientists from the United States to attend the three- destroyed parts of Goma in the Democratic Republic of day workshop. Anthony Vodacek, conference organizer Congo, only 11 miles north of Lake Kivu. Although scientists and associate professor at RIT’s Chester F. Carlson Center were alarmed, neither event sufficiently disturbed the gas. for Imaging Science, is working closely with the Rwandan Vodacek likens the contained pressure in the lake to a bottle Ministry of Education to organize the meeting. of carbonated soda or champagne. “In the lake, you have “Rwandan universities suffered greatly in the 1994 genocide the carbon dioxide on the bottom and 300 meters of water and there are few Rwandan scientists performing significant on top of that, which is the cap,” he says. “That’s the pres- work on the lake or within the rift system,” Vodacek notes. sure that holds it. The gas is dissolved in water.” “We will work with the government to identify interested When the cap is removed, bubbles form and rise to the sur- researchers.” face. More bubbles form and create a column that drags the Vodacek is convening the workshop with Cindy Ebinger, an water and the gas up to the surface in a chain reaction. expert in East African Rift tectonics at the University of Roch- “The question is, and what’s really unknown, is how explo- ester, and Robert Hecky, an expert in limnology—the study sive is that?” Vodacek says. of lake systems—at University of Minnesota-Duluth. Core samples Hecky took in the 1970s initially brought the safety Through his own research Vodacek plans to simulate the of Lake Kivu under question. circulation of Lake Kivu. Modeling the circulation patterns above the layers of carbon dioxide and methane will help Addressing the lake as a whole system is a new concept determine the energy required to disrupt the gas and cause for the workshop participants, who will bring their expertise Lake Kivu to explode. in volcanology, tectonics and limnology to the problem. Vodacek’s goal is to prioritize research activities and improve

28 29 30 Laboratory for Imaging ing. A camera geometry calibration laboratory with a unique opportunities with faculty from other colleges at RIT such as imaging cage has been constructed for the calibration of the College of Engineering, College of Applied Science and Algorithms and Systems (LIAS) infrared and visible camera equipment. Technology, and the College of Liberal Arts. Overview Networked, Ground Based Sensors Students LIAS provides students with valuable hands-on experience The Laboratory for Imaging Algorithms and Systems (LIAS) The LIAS Ground Station Laboratory develops sensors that developing sensor systems, working in field environments, was founded in 2001 to develop imaging systems and algo- can be deployed on the surface or in the water to monitor and processing sensor data. The multidisciplinary of rithms and carry them to the point of prototypical use. LIAS environmental parameters for environment and emergency our work draws students together form a variety of programs research and development thrusts include response monitoring. The ground sensor systems and the air- including • high performance airborne imaging systems borne systems can be used together to provide an integrated view of the environment using imagery and sensor data. • Imaging Science • networked, ground based sensing systems • Electronic/Mechanical Technology • management and processing of sensor data Data Processing and Management • Computer Engineering • development of high value information products Imaging algorithms are developed by the group, often in collaboration with the DIRS laboratory, for the managing • Bio-Medical Engineering LIAS is housed on the second floor of the IT Collaboratory, and extracting information from remote sensing imagery. An • Mechanical Engineering Building 17. The current facilities include about 10,000 airborne system software architecture has been developed square feet of laboratory space for the construction and to manage real-time collection, processing and delivery of • Computer Science calibration of equipment and the development of software image and sensor information to end users such as emer- • Electrical Engineering systems. gency responders. Currently 5 graduate students and 10 undergraduates are . Airborne Imaging Systems High Value Information Products working on LIAS projects. LIAS operates 4 airborne imaging systems. Imagery from Data realizes it's maximum value when it is used to make a these sensors is processed into georeferenced images for decision. LIAS researchers work with application specialists integration and display with standard geographic information to develop new ways of collecting and processing remote systems (GIS). Airborne sensors include: sensing data into high value information that enables quicker, more effective decision making. Application areas are varied WASP: High performance visible/IR (RGB, SWIR, MWIR, and include wildfire behavior, environmental management LWIR) mapping system and, emergency response. WASP LITE: Light weight 7 band imaging system with . reconfigurable spectral filters Our People MISI: 70 band visible, 10 band infrared imaging spectrometer Faculty and Staff CAMMS: compact, light weight mapping system for light LIAS faculty and staff work as an interdisciplinary team aircraft or UAV applications to integrate systems, analyze problems and advance the The WASP system is unique in its ability to do rapid image state of knowledge in remote sensing. We also work with collection in both visible and infrared bands and its ability to collaborators in the academic, industrial and government process and deliver the imagery to users in various locations sectors. The LIAS team operating under the leadership of Dr. in real time. The airborne data processing (ADP) architec- Jan van Aardt includes faculty members Dr. Harvey Rhody ture supports sensors, algorithms and communications as and Dr. Robert Kremens plus senior research staff Mr. Don modules in a network environment. This enables distributed McKeown, Mr. Robert Krzaczek, and Mr. Jason Faulring. processing between remote and ground stations and imme- Together, this team expertise includes environmental remote diate response to users. The uniqueness of this framework sensing, image processing, data management, system led Leica Geosystems, Inc. to name the LIAS laboratory a engineering and sensor integration. With close working ties Center of Excellence in Photogrammetry and Remote Sens- across departmental boundaries, LIAS provides collaboration

31 Major Projects in 2009 the absorption. This project has implications both for airborne measurements of wildfires (see 1 above) Wildfire Behavior and satellite measurements (e.g. MODIS Product LIAS under the leadership of Dr. Kremens has performed #14). The satellite measurements have been used in collaborative research on wildland fire behavior with three the past to estimate global carbon production from research groups within the USDA Forest Service: Northern wildfires burning; these estimates may be seriously Research Station (NRS), Pacific Northwest Research Sta- compromised if absorption/scattering proves to be a tion (PNWRS), and the Rocky Mountain Research Station significant effect in IR measurement of wildfires. (RMRS). These projects build on our expertise in infrared 3. Development of Infrared Sensing Systems to Un- remote sensing, image analysis, instrumentation, design of derstand Radiant Heat Release for Wildland Fire experiments, and the application of basic physics principles Research: A Research Joint Venture Agreement with to environmental problems. The projects, goals and achieve- Colin Hardy and others at the RMRS. The purpose ments are outlined below: of this agreement is to explore, develop, and apply 1. Validation of Fuel Consumption Models for Smoke state-of-science thermal infrared (TIR) remote sens- Management Planning in the Northcentral and ing hardware, algorithms, data acquisition methods, Northeastern Regions of the United States with Roger and integrated systems to quantify the processes and Ottmar (PNWRS) and Matt Dickinson (NRS). We have first-order effects of combustion in wildland fuel. In particular, we seek to understand the radiant heat re- developed ground based and airborne data collec- Figure 1: LIAS Support to Wildfire Research tion systems to measure fuel consumption in several lease from wildland fire combustion at laboratory and in the Northeast (KY, OH, VA) and North ‘field’ scale, including parameters such as emissivity, Central (AK, MS). The ground based equipment total energy release, radiant flux, and energy partition consists of man-portable 6.5m observation towers between radiative and non-radiative processes such with instruments to measure radiant energy release, as convection. To these ends, we will collaborate in weather parameters (wind speed, direction, relative the development of new and improved instrumenta- humidity and air temperature at two heights, mid-flame tion, laboratory and field experiments, data analysis and 6.5 m), gas composition (CO and CO2) and and publication and dissemination of the results of the ground temperatures. We also deploy a long dura- work. Our laboratory will develop the next generation tion recording RIT-developed fireproof video camera of field instruments for the US Forest Service under to observe flame heights and measure flame front this agreement. speed. The NASA-developed WASP airborne camera Figure 1 shows Scientist Bob Kremens during a prescribed system will be used to observe the fires on a land- fire operation in which 6 RIT ground stations were deployed scape scale from above. Fuel consumption for the with a sequence of mosaic longwave infrared images . entire landscape will be made with the WASP camera produced by overflight of the WASP-LIE camera system . system using methods developed with the NRS during on a 800 acre prescribed fire in Daniel Boone National . previous research campaigns. Forest. The ignition patterns and progression of the fire . 2. Developing technologies for remote and on-the- may be clearly seen. for this major NASA observatory. The DCS was successfully ground monitoring of wildland fires with Matt Dickinson SOFIA Data Cycle System (DCS) of the NRS. This focus of this project is estimation of delivered for integration last year. Bob Krzaczek is the lead the transmission of infrared radiation through the forest This year saw the continuation of the grant for the de- software architect on this project which is undergoing the canopy. In conifer or leaf-on deciduous landscapes, velopment of the DCS for the Stratospheric Observatory final stages of integration at NASA. SOFIA is slated to begin some of the infrared radiation produced by a forest for Infrared Astronomy (SOFIA). SOFIA is a joint program its “first light” observations in early winter 2009-2010 as part fire may be intercepted by the forest canopy and between NASA and the German Space Agency, Deutsches of the airborne telescope’s 20-year celestial observation effectively removed from the measurement process. Zentrum fur Luft- und Raumfahrt (DLR). Bonn, Germany. This program. Using field measurements and modeling (analytic project was begun several years ago to develop a complete and DIRSIG) this project will measure the severity of observation management system for general investigators

32 Integrated Sensing Systems Testbed (ISST) ment of ice on a designated power plant cooling lake in Michi- ISST is a NASA funded program lead by Don McKeown that gan. In support of DIRS, LIAS under the leadership of Jason follows on the highly successful WASP program. The WASP sys- Faulring, provides development of specialized buoy-based tem, originally conceived as a new airborne system for the detec- sensors, weather sensors, and airborne thermal infrared imag- tion and mapping of wildfires in support of the US Forest Service, ing. The buoys are complex systems that measure water tem- was successfully demonstrated as a tool for disaster response perature at various depths and automatically log and transmit and law enforcement during 2007. A key objective is to demon- measurements wirelessly to RIT from the test site in Michigan. strate the integration of WASP imagery information products into Thermal infrared imagery gathered on a periodic basis is the disaster response workflow. Figure 3 shows the installation of combined with buoy temperature data to provide detailed 3D the WASP sensor system in a high performance Piper Navajo for temperature distribution estimates over the entire lake. rapid deployment to designated target areas. Figure 5 shows a colorized thermal infrared image collected by the LIAS WASP sensor of the power plant cooling lake dur- Figure 3: WASP Sensor Installed in High Speed Aircraft ing winter. The yellow areas indicate warm water discharged ISST also features integration of WASP imager data with NASA's World- from the power plant. Blue areas are areas of snow and ice. Wind image viewer software. Figure 4 shows a "screen capture" of a The inset at upper right is a color image showing the power high resolution archived WASP image (RGB) of the city of Rochester, NY plant and cooling lake during the summer. The inset at lower displayed as a data layer in the World Wind viewer. In this example the World Wind viewer accessed the WASP imagery through a dedicated right shows one of five LIAS temperature measurement buoys server at RIT using GeoServer, an Open Geospatial Consortium (OGC) deployed on the power plant cooling lake in Michigan that compliant, open source (WMS). The underlying base continuously monitor lake water temperature and relay those image seen in the upper right corner is a standard LANDSAT image. measurements via wireless link back to RIT. Note the high resolution of the WASP imagery as compared to LANDSAT.

Figure 2: NASA’s SOFIA Observatory

Figure 4: Integration of WASP imagery with NASA WorldWind Viewer

Figure 5: LIAS Provides High Resolu- Cold Lake Project (support to DIRS) tion Thermal Imagery and Automated Temperature Measurements In support of a major research effort funded by the Depart- ment of Energy (DOE) to model ice formation on power plant cooling lakes, the DIRS laboratory under the direction of Dr. Carl Salvaggio has been tasked to characterize the develop-

33 Information Products Laboratory for Emergency Data Process Management Architecture Response (IPLER) LIAS is developing new sensor system development software Under sponsorship from the National Science Foundation tools for the Air Force Office of Scientific Research (AFOSR) (NSF), LIAS has kicked off a new project to promote the use under a subcontract with City College of New York (CUNY). of remote sensing technologies for emergency response Dr. Rhody assisted by Bob Krzaczek is developing the Data applications. The Information Products Laboratory for Emer- Process Management Architecture (DPMA), a software gency Response (IPLER) is a joint research project between system that provides a team development environment and a LIAS and the MCEER extreme events research laboratory at structured operational platform for systems that require many Figure 8: End to End Modeling Flow Provided by the DPMA imaging provided by Light Detection and Ranging (LIDAR) systems has enor- the University at Buffalo. Dr. Don Boyd, RIT VP of Research is interrelated and coordinated steps. It is intended to support mous potential for various applications ranging from environmental studies to principal investigator, with Dr. van Aardt and Dr. Tony Vodacek team-based design and evaluation of complex systems by disaster response. Under the Dr. van Aardt's leadership, LIAS is rapidly increas- from DIRS as co-PIs. providing mechanisms that enable evolutionary development ing the collection and processing of LIDAR datasets. Figure 9 shows a display The mission of IPLER is to facilitate the communication of and capture of knowledge about the behavior of compo- of LIDAR data for a portion of the RIT campus. LIDAR data consists of "point information user (emergency manager) needs to the technol- nents and their interactions. This enables valuable, and often clouds" in which each point corresponds to a LIDAR "hit" or return located in ogy and service provider community and conversely, inform expensive, knowledge to be captured and reused. The DPMA terms of its X, Y, and Z coordinates. Colors in the image indicate elevation. users of the capabilities of new and emerging technologies design is based on three primary capabilities: archival data to provide the information they need. The desired outcome is management that maintains a complete pedigree of all data renewed growth of business opportunities for technology and elements, intelligent distributed agents that carry out all of the service providers, and better decision making capabilities for processing tasks in a heterogeneous environment, and pro- incident managers. cessing workflows that provide a fluent means to describe the relationship of modules within the design environment. The Figure 6 shows an example information product in which design is based on concepts of Representational State Trans- aerial imagery of a large river flood area can be displayed on fer (REST) and provides a modular and scalable framework top of a to provide instant situational aware- in which a heterogeneous collection of algorithms in different ness to emergency managers. programming languages and data in different formats can be Technology Transfer Projects utilized fluently in the development of complex data process- ing systems. LIAS under sponsorship from the New York Office for Sci- ence, Technology, and Innovation (NYSTAR), and in collabora- Figure 8 illustrates the progression of the modeled data path Figure 9: LIDAR Image of RIT Campus tion with Geospatial Systems Inc. (GSI) is showcasing GSI from the raw scene to a processed target detection map that camera technology as part of demonstrations to the Monroe is managed by the DPMA. LIAS is collaborating with Carnegie Institution for Science County Office of Emergency Management. Figure 7 shows (Dr. Greg Asner), the Council for Scientific and Industrial the GSI KCM-11 high resolution metric imaging sensor with Research, South Africa (Drs. Renaud Mathieu and Konrad an aerial image in the Rochester area collected by LIAS. Wessels), and the University of the Witwatersrand (Dr. Barend Erasmus) on an ambitious hyperspectral-lidar project to quan- tify savanna structure, function, and composition. The project is hosted by the Kruger National Park in South Af- rica and juxtapositions protected, commercial wildlife tourism, and communal grazing land use areas. The main goals of the initiative is to quantify landscape heterogeneity, investigate the effect of fire on vegetation structure, and assess eco- system structure and function, as well as land degradation, along a land use gradient. The novelty lies in the combined use of imaging spectroscopy and waveform LIDAR data from the Carnegie Airborne Observatory; both data types require advanced analysis approaches and signal processing skills.

Figure 6: Aerial Imagery Combined with Maps Provide Information Figure 7: LIAS Integrated GSI Camera System for Flight Demonstrations

34 CIS in general, and DIRS and LIAS specifically, are well versed Mosaics", Electronic Imaging Symposium, San Jose, . Autonomous Sensor Network for Remote Sensing Applica- in research that utilizes remote sensing modalities of high data CA, Jan 2007 tions—Published in the proceedings of the International dimensionality. LIAS has carved a niche for itself in this project Society for Computers & Their Applications First International in terms of waveform processing research, woody and herba- Seminars and Presentations Conference on Sensor Networks & Applications, November . ceous biomass assessment, structural unmixing approaches, Stephen R Lach, Semi-Automated DIRSIG Scene Modeling 4 -6 2009, San Francisco, California USA and fusion of the two modalities towards assessing savanna from 3D LIDAR and Passive Imaging Sources, February 7, Wu J., J.A.N. van Aardt, G. P. Asner, R. Mathieu, T. . ecosystem structure and land degradation. Dr. van Aardt 2007. (Digital Imaging and Remote Sensing seminar) Kennedy-Bowdoin, D. Knapp, K. Wessels, B.F.N. . is leading the effort locally, and is supported by William Wu Erasmus, and I. Smit, 2009. Connecting the dots between (PhD; processing, simulation, and biomass estimation), Diane Harvey Rhody, Automated Imagery Analysis & Scene . laser waveforms and herbaceous biomass for assessment . Sarrazin (MS; data fusion approaches), Joe McGlinchy . Modeling, NARP Symposium, September 13-15, 2006, of land degradation using small-footprint waveform lidar . (MS; structural umixing), and David Kelbe (senior; waveform Washington, DC data. Proceedings of 2009 IEEE International Geoscience . scaling). This research has the potential to establish . Li, Y., A. Vodacek, N. Raqueno, R. Kremens, A.J. Garrett, & Remote Sensing Symposium, July 13-17, 2009, Cape operational workflows and algorithms for waveform lidar . I. Bosch, J.C. Makarewicz, and T.W. Lewis. Circulation and Town, South Africa, 4p. processing and applications in the context of vegetation stream plume modeling in Conesus Lake. Environmental structural assessment. Modeling and Assessment. 13:275-289. doi:10.1007/ Wu J., J.A.N. van Aardt, G.P. Asner, T. Kennedy-Bowdoin, D. Knapp, B.F.N. Erasmus, R. Mathieu, K. Wessels, and Figure 10 shows a cross section of high resolution waveform s10666-007-9090-x. (2008) I.P.J. Smit, 2009. LiDAR waveform-based woody and foliar LIDAR imagery from Kruger National Park in South Africa. . Kremens, R.L., Dickinson, M.B., Bova, A. Multi-Scale Wildfire biomass estimation in savanna environments. Peer-reviewed Note the fine detail in the tree canopies where individual Radiant Energy and Power Measurements: 1. Field Scale proceedings: Silvilaser 2009 - 9th International Conference on leaves can be seen. Experiments. Submitted to the Canadian Journal of . Lidar Applications for Assessing Forest Ecosystems, October Forestry (2008) 14-16, 2009, College Station, TX, 10p. Presentations Kremens, R.L, Dickinson, M.B., Bova, A, Suciu, L., Young, . V. Multi-scale remote sensing of wildland fires: from laboratory Figure 10: High Resolution Waveform LIDAR Shows Detailed Tree Canopy to landscape. Presented at the SPIE Annual Meeting, . Structure San Diego, CA. July 2008. Kremens, R.L, Dickinson, M.B., Bova, A, Suciu, L., Young, Group Publications V. Airborne Multi-spectral imaging as an assessment and S.R. Lach, S.D. Brown and J.P. Kerekes, "Semi-Automated management tool for prescribed fires. Presented at the 23rd DIRSIG Scene Modeling from 3D LIDAR and Passive Imag- Annual Society for Conservation Biology Annual Meeting, ing Sources", SPIE Laser Radar Technology & Applications Chattanooga, TN. July 2008. XI, Defense & Security Symposium, Orlando, FL, April, Kremens, R.L, Drake, R, Hovey, A., Bove, G.E. and . 2006 Tompkins-Tinch, C.H. Inexpensive Buoys for Environmental Stephen R. Lach and John P. Kerekes, "Multisource Data . Education and River Water Quality Monitoring. Presented Processing for Semi-Automated Radiometrically-Correct at the 51st Annual Conference on Great Lakes Research Scene Simulation", URBAN/URS, Paris, April 2007. (IAGLR). Peterborough, Ont., Ca. May 2008 Xiaofeng Fan and Harvey Rhody, "A Harris Corner Label . R.L Kremens, G. E. Bove, R. Drake and D. E. Shields. . Enhanced MMI Algorithm for Multi-Modal Airborne Image . Remote Sensing Solutions to Monitor Water Pollution and Registration, 2nd International Conference on Computer . Energy Distribution System Security. Presented at the . Vision Theory and Applications, Barcelona, 8-11 March, . conference ‘Natural Disasters in Small Communities’, SUNY 2007 VISAPP 2007 Buffalo, Buffalo, NY February 2008. Prudhvi Gurram, Eli Saber and Harvey Rhody, "A Novel Tri- Faulring, Jason W., Casterline, May V., Salvaggio, Carl, . angulation Method for Building Parallel-Perspective Stereo Kremens, Robert L., Salvaggio, Philip S., Deployment of an

35 university  NEWS ❯❯ Information products developed at the RIT-UB lab will identified products,” says Jan van Aardt, RIT co-principal | identify priority areas in disaster events through the use of investigator. “It’s all about open flow of communication from Release Date: Aug. 19, 2009 digital elevation models of ground surfaces for flood-plain end-user up to the level where we integrate systems and mapping using radar or light detection and ranging, or algorithms for operational purposes. ” LIDAR, sensors, and multi-spectral infrared detection of fire Contact: Susan Gawlowicz. The first set of information products will focus on flood and floods through long- and short-wave infrared sensing. 585-475-5061 or [email protected] and wild land fire mapping using existing data collected by Managing Disasters with High-tech Imaging Could “By working with agencies, companies and end-users, researchers at RIT’s Chester F. Carlson Center for Imaging Save Lives IPLER allows us to leverage the broad expertise in disas- Science and UB’s MCEER. Next year, the team will define ter mitigation and response that is exemplified by the UB another set of disasters based on user need. RIT, University at Buffalo seek to improve emergency 2020 extreme events strategic strengthUB 2020 Strategic “We could potentially go from fires to gas leak detec- response with real-time information Strength on Extreme Events,” says Chris Renschler, asso- tion, environmental disasters, terrorist attacks,” says Don ciate professor in the UB Department of Geography, leader The debacle of Hurricane Katrina proved that scram- McKeown, RIT research scientist and Information Products of the UB team and research scientist of the National Cen- bling for information during a disaster is no way to run an Laboratory for Emergency Response team member. “A ter for Geographic Information and Analysis and at UB’s emergency response effort. Quick access to information is lot of the tools you have in your remote-sensing tool box MCEER, (formerly known as the Multidisciplinary Center for critical to saving life and property in the precarious hours are the same; it doesn’t matter what the application is.” Earthquake Engineering Research). “An important goal of following a disaster. “Research won’t gather dust on a shelf,” adds van Aardt. this project is ensuring that the new technologies that we “Research outputs will actually be used in operational envi- Improving disaster response is one of the goals of the develop in our research labs at RIT and UB will best meet ronments. I think that’s really exciting.” Information Products Laboratory for Emergency Response, the needs of the people in agencies and industries who are a partnership between Rochester Institute of Technology charged with protecting our communities during disasters Student research is another important aspect of the labora- and the University at Buffalo. The collaboration will foster and attempting to improve their resilience in the face of tory. The NSF grant will support an undergraduate in imag- research to improve disaster mitigation planning, real-time natural and man-made hazards.” ing science and in computer science, as well as a doctoral response and recovery efforts, and to create potential busi- candidate. Working under Tony Vodacek, RIT co-principal Researchers at the Information Products Laboratory for ness opportunities for industry. investigator on the lab team, is Bin Chen, a doctoral candi- Emergency Response will hold a series of workshops date at RIT’s Center for Imaging Science, who will provide The incubator, funded with $600,000 from the National starting in the fall to bring together disaster management the research backbone for product development. Science Foundation, will focus on technology, policy experts and technology and service providers. Industry and business-development and bring together university partners specializing in satellite and airborne sensors and “We’re educating students who know something about researchers, private sector service and product providers, analysis software tools are Kucera International, ImageCat the emergency response community,” notes Vodacek. and emergency response decision makers. Inc., DigitalGlobe and Pictometry International. These team “Their potential jobs would be working for companies like “The economic benefit of this initiative will be seen in the members will share data sets for research and develop- the ones we’re partnering with. In essence, they’d get growth of disaster-related information products and work- ment and existing software tools. In turn, the companies scientists with the expertise so that they can do their own ers who know how to use them,” says Donald Boyd, RIT will benefit from products developed at the lab and con- research.” vice president of research and lead scientist on the project. tacts with potential clients. The Information Products Laboratory for Emergency Re- RIT and UB are leading centers in remote sensing, or the Public sector partners will provide consultation for informa- sponse team is led by RIT’s Don Boyd. Supporting mem- use of airborne sensors or to capture data tion product needs and requirements, and feedback on bers of the laboratory include remote sensing researchers over large areas. The laboratory team has extensive experi- research. The U.S. Forest Service Remote Sensing Ap- at RIT: Jan van Aardt, Don McKeown and Tony Vodacek, ence in fire and flood research, and previous collaborations plications Center, New York State Office of Homeland Se- and Jamie Winebrake, chair of science, technology and with local emergency response personnel. Matching the curity, New York State Foundation for Science, Technology society/public policy; and geospatial analysis experts at needs of emergency responders with information products and Innovation and Monroe County Office of Emergency UB: Chris Renschler and Ronald Eguchi, an MCEER affili- that combine remote sensing imagery with geographical in- Management will provide feedback. ate from ImageCat Inc. of Long Beach, Calif. formation systems is central to the lab’s mission. Geospa- “The idea is that we go directly to end-users and ask tial analysis technology can be used to show crisis manag- them what they need in terms of disaster management ers what is happening during a disaster, where events are products, and then go back to the sensing system and do occurring and how they might develop over time. the research and develop the algorithms that lead to the

36 37 Professor Roy S. Berns making spectral reflectance factor measurements of The Bedroom (F 482) at the Van Gogh Museum in Amsterdam. These measurements were used to identify appropriate retouching paints for an upcoming treatment and to assess color changes during the last 75 years.

38 Munsell Color Science a university research program. A proposal was made to the as the geometric and spatial properties of materials, both of foundation by RIT to use the assets to establish a research which affect the color perception of an object. Words such Laboratory (MCSL) laboratory, the Munsell Color Science Laboratory, which as glossy, hazy, rough, smooth, and matte are aspects of would be directed by the Hunter Professor. The combina- appearance. During the 20th Century, color and appearance Laboratory Director’s Comments tion of an endowed professorship in color science, a history were measured separately using instruments that integrated By Roy S. Berns of industrial color research, and Franc Grum’s interests and large areas. In the 21st Century, these measurements are reputation proved to be a winning combination. The Munsell performed using imaging systems, enabling material color and Overview Color Science Laboratory (MCSL) was established following appearance to be quantified simultaneously. Color appear- the dissolution of the Munsell Color Foundation in 1983. MCSL Celebrates Its Silver Anniversary ance is a term defining color perception within the context of Using the Rensselaer Color Measurement Laboratory, a highly an environment and enables numerical specification taking RIT’s commitment to color technology began long before the into account factors such as lighting, surround, and size. A creation of the Munsell Color Science Laboratory (MCSL). successful academic research program in color science di- digital image quantifies a complex scene. Image appearance Starting with the Graphic Arts Research Center (GARC) and rected by Fred Billmeyer, Jr. (also the secretary of the Munsell models are used to predict how our visual system interprets later the RIT Research Corporation, there were research Color Foundation Board of Trustees), as a model, four guiding such a scene by re-rendering the image at different points projects concerned with improving our understanding and objectives evolved for MCSL: along the visual pathway. Clearly, imaging science is a critical practices of color reproduction, particularly color printing. As (1) To provide undergraduate and graduate education in discipline in our research and education. early as 1975, Milton Pearson, a leader in graphic arts color color science, research and a GARC scientist, proposed the formation of a (2) To carry on applied and fundamental research, Since the lab’s creation, we have bridged basic science and color research laboratory in order to expand such activities its practical application in advancing technology. While we on campus. RIT fostered research connections with Hunter (3) To facilitate spectral, colorimetric, photometric, spatial, have received substantial, ongoing funding for basic research Associates Laboratories and Richard Hunter, its founder, and and geometric measurements at the state-of-the-art, from federal agencies and foundations, one of the unique with Eastman Kodak and Franc Grum. By the 1980’s, Franc and aspects of MCSL is the strength of our research ties and Grum was a research laboratory head in optical metrology (4) To sustain an essential ingredient for the success of support from industry. Most of our graduates have gone on to and standards at Kodak, the Division 2 director of the Inter- the first three—namely, liaison with industry, academia successful careers within these industries. national Commission on Illumination, and the vice president and government. of the Board of Trustees of the Munsell Color Foundation, Inc. Twenty-five years ago, MCSL began in a single room. The current facilities encompass about 8000 square feet dedi- This foundation had been supporting graduate research in Thus the mission of the Munsell Color color science for many years. cated to color science education and research. They include Science Laboratory is to advance the student, faculty, and staff offices, a teaching laboratory (Franc During this time, Franc Grum became an adjunct professor science, understanding, and technology Grum Color Science Learning Center), several research within the School of Photographic Arts and Sciences at RIT laboratories (Spectral Color Reproduction, Material Appear- and assumed the pivotal role in expanding the concept of a of color and appearance through ance and Novel Displays, 3-D Imaging, Metrology, and Vision color science research laboratory to include a significant edu- and Psychophysics), and support facilities. The facilities have cational component and a standards facility in color measure- education, research, and outreach. been equipped with several million dollars worth of instrumen- ment. Richard Hunter recognized the need for a faculty mem- tation and systems through a long history of external research ber devoted to this scientific discipline culminating in 1982 Today, color science research at RIT encompasses diverse funding and corporate donations. with the establishment of the Richard S. Hunter Professorship fields such as computer graphics and animation, art con- in Color Science, Appearance, and Technology through a gift servation, spectral and spatial measurements of materials, from Richard and Elizabeth Hunter. The goal of the professor- color printing and display, lighting, digital photography, digital ship was to increase RIT’s research and educational efforts cinema and television, digital image processing, and vision in the area of color science, appearance and technology in modeling for use in defining color quality for manufacturing. order to “benefit the industry and science concerned with MCSL is one of the research labs within RIT’s Chester F. color.” Franc Grum took early retirement from Kodak and was Carlson Center for Imaging Science. Imaging science has appointed the first Hunter Professor in 1983. provided many synergistic technologies that aid the advance- Concomitantly, the Munsell Color Foundation, Inc. was mak- ment of color science knowledge, particularly when relating ing plans to dissolve itself and looking to transfer its assets to “color” and “appearance.” Richard Hunter defined appearance

39 Our educational programs have also continued to grow in 25 Professor), and Garrett Johnson (CIS Affiliate Professor). . years. In 1983, a lone student in the Photographic Science Current staff include David Wyble (Associate Scientist), . department was helping Franc Grum create an operational Lawrence Taplin (Assistant Scientist), and Valerie Hemink research laboratory. There was a single undergraduate course (Administrative Assistant). in colorimetry. Today, we have M.S. and Ph.D. degrees in color science and imaging science students can concentrate in color imaging. There are seven core graduate courses in Research Themes color science. MCSL has had up to 20 students engaged Research in MCSL can be organized into these general in research at one time. This year is a milestone in graduate themes: education; the number of MCSL graduates has topped 100. Currently, we are four full-time and two affiliate faculty mem- 1) Colorimetry including metrology, psychophysics, . bers, two technical staff, and one administrative assistant. and tolerance formulae modeling, The industrial courses developed by Fred Billmeyer, Jr. and 2) Image color-appearance psychophysics and modeling, transferred to RIT in 1983 have evolved to “Essentials of Color Science,” a four-day course containing 16 seminars from the 3) High-dynamic range image capture and display, basics to our latest research activities, team-taught by MCSL 4) 3-D imaging of paintings including BRDF, surface-. faculty and staff. The course has remained fully enrolled since normal, and visible-spectral measurements and . 1983.We have also developed a visiting scientist program realistic image synthesis, providing advanced education and research opportunities for 5) Spectral color reproduction including multi-spectral . industrial scientists and engineers. capture, multi-ink inkjet printing, and spectral color . A MCSL hallmark is the publication of articles, writing books, management, participating in conferences, and participating in standards 6) Art conservation science, committees. As an example, during 2007, we had 53 publi- cations, and this year, 50. 7) Material appearance Clearly, our achievements are a result of community: the color science community beyond RIT that has given us support, guidance, and encouragement; the RIT community that has Facilities encouraged our evolution; and most importantly, the com- The laboratory has been housed in RIT’s Color Science munity created by the graduates, students, faculty, and staff Building (Bldg. 18) on the south side of campus since the associated with the Munsell Color Science Laboratory. I thank fall of 2003. Previously the laboratory was housed in the all of you for this continued support. Carlson (76) and Gannett (7B) buildings. The current facili- ties encompass about 8000 square feet dedicated to color Writing this short history, I realize that this also marks my . and imaging science education and research. They include 25th anniversary! student, faculty, and staff offices, a teaching laboratory (Franc Grum Color Science Learning Center), several research Staff laboratories (Spectral Color Reproduction, Material Appear- ance and Novel Displays, 3-D Imaging, Metrology, and Vision MCSL is made up of a group of RIT faculty who have joined and Psychophysics), and support facilities. The facilities have together with a commitment to the lab’s objectives and its col- been equipped with several million dollars worth of instrumen- laborative funding along with the graduate students, technical tation and systems through a long history of external research and administrative staff, and visitors that they supervise and funding and corporate donations. advise. Current faculty associated with MCSL include Roy S. Berns (Richard S. Hunter Professor of Color Science, Appear- ance, and Technology), Mark D. Fairchild (Professor), James Ferwerda (Associate Professor), Noboru Ohta (CIS Affiliate

40 Sponsors Selected Journal Publications Apple Computer Inc. Berns RS. Generalized industrial color-difference space based Avian Technologies LLC on multi-stage color vision and line-element integration. Óptica Pura Y Aplicada 2008:41:(4)301-311. Canon Inc. Berns RS, Taplin LA, Urban P, Zhao Y. Spectral color . The family of Chester F. Carlson reproduction of paintings. Proceedings CGIV 2008 / MCS’08:. E. I. du Pont de Nemours and Company 484-488. Eastman Kodak Casella SE, Heckaman RL, Fairchild MD, Sakurai M. Mapping standard image content to wide-gamut displays. Proceedings Entertainment Experience LLC IS&T/SID 16th Color Imaging Conference. Scot Fernandez Chen Y, Berns RS, Taplin LA, Imai FA. A multi-ink color-sep- Hallmark Cards Inc. aration algorithm improving image quality. Journal of Imaging Science and Technology 2008:52 020604-1 Hewlett Packard Company Fairchild MD. The HDR Photographic Survey. MDF, Honeoye Andrew and Maureen Juenger Falls. 2008. The Andrew W. Mellon Foundation Fairchild MD. Beyond the locus of spectrally pure colors. Corporation SPIE/IS&T Electronic Imaging, San Jose. 2008:Proc. SPIE Museum of Modern Art (MoMA), New York Vol. 6807, 680702. National Science Foundation (NSF) Ferwerda JA, Ramanarayanan G, Bala K, Walter BJ. Visual Equivalence: an object-based approach to image qual- New York State Foundation for Science, Technology and In- ity. Proceedings IS&T/SID 16th Color Imaging Conference. novation (NYSTAR/CEIS) 2008:347-354. Nikon Corporation Fujine T, Kanda T, Yoshida Y, Sugino M, Teragawa M, Ya- ONYX Graphics mamoto Y, Ohta N. Bit depth needed for high image quality TV-evaluation using color distribution index. Journal Display Philips Solid State Lighting Technology 2008:4(3), 340-347. Sinar AG Kuniba H and Berns RS. Spectral sensitivity optimization of Sony Corporation color image sensor considering photon shot noise. Proceed- ings of SPIE Electronic Imaging Conference 2008:6817, Toppan Printing Co., Ltd. 10.1117/12.765565. U.S. Army Night Vision and Electronic Sensors Directorate Ramanarayanan G, Bala K, Ferwerda JA. Perception of . X-Rite Inc. complex aggregates. ACM Transactions on Graphics . (SIGGRAPH ’08) 2008:27(3):1-10. Reinhard E, Khan EA, Akyüz AO, Johnson GM, Color . Scholarship Imaging: Fundamentals and Applications, A K Peters, LTD, In the past year, MCSL students, faculty, and staff published Wellesley, MA 2008. 50 journal papers and conference proceedings. Several, high- Sakurai M, Heckaman RL, Casella SE, Fairchild MD, Nakat- lighting our breadth, are listed below. Further details on MCSL sue T, Shimpuku Y. Effects of display properties on perceived activities and publications can be found at the lab website, color-gamut volume and preference. Journal of the Society of www.cis.rit.edu/mcsl or specifically in recent MCSL Annual Information Display 2008:16, 1203-1211. Reports, www.cis.rit.edu/mcsl/about/AnnualReports.php.

41 university  NEWS ❯❯ But when the opportunity came to take early retirement, he opment, modeling color-imaging systems, and spectral | was not reluctant to leave. “We all went into the auditorium imaging, including capture and printing. His spectral imaging and they said ‘Any volunteers?’ I must have been the first guy systems are currently in use by museums and archivists to Newest Ph.D. has long history in imaging on the stage.” document, conserve and reproduce works of art and other cultural heritage. Release Date: Jan. 5, 2009 He tried his hand at consulting and worked on a couple Contact: Kathy Lindsley of dot-com companies. But eventually, he was ready for “The Godlove Award is a very fitting recognition for the something new. It was Heckaman’s friend and neighbor, RIT breadth and depth of Roy Berns’ sustained and significant (585) 475-7616 or [email protected] Criminal Justice Professor John Klofas, who steered the contributions to the field of color and imaging science,” The first year was difficult, says Rodney Heckaman, the lat- former Kodak engineer to the Ph.D. program. states the ISCC’s award announcement. “His endeavors have empowered numerous students and advanced many est person to earn a Ph.D. from RIT Klofas is not surprised that Heckaman did so well in the pro- areas of understanding in color and imaging science, both gram. “He’s a very talented guy with very broad interests,” he “My wife called me a ghost,” he says. “She never saw me.” directly through his own research and indirectly through the says. “I have no doubt it was difficult, but he’s the kind of guy many researchers that he has trained.” That was 2003, when Heckaman, approaching age 60, who enjoys a challenge. He could never just sit around and began working toward a doctoral degree in imaging science. do nothing.” “I am so excited to be joining the ranks of many of my color- Between classes, homework and projects, he typically science idols who have received this prestigious award in Although he’s completed the Ph.D., Heckaman won’t be logged just a few hours of sleep each night. the past,” Berns says. “My success is due, in no small part, leaving RIT any time soon. He’s been asked to stay on as a to the talents of my colleagues and students. This award will He liked the work, the environment and, especially, the post-doctoral researcher. other students and the professors in the Chester F. Carlson serve as inspiration as we continue to advance color sci- Center for Imaging Science. “The people here are brilliant,” “I get to stay here and keep working. It’s amazing to me.” ence education and research at RIT.” he says of the faculty. “And I love working with the students; Berns is the author of more than 200 journal publications they have such great insight.” Release Date: June 2, 2009 and the third edition of Billmeyer and Saltzman’s Principles Heckaman proved to be an outstanding student, winning of Color Technology. He is a member of the International the prestigious Macbeth-Engel Fellowship for his educational Contact: Susan Gawlowicz. Commission on Illumination, a fellow of the Society for Imag- excellence. He focused in the area of color science; the in- 585-475-5061 or [email protected] ing Science and Technology, an executive board member of triguing title of his doctoral thesis is Brilliance, Contrast, Col- the International Association of Colour and the Inter-Society orfulness and the Perceived Volume of Device Color Gamut. RIT Professor Wins Prestigious Color Science Award Color Council. He is a past recipient of the color council’s His image processing work has implications for improved Roy Berns named the 2009 Godlove Award recipient MacBeth Award. display media of various types, including cinema and video. Rochester Institute of Technology professor Roy Berns is Berns will receive the Godlove Award at the annual meeting “The technology is growing so fast that soon we will be able being recognized with one of the most prestigious awards in of the Inter-Society Color Council, held at RIT June 7, and in to see displays that have the look of real life,” he says. the field of color science. conjunction with the Munsell Color Science Laboratory 25th Anniversary Symposium featuring several past recipients of Despite being the oldest Ph. D. candidate anyone can The Inter-Society Color Council, the professional association the Godlove Award. remember, Heckaman was treated like any other student, of the field of color science, has named Berns the recipient says his Ph. D. adviser, Mark Fairchild ’86 (imaging science), of the 2009 Godlove Award for his contributions, through professor, Munsell Color Science Laboratory. “He was a research and education, in color and imaging science and very good student,” says Fairchild, “very involved in research for his leadership in the color community. we’re doing and working with other students.” Berns is the Richard S. Hunter Professor of Color Science, Before coming to RIT, Heckaman spent 32 years as a prod- Appearance and Technology and director of the Munsell uct development engineer at Eastman Kodak Co.; among Color Science Laboratory in RIT’s Chester F. Carlson Center many projects he worked on were the Advanced Photo for Imaging Science. System (APS) as well as the disc photo system that became The biennial Godlove Award, established in 1956, honors a billion-dollar product for the company. Berns’ advancements in fundamental and applied color science and color imaging. Berns is especially known for his work in color difference perception and formula devel-

42 43 RIDL camera mounted to the 2.1 meter telescope at the Kitt Peak National Observatory in Tucson, AZ.

44 Rochester Imaging Detector the planned giant telescopes that will be operational within the Publications next ten years. Discovery Of A Globular Cluster In The Galactic Disk Laboratory Other staff members who assist RIDL with its mission include Figer, D. F. et al. 2009, , Astrophysical Journal, in preparation Laboratory Director’s Comments Brian Ashe, Project Manager, Brandon Harold , Donald Stauffer and Tom Montagliano, Lab Engineers; Christine Trom- Supermassive Star Clusters in the Milky Way: Total By Dr. Don Figer bley, Data Analysts; and Post Doc’s Ben Davies and Maria Number Estimate and a Constrained Search in the Two Messineo. Micron All Sky Survey Point Source Catalog Overview Grants and Contracts Ivanov, V. D., Messineo, M., Zhu, Q., Figer, D., Borisso- va, J., & Kurtev, R. 2009, Astronomy & Astrophysics, in In 2006, the Rochester Institute of Technology established the New preparation Rochester Imaging Detector Laboratory (RIDL). The Rochester Imaging Detector Laboratory (RIDL) seeks to develop and • Gordon and Betty Moore Foundation A low progenitor mass for the magnetar SGR1900+14 implement quantum-limited photon detectors. These devices o Next Generation Imaging Detectors for Near- and ... .Davies, Ben, Figer, Don F., Kudritzki, Rolf-Peter, Tromb- will extract all possible information from each incoming photon Mid-IR Wavelength Telescopes, Sept08-Oct12, ley, Christine 2009, Astrophysical Journal, submitted in order to enhance signal detection to the highest theoretical $2,839,193 level. In pursuit of this mission, the RIDL has about ten funded HST/NICMOS observations of the GLIMPSE9 stellar • Sandia National Laboratories programs (~$6M) to develop emerging detector technology at cluster all levels of maturity and integration for a wide range of appli- o FPGA Image Acquisition Software Development, Messineo, M., Figer, Donald F., Davies, B., Kudritzki, R. cations, e.g. astrophysics, biomedical imaging, Earth system June08-Sept10, $95,115 P., Rich, R. Michael, MacKenty, J., & Trombley, C. 2009, science, and inter-planetary travel. The RIDL collaborates with Current Astrophysical Journal, submitted over a dozen organizations in academia, industry, and national The stellar population of the star forming region laboratories. The RIDL enjoyed a year of expansion, growth, • NYSTAR—Faculty Development Award, May06- G61.48+0.09 and discovery. During the academic year, RIDL hired a project June09, $727,900 manager and two lab engineers/ to work on our • NASA Martin-Franch, A., Herrero, A., Lenorzer, A., Najarro, F., designing and developing imaging detectors. Ramirez, S., Font-Ribera1, A., & Figer, D. 2009, As- o A Very Low Noise CMOS Detector Design for tronomy & Astrophysics, 502, 559 While some of our goals include detector testing, character- NASA, Jan07-Jan10, $847,000 ization, and research and development, the staff is deeply A Near-Infrared Study of the Stellar Cluster: [DBS2003] 45 involved in scientific discovery. During the year Ben Davies o A Radiation Tolerant Detector for NASA Planetary Missions, June07-June10, $592,000 Zhu, Q., Davies, B., Figer, D. F., Trombley, C. 2009, . and Don Figer published their findings on newly discovered ApJ, 702, 929 massive star clusters which provide the unique opportunity to o A LIDAR Imaging Detector for NASA Planetary Mis- study the pre-supernova evolution of massive stars, and the sions, August08-July12, $546,711 A Third Red Supergiant Rich Cluster in the Scutum- blue- to red-supergiant ratio at uniform chemical content. Crux Arm o "The Journey of a Photon:" High School Student Clark, J. S. et al., Astronomy & Astrophysics, 498, 109 Faculty and Staff Involvement in Developing their Community's Understanding of Detector Science for the Interna- Chemical abundance patterns in the inner Galaxy: the RIDL’s director is Dr. Don Figer who joined RIT as a result of tional Year of Astronomy/Year of Science (2009) and Scutum Red Supergiant Clusters Beyond, Dec07-June10, $44,850 a NYSTAR Faculty Development grant, which highlights New Davies, B., Origlia, L., Kudritzki, R. P., Figer, D. F., Rich, York State’s commitment to assisting universities develop new • Stanford Linear Accelerator Center R. M., Najarro, F., Negueruela, I., Clark, J. S. 2009, . areas of expertise leading to economic development. Figer o Research and Development related to the Large ApJ, 696, 2014 has teamed together with faculty member Zoran Ninkov, Lead Synoptic Survey Telescope (LSST) camera, Oct07- Instrument Development in proposing and winning numerous Near-infrared spectra of Galactic stellar clusters de- Sept08, $25,000 NASA grants for the research and development of novel de- tected on Spitzer/GLIMPSE images tectors that will fly in future NASA space missions. During this Messineo, M., Davies, B., Ivanov, V. D., Figer, D. F., period the RIDL was awarded a $2.8 million grant to develop Schuller, F., Habing, H. J., Menten, K. M., & . the multi-array detector for the Thirty-Meter Telescope, one of Petr-Gotzens, M. G. 2009, ApJ, 697, 701

45 Publications (continued) The RIDL detector hardware systems consist of two large other problems. dewars. They each use a CTI Model 1050 cryo-cooler to . Our device will deliver lower noise, lower power consumption, provide two cooling stages, at ~10 K (7 W), and at ~60 K. The Chemical Abundances in the Galactic Centre from much larger dynamic range, and greater radiation immunity (70 W). We use a Lakeshore Model 340 temperature controller the Atmospheres of Red Supergiants than presently available CCD and CMOS detectors. In addi- to sense temperatures at 10 locations and control a heater in tion, it will allow much greater operational flexibility. All of these Davies, B., Origlia, L., Kudritzki, R. P., Figer, D. F., Rich, the detector thermal path. We are able to control the detector benefits will lead to lower mission cost and greater scientific R. M. & Najarro, F. 2008, ApJ, 694, 46 thermal block to 400 μK RMS over timescales greater than 24 productivity. Our design efforts will produce a new multiplexer hours. The RIDL detector electronics include field program- Discovery Of A Globular Cluster In The Galactic Disk having application over a large wavelength range, spanning mable gate array (FPGA) development systems, including the Figer, D. F. et al. 2009, , Astrophysical Journal, in prepa- from UV to mid-infrared, via hybridization to a variety of light- Altera DE3 Stratix-III, Altera Cyclone-III, Altera Spartan-III, Xilinx ration sensitive materials, i.e. silicon, HgCdTe, InSb, InGaAs, Si:As, Vertex-4, and Xilinx Vertex-5. Each FPGA system controls the and Ge:As. The new device will also have applications for A Proposed Student Built and Operated Satellite: The detector either through a Cameralink or USB interface. The Homeland Safety, i.e. in surveillance in low light conditions on Gamma Ray Burst Polarization Observer (PolOSat) RIDL also has an Astronomical Research Cameras control- our nation’s borders and in battlefield platforms on UAVs. Malphrus, B.K., Jernigan, J.G., Bloom, J.S., Boggs, S., ler, with 32 digitizing channels with 1 MHz and 16-bit readout Butler, N.R., Cominsky, L.R., Doering, T.J., Doty, J.P., Erb, capability, and two Teledyne SIDECAR ASICs, each with 36 D.M., Figer, D.F., Hurley, K.C., Kimel, K.W., Lumpp, J.E., channels and speed up to 5 Mz at 12-bits and 500 kHz at Labov, S. 2009, AAS, 213, #476.03 16-bits. Metallicity in the Galactic Center: The Quintuplet cluster Najarro, F., Figer, D. F., Hillier, D. J., Geballe, T. R., and Detector Development in RIDL Kudritzki, R. P. 2008, ApJ, 691, 1816 A Very Low Noise CMOS Detector Design for NASA Equipment/facilities Figer, Ninkov, Ignjatovic (U of R) The RIDL contains special facilities and equipment dedi- NASA cated to the proper handling and testing of detectors. These The purpose of this project is to design, fabricate, develop, include a permanent class 10,000 clean room, ESD stations, and test a novel new detector for NASA space missions. vacuum pumping systems, 1800 ft2 of laboratory space, These missions rely on low noise array detectors that must optical benches, flow tables, light sources, a monochroma- operate in the harsh radiation environment of space. Most tor, a pulsed 683nm laser, thermal control systems, cryogenic current missions use CCDs for their optical detectors. While motion control systems, power supplies, general lab electron- these devices have low noise (a few electrons) at the begin- ics, mutiple data reduction PCs with four processors at 4GB ning of mission life, they are gradually degraded by radiation memory each, and 12 TB of data storage. damage. The design we propose will address this, and several

46 insensitive to threshold voltage variations of the readout transistor, we have applications on Earth improving everything from cell phone believe that our design will be less susceptible to radiation transients cameras to securing communications and surveillance systems. and long-term damage that can cause shifts in the readout transistor “You could effectively quadruple the collecting power of a telescope performance parameters. just by using this detector,” says Donald Figer, director of the Roch- Research and Development related to the Large ester Imaging Detector Laboratory at RIT’s Chester F. Carlson Center Synoptic Survey Telescope (LSST) camera for Imaging Science and leader of the research team. “Or you can do the same thing by making a telescope twice the size, but then Figer we’re talking a cost of billions of dollars and taking on a monumental DOE/Stanford Linear Accelerator Center engineering challenge.” Imaging sensors produce their own “noisy” signal that often de- This work includes evaluating the Large Synoptic Survey Telescope grades images, especially under low-light conditions. The noise can (LSST) guider prototypes in the Rochester Imaging Detector Labora- sometimes be seen as the grainy, salt-and-pepper speckling found tory during FY08. RIT's role in the camera effort will be to develop, in in pictures snapped in a dark room. In applications like astrophysics, Radiation-Tolerant Detector for NASA Planetary partnership with SLAC and partner organizations, the guider sensor that noise can do more than ruin a picture; it can mean the differ- Missions needed to complete the R&D phase of LSST. Pending availability ence between making a discovery or not. Figer, Ninkov, Ignjatovic (U of R) of prototypes to evaluate, it is anticipated that at least one Teledyne H4RG or H2RG plus a SIDECAR ASIC will be evaluated. A final test Designing a quantum-limited detector using a digital photon counter NASA report will be the deliverable. The test report will include performance to detect every single photon, or unit of light, coming from a target can circumvent the problem. According to Figer, the zero-noise de- The purpose of this project is to design, fabricate, develop, and test measurements for parameters that are relevant to the LSST Guider tector employed with the Thirty Meter Telescope will have the same a novel detector that will revolutionize future NASA planetary space application, including: dark current, read noise, quantum efficiency, sensitivity as a combination of today’s detectors and a 60-meter missions in the area of radiation tolerance, low noise, low power, and inter-pixel capacitance, well depth, and linearity. These measure- telescope for probing the farthest reaches of the universe. low mass. These missions rely on low noise array detectors that must ments will be reported for full-frame readout, as well as window operate in the harsh radiation environment of space. Most current mode readout. In addition the measurements will be reported over a Figer’s team, which includes scientists from Massachusetts Institute of missions use CCDs for their optical detectors. While these devices range of operating conditions, i.e. flux levels, wavelengths, tempera- Technology’s Lincoln Laboratory, is currently testing the new detector have low noise (a few electrons) at the beginning of mission life, they ture, and readout speed. at cryogenic temperatures in the Rochester Imaging Detector Labora- are gradually degraded by radiation damage. Our device will deliver tory. Cooling the device to lower temperatures will freeze its dark cur- NEWS ❯❯ lower noise, lower power consumption, much larger dynamic range, university | rent, another potential source of noise, and keep it stuck in the crystal greater short wavelength sensitivity, and greater radiation immunity Release Date: May 29, 2009 lattice like flies on flypaper and away from the conduction band. than presently available CCD and CMOS detectors. In addition, it will In the second phase of the project, Figer’s team will adapt the detec- allow much greater operational flexibility. All of these benefits will lead Contact: Susan Gawlowicz. 585-475-5061 or [email protected] tor technology to infrared applications, replacing silicon, a material to lower mission cost and greater scientific productivity. Our design sensitive only in optical light, with the semiconductor material Indium efforts will enable a broad range of applications, including demanding RIT Scientist Developing the Next Generation of Imaging Gallium Arsenide. The infrared version of the detector will give astro- hyper-spectral imaging in the most severe radiation environments in Detectors physicists the ability to peer through cosmic dust and also to detect the Solar system. They will help NASA to achieve science objectives stars in the early universe. for future planetary missions now being considered by the Discovery, Donald Figer leads effort to build detector for the Thirty Mars Exploration, and New Frontiers programs. Meter Telescope “If you want to look back into the early universe, you have to look back into the infrared,” Figer says. Our design uses low power CMOS circuits that are arranged in high A team of scientists at Rochester Institute of Technology is designing density packaging within individual pixels. The low noise readout is and developing an imaging detector that will read individual beams of The Thirty Meter Telescope is a joint collaboration of California Insti- achieved by sampling the signal using a sigma-delta analog-to-digital light, greatly enhancing imaging quality and application. tute of Technology, the University of California and the Association of Canadian Universities for Research in Astronomy. The RIT portion (A/D) circuit with a feedback path that restores charge to the charge The centerpiece of this work is the design of a quantum limited, zero- collection node. The keys to its performance are the close proximity of the project is being funded through a grant from the Gordon and noise detector for the future Thirty Meter Telescope. Expected to be Betty Moore Foundation. of the conversion circuit to the photogenerated charge, oversampling operational in the next decade, the telescope’s light-collecting power nature, and noise-shaping property of the in-pixel sigma-delta A/D will be 10 times that of the largest telescopes now in operation. A broader description of Figer’s research is presented in the 2009 converter. These properties allow our design to highly attenuate the Spring/Summer issue of Research at RIT. To view the issue, visit photodetector reset noise, DC offset related fixed-pattern noise, The detector’s new sensing technology promises to penetrate the http://www.rit.edu/research. and readout transistor thermal and 1/f noise. Since the design is darkness of space with the greatest sensitivity ever. It could also

47 RIT Multidisciplinary Senior Design (MSD) Program members. A program developed by the Kate Gleason College of Engineering (KGCOE) to offer multidisciplinary capstone projects which challenge engineering students from a variety of technical disciplines to work together as teams to accomplish a complex, practical project.

48 Print Research and Imaging Marcos' expertise is in the modeling of engineering systems, • Development of analytical protocols for assessment of the development of robust design methods, and in product and print image quality process development. System Modelling Lab • Application of uncertainty modeling and robust control theory to printing systems June 1, 2008—May 31, 2009 Dr. Jonathan Arney, Professor, CIS, [email protected] Jon's expertise is in physical and optical measurements of • Evaluating the image quality gap between digital print- Laboratory Director’s Comments: materials and the mechanistic analysis of printing processes. ing and conventional printing technologies By Dr. Marcos Esterman Ms. Susan Farnand, Staff Scientist (CIS), [email protected]. Summary of Service in Imaging edu Susan's expertise is in human vision, psychometrics, and Printing: Overview color science, and the application of these sciences to . Members of PRISM have served active roles in Imaging product and process development. The PRISM Lab continues to focus on three key areas; and Printing through service on committees and support of Print Image Quality, Printing Technology Characteriza- professional conferences. In particular, Susan Farnand has Dr. Juan Cockburn, Associate Professor, KGCOE participated with the WG04 committee on Print Image Quality tion and Development, and Sustainability in Printing. In (Computer Eng.), [email protected] November of 2008, PRISM hosted its second research under the auspices of SC 28 Office Equipment committee of round-table which included participation from Eastman Juan's expertise is in the modeling of control systems and the ISO, designing psychophysical test procedures to be used Kodak, Hewlett-Packard, Ricoh and Xerox. The focus of design of robust, nonlinear control systems. in international experimentation leading to new and updated the meeting was to discuss challenges of incorporating standards on image quality assessment. Susan also served sustainability into business, and in particular, technol- Dr. Franziska Frey, Associate Professor, McGhee Professor, as co-editor for a special issue of the Journal of Electronic ogy decision-making. In recognition of the importance of School of Print Media, [email protected] Imaging on image quality, as well as continuing to co-chair sustainable printing as its own research area, the Sustain- Franziska is a member of the Center's Graduate Pro- the Image Quality Systems Performance conference at the able Print Systems Laboratory (SPSL) was founded in 2008 gram Faculty. Her expertise is in the digitization of cultural Electronic Imaging Symposium in San Jose, CA and chairing by Marcos Esterman and Sandra Rothenberg (from the heritage materials, digital fine art printing, and digital asset the Print and Image Quality session at the NIP25 conference Saunders College of Business). The obvious close link with management. on Digital Printing Technologies. Marcos Esterman was the PRISM and the SPSL will remain. Additional, infrastructure conference chair for the 2009 ASME International Design has been added to characterize and better understand Dr. Sandra Rothenberg, Associate Professor, Saunders Engineering and Technical Conferences Design for Manufac- Electrophotographic process physics through the gener- College of Business, [email protected] turability and Life-Cycle Conference (DFMLC) and will be the ous donation of a linear test-bed by Eastman Kodak. This DFMLC secretary for the 2009–2010 academic year. Sandra is an Associate Professor at Rochester Institute of test-bed has already been a vehicle for fostering industry Technology’s Philip E. Saunders College of Business in the collaboration between local print manufacturers and will Graduate Thesis and Dissertation Topics: Department of Management. Her research primarily focuses form the center-piece for further research of interest to the on corporate environmental strategy and management, lean PRISM's contribution to academic degree programs has been industry as a whole. With this added infrastructure coupled manufacturing and environmental performance, government focused on increasing student opportunities in print imaging with previously developed infrastructure, PRISM is position- regulation and technical innovation, international environmental technology. Toward this end we have supported thesis proj- ing itself to be a valuable resource for developing new em- management, worker participation, and environmental activ- ects for several graduate students as described below. pirical and analytical knowledge and enabling more sustain- ism within firms. able printing. PRISM continues to use sponsored research Mr. Fermin Colon-Lopez: Ph.D. Project Title "A model of electrophotographic printing that is independent of the projects to support student projects. These have included Summary of Current Research Interests: both individual thesis projects and multi-disciplinary team halftone algorithm". Mr. Colon-Lopez has been a part time projects through the Kate Gleason College of Engineering. • Electrophotographic process physics graduate student in CIS for many years, earned a MS in Imag- ing Science, and is expected to complete his dissertation by • Enabling sustainable printing practices through the the end of the current academic year. Faculty and staff: characterization and development of the needed technologies Mr. Carl Smith: M.S. Project Title "The Analysis of Specular Dr. Marcos Esterman, Laboratory Director, CIS Graduate Reflections from Printed Surfaces". Mr. Smith is a graduate Program Faculty, and Associate Prof, KGCOE (Industrial & . • Mechanisms of fusing in dry toner electrophotography student in CIS and is working with PRISM on the develop- Systems Engineering), [email protected] • Optical and physical interactions of toners and inks ment of instrumentation and analytical protocols for the optical with papers characterization of printed images.

49 Mr. Alvaro Rojas: M.S. Project Title "A Selection Framework Masters in Product Development: Marcos Esterman is on and transfer station function and to improve its usabil- for Derivative Product in Changing Platforms ". Mr. Rojas the teaching faculty of the Masters in Product Development ity. The design team involved eight senior engineering completed his MS Thesis in the Industrial and Systems Program. One of his roles is to supervise the capstone students in KGCOE including three from mechanical Engineering in the summer of 2008. While his thesis work is thesis of a project team of 2-3 students. In the past two engineering, three from electrical engineering, one not directly related to PRISM, Mr. Rojas had been the lead years, the projects have been focused on gaining increased from computer engineering and one from industrial research assistant on development of the fuser test-beds. understanding of the role that R&D plays in the development and systems engineering. He has taken the feasibility prototypes developed by the of sustainable technologies. In particular, the topics of these Multidisciplinary Design program and made them working capstones have been: “The Challenges in Incorporating Funded Research: (totaling $135,000) lab instruments. Sustainability into Product Development” and “Enabling By- Funding (both monetary and equipment donations) over the Product Exchanges through Product Development”. Mr. Jared Russell: M.S. Project Title "An Optimization Ap- past year has been primarily from Hewlett-Packard, Xerox, proach to Plant-Controller Co-Design ". Mr. Russell gradu- Eastman Kodak, Sherwin/Williams, and the Print Industry ated with a dual degree BS/MS in Computer Engineering in Undergraduate Projects: Center. Specific projects are shown below the summer of 2009. His work with PRISM developed the PRISM also has a commitment to provide research opportu- Evaluating the Value of Print on Screen versus on Paper control systems for both fuser-test beds, and was the basis nities to undergraduates at RIT. Using Eye-Tracking—Susan Farnand, PI. The objective of of his thesis work. Mr. Allan Liburd: Project Title: "Improvement of Code this print versus display project is to develop a methodology Ms. Alicia Tejada Abreu: M.S. Project Title: “Explaining for the microgoniophotometer". This work was performed for and to conduct initial experimentation examining the differ- Print Media Paper Consumption Patterns through a Sys- as a summer project in 2009. Previous work in PRISM has ences in the efficacy of magazine advertising on screen relative tem Dynamics Approach”. Ms. Tejada Abreu is a first year shown that a more thorough analysis of gloss can be ac- to the printed page, with particular attention to the advantages PhD student in Golisano Institute for Sustainability and a complished with little additional effort using the RIT microgo- and disadvantages of print. Longer term, it is intended that the researcher in the PRIM lab. He long-term research focus niophotometer as compared to a traditional gloss meter. In experimental methodology will be used to explore possible dif- is on the role that technology can play to enable reduced order to improve the usability of this device, a Java program ferences in efficacy of print on paper versus display and which media consumption in the print industry. Her MS thesis is was previously developed to control and analyze the result- characteristics of these media are particularly relevant when expected to be complete in the Fall 2009, where she is ing images. The focus of this project was to debug and comparing the consumption of information on paper versus on modeling historical media consumption patterns so that we improve the existing code. screen. Development of this methodology will involve an as- can understand the relevant dynamics that have led to some sessment of evaluation criteria including information retention, counter-intuitive behavior (e.g. why is the paperless office an Senior Undergraduate Engineering Design Projects: distribution of visual gaze as measured by eyetrackers, time elusive goal). needed and eye movements that occur when detecting image A particularly successful way in which the PRISM lab has differences, and visual comfort. The initial phase of the project Ms. Suparna Kishore Kalghatgi: M.S. Project Title: TBD. contributed to RIT academic opportunity has been through will involve using eyetrackers to monitor eye movements when Ms. Kalghatgi is a second year graduate student in Industrial the sponsorship of projects in the RIT Multidisciplinary looking at a photo booklet either on screen or in print. Areas of and Systems Engineering and will be working with PRISM to Senior Design (MSD) Program. This is a program developed the images fixated for each media will be recorded and com- support the Sherwin/Williams project. The goal of this proj- by the Kate Gleason College of Engineering to offer mul- pared. Information retention will be assessed by having partici- ect is to provide Sherwin/Williams with quantitative informa- tidisciplinary capstone projects. These projects challenge pants answer questions about the images that were viewed. tion about the material parameters that must be controlled engineering students from a variety of technical disciplines to The time spent with each medium will also be recorded. to minimize the "touch-up" effect in painted surfaces, to pro- work together as a team to accomplish a complex, practi- vide guidance on how to measure those parameters physi- cal project. Professor Esterman is a member of the KGCOE Measurement, Modeling and Perception of Painted Sur- cally, and to use psychophysical experimental techniques to MSD teaching team and steering committee as well as faces—Jim Ferwerda PI, Jon Arney Co-PI, Susan Farnand, generate models for predicting changes in appearance. an Extended Faculty member in CIS and has devoted a Co-PI. The project will apply RIT's unique capabilities in (1) significant amount of time to the development of this unique measurement of optical surface properties, (2) modeling and Ms. Angelica Li: M.S. Project Title: Implementing Sustain- educational opportunity. Over the past year, the PRISM lab simulation of surface appearance based on physical mea- ability in Commercial Lithographic Printing Operations - A sponsored one project and was involved in advisory capac- surements (3) psychometric analysis and prediction of ap- Workflows Approach to Identifying Sustainable Actions”. Ms. ity on a second. pearance. Using samples provided by Sherwin-Williams, we Li is a graduate student in School of Print Media. This work will use our unique microgoniophotometer to capture spatially is supervised by Franziska Frey and Marcos Esterman. This • Project Title: "The Development of an Electrophoto- resolved BRDF data inside, outside and at the edges of the work will contribute better understanding of the impact that graphic Development and Transfer Station”. This Se- touch up region. These data will be represented as calibrated workflow decisions have on the sustainability of printing. nior Design project was sponsored by the PRISM lab to make an existing electrophotographic development reflectance images taken under controlled lighting conditions.

50 We will then analyze these images using multiscale image an electrophotographic linear test-bed. This test-bed will be S. P. Farnand, F. Frey, and E. Anderson, “Benchmarking Art processing methods to determine if and how the regions differ the centerpiece with which to perform informative experiments Image Interchange Cycles: Image Quality Experimentation”, in texture at different spatial frequencies. This analysis will give that will benefit a consortium of EP-based printer manufactur- AIC 2009, Sydney, Australia, 2009. us the data we need to understand what particular surface ers, to develop education programs to train future electropho- C.G. Smith, J.S. Arney, S.P. Farnand, C. MacDonald, and B. properties are contributing to the measured (by the glossme- tographers, and to develop ideas for novel applications of EP. Stroka, “Analysis of Specular Reflections from Printed Images ter) and visual gloss differences. We anticipate that different Benchmarking Art Image Interchange Cycles Image and the Characterization of Gloss Bronzing”, IS&T NIP-24 formulations and application methods will lead to significant Quality Experimentation—Franziska Frey, PI and Susan Pittsburgh, PA, 2008. differences in the spatial frequency statistics that may be Farnand. This project is being conducted to evaluate current important with respect to the measured and observed gloss M. Esterman, S. Dargan, B. Thorn, and J. Arney, “Application practices in fine art image reproduction, determine the image differences. of the Operating Window Concept to Improve Fuser Reli- quality generally achievable, and establish a suggested frame- ability: A Case Study on Failure Modes of Hot & Cold Offset”, Design and Initial Approach for a Print Energy Life- work for art image interchange. Toward this end, experimen- IS&T NIP-24 Pittsburgh, PA, 2008. cycle Decision Tool—Marcos Esterman Co-PI, Sandra tation is being conducted in which a set of objective targets Rothenberg Co-PI, Scott Hawker, Co-PI. Information technol- and pieces of artwork in various media are being imaged A. Rojas, M. Esterman, A Measure of Impact for Platform ogy holds tremendous potential to help consumers and firms by participating museums. Print files and guide prints will be Changes, Proceedings of IDETC ‘08: ASME International De- make more sustainable choices by providing information at delivered to the Rochester Institute of Technology where prints sign Engineering Technical Conferences and Computers and key decision points. As one example, there are a number will be made and used as stimuli in psychometric testing to Information in Engineering Conferences, August 3-6, 2008, of software programs that help calculate and summarize generate scales of image quality. The experimental results will New York, New York, USA. environmental metrics for various products and processes. be among the inputs used to construct a conceptual frame- M. Esterman, Spano, J., Pereda, D., Zimmerman, R., “An Surprisingly, while many printers are moving into the IT arena, work of the various types of imaging taking place in cultural Exploratory Study into Process Failures During The Voice of the technology has not been fully utilized. For the most part, institutions at present. Based on this framework, an image Customer Process In Product Development”, Proceedings of there is a lack of knowledge on the part of the consumer on processing tool that incorporates appearance models that IDETC ‘08: ASME International Design Engineering Technical the sustainability impacts of their communication decisions. are adequate for the various working environments in cultural Conferences and Computers and Information in Engineering Thus, this work outlines a prototype decision tool which could heritage institutions will be developed. Conferences, August 3-6, 2008, New York, New York, USA. be used to estimate the energy consumption of printing a given document, by analyzing the user’s requirements for the Journal Publications: M. Esterman, J. Knapp, C. Saunders, M. Slot, “Environmental print job, the printer selected and the corresponding life-cycle and Reliability Challenges for Electrophotographic and Ink Jet Briceño, C. M., Carrano, A. L., Thorn, B. K., and Esterman, Printing, Panel Session”, IS&T NIP-24 Pittsburgh, PA, 2008. criteria for these elements. M., “A Design Optimization Framework To Estimate Environ- A Survey into Sustainability Metrics and Methods— mental Impact Of Design Decisions In Consumer Products”, F. A. Colon-Lopez and J. S. Arney, “A Method for Classifying Marcos Esterman Co-PI, Sandra Rothenberg, Co-PI. The Journal of Green Building, Spring 2009, Volume 4, Number 2, Halftone Patterns Based on Pattern Morphology (Interactive)”, goal of this research it to perform a survey into metrics and College Publishing. IS&T NIP-24 Pittsburgh, PA, 2008. methods employed by the printing industry to measure, track and integrate sustainability into their business practices. In Conference Proceedings: addition, it is also recognized by the PI’s that a great deal of S. P. Farnand, " Minding the Gap: An Examination of the work has been conducted in this area by the print industry, Image Quality Differences Between Digital Print Technologies but that a proper inventory of the current state of the art is and Traditional Offset Lithography lacking. Therefore, the focus of this work is to define the re- search roadmap that will be required to develop this inventory (Focal)", IS&T NIP-24 Louisville, KY, 2009. and execute the first phase of that inventory. In addition to the Athalye, S. A., S. K. Govindarajan, C. A. Lopez, Marcos inherent value of just the described service, this work would Esterman, Jr., Sandra Rothenberg , “Challenges in Incorporat- serve as the foundation for the future development of a print- ing Sustainability into Product Development: An Exploratory ing value chain test-bed envisioned by the PI’s. Study”, Proceedings of IDETC ‘09: ASME International Design Implementation of an Electrophotographic Linear Test- Engineering Technical Conferences and Computers and Infor- Bed—Marcos Esterman Co-PI, Jonathan Arney Co-PI, Susan mation in Engineering Conferences, August 31-September 3, Farnand Co-PI. The proposed project will leverage resources 2009, San Diego, California, USA. from Eastman Kodak and Xerox to finish the development of

51 Gigapan panoramic image taken in the Adirondack Mountains.

52 Multidisciplinary Vision In addition to the graduate students working on the CBIR proj- the observer’s gaze. The video records are from a ‘dry run’ ect, the lab welcomed two other graduate students this year. the team did this Fall in preparation for the first field trip in Research Lab Thomas Kinsman, a Ph.D. student in Imaging Science, is March, 2010. The gaze of four observers was tracked on a This was a year of significant growth for the Multidisciplinary doing his dissertation research in the area of applying pattern two-day excursion in the Adirondacks. The left panel of Figure Vision Research Laboratory (MVRL), a joint program of the recognition techniques to the analysis of gaze data. Funded 1 shows the gaze of one observer as she looks at one of the Carlson Center for Imaging Science and the College of Liberal by a research grant to the MVRL from Procter & Gamble, other students, also wearing a Positive Science eyetracker, at Arts. Growth came this year in the form of new members in Thomas’ research aims at replacing some of the laborious the summit of Whiteface Mountain. The right panel shows the the lab, major new funding, and new instrumentation. The manual coding with a semi-automated system that leverages observer’s gaze as she examines an outcropping. MVRL is also bidding farewell to lab alumni who have made the tools of pattern recognition and machine learning. Daniel major contributions to the lab. Pontillo, an MS student in Imaging Science, is working with Thomas, focusing on software development and on semantic Dr. Anne Haake, Associate Professor of Information Technol- coding – the ability to assign semantically meaningful labels to ogy in the Golisano College of Computing and Information individual scene elements based on image content. Daniel’s Sciences, joined the MVRL this year. With a BA in biology current work is funded by another new NSF grant to the from Colgate University, and an MS and Ph.D. in develop- MVRL. mental biology from the University of South Carolina, Dr. Haake’s expertise in bioinformatics and human-computer in- “An Active Vision Approach to Understanding and Improv- teraction add breadth and depth to the faculty mentors in the ing Visual Training in the Geosciences” is a new five-year, MVRL. She came to RIT in 2000 after serving as an Assistant $930,000 project that capitalizes on the MVRL’s develop- Professor at the University of Rochester Medical Center. Dr. ment of wearable eyetrackers over the last decade. Jeff Haake is Principal Investigator on a major new project in the Pelz, PI, and Mitchell Rosen, Research Professor in RIT’s MVRL. Funded by the National Science Foundation, “Multi- Center for Student Innovation, and Director of RIT’s iPix- modal Interface for Retrieval of Perceptually and Semantically Lab, are collaborating with Drs. Robert Jacobs, PI, and Similar Biomedical Images” is a three-year, multidisciplinary John Tarduno from the University of Rochester’s Brain and research effort to develop a human-centered, content-based Cognitive Science and Earth and Environmental Sciences, image retrieval (CBIR) system for biomedical images. To gain respectively. The University of Rochester was also awarded access to the domain-specific knowledge of experts (medi- over $1M in NSF funds over five years for the collaborative Figure 1 Frames from eyetracking video; red crosshairs indicate cal specialists), Dr. Haake will use eyetracking and language project. Together, the team of RIT and U of R scientists will observer’s gaze processing-tools to monitor the master/apprentice interaction use mobile eyetracking systems to study the eye move- as the content experts examine images and describe and ex- ments of expert and novice geologists over the course of plain their inspection and analysis of the images. The goal is a 10-day field trip in California. Starting near where the San to develop an integrated, hybrid image classification method Andreas Fault meets the Pacific , the geologists will that makes use of the spoken descriptions and the gaze data. travel to sites of geographical significance, from the snowy Jeff Pelz, Professor of Imaging Science and Co-Director of the Sierra Nevada to Death Valley. At each location, 10 – 14 of MVRL, and Pengcheng Shi, Associate Professor of Computer the novice and expert geologists will have their gaze tracked Science and Director of the Ph.D. Program in computing and concurrently as they view the scene and interact with the Information Sciences, are Co-Investigators on the $520,000 environment, an instructor, and their peers. project. In addition to the faculty collaboration, the NSF The project is unique in several respects. The MVRL team project supports a multidisciplinary team of Imaging Science will concurrently monitor the gaze of up to 14 observers at and Computer Science graduate students. Sai Mulpuru, an each of the sites. Using new instrumentation and software MS Imaging Science student, is working on the NSF/CBIR developed by Positive Science, LLC, this is the first time that project, along with Rui Li, a Ph.D. Computing and Information any group has attempted to track a large number of observ- Sciences student. ers involved in an active, outdoor task. Figure 1 shows two frames from the eyetracker video; the red crosshairs indicate

53 Another unique aspect of the project is the manner in which This 360° video record, along with wireless audio of the in- the RIT team will capture the entire event and environment. structor, provides a record of the relative position of each ob- Mitchell Rosen, along with Brandon May, Imaging Science server and his/her movements throughout the trial; important Ph.D. candidate, are using a number of specialized imaging information for reconstructing the interactive gaze data. One systems to capture the events in 360° panoramic detail for fu- goal of the NSF-funded study is to capture the environments ture analysis, and the environments at extremely high resolu- in sufficient fidelity to allow experiments to be conducted in tion for both analysis and re-use. Figure 2 shows a frame from the laboratory. In this way, we hope to evaluate the efficacy of an HD video stream, captured with a hyperbolic mirror optic. ‘virtual field trips,’ which could dramatically increase the num- When positioned in front of the lens and aligned vertically, the ber of students who could benefit from the experience. system captures a 360° view of the scene. Figure 3 shows Figure 4 is an image captured from a point near the image the same frame, digitally ‘unwrapped’ to remove the non-linear shown in Figure 3. Unlike that image, which is limited by the distortions introduced by the hyperbolic mirror. number of pixels available in a single HD video frame and the nonlinear unwrapping of the hyperbolic distortion, Figure 4 is a composite of dozens of ten-megapixel digital images. Brandon May captured the image with a digital camera on a robotic “Gigapan” tripod head, then merged the images into a single digital image. Unlike the HD video frame, MVRL researchers can enlarge the Gigapan image for projection in Rosen’s iPixLab, or still farther for analysis. Because of the extreme resolution in the captured image, the images can be enlarged dramatically without encountering artifacts that would typically interfere with image quality. Figure 5 is a detail from the Gigapan panoramic image, enlarged approximately 150 times (linear magnification). The close-up view clearly shows the eyetracking headgear worn by one of the observers. By comparison, had the HD video image Figure 5 150X Detail from Gigapan panoramic image shown in Figure 3 been magnified to the same degree, the same region would be represented by an image measuring only 6 x 7 pixels; less than 0.01% the data available from the In addition to the new Positive Science eyetrackers and panoramic Gigapan image. image capture hardware, the MVRL has added two new eyetrack- One use of the high-resolution images will be to create “virtual ing systems to the lab. Funded by Dr. Haake’s NSF grant and joint field trips.” Observers’ gaze behavior while viewing the virtual funding from CIS, the Department of Psychology Department, and scenes will be compared to those of novices and experts MVRL funds, the lab just acquired SMI RED-60 and RED-250 Remote Eyetrackers with SMI and iMotions software suites. In Figure 2 Single frame from 360° panoramic video capture viewing the real scenes in the field, and their performance on tests will be used to evaluate the efficacy of the virtual experi- addition to the new NSF projects, the new systems will be used by ence. Figure 6 and Figure 7 show Brandon May evaluating Dr. Lindsay Shenkel in her research on clinical pediatric popula- a section of a Gigapan image on the projection wall in RIT’s tions, Dr. Kirsten Condry in the MVRL’s KIDS lab, and Dr. Andrew Center for Student Innovation. Herbert for research on symmetry and change blindness.

Figure 3 “Unwrapped” frame from 360° panoramic video capture

Figure 4 Gigapan panoramic image

54 Carlson, V., & Vigo, A. (2009). Testing infants' and eye tracker” Proc. of the 2008 ACM SIGCHI Eye Tracking children's visual perception using eye tracking technology. Research & Applications Symposium, Savannah, GA Poster presented at the National McNair Scholars Confer- Munn, S., Stefano, L., & Pelz, J.B., (2008) “Fixation identifi- ence, Niagara Falls, NY. cation in dynamic scenes: comparing an automated algorithm Cattaneo, Z., Rosen, M., Vecchi, T., & Pelz, JB. (2008) to manual coding” Applied Perception in Graphics and Visual- “Monitoring eye movements to investigate the picture . ization – Proc. of the 5th symposium on Applied perception in superiority effect in spatial memory” Perception, 37(1), 34-49 graphics and visualization. 33-42 Condry, K., & Spelke, E. S. (2008). The development of Pelz, J.B., Marschark, M, & Convertino, C. (2008) “Visual language and abstract concepts: The case of natural number. Gaze as a Marker of Deaf Students' Attention During Medi- Journal of Experimental Psychology: General, 137, 22-38. ated Instruction” in M. Marschark & P.C. Hauser, (Eds.), Deaf Figure 6 Gigapan image projected for “virtual field trip” cognition: Foundations and outcomes. New York: Oxford DeAngelus, M. & Pelz, J.B. (2009). Top-down control of eye University Press. movements: Yarbus revisited. Visual Cognition, (3), 1-22. Pelz, J. B., Purington, J., Herbert, A. M. (2009). Travel Gopal, S., Haake, A., Price Jones, R. and Tymann, P., (2008). gaze? Re-examining gaze behavior during locomotion. Bioinformatics: A Computing Perspective. McGraw-Hill Presented at the 9th Annual Meeting of the Vision Sciences Haake A, Pelz J, Smagner J, Colombo D, Lindsey L, Society, May, 2009, Naples, FL. Papier A. (2008) “Eye Tracking Users of a Visual Diagnostic Stefano, L. & Herbert, A. M. (2008). Screen versus hard- Clinical Decision Support System to Discover Decision-Mak- copy: Reading faster from and LCD Monitor than paper. ing Strategies and to Inform Design” Presented Presented at the annual meeting of the Object Perception, At- at the American Medical Informatics Association (AMIA), . tention and Memory Symposium at The Psychonomic Society November 2008, Washington, DC Meeting, November, 2008, Chicago, IL. Herbert, A. M., Stefano, L., Conley, T. L. & Pelz, J. B. Schenkel, L. S., Marlow-O’Connor, M., Moss, M., Sweeney, . (2008). Re-examining the preferential detection of negative J. A., & Pavuluri, M. N. (2008). Theory of mind and social . stimuli: Better performance for positive faces. Presented at inference in pediatric bipolar disorder. Psychological Medicine, the Optical Society of America Fall Vision Meeting, October, . 38, 791-800. 2008, Rochester, NY. Schenkel, L. S., West, A. E., Harral, E. M., Patel, N. B., & . Li, F, Munn, S. & Pelz, JB. (2008) “A model-based approach Figure 7 Gigapan image projected for “virtual field trip” Pavuluri, M. N. (2008). Parent-child interactions in pediatric to video eye tracking” Journal of Modern Optics, 55(4), bipolar disorder. Journal of Clinical Psychology, 64, 422-437. 503-531. Susan (Kolakowski) Munn graduated this year after defending West, A. E., Schenkel, L. S., & Pavuluri, M. N (2008). Early her dissertation, “3D Head Motion, Point-of-Regard and En- Li, F, Pelz, JB., & Daly, S. (2009) “Measuring hand, head, childhood temperament in pediatric bipolar disorder and . coded Gaze Fixations in Real Scenes: Next-Generation Portable and vehicle motions in commuting environments” Proc. of attention deficit hyperactivity disorder. Journal of Clinical Video-Based Monocular Eye Tracking.” Sue is continuing her SPIE-IS&T Electronic Imaging, SPIE Vol. 7240,. Psychology, 64, 402-421. work in the field, having accepted a position with Applied Sci- Marschark, M, Convertino, C, Sapere, P, Arndt, ME, Pelz, ence Laboratories in Bedford, Massachusetts. ASL is a leading Wagner, S. M., Schenkel, L.S., Burton, M. M., Towne, T. L., J, (2008) “Learning via Direct and Mediated Instruction by Herbert, A. M., & Pelz, J. B. (2009). Analysis of visual scan- manufacturer of eyetracking systems, and Sue is going to be Deaf Students” Journal of Deaf Studies and Deaf Education leading their 3D development efforts. ning using eye tracking during facial emotion recognition tasks 13(4):546-561 in adults with manic and depressive symptoms. Presented Munn, S, & Pelz, JB (2009) “FixTag: An algorithm for identify- at the 18th Annual Undergraduate Research Symposium, MVRL Publications and Conference ing and tagging fixations to simplify the analysis of data col- August, 2009, RIT, Rochester, NY. lected by portable eye trackers” ACM Transactions in Applied Presentations 2008-2009 (Student authors in bold) Yacci P, Haake A, and Gaborski. “Feature Selection of . Perception, 6(3), 16:1-25 Microarray Data using a Hybrid Algorithm and Artificial Neural Beall, P. M. & Herbert, A. M. (2008). The face wins: Stronger Munn, S, & Pelz, JB (2008) “3D Point-of-regard, position, Network Approach” Presented at the Artificial Neural Networks automatic processing of affect in facial expressions than words in and head orientation from a portable monocular video-based in Engineering symposium, November, 2009, St. Louis, MO. a modified Stroop task. Cognition and Emotion, 22, 1613-1642.

55 Dr. Maria Helguera, assistant professor of imaging science and director of the Biomedical and Materials Multimodal Imaging Laboratory, is conducting research designed to advance the use of positron emission tomography (PET), X-ray computed tomography (CT), and magnetic resonance imaging (MRI). Here Dr. Helguera and one of her students discuss an image developed by the lab through registering and fusing separate MR and PET images. This work could eventually enhance several areas of medical imaging, including the detection of cancer.

56 Biomedical Imaging Laboratory • Joseph Lawson, MS in Mechanical Engineering. “On the Si:Al ratio with a maximum value of 0.22 and a minimum value Determination of the Elastic Properties of Geopolymeric of 0.05. Overview Materials Using Non-Destructive Ultrasonic Techniques”. • Stephanie Shubert, MS in Imaging Science. “Effect of To develop innovative ways to visualize, analyze, and charac- Anisotropy on the High-Frequency Ultrasound Backscat- terize biological tissues and synthetic materials by means of ter of Simulated Nerve Fiber”. multimodal medical imaging devices. • Gary Ashton, MS in Imaging Science, online, “Segment- ing Knee Cartilage Using Thresholds Determined from Staff Histogram Information” The lab hosts two full time faculty, Drs. María Helguera and • Raymundo Vázquez-Lugo, MS in Imaging Science, Navalgund Rao, and a post-doc fellow, Dr. Karl G. Baum. The online, “Application of Fuzzy Segmentation for Face Clas- lab facilities are used as well by Dr. Benjamín Varela from the sification” department of mechanical engineering. • Di Lai, Ph.D in Imaging Science. “Independent Compo- Research in the lab was conducted and supported by a nent Analysis (ICA) Applied to Ultrasound Image Process- number of students: ing and Tissue Characterization”. • Gary Menezes, High School Intern. “Simulation of High- • Christopher McDade, ME MS Candidate. “High fre- Resolution Magnetic Resonance Images on the Blue quency ultrasound c-scan imaging system design and Gene/L Supercomputer Using SIMRI” fabrication”. • Harold Mendoza, CE, “Simulation of PET images Using • Todd Fernández, ME MS Candidate. “High frequency the OpenGate and Geant4 Software Packages” ultrasound characterization of thin films”. Figure 1. Poisson’s ratio of each sample plotted as a function of Si:Al • Natalie Tacconi, CIS, “DICOM Calibration of a Dual Layer Research Projects ratio. High Dynamic Range Display” Ultrasound Materials Characterization • Dien Nguyen, CIS, “Development of Novel 3D Optical Molecular System Incorporating Structured Illumination Geopolymeric Materials: This project is conducted in collabo- Technology”. Interdisciplinary Senior Project. ration with Dr. Benjamin Varela in the Mechanical Engineer- ing Department. Current methods of determining the elastic • Aaron Phipps, BS in Mechanical Engineering, “Develop- modulus and Poisson’s ratio for geopolymeric materials are ment of Novel 3D Optical Molecular System Incorporat- limited by the destructive nature of compressive strength ing Structured Illumination Technology”. Interdisciplinary and bending testing analysis techniques. Since these tests Senior Project. are not repeatable, there is no means of evaluating whether • Patricia Emord, BS in Mechanical Engineering, “Develop- measured properties are a result of the actual materials or the ment of Novel 3D Optical Molecular System Incorporat- effect of possible mechanical defects. This study applies a ing Structured Illumination Technology”. Interdisciplinary relationship between the speed of sound through a material Senior Project. and its elastic properties to determine the elastic modulus and • Ben McGee, BS in Electrical Engineering, “Develop- Poisson’s ratio of geopolymeric samples. In addition to these ment of Novel 3D Optical Molecular System Incorporat- elastic properties, the density, percent pore volume, average ing Structured Illumination Technology”. Interdisciplinary pore diameter and standard deviation of pore diameter were Senior Project. also evaluated. These material characteristics were deter- mined as a relationship to the Si:Al ratio of sodium activated • Brandon Luquette, BS in Electrical Engineering, “Devel- metakaolin based geopolymers with Si:Al ranging from 1.49 opment of Novel 3D Optical Molecular System Incorpo- to 6.4. It was found that lower Si:Al values were consistently rating Structured Illumination Technology”. Interdisciplin- around 8.5 GPa in samples above 3.1 Si:Al ratio. The Pois- ary Senior Project. son’s ratio for each sample decreased proportionally to the

57 Figure 4. Top row: Raw reflectance image of phantom block at 0.8 line pairs/mm. Bottom row: Combined reflectance image.

Figure 2. Five slices from a simulated image acquisition of the Montreal Molecular Imaging: A currently available 2-D high-resolution, Brain Phantom. optical molecular imaging system was modified by the addition Medical Imaging of a structured illumination source, Optigrid™, to investigate the feasibility of providing depth resolution along the optical Image Synthesis: Creating software models of the human axis. The modification of the system involved the insertion of anatomy and imaging systems, and modeling the medical the Optigrid™ and a lens in the path between the light source physics of the imaging acquisition process can provide a and the image plane, as well as control and signal processing means to generate realistic synthetic data sets. In many cases software. The primary challenge of the design, which was to synthetic data sets can be used, reducing the time and cost project the Optigrid™ onto the imaging surface at an angle, was High Dynamic Range Displays: Liquid crystal displays have of collecting real images, and making data sets available to resolved applying the Scheimpflug principle. The illumination replaced film as the display of choice in radiologic imaging. institutions without clinical imaging systems. system implements modulation of the light source and provides Light boxes have a peak brightness of around 4000 cd/m2, Students in the lab have been investigating and implementing a framework for capturing depth resolved mages. providing a 3000:1 contrast ratio (maximum brightness divid- ed by black offset), well in excess of what a diagnostic LCD tools for creating these synthetic data sets. Existing software The system is capable of in-focus projection of the Optigrid™ packages such as SimSET, GATE, and SIMRI are being lever- display can achieve. This provides them with a diagnostic ad- at different spatial frequencies, and supports the use of different vantage in some situations. For this reason it is believed that aged and modified as necessary to enable the generation of lenses. A calibration process was developed for the system to large quantities of high-resolution data. Efforts have included a display with an increased dynamic range and an increase in achieve consistent phase shifts of the Optigrid™. Post-process- the number of perceivably different grey levels (just noticeable grid implementations, and most recently a porting of SIMRI for ing extracted depth information using depth modulation analysis the IBM Blue Gene super computer systems. What resulted differences— JND) may provide diagnostic benefits. using a phantom block with fluorescent sheets at different depths. is perhaps the first tool for generating high-resolution, three- A dual layer HDR display with a dynamic range of five orders dimensional magnetic resonance images. of magnitude was investigated. Calibrating the display to the DICOM standard presents a unique challenge, as the ad- ditional dynamic range and quantization levels are achieved by driving the display with two independent 8-bit graphic devices. Following standard calibration techniques, the system characteristic curve was first determined. Since the system luminance is multiplicative in nature, two characteristic curves, one for the projector and one for the LCD panel, were independently measured. Multiplying the two curves provides a two-dimensional characteristic surface. Given a desired lu- minance, this surface can be used to identify the appropriate digital driving levels for both the LCD panel and the projector in order to match the grayscale standard display function defined in the DICOM standard. Calibration was success allowing the diagnostic benefit of dual layer HDR displays to Figure 3. Plot of run time verse number of nodes used when performing be further explored. a 1283 voxel spin-echo simulation on an IBM Blue Gene system. The plot demonstrates the scalability of the code and shows a near linear speedup. Figure 4. CAD model of the conceptual design

58 Ultrasound Image Processing reflectivity in a plane defined by the beam axis and the beam scanning direction. Focusing with improved resolution at ICA Based Ultrasound Speckle Texture Analysis: Higher fixed depth is achieved by attaching acoustic lens to a single order statistics may provide information about the speckle element transducer. Variable depth focusing is possible in texture beyond the information provided by first and second most modern scanners through the use of phased arrays that order statistics only. However, the higher order statistics of electronically focus the ultrasound wave when it is transmit- ultrasound speckle texture is still not clearly understood and ted. The same array also achieves focusing of the backscatter very difficult to model analytically. In this project, an Indepen- waves from different depths by introducing appropriate time dent Component Analysis (ICA) based multichannel filtering delays to the signal received by the individual elements of the texture analysis algorithm, which considers both higher order array. Photoacoustic (PA) imaging is a new emerging modality. statistics and data adaptation, was proposed and tested on It uses nanosecond laser pulses to instantaneously heat and the numerically simulated ultrasound speckle textures. Several expand the object due to its high optical absorption. Conse- representative conventional methods including both first and quently, thermoacoustic transient ultrasound waves are gener- second order statistics based methods, and both the filtering ated that propagate in all directions. These waves can be Figure 5. Surface map of MSE of phase shifted image of the and non-filtering methods, have been chosen for comparison phantom block. detected as time signals either by scanning a single transduc- study. The numerical experiments showed that proposed ICA er or an array of transducers. The imaging task is to achieve based algorithm in most cases out-performs other algorithms spatial mapping the received signals, or in other words, we in terms of classification accuracy. The proposed algorithm need to determine the spatial location and strength of the may potentially find clinical application in the early detection absorbing sources. This is identical to what phased arrays do of soft tissue disease, and also help in better understanding in reception mode. However, this type of electronic focusing of ultrasound speckle phenomenon from the perspective of requires dedicated hardware and software that can be expen- higher order statistics. sive. Furthermore, the entire high frequency ultrasound time ICA Based Ultrasound Image Despeckling: This project signal has to be recorded as raw data that is subsequently tackled the problem of reducing the speckle noise in the used for image reconstruction. Goal of this project is to ultrasound B-scan image while preserving the structure of develop an acoustic lens based C-scan imaging technology. boundaries and lesions. Our contribution was two fold: (i) From a fundamental perspective, image reconstruction tasks We demonstrated for the first time that ICA Sparse Code in both ultrasound pulse echo and photoacoustic imaging Shrinkage (ICA-SCS) denoising algorithm can be applied to are identical. Therefore we use an ultrasound based method the ultrasound B-scan image despeckling problem. ICA_SCS to evaluate the system Line-spread-function (LSF). Fig. 10(a) Figure 6. Characteristic surface of HDR display. Colored lines represent algorithm is successful when the noise is additive White and 10(b) show the face of flat disk 5 MHz transducer and its grey values selected for specific calibrations. Gaussian Noise (WGN). It uses higher order statistics and lens based C-scan image respectively. is also data adaptive. However, the speckle noise found in medical ultrasound B-scan image is not strictly additive WGN. (ii) Therefore, as a secondary improvement, we have incor- porated a pre-processing step that makes the speckle noise much closer to real additive WGN, hence more amenable to denoising algorithm such as ICA-SCS. The experimental results on simulated image data show that the proposed method outperforms several classical methods, such as Wie- ner filtering and wavelet shrinkage, chosen for comparison. Lens based C-scan Photoacoustic Imaging: ultrasound B-scan imaging is an established modality in medical imag- Fig. 10(a) Transducer face- object Fig.10(b) C-scan image of object Figure 7. Luminance of calibrated display (768 quantization levels, ing. A two dimensional B-scan image represents the object in 10(a) 1200 cd/m2 maximum luminance) and the DICOM standard display function. Close agreement between the two curves shows calibration was successful.

59 Professor Stefi Baum continued her collaboration with the Selected Publications Biology Society. EMBS 2007. 29th Annual International Mind Research Network in Albuquerque New Mexico, with Conference of the IEEE. pp. 6523-6526. CIS Affiliate Faculty member Vince Calhoun Associate Profes- Conference presentations and Proceedings Papers: Link: http://ieeexplore.ieee.org/xpls/abs_all. sor, University of New Mexico, and Director, Image Analysis 1. Walvoord, D., Easton, R., Baum, K.G., Krol, A., Hel- jsp?arnumber=4353854 and Magnetic Resonance Research, The Mind Research guera, M. " Localization of Fiducial Skin Markers in MR Network. Their work focused on application of new image Images using Correlation Pattern Recognition for PET/ Journal articles and book chapters: processing techniques and analysis algorithms to brain imag- MRI Nonrigid Breast Image Registration ", Applied Imag- 1. Baum, K.G., Helguera,M., Krol, A. “Fusion Viewer: A ing for diagnosis of schizophrenia. Their first joint PhD student, ery Pattern Recognition, AIPR, 2008. New Tool for Fusion and Visualization of Multimodal Andrew Michael, completed his PhD thesis, titled “Imaging 2. Baum, K., Helguera, M., Schmidt, E., Rafferty, K., Krol, Medical Data Sets”, Journal of Digital Imaging, 21, Schizophrenia: Data Fusion Approaches to Characterize and Suppl. 1, 59-68, 2008. Classify” in May of 2009 and Andrew took up a position as A., "Evaluation of Genetic Algorithm-Generated Multivari- research scientist at the Mind Research Network. A new ate Color Tables for the Visualization of Multimodal Medi- 2. Helguera, M. ¿Qué información podemos obtener de first year PhD student, Siddharth Khullar, started on a joint cal Fused Data Sets", 2008 IEEE NSS-MIC, 4350-4360, imágenes médicas? In “Imágenes en la Ciencia. Ciencia research project at MRN this summer focusing initially on the 2008. en las Imágenes.” Elke Köppen, Ed. Col. Debate y application of wavelets to fMRI data in the analysis of schizo- 3. Canosa, R.L., Baum, K.G., “Modeling Decision-Making Reflexión, Centro de Investigaciones Interdisciplinarias en phrenia. Biweekly telecons between MRN and CIS keep the in Single- and Multi-Modal Medical Images”, SPIE Medi- Ciencias y Humanidades, UNAM, 2009. collaboration and the research running smoothly. cal Imaging, 7263, 72630J, 2009. 3. Di lai, Navalgund Rao, Chung-hui Kuo, S. Bhatt and V. 4. Navalgund A. Rao, Di Lai, Shweta Bhatt, Stephen C. Dogra, “Application of Independent Component Analysis Publications Arnold, Bhargava Chinni and Vikram S. Dogra, "Acoustic (ICA) to Ultrasound Speckle Texture Analysis and Tissue Characterization”, submitted to Medical & Biol. Engg. & A. Michael, S. A. Baum, T. W. White et al., “Does Function Lens Characterization for Ultrasound and Photoacoustic Computing (2009). Follow Form”: Methods to Fuse Structural and Functional C-scan Imaging Modalities". Engineering in Medicine and Brain Images Show Decreased Linkage in Schizophrenia,” Biology Society. EMBS 2008. 30th Annual International Neuroimage, Vol 49, Issue 3, 1 February 2010, pages . Conference of the IEEE. pp. 2177-2180. Grants and Research Funding 2626-2637 .. .Link: http://www.ieeexplore.ieee.org/xpls/abs_all. NSF Research Graduate Fellowship, "The Effect of Anisot- A. Michael, S. A. Baum, J. F. Fries, B-C Ho, R. K. Pierson, . jsp?arnumber=4649626 ropy of Ultrasound Scattering on Ultrasound B-Scan Nerve N. C. Andreasen, and V. D. Calhoun, “A Method to Fuse fMRI 5. Di Lai, Navalgund Rao, Chung-hui Kuo, Shweta Bhatt Images," $45,000, 2007-2009. Robert Rose, “Research Gift,” Tasks Through Spatial Correlations: Applied to Schizophre- and Vikram Dogra, "An Ultrasound Image Despeckling 2007, 2008. nia”. Human Brian Mapping 2009, August 30(9) 2512-2529. Method Using Independent Component Analysis". NSF, “Upstate Louis Stokes Alliance for Minority Participation,” Image below is of the Mind Research Network in Albuquerque 2009 6th IEEE International Symposium on Biomedical $15,000, 2008. New Mexico Imaging: From Nano to Macro. pp. 658-661. Link:http:// ieeexplore.ieee.org/search/searchresult.jsp?queryTex CAT-CEIS, “Development of a Novel 3D Optical Molecular t=%28di+lai+%3Cin%3E+metadata%29+%3Cand%3 Imaging System Prototype and Calibration Methods,” in col- E+%285192959+%3Cin%3E+isnumber%29&coll2=i laboration with Carestream Health, $29,000. eeecnfs&coll3=ieecnfs&history=yes&reqloc=others&s DOE, “Visualization of Fuel Cell Water Transport & Perfor- cope=metadata&imageField2.x=0&imageField2.y=0 mance Characterization”, project awarded to PI Dr. S. Kand- 6. Di Lai, Navalgund Rao, Chung-Hui Kuo, Shweta Bhatt likar, Mech. Engg. Dept, RIT, Co-I N. Rao, 1.5M., 2006-2009. and Vikram Dogra, "Independent Component Analysis CEIS Bioimaging grant, “Photoacoustic Imaging of Prostate”, Applied to Ultrasound Speckle Texture Analysis and funded through U of R, PI Dr. Dogra, Co-PI Navalgund Rao in Tissue Characterization". Engineering in Medicine and collaboration with AAIT, $45,000, 2009.

60 61 Magnetic field strength measurements made by high school intern Bethany Connors of Spencerport, NY, to facilitate the placement of an NMR spectrometer in the Carlson Building.

62 Magnetic Resonance Staff News

Imaging Laboratory Sangyun Moon, finished up his Nicole Conway, a junior at the Research Group Leader’s Comments work on a volume resolution phan- Canandaigua Academy in Canan- tom for MRI and received his MS in daigua NY, was a High School By Professor Joseph Hornak Imaging Science from RIT. He is now Summer Intern in the lab. She employed with Rainbow Research worked on optical measurements of Overview Optics in Denver Colorado. the complexation of copper (II) with The RIT Magnetic Resonance Laboratory is a research and the diamide ligand. development laboratory devoted to solving real world prob- lems with magnetic resonance. This year we continued our focus on three research topics: volume resolution phan- toms for magnetic resonance imaging (MRI), near-surface Brittany Lipchick, received her BS Gretchen Smith, a junior at Naza- MRI, and the interaction of the MRI contrast agents with in Biochemistry from RIT and is now reth Academy in Rochester NY, was transition metal ions. On the phantom front, we completed a PhD graduate student at the Ro- a High School Summer Intern in the development of a three-dimensional phantom for determin- swell Park Cancer Institute Division lab. She worked on optical mea- ing the point spread function and linearity of an MRI system of the University at Buffalo. surements of the complexation of anywhere in a 10×10×10 cm volume without the need to copper (II) with the diamide ligand. reposition the phantom. This work was presented at the 10th Upstate NY Nuclear Magnetic Resonance (NMR) Symposium. We finished a study of the NMR spin-lattice relaxation rate (R1) of hydrated natural sands finding the relationship Rebecca Smith, a BS Chemis- Gianni Ferrante, President of between R1 and sand grain diameter, paramagnetic metal try student at RIT, joined the lab in Stelar, s.r.l in Mede Italy, continued content in the sand grains, and magnetic field strength. March. She is studying the inter- his collaboration with the lab . This research has evolved to a study of the influence of action of copper (II) ions with the measuring hydrogen NMR . weathering on the sand grains. This work was presented at diamide ligand. She received a Sum- spin-lattice relaxation rate values . the 9th International Conference on Magnetic Resonance mer Research Fellowship for 2009 of hydrated real-sand as a function in Porous Media, the 2008 NY State Complex Matter from the RIT College of Science. of magnetic field. Workshop at Cornell University, and the 50th Experimental NMR Conference. Our study of the MRI contrast agent gadodiamide with . copper (II) shows that transmetallation is occurring and gad- Hongmei Yuan, a MS chemistry Andrew Coy, CEO of Magritek olinium (III) is released. Work leading up to this conclusion student at RIT, joined the lab in Limited in Wellington New Zealand, was presented at the 10th Upstate NY NMR Symposium. September after four years as an started a collaboration with the engineer with the Qingdao Quick lab measuring the hydrogen NMR Prosperous Logistics Company in spin-lattice relaxation rate values of China. She is studying isotropic hydrated real-sand at the Earth’s and anisotropic diffusion of water in magnetic field. constrained materials. The aim of her research is to develop diffusion phantoms for MRI.

63 Conference Presentations Publications New Equipment & Facilities

1. C.L. Bray, R.G. Bryant, M.J. Cox, G. Ferrante, Y. 1. C.L. Bray, R.G. Bryant, M.J. Cox, G. Ferrante, Y. The lab acquired a Magritek Terranova-MRI, an Earth's field Goddard, S. Sur, and J.P. Hornak, The 1H NMR R1 of Goddard, S. Sur, J. P. Hornak, The Proton Nuclear magnetic resonance imaging system and nuclear magnetic Some Hydrated Synthetic and Natural Sands, 9th Inter- Magnetic Resonance Spin-Lattice Relaxation Rate of resonance spectrometer. The instrument will allow us to mea- national Conference on Magnetic Resonance in Porous Some Hydrated Synthetic and Natural Sands. Diffusion sure the hydrogen spin-lattice relaxation rate of hydrated soils Media, Cambridge, MA July 2008. Fundamentals 10:8.1-8.3 (2009). at the Earth’s magnetic field of 0.5 Gauss.

2. S-Y. Moon, J.P. Hornak, A 3D Volume Resolution Phantom for MRI, 10th Upstate NY NMR Symposium, Rochesterm, NY, October 2008.

3. B. Lipchick, J. Swartzenberg, N. Conway, G. Smith, J.P. Hornak, Evidence for and Against Transmetallation between Cu and Omniscan®, 10th Upstate NY NMR Symposium, Rochesterm, NY, October 2008.

4. M. Cheung, R. Boswell, B. Lipchick, T.W. Smith, C.L. Bray, J.P. Hornak, A Low Dielectric Constant High-Con- ductivity Filler Material for MRI Phantoms, 10th Upstate NY NMR Symposium, Rochester, NY, October 2008.

5. C.L. Bray, R.G. Bryant, M.J. Cox, G. Ferrante, Y. God- dard, S. Sur, J.P. Hornak, The 1H NMR R1 of Some Hydrated Synthetic and Natural Sands, 2008 NY State Complex Matter Workshop, Cornell University, Ithaca, NY, December 2008.

6. J.P. Hornak, G. Ferrante, A. Coy, E. McCarney, A 1H NMR Spin-Lattice Relaxation Time Study of Asilomar Sands, 50th Experimental NMR Conference, Asilomar, CA March 2009.

64 Optics Local and International Collaborations Tatyana Fadeyeva, Alexander Rubass, Yuriy Egorov, Alexan- der Volyar, and Grover Swartzlander, Jr., “Quadrefringence of Overview Prof. Scott Williams, School of Print Media, RIT optical vortices in a uniaxial crystal,” J. Opt. Soc. Am. A 25, Dr. Alan Raisanen, Semiconductor and Microsystems Fabrica- 1634-1641 (2008). An optics thrust was reestablished with the hiring of Prof. tion Laboratory, RIT Grover Swartzlander, who came on board in January 2009. He Greg Gbur and Grover A. Swartzlander, Jr., “Complete trans- brings experimental and theoretical experience in multiple areas Dr. Steven Martin, Systems Technology Dept., Sandia National verse representation of a correlation singularity of a partially of physical optics, including optical vortices, optical tweezers, Laboratories coherent field,” J. Opt. Soc. Am. B 25, 1422-1429 (2008). optical coronagraphs, holography, nonlinear optics, coherence, Dr. Aaron Gin, Center for Integrated Nanotechnolgy, Sandia and micro-optical elements. A strength in optics will provide National Laboratories graduate and undergraduate students with opportunities to (1) gain fundamental knowledge of optical principles in a core Dr. Daniel Wilson, Jet Propulsion Laboratory area of imaging science, and (2) to conduct and publish novel Prof. Greg Gbur, Physics Dept., Univ. N. Carolina at Charlotte research in several exciting frontiers of optics. Prof. Alexander Volyar, Taurida National University, Ukraine Current Research Themes Prof. Mark Dennis, Univ. of Bristol, United Kingdom 1) Optical Vortex Coronagraph—design a high contrast imaging instrument to detect biomarkers on Earth-like Recent Publications exoplanets, Grover A. Swartzlander, Jr., “The optical vortex coronagraph,“ J. Opt. A: Pure Appl. Opt. 11, 094022 (2009). 2) Optical Tweezers —develop laser based non-contact micromanipulation techniques for controlling microm- Grover A. Swartzlander, Jr., Arvind Marathay, Jennifer M. eter sized objects such as biological cells or rare Harwell, Joshua Gordon, and Jason Figueiredo, “Optical Vortex particles, Vectographs,” Optics Letters 34, 1216-1218, (2009). 3) Polarization-based beam shaping —use vectographic print- Grover A. Swartzlander, Jr., Erin L. Ford, Rukiah S. Abdul-Malik, ing techniques to control the amplitude and phase of light, Laird M. Close, Mary Anne Peters, David M. Palacios, and 4) Micro-optic fabrication—use photolithography and Daniel W. Wilson, “Astronomical demonstration of an optical electron beam lithography to create precision optical vortex coronagraph,” Optics Express 16, 10200-10207 (2008). elements such as vortex lenses.

65 Transmission electron microscope operating at 200 kV.

66 Nanoimaging Research Laboratory

The NanoImaging Lab has just completed its third year of operation. The Lab is divided into three facilities: Micros- copy, Fabrication and Evaluation of Imaging Devices, and Nanoparticle Synthesis. Microscopy. In this facility we characterize materials by imaging, electron diffraction, and x-ray microanalysis. Ongo- ing work focuses on correlating polymer particle size and Fig. 3. (Left) Device efficiency vs applied voltage for different loca- structure with synthesis methods. Prof Matt Miri’s group, tions of the LiF buffer layer (see text for details). (Right) Basic device Chemistry, is synthesizing high-density polyethylene particles schematic showing one possible location for the LiF buffer layer. in a starch binder with a goal of developing largely biode- gradable plastic film. We are using the TEM to image the We have made much progress in the SMOLED category polymer particles to characterize their size, size distribution, and are now reproducibly fabricating devices whose opto- and morphology. We also use the SEM to image cross sec- electronic characteristics are consistent with those pub- tions of films designed to mimic what would happen if the lished in the scientific literature. Figure 3 shows some of our material were used to fabricate plastic bags. results, including a schematic cross section of the device We have also initiated a collaboration with Prof Benjamin on the right-hand side. Holes are injected from the left-hand Varela in Mechanical Engineering. Prof Varela’s research side of the device via the indium tin oxide (ITO) layer and the interest is in the use of geopolymers (ceramics) as construc- polymer buffer layer (PSS:PEDOT) and finally into the hole tion materials. We have used the SEM to both image the transport layer (TPD). Meanwhile electrons are injected from material and provide elemental analysis via x-ray microanaly- the right-hand side via the aluminum cathode and LiF layers sis. Examples are given in Fig. 1. into the electron transport layer (Alq3). With balanced charge injection, which is part of the optimization of the device structure, the electrons and holes meet in the Alq3 layer and form an exciton, which decays by emitting a photon (green in this device structure).

Fig. 2. Image of a tin-CNT complex. The dark areas are the tin clusters The data shown in the left-hand side of Fig. 3 pertain to an adsorbed to the bundle of carbon nanotubes. experiment in which we varied the placement of the LiF buf- fer layer. LiF was deposited either under the cathode, above Fabrication and Evaluation of Imaging Devices. We the PEDOT:PSS layer, placed at both sites, or placed below continue to build our expertise in fabrication of organic- the cathode and between the TPD and Alq3 layers. The best based light-emitting devices (LEDs). Our ultimate goal is to device was that with LiF only below the cathode. Personnel fabricate hybrid devices in which inorganic nanocrystals are involved: Omkar Vyavahare and Nikita Surve, both graduate Fig. 1. Example SEM images of ceramic material with different el- the light-emitting element and the organic layers are used for students in the Materials Science & Engineering program. emental compositions strictly electron and hole transport. A necessary prerequisite to that goal is building devices that use the organic material Prof Davide Mariotti’s research is in nanofabrication and to emit light. These are commonly called organic light-emit- we are imaging materials and devices fabricated by his ting devices (OLEDs), which are further characterized on the students. We have also worked with R. DiLeo, NanoPower basis of whether the devices use small molecules that are Research Labs, to image a complex between tin and carbon vacuum evaporated to form the device structure (SMOLEDs) nanotubes, as illustrated in Fig. 2. or polymeric materials that are typically fabricated by spin- coating techniques (PLEDs). We are just beginning our study of PLED devices.

67 Nanocrystal Synthesis. We are synthesizing nanocrys- intended application of this material. We have extended the Grants and Contracts FY09 particle size down to 1.1 nm diameter, smaller than any other tals composed of CeO2, which are currently intended for a nonimaging application. These are grown by an aqueous published result. Our electron diffraction analysis shows that Cerion Energy, $135k

precipitation route that is “green” and inherently scalable. The the material is still CeO2 at this size, hopefully clearing up the disputed interpretation of the lattice expansion. Personnel techniques we are developing can be readily applied to other Facilities compositions that have more imaging relevance. involved: Gary DiFrancesco, Associate Scientist. Project sup- ported by Cerion Energy, Inc. Microscopy: JEOL 6400V scanning electron microscope Of importance to the potential application is whether or not with a LaB6 electron gun and energy dispersive X-ray analysis the nanocrystals we produce are crystalline. With the help of Course and Outreach Support. The Microscopy Facil- for elemental detection. JEOL 2000FX transmission electron M. Rodriguez at SUNY Albany we were able to obtain high- ity has become a popular resource for supporting various microscope with energy dispersive X-ray analysis for elemen- resolution TEM pictures of our material as shown in Fig. 4. CIS/COS/COE courses. In the last year it has been used to tal detection (See frontpiece for a picture). JEOL 100CX II These images show lattice planes characteristic of crystalline support Introduction to Electron Microscopy, Imaging Sci- transmission electron microscope. Reichert Jung ultramicro- material. Electrons moving down the columns are retarded ence Fundamentals (two sections), Frontiers in Science, and tome for cross-section preparation. Nikon 9000 Film Scanner. in phase via their interaction with the crystal atoms, whereas Introduction to Nanotechnology. In addition, the Microscopy those electrons moving down the spaces between lattice Device Fabrication and Evaluation: Denton vacuum Facility has supported outreach events including one CIS plans are not. The result is an interference pattern character- coater, Laurell spin coater, Keithly digital source meter for I-V Open Houses, the CIS High School Intern program, and a istic of crystalline material. Measurement of spacing between curves, Ocean Optics monochromator for electrolumines- cooperative venture between CIS and the Rush-Henrietta the planes, as well as fast Fourier transforms of the individual cence spectra and radiance measurement. School District. particles, show that the imaged planes are characteristic of Nanocrystal Synthesis: Three- and nine-liter reactors for the (111) planes for CeO . 2 precipitation of inorganic nanocrystals, with extensive process Fig. 4. High-resolution TEM image Publications and Patents control by Labview software. Brookhaven dynamic light scat- of CeO nanocrystals. tering instrument for particle size measurement. 2 R. K. Hailstone, A. G. DiFrancesco, J. G. Leong, T. D. Allston, K. J. Reed, “A Study of Lattice Expansion in CeO2 by Transmission Electron Microscopy”, J. Physical Chemistry C, 113, 15155-15159 (2009). R. K. Hailstone, A. G. DiFrancesco, J. G. Leong, T. D. Allston, K. J. Reed, “Preparation and Characterization of CeO2 Nanoparticles”, Fall MRS Proceedings, (2008). O. Vyavahare, R. K. Hailstone, “Enhanced Performance As crystal size decreases the general expectation is that the of Organic Light-Emitting Diodes Using a LiF Buffer Layer”, lattice constant of the crystal should decrease due to surface Spring MRS Proceedings (2009). tension and other forces. But, just the opposite is seen in CeO . The published literature supports the observation, but A. G. DiFrancesco, T. D. Allston, R. K. Hailstone, A. 2 , “Fuel Additive Containing Lattice Engi- the mechanism causing this effect is controversial. Some Langner, K. J. Reed neered Cerium Dioxide Nanoparticles”, US Patent App PCT/ have suggested that the expansion is due to reduction of US08/87133, December (2008). the crystal to Ce2O3, a form that would be useless for our

68 Laboratory for Space Weather Alert Technologies

Overview: This has been the inaugural year for RIT’s Laboratory for Space Weather Alert Technologies (LSWAT). During this initial year of operation, the lab has acquired three dual frequency GPS antenna receivers. With the participation of four under- graduate researchers (Kim Doyle, Soham Ghosh, Matthew Marsh and Galen Doser), three RIT building sites were select- ed to host each of the three receivers. To date, one of these receivers has been installed on Building 17, and the process is well underway to install the remaining two. Armed with these receivers, LSWAT researchers will be able to perform real time three-dimensional imaging of the Earth’s ionosphere. This data, coupled with live data from a variety of NASA deep space solar probes, will allow the development of advanced artificial intelligence algorithms that will seek to predict the arrival of severe space weather storms days before they affect the earth’s power grid and communications infrastructure.

Staff: The LSWAT group consists of two faculty members and six student researchers. Dr. Roger Dube is the Principal Investiga- tor and directs the overall project. Dr. Chance Glenn, Jr. (a data requires the development of both data analysis algo- retraining. A publication is being prepared for submission. faculty member in CAST) is also an active participant in the rithms that convert GPS signals to line of sight total electron project. Undergraduate students include Kim Doyle, Soham content (TEC) as well as algorithms that perform triangulation Outreach: Ghosh, Matthew Marsh and Galen Doser. Santosh Suresh, a and interpretation of this data for 3D visualization of iono- spheric activities. Dr. Dube continues to bring his personal connections with the PhD candidate in CIS, has recently joined the team and seeks local Native American community to the research activities to conduct his thesis work on space weather prediction. Artificial Intelligence: In order to predict the future arrival of at RIT. This past spring, he hosted visits from the Seneca Kevin Miller, a graduate student in Computer Science, has space weather storms, the above library of databases must Nation of Indians (shown in the attached photo) where he and conducted research to develop dynamically learning artificial be digested and specific precursors extracted from the data. CIS graduate student Santosh Suresh explained the Labora- intelligence algorithms. Current Research: This requires the development of AI recognition and prediction tory’s mission and research to multiple groups of students Data Aggregation: The task of identifying precursors that algorithms. In this regard, Dr. Glenn has been working with from Seneca Nation. Working with Dr. Jason Younker and Dr. can reliably predict the future arrival of a solar space weather Santosh Suresh to implement D-Transform technology. Those Paul Shipman of the Future Stewards program, this outreach storm requires the use of a wide variety of data sources. algorithms are working and are being modified to accept seeks to interest local Native American high school students Over the years, NASA has launched many satellites into orbit image data as well as single temporal data. Neural network in scientific research as they consider their future college whose primary task is to provide real time solar data, including algorithms historically require retraining whenever new data is careers. images at various wavelengths, particle flux, x-ray intensities added to the training set. With a continually growing data- and more. The team has constructed a data aggregator that base of multiple sources, this characteristic rapidly becomes will provide local researchers with access to such data span- undesirable. To correct this, Kevin Miller, a graduate student in ning a long period of time. computer science, has developed a neural network algorithm that incrementally learns new information without the need for Ionospheric modeling: The real time acquisition of ionospheric

69 Dr. Roger L. Easton and his research collaborators at St. Catherine’s Monastery in the Sinai Desert of Egypt.

70 Historical Manuscript Restoration Imaging of Historical Manuscripts By Roger L. Easton, Jr. Activities of this laboratory were directed primarily at further imaging and image processing of the Archimedes Palimp- sest and of a 9th–century Syriac palimpsest owned by the same individual. The original text of the Syriac manuscript may be a medical textbook. Selected leaves from this manuscript were imaged in February 2009 and plans have been developed to image the entire manuscript in early 2010 using the same tools and algorithms developed for the Archimedes palimpsest. One of the original texts in the Archimedes palimpsest is a partial manuscript (seven leaves) of a commentary on Aristo- tle’s “Categories” by Alexander of Aphrodisias. The scholars had found the text on these leaves to be very difficult to read, even after pseudocolor image processing. Dr. William Noel of the Walters Art Museum challenged the imaging team to work intensively on these images over the Christmas holidays in 2008 to assist the scholarly transcription. First-year imag- ing science undergraduate student Kevin Bloechl took up the challenge, and within one day, he had demonstrated a method that successfully retrieved much of the lost text. He performed principal component analysis on RGB images collected under ultraviolet illumination. In other words, he ana- lyzed the spectrum of the fluorescent light emitted by these oratory in Kihei, HI, Dr. William A. Christens-Barry of Equipoise leaves. The original undertext appears almost as by magic, Imaging in Ellicott City, MD, and Ken Boydston of Megavision, stone, now kept at the David Livinstone Museum in Blantyre which has allowed scholars to transcribe more than 90% of Inc. in Santa Barbara, CA, Approximately fifty leaves were im- Scotland, and from Dr. Gregory Heyworth of the University the text on these pages where formerly only about 10% might aged under the supervision of Father Justin of the Monastery, of Mississippi, who is trying to read lacunae of a manuscript have been read. David Cooper, Director of Digital Lightforms, Ltd., U.K. and that was damaged during the bombing firestorm in Dresden. The laboratory is now currently working with the Preservation, former Librarian of Corpus Christi College at Oxford University. The laboratory is actively seeking funding for these activities in Research, and Technology Directorate of the U.S. Library of The project was managed by Michael Phelps, Executive Di- collaboration with these scholars. Congress to develop methods for imaging watermarks in pa- rector of the Early Manuscript Electronic Library in Rolling Hills Dr. Easton consulted with the staff of the National Library of per. Dr. Fenella France of the Library is collaborating with Dr. Estates, CA and Michael Toth of R.B. Toth Associates of Oak- Medicine at the Solid-Dose Pharmaceutical Imaging Speci- Roger Easton and graduate student Francesca Polo in this ton, VA. The team will present their results to the Monastery fication Meeting and to the Yad Hanadiv Foundation of Je- one-year project that is aimed at replacing the former method and then propose a long-term project to image the collection rusalem. The laboratory presented at the ImagineRIT festival of beta radiography in this application. of palimpsests. on 2 May 2009. Dr. Easton presented an invited talks to the An imaging team including Dr. Roger L. Easton, Jr. of the Additional inquiries have been received from Dr. Adrian Wis- Rochester Society of the Archeological Institute of America, to Carlson Center, surveyed palimpsested manuscripts at St. nicki, Honorary Research Fellow of the School of English and the Rochester Section of the Optical Society of America, and Catherine’s Monastery in the Sinai in September 2009. The Humanities at Birkbeck College of the University of London, to the Friends of the Linda Hall Library in Kansas City on 12 team included Dr. Keith Knox of the Air Force Research Lab- who is trying to read the African diaries of David Living- November 2009.

71 Frontiers of Science II (1099-261) students present their project work at the annual Imagine RIT festival. Their work received the most hits from the new “Tagg Imagine RIT” where visitors could tag their favorite exhibits using their cell phones.

72 Outreach

The RIT Insight Lab for Science Outreach and Learning Re- of Science” as a lab science sequence in interdisciplinary search, led by Dr. Jake Noel-Storr and Dr. Stefi Baum, contin- science. The 08/09 Frontiers students again presented their ues to develop, test and deliver cutting edge science educa- work at the annual Imagine RIT festival—using the insight tion and outreach activities, and research the effectiveness lab ‘SCUBE’ (insight.cis.rit.edu/SCUBE) and LIAS IR Imaging of all learners, in domains centered in Astronomy, Imaging of campus to create an immersive, explorable model of the Science, and all sciences in general. We have developed five thermal emissions of buildings of campus, within a Google key working areas to work and pursue funding in – Science Earth based framework. The Insight Lab has become the hub in Digital Immersive Environments; Family Science Learning; for the new RIT Astrobiology club. The president and vice- Science Stepping Stepping Stones to Research; Learning Landscapes; and president of the club are both Insight Lab students, and Lab Immersive Science Education Experiences. Director Dr. Noel-Storr is the club’s advisor. Learning Stones to Over the summer and through the school year we have To promote STEM learning on the national stage, we have Landscapes Research supported over twenty undergraduate students in astrophys- continued our partnership with NASA’s Solar Dynamics (K-12) (6-Grad) ics research projects or science education and outreach Observatory Education and Outreach team based at the projects. Our student team consisted of everything from high Goddard Spaceflight Center to operate AstroZone and Explo- school juniors to college seniors—from five of the seven RIT ration Station ahead of the National Meetings of the Ameri- colleges and over a dozen majors on the RIT campus. The can Astronomical Society and American Geophysical Union insight lab has become a truly interdisciplinary learning envi- respectively along with K12 Educator Receptions alongside ronment. A group of three of our students won an award for each event. Through these programs, in the past year we Family Digital the best presentation during the RIT Summer Undergraduate have provided engaging STEM events for communities in St. Youth Science Immersive Research Symposium. Louis, MO, Long Beach, CA, and San Francisco, CA. Locally Learning Environments To provide a landscape of innovative and engaging science we continued to run a successful program of Astronomy (K-12) (6-Grad) education experiences for RIT undergraduate students, we Overnights for the Girl Scouts of Western New York; to work offered “Scientific Community”, “Hitchhikers Guide to the with Rush Henrietta High School Students on research and Galaxy”, and “Scientific Mythbusting” through the Honors digital immersive projects; and began to develop a new Family program. The College of Science Curriculum Committee ap- Science program to begin in the fall of 2009. proved our interdisciplinary science class sequence “Frontiers

73 Our daily summer team meeting in the Insight Lab, students share their accomplishments of the day – pictured working together are high school interns, pre-freshmen researchers, undergraduates, and recent RIT graduates.

Girl Scouts of Western New York learn how to setup and use an 8” telescope as a part of their Reach for the Stars Overnight program hosted by the Insight Lab. During the year over 200 girls and their leaders took part in this popular program.

20090104_1635.jpg High School Students and Teachers meet with the The Insight Lab’s Digital Immersive Science Cube (or SCUBE) on Education Director of the American Institute of Physics at the semi- display in the RIT College of Science atrium to prospective students annual K12 Astronomy Educator Reception in Long Beach. and their parents touring the RIT campus.

74 Johannes Kepler learns about the Kepler mission from a team from the SETI Institute exhibiting at AstroZone: St. Louis. Up to 500 visitors attend each AstroZone event hosted across the country.

Astronomers, Teachers, and Astronomy Educators RIT Alumni and Insight Lab staff help run the annual interact at the semi-annual K12 Astronomy Educator Family Science Overnight at the NASA Goddard Space- Reception, held in conjunction with the American Astro- flight Center’s Visitor Center and “Rocket Garden”. nomical Society Conference, hosted by the Association for Astronomy Education and Operated by the Insight Lab and NASA’s Solar Dynamics Observatory.

RIT Alumni Russell Barkley and George Privon, Insight Rush Henrietta High School students developing a digi- Lab Undergraduate Kevin Shimkus, and Prospective tal immersive “Journey of a Photon” experience meet in Student (now at RIT) Adam Simon join the Insight Lab/ the Center for Imaging Science to plan their work and Solar Dynamics Observatory tour of the facilities at collaborate with the Insight Lab team. NASA Goddard Spaceflight Center.

75 76 The CIS Platypus College and Careers Social Networking Throughout planning for outreach materials and presenta- The Center for Imaging Science is now on Facebook! Please tions, it became apparent that the Center for Imaging Science Classroom Visits become a “fan” of our page at www.facebook.com/RITim- was in need of a defining symbol, metaphor, or mascot to Looking ahead, CIS hopes to broaden its contacts with K-12 agingsci. Here you can find information about the Center; help illustrate what CIS is as an entity. Out of this, the CIS schools. This includes both schools in the local region, as opportunities for potential students, current students, and Platypus was born. Imaging Science is to disciplines as the well as across the country. The way we wish to achieve this is alumni; links to interesting Imaging-related articles; CIS event platypus is to the animal kingdom: a conglomeration of usually through collaboration with CIS alumni. Alumni can assist by pro- invitations; discussion boards; as well as general announce- independent characteristics all brought together into a single viding CIS with contacts for schools they are involved in, as well ments. It is also a great way to find former classmates and body. You can perhaps consider the duck-bill to be calculus; as by going out themselves to make classroom visits utilizing reconnect with each other! We encourage anyone involved the beaver-like tail as computer science; the eggs as physics; CIS-provided materials (See: CIS Street Team). with CIS to become a fan, interact with the site, and spread the fur as engineering. So far, the Platypus concept has been the word to others. received with a warm welcome. CIS can also be followed on Twitter via the username RITim- Special Projects agingsci. Prospective Student Alumni Involvement Outreach Programs CIS is looking to increase and improve alumni relations with . The “CIS Street Team” its graduates. CIS is asking for Alumni volunteers to help spread the word I. CIS Intern Program An Alumni Involvement Survey questionnaire will be going . about Imaging Science. To support this effort, the Center for out soon to gauge interest in Alumni activities, ranging . Imaging Science is currently forming the “CIS Street Team”. CIS ran its CIS High School Intern program for the ninth from casual gatherings, to social networking, to “CIS . Planning for this effort is still in its beginning stages; however consecutive summer in 2008. A total of 15 students were Street Team” participation. several foundations have been laid. Members of this team will accepted as interns. For the first time this year, the RIT interns show a commitment to advancing awareness of the Center in were given the opportunity to interact with a group of high their communities. Different levels of involvement will exist to school students participating in a similar intern program at Social Events allow for flexibility of participation. Materials and orientation will the University of Rochester. The UR interns, who worked on be provided to Street Team members to prepare them to go research in the area of bioengineering, visited the labs used CIS hosted an alumni gathering event for Washington, DC out and promote Imaging Science in their communities. Gifts by their imaging science counterparts, hosted a tour of their and Virginia alumni in June, 2008, with nearly 30 alumni in and incentives will be awarded to those who volunteer. While UR labs for the RIT interns, and worked together with the RIT attendance. official sign up information will be a part of the Alumni Involve- interns on peer reviews of each group's final presentations. In the next year, CIS expects to host an alumni gathering in ment Survey, participation may be arranged in advance by The following table lists the names of the 2008 RIT imaging each of our 5 largest alumni concentration areas: Rochester, contacting Bethany Choate at [email protected]. science summer interns, as well as their high school and the NY; Washington, DC; Los Angeles/San Francisco, California; research group they worked with. Philadelphia, PA; and Boston, MA. California visits will most likely alternate annually between Los Angeles and . To ensure that you are included in CIS mailings, please Summer Courses San Francisco. update your contact info with us. Our internal database is separate from RIT, RIT Admissions, and RIT Alumni Relations; In the summer of 2009, CIS offered a 7-week, 4 credit con- Additional events will be held in Rochester to correspond with so be sure to update your information with them separately, densed course based on the first-year course Imaging in the major events, such as RIT’s Brick City Homecoming as well if you wish to do so. Your personal information will not be Physical Sciences. This course was offered to high school as the Imagine RIT festival in the spring. shared without your consent. Please complete and mail the students across the area and included several students also enclosed contact form, or complete this information online at involved in the Intern Program. Five students successfully http://somewebsite.com. completed the course.

77 Ph.D. graduates Mahdi Nezamabadi and Mahnaz Mohammadi

78 Alumni

Imaging Science is a family affair excellent researchers, each with their own approach.” for Ph.D. graduates Mahnaz completed her Ph.D. in Feb 2009, and Mahdi in May 2008. They now live in Moorestown, N.J., about Mahdi Nezamabadi and Mahnaz Mohammadi were studying halfway between their jobs. Mahdi and Mahnaz were hired textile chemistry in Iran when they became interested in color by Dolby and DuPont in 2007 when they were still work- science. ing on their theses. Mahnaz works for DuPont in the color research area, where she focuses on accuracy of color That led them to RIT’s Chester F. Carlson Center for Imaging matching for Automotive Refinish Paints. Mahdi works in the Science. image technology research division at the company’s facility “We found RIT on the Internet,” says Mahdi. His wife, in Pennsylvania. Dolby, well known for commercial audio, Mahnaz, was first to apply and be accepted into the imaging particularly movie sound, has a growing involvement in imag- science Ph.D. program. They intended to move to Roches- ing technology. ter in fall 2001. But it was difficult to get visas. Their son, now 12, is in seventh grade. He’s a good student They finally received the necessary documents and Mahdi, who enjoys school. Mahnaz and their 4-year-old son Navid arrived in the U.S. on Conversations around the dinner table often revolve around January of 2002. As that was in the middle of RIT’s winter science. But it’s a bit different from when Mahdi and Mahnaz quarter, they stayed with her sister in Albany, N.Y., and were students at RIT. “Most of the things that both of us are moved to Rochester in time for spring quarter. working on are confidential,” says Mahdi. “But, sometimes When Mahnaz went to her first meeting with her Ph.D. it’s helpful to get an opinion from another Ph.D.” adviser, Roy Berns, Mahdi came along. By the end of the The need to study did not end when they left the Center for conversation, it was clear that Mahdi was interested in the Imaging Science. program as well. “Because of our positions, we continue to study to keep up “Fortunately, I could accept them both,” says Berns, the to date,” says Mahdi. But working in industry is different than Richard S. Hunter Professor, Munsell Color Science Labora- the university. Now, the focus of research is development of tory. “It ended up being a good call. They did very, very well.” commercially viable outcomes. “We had a very good experience at RIT,” says Mahdi. “Ev- But their RIT education is serving them well, Mahdi believes. eryone was very supportive.” Their son attended day care on campus. CIS associates helped with rides until they got “I think that the Ph.D. program at RIT prepares you to do drivers licenses. They made friends. And “Roy Berns helped research independently.” us very much.” Still, “The first year was a little bit hard,” says Mahdi. For one thing, their background was in math and chemistry, while most imaging science graduate students come out of electri- cal engineering and physics. Berns says they brought some new perspective because of their academic background and also as the first Ph.D. stu- dents from Iran. “They knew very little about imaging when they came,” says Berns, “but they knew color. They were

79 university  NEWS ❯❯ “RIT had the right mix of theory, concepts and broad subjects Loce frequently works with the company’s intellectual property | as well as specific applications for me,” he says. He was able experts. In 2002, he passed the U.S. patent bar exam, mak- to immediately apply his academic work to projects at Xerox, ing him a registered patent agent. Release Date: Jan. 19, 2009 including his Ph.D. thesis research. The thesis ultimately When he’s not pursuing scientific discovery, Loce likes to take became a book, Enhancement and Restoration of Digital Contact: Kathy Lindsley on outdoor challenges. He has climed some of the high- Documents: Statistical Design of Nonlinear Algorithms (SPIE (585) 475-7616 or [email protected] est mountains in . For instance, to celebrate Press, 1997). completion of his Ph.D. in 1993, he climbed Popocatepetl, RIT’s first Ph.D. recipient follows trail to invention By the time Loce was working on the Ph.D., it had become a an 18,000-foot volcano in Mexico. In the past few years, he In 1993, Bob Loce received the first doctoral degree awarded bit easier to juggle work, school and family life: Xerox allowed has been spending a great deal of his vacation time hiking by RIT, thereby becoming the first person in the world to earn him two days a week to devote to the doctoral program. The and camping in the Adirondacks with his sons, ages 10 and a Ph.D. in imaging science. investment paid off well for the company. 13. He recently spent a week of very challenging backcountry hiking in the Wrangell Mountains in Alaska. By then, he already held more than 15 patents. “Among Bob’s many contributions are inventions that provided a foundation for Xerox’s transition from light lens technology to As a kid, he rode horses on the site of today’s RIT campus— Today, the Xerox principal scientist has more than 100 U.S. products based on laser imaging, inventions that made high- land that was then owned by his grandparents, Dominic and patents to his credit, reaching that milestone before reach- light color printing possible, and more recently, inventions cov- Francis Bianchi. ing his 50th birthday last year. He hasn’t stopped inventing: ering image processing technology used in the iGen3 Digital Another 40 potential patents are in the pipeline. “When I was growing up, I wanted to be a farmer or scientist,” Production Press and the Xerox Nuvera digital printers,” says he recalls. “I was of the generation that was inspired by the Loce talks about his work as if nothing could be more fun Sophie Vandebroek, chief technology officer and president of Apollo .” that developing a “Method of Selective Edge Softening and the Xerox Innovation Group. “In addition to his own inventions, Rendering for the Suppression of Halo,” the subject of his he has mentored many other researchers, helping to sustain He has enjoyed his career choice and believes that Rochester 100th patent. our culture of innovation in the Xerox labs.” is an ideal place for a technologist or scientist. “At Xerox, you’re encouraged to invent,” he says. “If you More recently, Loce has been working on development of “Rochester really is a center of invention. Forbes magazine write proposals that seem promising, you get to work on image processing methods for color electronic printing. He ranked Rochester first in innovation with the highest number of your own ideas.” has publications and many patents in the areas of halftoning, patents issued per worker. Invention is part of the Rochester identity and we need to let the world know about it. We inven- Loce has been particularly productive. Fewer than 20 Xerox digital image rendering, optics, imaging systems, and digital tors and city leaders shouldn’t rest until we hear Silicon Valley scientists have as many patents, and of those, “I’m on the image enhancement. say they are the Rochester of California.” young end,” he says. A few years ago, Loce and associates developed a multi- “If you’re going to invent, you have to be comfortable pre- plexed imaging process he has publicized as “switch-a-view.” senting your ideas. You have to be open to criticism. I think The process allows multiple color images to be printed on top that’s an advantage I had,” he says. “I was never afraid to of each other. Different images show up when viewed under get criticized.” different colors of light. Loce grew up in Rochester and joined Xerox as a lab techni- “This was one of the more fun things we’ve done,” he says. cian in 1981 after receiving an associate’s degree in optical But its unlikely that it will become part of a Xerox product, he engineering technology from Monroe Community College. says. At some point, Xerox could license the technology to another company. That potential source of revenue makes it “It was a great job,” he says. “I was working with Xerox scien- worthwhile to pursue almost any good idea. tists, Corning scientists. It was wonderful.” Even ideas that fail are valuable. “You don’t expand the While working full-time at Xerox, he earned his B.S. in 1985 boundaries of your technology by always working on a sure in Photographic Science from RIT’s College of Continuing thing. You have to advocate for ideas that are risky but could Education. Meanwhile, he was already writing patent propos- have a significant pay off, and you have to be comfortable als, and his first patent was issued in 1987. Loce completed with a few failures. Unless you are failing 10 to 20 percent of an M.S. degree in Optical Engineering from the University of the time, you are probably being too conservative in generat- Rochester, then returned to RIT for the Ph.D. program—RIT’s ing ideas and inventing new technologies,” Loce says. first—all while on the job at Xerox.

80 81 You can support the Center's academic, research, and outreach missions by making a contribution through the RIT web site. Just visit www.rit.edu/giving, and click on the "Ways To Give" button. Be sure to specify in the "comments" box exactly how you want your gift to be used. For example, "apply my gift to the imaging science high school intern program." Your generous donation will help ensure that the Center maintains its well-deserved reputation as the world leader in imaging education and research.

82 83 Chester F. Carlson Center for Imaging Science Rochester Institute of Technology 54 Lomb Memorial Drive Rochester New York 14623 Chester F. Carlson Center for Imaging Science 2009 Annual Report (585) 475-5944

http://www.cis.rit.edu/