Visualizing Optimization Trajectories

Total Page:16

File Type:pdf, Size:1020Kb

Visualizing Optimization Trajectories Visualization Research Center University of Stuttgart Allmandring 19 D–70569 Stuttgart Masterarbeit Visualizing Optimization Trajectories David Hägele Course of Study: Informatik Examiner: Prof. Dr. Daniel Weiskopf Supervisor: Dr. Antoine Lhuillier, M.Sc. Moataz Abdelaal, M.Sc. Rafael Garcia Commenced: May 27, 2019 Completed: November 27, 2019 Abstract Nonlinear constraint optimization has many applications in technical, scientific as well as economic fields. Understanding solver behavior can help to improve solvers, choose appropriate hyperparameters, and formulate better performing nonlinear programs. This thesis proposes a visual analytics tool for analyzing constraint optimization problems. The optimization process is depicted by a set of two-dimensional trajectories, representing the trace of intermediate solutions during the optimization process. This allows us to obtain an overview of the evolution of the optimization process. To support detailed analysis, sup- plemental views are added to show the constraints violations and areas of feasible solution. Furthermore, different interaction techniques are implemented to facilitate the exploration process. To showcase the usefulness of the approach, findings from an exemplary analysis based on optimization logs of robot motion planning are presented. Kurzfassung Nichtlineare Optimierung unter Nebenbedingungen hat vielerlei Anwendungen in technis- chen, wissenschaftlichen und auch ökonomischen Bereichen. Das Verstehen von Löserver- halten kann dabei helfen Löser zu verbessern, angemessene Hyperparameter zu wählen, und performantere nichtlineare Programme zu formulieren. Diese Masterarbeit schlägt ein Visual Analytics Werkzeug zur Analyse von Opti- mierungsproblemen vor. Der Optimierungsvorgang wird durch eine Menge von zwei- dimensionalen Trajektorien dargestellt, die den Verlauf der zwischenzeitigen Lösungen während des Prozesses repräsentieren. Das erlaubt es uns einen Überblick über die zeitliche Entwicklung des Optimierungsvorgangs zu gewinnen. Um eine detaillierte Analyse zu ermöglichen, werden ergänzende Ansichten zur Darstellung der Nebenbedingungsverlet- zungen und Bereiche zulässiger Lösungen hinzugefügt. Außerdem werden verschiedene Interaktionstechniken implementiert, um die Exploration zu erleichtern. Um die Nüt- zlichkeit des Ansatzes zu zeigen, werden die Ergebnisse aus einer beispielhaften Analyse eines Optimierungslogs zur Bewegungsplanung eines Roboters präsentiert. 3 Contents 1 Introduction 11 1.1 Motivation..................................... 11 1.2 Goals........................................ 12 1.3 Outline...................................... 13 2 Related Work 15 2.1 Optimization Visualization............................ 15 2.2 Visualization of Evolution............................ 17 3 Constraint Optimization 21 3.1 Optimization Problem.............................. 21 3.2 Nonlinear Programming............................. 22 4 Visualizing Optimization Trajectories 27 4.1 Visual Representation.............................. 27 4.2 Robot Path Trajectories.............................. 27 4.3 Dimensionality Reduction............................ 29 4.4 Constraints Visualization............................. 32 4.5 Explore Through Interaction........................... 34 5 Implementation 39 5.1 Architecture.................................... 39 5.2 Dataset Description................................ 40 5.3 Dimensionality Reduction Considerations................... 42 5.4 Used Technologies................................ 42 6 Evaluation 45 6.1 Visualization Tool Overview........................... 45 6.2 Use Case Scenarios................................ 47 7 Conclusion 55 7.1 Summary..................................... 55 7.2 Results....................................... 55 7.3 Future Work.................................... 56 Bibliography 59 5 List of Figures 3.1 Nonlinear program examples.......................... 22 4.1 Optimization Trajectory............................. 28 4.2 Per Configuration Trajectories.......................... 29 4.3 Dedicated Time Axis & Linesearch Highlighting................ 31 4.4 Dimensionality Changing Trajectories...................... 31 4.5 Per Configuration Trajectory Violations..................... 32 4.6 Constraint-Violations-View............................ 33 4.7 Constraint Curve Plots.............................. 33 4.8 Zooming in on a view.............................. 34 4.9 Supplementary GUI for Filtering......................... 35 4.10 Selected Per Configuration Trajectory...................... 36 4.11 Selected Per Configuration Trajectory...................... 37 4.12 Constraint-Violations of Selected Groups.................... 38 5.1 MVC Pattern.................................... 39 6.1 Visualization Tool Overview........................... 45 6.2 Video Sequence of Robot Movement...................... 47 6.3 Analysis of Robot Path Sections......................... 48 6.4 Analysis of Robot Path Velocities......................... 49 6.5 Analysis of Initial and Final Path........................ 49 6.6 Analysis of Path Evolution............................ 50 6.7 Analysis of Constraint Evolution......................... 51 6.8 Analysis of Constraint Violations on Trajectories................ 52 6.9 Analysis of Constraint Violations........................ 53 7 List of Listings 3.1 Pseudo code implementation of the augmented Lagrangian method..... 24 3.2 Pseudo code implementation of Newton’s method............... 25 5.1 Example KOMO log file content......................... 44 9 1 Introduction 1.1 Motivation Mathematical optimization plays an important role in today’s world where complex systems emerge in many different technical, economical and scientific fields. The subdiscipline constrained optimization also known as linear-/nonlinear programming, that deals with problems of finding optima within a constrained set of possibilities, is particularly challeng- ing. It has many applications such as utility maximization and expenditure minimization in microeconomics, route planning for drones [ZD15] or motion planning for autonomously moving robots [Tou15], solving inverse imaging problems such as tomographic reconstruc- tion [ABF11] or optimizing signal transmitting systems for minimal transmission power [YL07]. Constrained optimization bears many challenges starting with the formulation of the optimization problem that includes the objective function, as well as equality and inequality constraint functions. Functions can be linear or nonlinear, differentiable or discrete, and the optimization problem is classified accordingly, which leads to different possibilities for solving. Nonlinear programs (NLP) can be especially hard to solve due to possible local optima, disconnected feasible regions and hard to determine feasible starting points [Chi06]. Moreover, quite some effort has been put into determining whether an NLP is feasible at all, as it is not trivial [AA95; NTY99]. Apart from these general difficulties in constrained optimization, the choice of algorithm for solving may change the result, due to its individual behavior. Choosing an appropriate algorithm depends on the problem and whether it fulfills certain requirements the algorithm imposes. For iterative solvers different initializations can yield different results, or may even fail to produce a feasible solution in one case but not the other. Last but not least, the choice of parameters to tune an individual implementation of an algorithm can have a major effect on the optimization’s outcome. Exemplary optimization problems from text books may be easy to understand and are great for building intuition on the subject, but real world problems quickly become very complex for several reasons, such as a large number of constraints, which creates a large number of complicated regions. High dimensional problems are quite common and harder to grasp, especially when constraints depend on several of the dimensions. Also, nonlinear objectives or constraints make it difficult to envision a problem geometrically. Time dependent systems allow for further complication when introducing constraints that have to be met only at specific times or are subject to sets of subsequent time steps. 11 1 Introduction Ultimately a solver may generate an unsatisfactory solution or generate solutions under intolerable circumstances. For example an infeasible solution or a solution that is only locally optimal is generated. Maybe the algorithm takes too long to converge or does not converge at all, or the algorithm only succeeds for specific initializations. Diagnosis of the causes for such behavior is hard due to the sheer amount of variables that come into play during an optimization and due to the complexity of the optimization problem itself. Due to the fuzziness of such diagnostic tasks and the impossibility to algorithmically tackle them, it seems reasonable to leverage visualization in order to get a better understanding of the optimization problem and the corresponding algorithm behavior. The knowledge of a domain expert paired with a visual analytics tool has been proven to work well in these kind of scenarios in the past and should be able to bring light into the dark. 1.2 Goals Since constraint optimization solvers often employ iterative methods to refine their solution and work their way to the optimum step by step, there is an inherent notion of trajectories that an optimization algorithm leaves behind. These trajectories promise to be insightful with
Recommended publications
  • Saints of Hysteria a Half-Century of Collaborative American Poetry Edited by Denise Duhamel, Maureen Seaton & David Trinidad
    Saints of Hysteria A Half-Century of Collaborative American Poetry Edited by Denise Duhamel, Maureen Seaton & David Trinidad Saints of Hysteria A Half-Century of Collaborative American Poetry Edited by Denise Duhamel, Maureen Seaton & David Trinidad Soft Skull Press Brooklyn, NY 2007 Contents Denise Duhamel, Maureen Seaton & David Trinidad i Introduction Charles Henri Ford et al. International Chainpoem 1 Neal Cassady, Allen Ginsberg & Jack Kerouac Pull My Daisy 3 Copyright © 2007 by Denise Duhamel, Maureen Seaton & David Trinidad Jack Kerouac & Lew Welch Masterpiece 5 Cover art: Good’n Fruity Madonna © 1968 Joe Brainard John Ashbery & Kenneth Koch Used by permission of the Estate of Joe Brainard. A Postcard to Popeye 7 Crone Rhapsody 9 Credits & acknowledgments for the poems begin on page 389. Jane Freilicher & Kenneth Koch The Car 12 Soft Skull project editor & book designer: Shanna Compton Bill Berkson & Frank O’Hara St. Bridget’s Neighborhood 13 A note on the text: Because the poems in this anthology were created over seven decades Song Heard Around St. Bridget’s 16 by more than 200 authors, certain idiosyncrasies of style, orthography, and form St. Bridget’s Efficacy 17 have been preserved in order to present the works as their authors intended. These Reverdy 19 variations are characteristic textural effects of the collaborative process Bill Berkson, Michael Brownstein & Ron Padgett and should not be interpreted as errors. Waves of Particles 21 Ron Padgett & James Schuyler Soft Skull Press Within the Dome 22 55 Washington Street
    [Show full text]
  • The California Virtual School Report Table of Contents
    7KH&DOLIRUQLD 9LUWXDO6FKRRO5HSRUW A National Survey of Virtual Education Practice and Policy with Recommendations for the State of California &RPPLVVLRQHGE\ 8QLYHUVLW\RI&DOLIRUQLD&ROOHJH3UHSDUDWRU\,QLWLDWLYH Authors: Gordon Freedman, Knowledge Base, LLC Rob Darrow, Clovis Unified School District John Watson, contracted by Knowledge Base, LLC Editor: George Lorenzo, Educational Pathways Additional writing contracted by Knowledge Base, LLC: Fred Benz, Shery Hsi, Paul Linhardt, George Lorenzo, Frank Tansey 8QLYHUVLW\RI&DOLIRUQLD&ROOHJH3UHSDUDWRU\,QLWLDWLYH ZZZXFFSRUJ .QRZOHGJH%DVH//& ZZZNQRZOHGJHEDVHFRP &ORYLV8QLILHG6FKRRO'LVWULFW ZZZFORYLVXVGNFDXV Table of Contents About This Report .......................................................................................................................................... 5 Section I Executive Summary Executive Summary ......................................................................................................................................... 5 Section II Body of Report 1.0 Preface .............................................................................................................................................. 7 2.0 Introduction...................................................................................................................................... 9 2.1 Initial findings.................................................................................................................................. 10 2.2 A need for common goals and a common agenda ..........................................................................
    [Show full text]
  • Emotional Intelligence Methods Utilized by Successful Major League Baseball Closers to Perform Successfully in High Pressure Situations
    Brandman University Brandman Digital Repository Dissertations Spring 4-21-2020 Emotional Intelligence Methods Utilized by Successful Major League Baseball Closers to Perform Successfully in High Pressure Situations Joshua Rosenthal Brandman University, [email protected] Follow this and additional works at: https://digitalcommons.brandman.edu/edd_dissertations Part of the Cognitive Psychology Commons, Educational Psychology Commons, Health Psychology Commons, Other Psychology Commons, Sports Sciences Commons, and the Sports Studies Commons Recommended Citation Rosenthal, Joshua, "Emotional Intelligence Methods Utilized by Successful Major League Baseball Closers to Perform Successfully in High Pressure Situations" (2020). Dissertations. 328. https://digitalcommons.brandman.edu/edd_dissertations/328 This Dissertation is brought to you for free and open access by Brandman Digital Repository. It has been accepted for inclusion in Dissertations by an authorized administrator of Brandman Digital Repository. For more information, please contact [email protected]. Emotional Intelligence Methods Utilized by Successful Major League Baseball Closers to Perform Successfully in High Pressure Situations A Dissertation by Joshua Rosenthal Brandman University Irvine, California School of Education Submitted in partial fulfillment of the requirements for the degree of Doctor of Education in Organizational Leadership April 2020 Committee in charge: Philip O. Pendley, Ed.D. Committee Chair Jonathan L. Greenberg, Ed.D. Walt Buster, Ed.D. Emotional Intelligence Methods Utilized by Successful Major League Baseball Closers to Perform Successfully in High Pressure Situations Copyright © 2020 by Joshua Rosenthal iii ACKNOWLEDGEMENTS I consider myself a passionate educator and sports fanatic. I was fortunate to meet the right people who were able to help me marry these passions into a career where I am able to educate student athletes both amateurs and professionals.
    [Show full text]
  • Gender-Specific Manifestations of Hysteria, Chlorosis, & Consumption
    Marquette University e-Publications@Marquette Dissertations (2009 -) Dissertations, Theses, and Professional Projects Insane in the Brain, Blood, and Lungs: Gender- Specific aM nifestations of Hysteria, Chlorosis, & Consumption in 19th-Century Literature Anna P. Scanlon Marquette University Recommended Citation Scanlon, Anna P., "Insane in the Brain, Blood, and Lungs: Gender-Specific aM nifestations of Hysteria, Chlorosis, & Consumption in 19th-Century Literature" (2019). Dissertations (2009 -). 884. https://epublications.marquette.edu/dissertations_mu/884 INSANE IN THE BRAIN, BLOOD, AND LUNGS: GENDER-SPECIFIC MANIFESTATIONS OF HYSTERIA, CHLOROSIS, & CONSUMPTION IN 19TH-CENTURY LITERATURE By Anna Scanlon A Dissertation submitted to the Faculty of the Graduate School, Marquette University, in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy Milwaukee, Wisconsin June 2019 ABSTRACT INSANE IN THE BRAIN, BLOOD, AND LUNGS: GENDER-SPECIFIC MANIFESTATIONS OF HYSTERIA, CHLOROSIS, & CONSUMPTION IN 19TH-CENTURY LITERATURE ANNA SCANLON MARQUETTE UNIVERSITY, 2019 This dissertation examines literary and medical texts from throughout the nineteenth and early twentieth centuries to better understand prevailing attitudes about gender and disease. The project traces the progression of three diseases – consumption, chlorosis, and hysteria – throughout the long nineteenth century, paying particular attention to the stereotypes and prevailing medical notions of each illness. In general, this work examines the influence of lovesickness, female-patient/male-doctor dynamics, and pathology on the endemic or epidemic nature of each disease. In particular, the first three chapters of this project study tuberculosis – or consumption as it was called in the nineteenth century – and the ways in which society presumed this illness manifested either through the female’s beauty or spirituality.
    [Show full text]
  • The New Yorker 11/9/20, 9:20 PM
    Utopian for Beginners | The New Yorker 11/9/20, 9:20 PM Annals of Linguistics December 24 & 31, 2012 Issue Utopian for Beginners An amateur linguist loses control of the language he invented. By Joshua Foer December 17, 2012 here are so many ways for speakers of English to see the world. We can glimpse, glance, visualize, view, look, spy, or T ogle. Stare, gawk, or gape. Peek, watch, or scrutinize. Each word suggests some subtly different quality: looking implies volition; spying suggests furtiveness; gawking carries an element of social judgment and a sense of surprise. When we try to describe an act of vision, we consider a constellation of available meanings. But if thoughts and words exist on different planes, then expression must always be an act of compromise. Languages are something of a mess. They evolve over centuries through an unplanned, democratic process that leaves them teeming with irregularities, quirks, and words like “knight.” No one who set out to design a form of communication would ever end up with anything like English, Mandarin, or any of the more than six thousand languages spoken today. “Natural languages are adequate, but that doesn’t mean they’re optimal,” John Quijada, a "fty-three-year-old former employee of the California State Department of Motor Vehicles, told me. In 2004, he published a monograph on the Internet that was titled “Ithkuil: A Philosophical Design for a Hypothetical Language.” Written like a linguistics textbook, the fourteen-page Web site ran to almost a hundred and sixty thousand words. It documented the Quijada’s invented language has two grammar, syntax, and lexicon of a language that Quijada had spent seemingly incompatible ambitions: to be three decades inventing in his spare time.
    [Show full text]
  • Video-As-Data and Digital Video Manipulation Techniques for Transforming Learning Sciences Research, Education, and Other Cultural Practices Roy D
    Video-as-Data and Digital Video Manipulation Techniques for Transforming Learning Sciences Research, Education, and Other Cultural Practices Roy D. Pea To cite this version: Roy D. Pea. Video-as-Data and Digital Video Manipulation Techniques for Transforming Learn- ing Sciences Research, Education, and Other Cultural Practices. J. Weiss et al. The International Handbook of Virtual Learning Environments, Springer, pp.1321-1393, 2006. hal-00190627 HAL Id: hal-00190627 https://telearn.archives-ouvertes.fr/hal-00190627 Submitted on 23 Nov 2007 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Chapter 55: Video-as-Data and Digital Video Manipulation Techniques for Transforming Learning Sciences Research, Education, and Other Cultural Practices∗ ROYD.PEA Stanford University, Stanford Center for Innovations in Learning 1. INTRODUCTION This chapter concerns the theoretical and empirical foundations and current progress of the Digital Interactive Video Exploration and Reflection (DIVER) Project at Stanford University. The DIVER Project aspires to accelerate cul- tural appropriation of video as a fluid expressive medium for generating, shar- ing, and critiquing different perspectives on the same richly recorded events and to work with others to establish a Digital Video Collaboratory (DVC) that enables cumulative knowledge building from video-as-data for discovery and commentary.
    [Show full text]
  • 2016 Annual Town Report
    TTOOWWNN OOFF SSHHEEFFFFIIEELLDD 2016 ANNUAL REPORT Municipal Profile Area in Square Miles . 48.54 Elevation . 648’ to 2,050’ Elevation at Town Hall . 675’ above sea level Population: Federal Census - all residents . 3,335 2016 Annual Town Census - all residents . 3,330 Registered Voters, December 31, 2016 . 2,366 Miles of States Highway . 17.75 Miles of Town & Country Roads . 84 Open Space Acreage: Federal Land . 1,036.08 State Land . 1,800.67 Town Land . 283.84 Private Land Conservancy Organization . 2,083.94 Legislators: US Senator . Elizabeth Warren US Senator . Edward Markey US Congressman . Richard Neal State Senator . Adam Hinds State Representative . William “Smitty” Pignatelli Community Profile Statement: The Town of Sheffield is located in the Housatonic River Valley at the southern end of Berkshire County. With two distinct villages, Sheffield and Ashley Falls, the Town’s development pattern has been greatly influenced by its physical features: the Housatonic River and its wide floodplain; the Schenob Brook wetland com - plex; and the steep slopes of the Berkshire Hills on the east and the Taconic Range on the west. The oldest town in Berkshire County, the community has maintained its rich historical character. Noted for its deep agricultural soils, much of Sheffield remains open and in agricultural production. The combination of wide-open river valley, mountain vistas and active farmland, residents feel makes Sheffield one of the most beautiful towns in the Commonwealth. Front Cover: Brian Ovitt, 52 Year Fire Department Member Photograph by Fred Harwood ANNUAL REPORT OF THE TOWN OF SHEFFIELD MASSACHUSETTS For the Year Ending December 31, 2016 Table of Contents Agricultural Commission .
    [Show full text]
  • I Diaspora Media: a Rhizomatic Study of Identity, Resistance and Citizenship a Dissertation Presented to the Faculty of the Scri
    Diaspora Media: A Rhizomatic Study of Identity, Resistance and Citizenship A dissertation presented to the faculty of the Scripps College of Communication of Ohio University In partial fulfillment of the requirements for the degree Doctor of Philosophy Luis S. Pascasio April 2021 © 2021 Luis S. Pascasio. All Rights Reserved. i This dissertation titled Diaspora Media: A Rhizomatic Study of Identity, Resistance and Citizenship by LUIS S. PASCASIO has been approved for the School of Media Arts and Studies and the Scripps College of Communication by Wolfgang Suetzl Assistant Professor of Media Arts & Studies Scott Titsworth Dean, Scripps College of Communication ii Abstract PASCASIO, LUIS S. , PhD, April 2021, Mass Communication Diaspora Media: A Rhizomatic Study of Identity, Resistance and Citizenship Director of Dissertation: Wolfgang Suetzl This dissertation is an ethnographic study of the communication and media practices of Filipino Americans in Chicago. It investigates how their everyday encounters with diaspora media produce patterns of consumption and interpretation that locates identity, resistance and citizenship as discourses performed with and in media. Through interviews, participant observation and storytelling, the study argues that Filipino Americans’ active engagement with karaoke, the Filipino Channel, a transnational media platform and community newspapers activates becoming more Filipino in the diaspora, long distance activism and a performance of diasporic citizenship informed by cosmopolitanism. These media performances are not mere happenstances but are conscious acts informed by a logic of diasporic performativity that locates active engagement with media as an expression of human agency. iii Dedication To my loving parents, Anselmo and Natividad, for all the sacrifice, wisdom and stories that nourished me as a child and as a student of life iv Acknowledgments I would like to express my heartfelt gratitude to Dr.
    [Show full text]
  • The True Meaning of Green Day's Song: Holiday in the Social, Political and Economic Context a Sarjana Pendidikan Final Paper P
    PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI THE TRUE MEANING OF GREEN DAY’S SONG: HOLIDAY IN THE SOCIAL, POLITICAL AND ECONOMIC CONTEXT A SARJANA PENDIDIKAN FINAL PAPER Presented as Partial Fulfillment of the Requirements to Obtain the Sarjana Pendidikan Degree in English Language Education By Bondan Jiwandana Student Number: 101214146 ENGLISH LANGUAGE EDUCATION STUDY PROGRAM DEPARTMENT OF LANGUAGE AND ARTS EDUCATION FACULTY OF TEACHERS TRAINING AND EDUCATION SANATA DHARMA UNIVERSITY YOGYAKARTA 2017 i PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI A Sarjana Pendidikan Final Paper on THE TRUE MEANING OF GREEN DAY’S SONG: HOLIDAY IN THE SOCIAL, POLITICAL AND ECONOMIC CONTEXT By BONDAN JIWANDANA Student Number: 101214146 Approved by Advisor Dr. Antonius Herujiyanto, M.A June 14th, 2017 ii PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI A Sarjana Pendidikan Final Paper on THE TRUE MEANING OF GREEN DAY’S SONG: HOLIDAY IN THE SOCIAL, POLITICAL AND ECONOMIC CONTEXT By BONDAN JIWANDANA Student Number: 101214146 Defended before the Board of Examiners on July 10th, 2017 and Declared Acceptable Board of Examiners Chairperson : Yohana Veniranda, M.Hum., M.A., Ph.D. ______________ Secretary : Christina Lhaksmita Anandari, Ed.M. ______________ Member : Dr. Antonius Herujiyanto, M.A. ______________ Member : Paulus Kuswandono, Ph.D. ______________ Member : Truly Almendo Pasaribu, S.S., M.A. ______________ Yogyakarta, July 10th, 2017 Faculty of Teachers Training and Education Sanata Dharma University Dean Rohandi, Ph.D. iii PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI STATEMENT OF WORK’S ORIGINALITY I honestly declare that this paper, which I have written, does not contain the work or parts of the work of other people, except those cited in the quotations and the references, as a scientific paper should.
    [Show full text]
  • DECREES SONGS and SERVICES
    DECREES SONGS and SERVICES TO DOWNLOAD FREE E-BOOKS: www.iamfree.co.za Email [email protected] DECREES, SONGS AND SERVICES [2] CONTENTS ESSENTIAL MORNING AND EVENING APPLICATIONS ................................................... 8 SUGGESTED MORNING MEDITATION AND DECREES .................................................... 8 MEDITATION – CONTEMPLATION ............................................................................ 8 MORNING DECREES .................................................................................................. 8 DECREE FOR PROTECTION ........................................................................................ 9 DECREE FOR THE CIRCLE AND SWORD OF BLUE FLAME .......................................... 9 VIOLET FIRE DECREE ............................................................................................... 10 “I AM” STATEMENTS .............................................................................................. 11 SUGGESTED EVENING MEDITATION AND DECREES .................................................... 12 ASCENDED MASTERS’ DIVINE LOVE ....................................................................... 12 DECREE FOR THE PILLAR OF LIGHT AND PROTECTION ........................................... 12 EVENING DECREES FOR THE VIOLET FIRE ............................................................... 12 PERSONAL DECREE TO BE SAID EVERY NIGHT ........................................................ 14 DECREE FOR SERVICE RENDERED WHEN ASLEEP ..................................................
    [Show full text]
  • Sing out Loud: Using Music in the Classroom Traditional Songs
    Sing Out Loud: Using Music in the Classroom Traditional Songs & American Rhythms Published by the Office of English Language Programs Bureau of Cultural and Educational Affairs United States Department of State Washington, DC 20037 americanenglish.state.gov / englishprograms.state.gov First Edition 2012 americanenglish.state.gov Sing out Loud American Themes CD Produced by John Hart, Hawai’i Pacific University Mastered by Daniel Ho CD design by Kim Okamura, Illustrations by Jay Ryan Special thanks to Carlos Juarez of Hawai’i Pacific University and all of the wonderful musicians involved. Photo Credits: All photos © Shutterstock, Inc. unless otherwise noted. Page 97, Postage stamp of musical The Wizard of Oz and Judy Garland, circa 1990. © Krylova Ksenia / Shutterstock.com Page 119, A stamp printed in the USA shows Helen Keller & Anne Sullivan, circa 1980. © tristan tan / Shutterstock.com Page 119, A stamp printed in the USA showing Thomas Alva Edison, circa 1930s. © EtiAmmos / Shutterstock.com Page 119, A stamp printed in the USA shows Martin Luther King Jr. and civil rights marchers, Black Heritage, circa 1979. © Neftali / Shutterstock.com Page 120, A stamp published in the USA shows the brothers Orville and Wilbur Wright circa 1995. © Yuriy Boyko / Shutterstock.com Page 120, A stamp printed in the USA shows a portrait of Susan Brownell Anthony circa 1930. © MarkauMark / Shutterstock.com Page 159, Mardi Gras 2010 in New Orleans. © Dustie / Shutterstock.com Page 160, A jazz band plays in New Orleans, Louisiana after Hurricane Katrina just before the Jazz and Heritage Festival. © Ken Durden / Shutterstock.com Page 189, City streetlife at intersection of 5th Ave.
    [Show full text]
  • The Extent to Which American Children's Folk Songs Are Taught by General Music Teachers Throughout the United States
    THE EXTENT TO WHICH AMERICAN CHILDREN’S FOLK SONGS ARE TAUGHT BY GENERAL MUSIC TEACHERS THROUGHOUT THE UNITED STATES By MARILYN J. WARD A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY UNIVERSITY OF FLORIDA 2003 Copyright 2003 by Marilyn J. Ward ACKNOWLEDGMENTS I would like to thank God for His help in this endeavor. I believe that He was responsible for the good response rate and provided direction, assistance, and wisdom along the way. I would also like to thank my mother, Dr. Iva Maybelle Hollingshead, who funded and personally delivered, retrieved, and processed the information from the majority of elder study instruments. Not only did my mother physically and financially assist in this project, she has also been a constant source of inspiration and encouragement throughout my life. I owe a great debt of gratitude to both my mother and father, who are some of the most wonderful people I have ever known. Sincere appreciation is expressed to the members of my supervisory committee for their insight, wisdom, and wonderful suggestions for improvement through the many stages of this research study: Dr. Russell Robinson (chairman, music education); Dr. Charles Hoffer (music education); Dr. Budd Udell (theory/composition); and Dr. David Young (directing/theatre). Many thanks are extended to Brad Ward, my husband, who has ever so graciously funded this project, in its enormity. iii TABLE OF CONTENTS page ACKNOWLEDGMENTS ................................................................................................
    [Show full text]