Studies in Continuous Black-Box Optimization

Total Page:16

File Type:pdf, Size:1020Kb

Studies in Continuous Black-Box Optimization Technische Universität München Lehrstuhl VI: Echtzeitsysteme und Robotik Studies in Continuous Black-box Optimization Tom Schaul Vollständiger Abdruck der von der Fakultät für Informatik der Technischen Universität München zur Erlangung des akademischen Grades eines Doktors der Naturwissenschaften (Dr. rer. nat.) genehmigten Dissertation. Vorsitzender: Univ.-Prof. B. Brügge, Ph.D Prüfer der Dissertation: 1. Univ.-Prof. Dr. H.-J. Bungartz 2. Univ.-Prof. Dr. H. J. Schmidhuber Die Dissertation wurde am 06.06.2011 bei der Technischen Universität München eingereicht und durch die Fakultät für Informatik am 28.06.2011 angenommen. ii Abstract ptimization is the research field that studies that studies the design of O algorithms for finding the best solutions to problems we humans throw at them. While the whole domain is of important practical utility, the present thesis will focus on the subfield of continuous black-box optimization, presenting a collection of novel, state-of-the-art algorithms for solving problems in that class. First, we introduce a general-purpose algorithm called Natural Evolution Strategies (NES). In contrast to typical evolutionary algorithms which search in the vicinity of the fittest individuals in a population, evolution strategies aim at repeating the type of mutations that led to those individuals. We can characterize those mutations by a search distribution. The key idea of NES is to ascend the gradient on the parameters of that distribution towards higher expected fitness. We show how plain gradient ascent is destined to fail, and provide a viable alternative that instead descends along the natural gradient to adapt the search distribution, which appropriately normalizes the update step with respect to its uncertainty. Being derived from first principles, the NES approach can be extended to all types of search distributions that allow a parametric form, not just the classical multivariate Gaussian one. We derive a number of NES variants for different distributions, and show how they are useful on different problem classes. In addition, we rein in the computational cost, avoiding costly matrix inversions through an incremental change of coordinates. Two additional, novel techniques, importance mixing and adaptation sampling, allow us to automatically tune the learning rate and batch size to the problem, and thereby further reduce the average number of required fitness evaluations. A third technique, restart strategies, provides the algorithm with additional robustness in the presence of multiple local optima, or noise. Second, we introduce a new approach to costly black-box optimization, when fitness evaluations are very expensive. Here, we model the fitness function using state-of-the-art Gaussian process regression, and use the principle of artificial curiosity to direct exploration towards the most informative next evaluation candidate. Both the expected fitness improvement and the expected information gain can be derived explicitly from the Gaussian process model, and our method constructs a front of Pareto-optimal points according to these two criteria. This iii makes the exploration-exploitation trade-off explicit, and permits maximally informed candidate selection. We empirically validate our algorithms on a broad set of benchmarks. We also include a study of how continuous black-box optimization can solve chal- lenging neuro-evolution problems, where multi-dimensional recurrent neural net- works are trained to play the game of Go. At the same time, we establish to what degree those network architectures can transfer good playing behavior from small to large board sizes. In summary, this dissertation presents a collection of novel algorithms, for the general problem of continuous black-box optimization as well as a number of special cases, each validated empirically. iv Dedicated to Joé Schaul In memory of Adina Mosincat v vi Table of Contents Abstract ................................. iii Table of Contents ............................ vii List of Tables .............................. xi List of Figures .............................. xiii List of Algorithms ........................... xv Preface .................................. xvii 0.1 Thesis Outline ............................xvii 0.2 Related Publications .........................xviii 0.3 Notation ................................ xxi Acknowledgments ............................ xxiii 1 Introduction: Continuous Black-box Optimization ...... 1 1.1 Problem Definition .......................... 1 1.1.1 Continuous Optimization: Real-valued Solution Space .. 2 1.1.2 Black-box Optimization: Unknown Function ....... 2 1.1.3 Local Optimization: Find a Nearby Optimum ....... 3 1.1.4 Noisy Optimization: Functions Corrupted by Noise .... 3 1.1.5 Multi-objective Optimization ................ 4 1.2 Evaluating Optimization Algorithms ................ 5 1.3 State-of-the-Art Approaches ..................... 6 1.3.1 Evolutionary Methods .................... 6 1.3.2 Response Surface Methods ................. 7 1.4 Impact and Applications ....................... 8 1.5 Related Problem Domains ...................... 8 1.6 Open Questions ............................ 9 2 Natural Evolution Strategies ................... 11 2.1 The NES Family ........................... 11 2.1.1 Chapter Outline ....................... 12 2.2 Search Gradients ........................... 13 vii 2.2.1 Search Gradients for Gaussian Distributions ........ 14 2.2.2 Limitations of Plain Search Gradients ........... 15 2.3 Using the Natural Gradient ..................... 16 2.4 Performance and Robustness Techniques .............. 19 2.4.1 Fitness Shaping ........................ 20 2.4.2 Fitness Baselines ....................... 20 2.4.3 Importance Mixing ...................... 22 2.4.4 Adaptation Sampling ..................... 24 2.4.5 Restart Strategies ...................... 25 2.5 Techniques for Multinormal Distributions ............. 28 2.5.1 Using Exponential Parameterization ............ 28 2.5.2 Using Natural Coordinates ................. 29 2.5.3 Orthogonal Decomposition of Multinormal Parameter Space 31 2.5.4 Connection to CMA-ES ................... 32 2.5.5 Elitism ............................ 35 Use for Multi-objective NES ................. 37 2.6 Beyond Multinormal Distributions ................. 38 2.6.1 Separable NES ........................ 38 2.6.2 Rotationally-symmetric Distributions ........... 40 Sampling from Radial Distributions ............ 41 Computing the Fisher Information Matrix ......... 41 2.6.3 Heavy-tailed NES ...................... 42 Groups of Invariances .................... 43 Cauchy Distribution ..................... 44 2.7 Experiments .............................. 45 2.7.1 Experimental Setup and Hyperparameters ......... 46 2.7.2 Black-box Optimization Benchmarks ............ 47 2.7.3 Separable NES ........................ 48 Separable and Non-separable Benchmarks ......... 48 Neuro-evolution ........................ 53 Lennard-Jones Potentials .................. 54 2.7.4 Heavy Tails and Global Optimization ........... 56 2.7.5 Results Summary ....................... 57 2.8 Discussion ............................... 58 3 Curiosity-driven Optimization .................. 61 3.1 Artificial Curiosity .......................... 61 3.1.1 Background .......................... 62 3.1.2 Artificial Curiosity as a Guide for Optimization ...... 62 3.1.3 Formal Framework ...................... 63 3.2 Exploration/Exploitation Trade-off. ................. 63 3.3 Curiosity-driven Optimization (General Form) .......... 65 3.4 Models of Expected Fitness and Information Gain ........ 65 viii 3.4.1 A Good Model Choice: Gaussian Processes ........ 66 3.4.2 Derivation of Gaussian Process Information Gain ..... 66 3.5 Curiosity-driven Optimization with Gaussian Processes ...... 67 3.6 Minimal Asymptotic Requirements ................. 68 3.6.1 Reaching Optima at Arbitrary Distance .......... 68 3.6.2 Locating Optima with Arbitrary Precision ......... 69 3.6.3 Guaranteed to Find Global Optimum ........... 69 3.7 Proof-of-concept ........................... 70 3.8 Discussion ............................... 71 4 A Study in Scalability ....................... 73 4.1 Scalability in Problem Size ..................... 73 4.2 Example Domain: the Game of Go ................. 74 4.2.1 Rules of the Game ...................... 74 4.2.2 Challenges of Go ....................... 74 4.2.3 Simpler Variants of Go .................... 75 4.2.4 Computer Opponents .................... 76 4.3 Scalable Neural Architectures .................... 76 4.3.1 Multi-dimensional RNN ................... 77 4.3.2 Multi-dimensional LSTM .................. 78 4.3.3 A Custom Architecture for Go ............... 78 4.4 Experiments .............................. 79 4.4.1 Experimental Setup ..................... 79 4.4.2 Random-weight Networks .................. 80 4.4.3 Optimized Networks ..................... 82 4.4.4 Coevolved Networks ..................... 84 4.5 Discussion ............................... 90 5 Conclusions ............................. 91 5.1 Perspectives .............................. 92 5.2 Closing Words ............................ 93 A Appendix: Implementations in Python ............. 95 B Appendix: Weighted Mann-Whitney Test ........... 97 Bibliography ............................... 99 Index ................................... 109 ix x List of Tables 1 Notation and symbols used. ..................... xxi 2.1 Default parameters .......................... 46 2.2 Summary of enhancing techniques ................
Recommended publications
  • Memories for a Blessing Jewish Mourning Rituals and Commemorative Practices in Postwar Belarus and Ukraine, 1944-1991
    Memories for a Blessing Jewish Mourning Rituals and Commemorative Practices in Postwar Belarus and Ukraine, 1944-1991 by Sarah Garibov A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (History) in University of Michigan 2017 Doctoral Committee: Professor Ronald Suny, Co-Chair Professor Jeffrey Veidlinger, Co-Chair Emeritus Professor Todd Endelman Professor Zvi Gitelman Sarah Garibov [email protected] ORCID ID: 0000-0001-5417-6616 © Sarah Garibov 2017 DEDICATION To Grandma Grace (z”l), who took unbounded joy in the adventures and accomplishments of her grandchildren. ii ACKNOWLEDGMENTS First and foremost, I am forever indebted to my remarkable committee. The faculty labor involved in producing a single graduate is something I have never taken for granted, and I am extremely fortunate to have had a committee of outstanding academics and genuine mentshn. Jeffrey Veidlinger, thank you for arriving at Michigan at the perfect moment and for taking me on mid-degree. From the beginning, you have offered me a winning balance of autonomy and accountability. I appreciate your generous feedback on my drafts and your guidance on everything from fellowships to career development. Ronald Suny, thank you for always being a shining light of positivity and for contributing your profound insight at all the right moments. Todd Endelman, thank you for guiding me through modern Jewish history prelims with generosity and rigor. You were the first to embrace this dissertation project, and you have faithfully encouraged me throughout the writing process. Zvi Gitelman, where would I be without your wit and seykhl? Thank you for shepherding me through several tumultuous years and for remaining a steadfast mentor and ally.
    [Show full text]
  • European Jewish Digest: Looking at the Headlines Across Jewish Europe
    EUROPEAN JEWISH DIGEST: LOOKING AT THE HEADLINES ACROSS JEWISH EUROPE VOLUME 2, ISSUE 6: JUNE 2015 1 / ISSUES CONCERNING ANTISEMITISM Violence, Vandalism & Abuse Instances of antisemitic vandalism and abuse occurred again in Greece in June. The disputed Holocaust memorial in Kevala (as reported in the May digest) was finally dedicated after the mayor agreed that no changes to the memorial were needed and it would be kept in its original location. However in his speech at the dedication, Panagiotis Sgouridis, deputy minister of rural development, was accused of abusing the memory of the Holocaust when he said that atrocities continue today including “the continuation of the extermination of the Assyrians by the jihadists, the invasion and occupation in northern Cyprus, the Kurdish issue, the blockade of Gaza, the genocidal dismemberment of Yugoslavia.” He added that monuments like this one was needed “because unfortunately many times the roles switch and the victims become bullies.” The memorial itself was then desecrated two weeks after its dedication, being covered in blue paint. In Athens, a memorial to the 13,000 Greek Jewish children murdered in the Holocaust was also desecrated with a Nazi swastika and SS insignia. The memorial is located next to a playground built in the children’s memory. In the UK, two Jewish men were allegedly racially abused and violently threatened. Whilst walking along the River Lea towpath in Hackney in London, a man approached the visibly looking Jewish males and allegedly shouted “f***ing Jews” before walking right up to the victims, saying “I’ll f***ing kill you” and “I’ll f***ing break your neck”.
    [Show full text]
  • Las Vegas Optic, 05-08-1911 the Optic Publishing Co
    University of New Mexico UNM Digital Repository Las Vegas Daily Optic, 1896-1907 New Mexico Historical Newspapers 5-8-1911 Las Vegas Optic, 05-08-1911 The Optic Publishing Co. Follow this and additional works at: https://digitalrepository.unm.edu/lvdo_news Recommended Citation The Optic Publishing Co.. "Las Vegas Optic, 05-08-1911." (1911). https://digitalrepository.unm.edu/lvdo_news/2964 This Newspaper is brought to you for free and open access by the New Mexico Historical Newspapers at UNM Digital Repository. It has been accepted for inclusion in Las Vegas Daily Optic, 1896-1907 by an authorized administrator of UNM Digital Repository. For more information, please contact [email protected]. tftrritorlal Itcrstarjr'i 0(Ah TEA THER FORECAST THE DAILY MAXIHl Tonfipjlit Fair and Swat the Fly These .Warmjer; Tues-da- y Days, Early and Fair LAS OFT Late EXCLUSIVE ASSOCIATED PRE68 LEASED WIRE TELEGRAPH SERVICE VOL. XXXII. No. 154 EAST LAS VEGAS, NEW MEXICO, MONDAY, MAY 8, 191 1 CITY EDITION the insurrectos had got into Juarez MUSICIANS IN ATLANTA and a' force of them surrounded the SUB-COMMITT- Ga., May 8. The American EE Atlanta, SNELL DECIDES TO DIAZ SIGNIFIES INTENTION TO bull ring. Federal soldiers came out Federation of Musicians, one of the to meet them and exchanged shots most prosperous and Influential lab t in the heart of the Juarez resident sec organizations in America, began its RESIGN AS MEXICO'S PRESIDENT tion. The federals returned to their MAKES REPORT annual convention In this city today PAY A FINE OF quarters, leaving two dead or wounded wtih a large attendance of delegates in the street from all over the United States and REVOLUTIONISTS NEW ARMISTICE A messenger bearing a white flag ON STATEHOOD Canada.
    [Show full text]
  • Holocaust Museums at a Crossroads: Ethical Debates and Moral Obligations
    Holocaust Museums at a Crossroads: Ethical Debates and Moral Obligations Leah Angell Sievers Midlothian, Virginia B.A. Literature, Yale University, 1997 M.T.S. World Religions, Harvard Divinity School, 2001 A Dissertation presented to the Graduate Faculty of the University of Virginia in Candidacy for the Degree of Doctor of Philosophy Department of Religious Studies University of Virginia October 4, 2013 Prof. Asher Biemann ___________________________ Prof. Larry Bouchard ___________________________ Prof. Gabriel Finder ___________________________ Prof. Jennifer Geddes ___________________________ Prof. Charles Mathewes ___________________________ TABLE OF CONTENTS Introduction Chapter One: Early Holocaust Memorial Practices Life in the Displaced Persons Camps Reestablishing a Sense of Jewish Life, Jewish Self, and Jewish Community Documenting Survivor Testimonies in the Displaced Persons Camps Post-War Immigration to the United States Conclusion Chapter Two: Holocaust Remembrance in Israel and Germany Memorials, Monuments, and Museums Yad Vashem The Jewish Museum Berlin Conclusion Chapter Three: Holocaust Museums in the United States Turning Points The United States Holocaust Memorial Museum The Los Angeles Museum of the Holocaust The Illinois Holocaust Museum & Education Center Conclusion Chapter Four: Holocaust Uniqueness and Holocaust Memory The Uniqueness Debate It’s Jewish to Remember The Memory Debate Conclusion Chapter Five: Engaging the Ethical and the Aesthetic The Ethical Tasks of Holocaust Museums Creating a Moral Museum Ethical
    [Show full text]
  • THE NEW JEWISH VOICE April 2015
    Cocktails and Comedy will raise Non-profit Organization 5 funds to support the JCC’s Tzahal U.S. POSTAGE PAID Shalom program. Permit # 184 Watertown, NY 11 UJF’s Super Sunday provided Friendship Circle members with work experience. 14 Betsy’s Buddies seeks volunteers. JFS announces its annual College 17 Ahead! program. april 2015/nisan-Iyar 5775 a publication of United jewish federation of Volume 17, Number 3 Greater Stamford, New Canaan and Darien JCC Tzahal Shalom Yom Hashoah Commemoration Making Connections to Israel Remembering the Holocaust 70 Years During this year’s JCC Tzahal Sha- unity of the Jewish people. Americans lom program, the community is invited and Israelis are given opportunities after Liberation to spend time with active-duty officers to learn about each other and their By Peter Lilienthal Shoah (the Holocaust). from the Israel Defense Forces at a societies, person-to-person, while build- On Wednesday, April 15, the Using the format of a seder led by week of community events scheduled ing lasting relationships and a sense of United Jewish Federation of Greater Rabbi Joshua Hammerman, the pro- for April 19-26. extended family. Stamford, New Canaan, and Darien gram will reflect on the story of the Now in its 37th year in Stamford, Representing all branches of armed will hold its annual Yom Hashoah liberation beginning with the honoring Tzahal Shalom, organized by the services, the officers are young men (Holocaust Remembrance Day) com- of survivors. Grandchildren, symboliz- Stamford Jewish Community Center and women who embody commitment, memoration at Temple Beth El, from ing the four sons in the haggadah, will in cooperation with the Friends of the dedication, courage and leadership, 7-9 pm.
    [Show full text]
  • The Ager Valley Historic Landscape: New Tools and Quantitative Analysis
    The Ager valley historic landscape: new tools and quantitative analysis. Architecture and agrarian parcels in the medieval settlement dynamics Antonio Porcheddu http://hdl.handle.net/10803/436891 ADVERTIMENT. L'accés als continguts d'aquesta tesi doctoral i la seva utilització ha de respectar els drets de la persona autora. Pot ser utilitzada per a consulta o estudi personal, així com en activitats o materials d'investigació i docència en els termes establerts a l'art. 32 del Text Refós de la Llei de Propietat Intel·lectual (RDL 1/1996). Per altres utilitzacions es requereix l'autorització prèvia i expressa de la persona autora. En qualsevol cas, en la utilització dels seus continguts caldrà indicar de forma clara el nom i cognoms de la persona autora i el títol de la tesi doctoral. No s'autoritza la seva reproducció o altres formes d'explotació efectuades amb finalitats de lucre ni la seva comunicació pública des d'un lloc aliè al servei TDX. Tampoc s'autoritza la presentació del seu contingut en una finestra o marc aliè a TDX (framing). Aquesta reserva de drets afecta tant als continguts de la tesi com als seus resums i índexs. ADVERTENCIA. El acceso a los contenidos de esta tesis doctoral y su utilización debe respetar los derechos de la persona autora. Puede ser utilizada para consulta o estudio personal, así como en actividades o materiales de investigación y docencia en los términos establecidos en el art. 32 del Texto Refundido de la Ley de Propiedad Intelectual (RDL 1/1996). Para otros usos se requiere la autorización previa y expresa de la persona autora.
    [Show full text]
  • Early Testimonies of Jewish Survivors of World War II
    Tragedy and Triumph Early Testimonies of Jewish Survivors of World War II Compiled and Translated by Freda Hodge ABOUT THIS BOOK In this collection Freda Hodge retrieves early voices of Holocaust survivors. Men, women and children relate experiences of deportation and ghetto­ isation, forced labour camps and death camps, death marches and liber­ ation. Such eye­witness accounts collected in the immediate post­war period constitute, as the historian Feliks Tych points out, the most important body of Jewish documents pertaining to the history of the Holocaust. The fresh­ ness of memory makes these early voices profoundly different from, and historically more significant than, later recollections gathered in oral history programs. Carefully selected and painstakingly translated, these survivor accounts were first published between 1946 and 1948 in the Yiddish journal Fun Letzten Khurben (‘From the Last Destruction’) in postwar Germany, by refugees waiting in ‘Displaced Persons’ camps, in the American zone of occupation, for the arrival of travel documents and visas. These accounts have not previously been available in English. ABOUT THE AUTHOR Freda Hodge holds degrees in English, Linguistics and Jewish Studies, and has taught at universities and colleges in South Africa and Australia. Fluent in Hebrew as well as Yiddish, she works at the Holocaust Centre in Melbourne conducting interviews with survivors and families. Copyright Information Tragedy and Triumph: Early Testimonies of Jewish Survivors of World War II Compiled and translated by Freda Hodge © Copyright 2018 All rights reserved. Apart from any uses permitted by Australia’s Copyright Act 1968, no part of this book may be reproduced by any process without prior written permission from the copyright owners.
    [Show full text]
  • Genetic Algorithms for the Exploration of Parameter Spaces in Agent-Based Models
    NORTHWESTERN UNIVERSITY Genetic Algorithms for the Exploration of Parameter Spaces in Agent-Based Models A DISSERTATION SUBMITTED TO THE GRADUATE SCHOOL IN PARTIAL FULFILLMENT OF THE REQUIREMENTS for the degree DOCTOR OF PHILOSOPHY Field of Computer Science By Forrest J. Stonedahl EVANSTON, ILLINOIS December 2011 2 c Copyright by Forrest J. Stonedahl 2011 All Rights Reserved 3 ABSTRACT Genetic Algorithms for the Exploration of Parameter Spaces in Agent-Based Models Forrest J. Stonedahl This work provides the first comprehensive investigation of the use of genetic algorithms for exploring the range of behaviors produced by agent-based models. Agent-based modeling (ABM) is a powerful computer simulation technique in which many agents interact according to simple rules resulting in the emergence of complex aggregate-level behavior. However, as ABM is increasingly employed in both natural and social sciences, the methods and tools for understanding, exploring, and analyzing the behavior of agent-based models have not kept pace. In particular, models may be characterized by a large number of parameters, and the task of discovering parameter settings for which a model will produce a certain behavior is both difficult and time-consuming. Genetic algorithms (GAs) offer a flexible metaheuristic search mechanism which has previously been successful in a variety of combinatorial opti- mization and search problems. There is a rich space of possible model exploration tasks, and we offer a new unified framework for the creation and application of quantitative measures to perform these tasks using an evolutionary-search paradigm. We demonstrate the utility of GAs for ABM parameter exploration through a sequence of case studies in various ap- plication domains, including behavioral biology, viral marketing, archeology, and web-based journalism.
    [Show full text]
  • Las Vegas Optic, 05-10-1911 the Optic Publishing Co
    University of New Mexico UNM Digital Repository Las Vegas Daily Optic, 1896-1907 New Mexico Historical Newspapers 5-10-1911 Las Vegas Optic, 05-10-1911 The Optic Publishing Co. Follow this and additional works at: https://digitalrepository.unm.edu/lvdo_news Recommended Citation The Optic Publishing Co.. "Las Vegas Optic, 05-10-1911." (1911). https://digitalrepository.unm.edu/lvdo_news/2966 This Newspaper is brought to you for free and open access by the New Mexico Historical Newspapers at UNM Digital Repository. It has been accepted for inclusion in Las Vegas Daily Optic, 1896-1907 by an authorized administrator of UNM Digital Repository. For more information, please contact [email protected]. fsrrltorlal GscrsUr's OtB TEATHER FORECAST THE DAILY MAXIM Tonigbl Colder With Boost For the Home 't Thurs- frost; Team This day Fair OP" Tear ; EXCLUSIVE ASSOCIATED PRE68 I EASED WIFE TELEGRAPH 6ERVICEI VOL. XXXII. No. 156 EAST LAS VEGAS, NEW MEXICO, WEDNESDAY, MAY 10, 191 1 CITY EDITION JUAREZ FALLS; FEDERAL COMMANDER AND STAFF SURRENDER j FINAL CAPITULATION COMES AFTER TWO DAYS' REDELS PREPARED ARMY AVIATOR NEITHER HOUSEOF TO MOVE ON I PLUNGES TO CONGRESS IN BATTLE IN WHICH HUNDREDS WERE KILLED ENSENADA HIS DEATH SESSION LOWER General Madero CALIFORNIA PORT CITY LIEUTENANT KELLY VICTIM OF HOWEVER DAY IS Civfn nucii LAST STAND BY SOLDIERS Explains Why IS THE NEXT IDE OBJECTIVE FATAL FALL AT SAN TO MEETINGS OF VARIOUS He Ordered Attack on Juarez POINT ANTONIO COMMITTEES OF DIAZ DISPLAYED BRAVERY SCOUTING PARTIES Declares President Diaz's Manifesto of ARE OUT PITCHED FROMTHE MACHINE STATEHOOD UNDER DISCUSSION INSURRECTOS WATCHING THAT WAS NOT LOOKED FOR Intention to Resign Was En FOR WHILE MAKING A LANDING, OF-CE- REPUBLICAN MEMBERS INSIST ADVANCE OF FEDERALS FROM SUDDENLY SHOT HEAD- NEW MEXICO BE ADMITTED Too MEXICALI tirely Vague LONG TO EARTH FORTHWITH El Paso, Tex., May 10.
    [Show full text]
  • Ancient Observatories - Timeless Knowledge
    Deborah Scherrer Ancient Observatories - Timeless Knowledge Compiled by Deborah Scherrer Stanford Solar Center Compilation © 2015-2018, Stanford University Solar Center and Deborah Scherrer. Permission given to use for educational, non-commercial purposes. Copyrights for much of the material and images remain with their creators. 1 Deborah Scherrer Table of Contents Introduction to Alignment Structures ........................................ 3 Monuments .................................................................................... 4 Steppe Geoglyphs ........................................................................................................... 4 Goseck Circle .................................................................................................................. 6 Nabta Playa ..................................................................................................................... 8 Temples of Mnajdra ...................................................................................................... 10 Newgrange .................................................................................................................... 12 Majorville Medicine Wheel .......................................................................................... 15 Stonehenge .................................................................................................................... 18 Brodgar ........................................................................................................................
    [Show full text]
  • Las Vegas Optic, 05-05-1911 the Optic Publishing Co
    University of New Mexico UNM Digital Repository Las Vegas Daily Optic, 1896-1907 New Mexico Historical Newspapers 5-5-1911 Las Vegas Optic, 05-05-1911 The Optic Publishing Co. Follow this and additional works at: https://digitalrepository.unm.edu/lvdo_news Recommended Citation The Optic Publishing Co.. "Las Vegas Optic, 05-05-1911." (1911). https://digitalrepository.unm.edu/lvdo_news/2962 This Newspaper is brought to you for free and open access by the New Mexico Historical Newspapers at UNM Digital Repository. It has been accepted for inclusion in Las Vegas Daily Optic, 1896-1907 by an authorized administrator of UNM Digital Repository. For more information, please contact [email protected]. ramurtal ScrtM-f'- t otflt TEATHER FORECAST THE DAILY MAXIM Tonight and Saturday Li , Generally Fair; U ,Jt, You . Can't Smile Warmer LAS Refrain From G "V Scowling- EXCLU8IVB ASSOCIATED PRE88 LEA8ED WIRE TELEGRAPH SERVICE 7 VOL. XXXII. No. 154 EAST LAS VEGAS, NEWJEXICO, FRIDAY, MAY 5, 191 1 meat to receive or discuss the BALDWIN SOLD? resig WORKS. nesses besides McManlgaL nation of the president. Efforts were Among Philadelphia, May 5. Great surprise them were and officials of RESIGNATION being made to resume the con INDICTED SOLONS NINETEEN TRUE employes and': general interest have been o the Llewellyn Iron Works and Paul ference of the peace commissioners casloned in financial and business cir Stuperlch, proprietor of a hotel at AIRICANSIN late thU afternoon to determine cles by the announcement that the Saulito, Calif., which the alleged dyn whether a basis of agreement could ENTER PLEAS DF Baldwin Locomotive Works have been DILLS AGAINST amiter known as J.
    [Show full text]
  • 2018 Minnesota 1000 Museums – Not Just for Field Trips
    2018 Minnesota 1000 Museums – Not Just For Field Trips Rider Name _____________________________________________________________________ Rider #________________________ [SMI] N 44 58.266 W 93 14.424 Minneapolis, MN Friday only at 8:45 PM Points: 495 What to do on a Friday night? Tell you what, let’s ride down to the river and strike a pose. At exactly 8:45 p.m. the shutter will close on the 2018 MN1K group photo. Take advantage of these early points (sort of) off the clock. Date:____________________ Time:______________________ Odometer:____________________________ Approved By:______________ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * [LAC] N 43 49.098 W 91 15.354 La Crosse, WI 24 hours Points: 249 Visitor Center and Riverside Museum Located in Riverside Park, the La Crosse Visitor Center and Riverside Museum is just off the banks of the river. Between the museum and the mighty Mississippi is a tall statue of Hiawatha. This statue was built in 1962 by local Artist Anthony D. Zimmerhakl with the assistance of his sons Don, David and Stephan. Take a photo of the Hiawatha statue. Date:____________________ Time:______________________ Odometer:____________________________ Approved By:______________ * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * [RIV] N 43 21.712 W 91 12.867 Lansing, IA 24 hours Points: 514 Museum of River History The Museum of River History is located at 61 S. Front St. and is in a bright gold building parallel to railroad tracks. (Caution: This is an active railroad.) The museum displays highlights of early Lansing’s development as a Mississippi River town including steam-boating, commercial fishing, the pearl button industry, and ice harvesting. To the left of the large doors to the museum is a bronze Iowa Historic Site plaque.
    [Show full text]