Rx: Treating Bugs As Allergies— a Safe Method to Survive Software Failures

Total Page:16

File Type:pdf, Size:1020Kb

Rx: Treating Bugs As Allergies— a Safe Method to Survive Software Failures Rx: Treating Bugs As Allergies— A Safe Method to Survive Software Failures Feng Qin, Joseph Tucek, Jagadeesan Sundaresan and Yuanyuan Zhou Department of Computer Science University of Illinois at Urbana Champaign ffengqin, tucek, sundaresan, [email protected] ABSTRACT Keywords Many applications demand availability. Unfortunately, software Availability, Bug, Reliability, Software Failure failures greatly reduce system availability. Prior work on surviving software failures suffers from one or more of the following limita- 1. INTRODUCTION tions: Required application restructuring, inability to address deter- ministic software bugs, unsafe speculation on program execution, 1.1 Motivation and long recovery time. Many applications, especially critical ones such as process con- This paper proposes an innovative safe technique, called Rx, trol or on-line transaction monitoring, require high availability [27]. which can quickly recover programs from many types of software For server applications, downtime leads to lost productivity and lost bugs, both deterministic and non-deterministic. Our idea, inspired business. According to a report by Gartner Group [48] the average from allergy treatment in real life, is to rollback the program to a cost of an hour of downtime for a financial company exceeds six recent checkpoint upon a software failure, and then to re-execute million US dollars. With the tremendous growth of e-commerce, the program in a modified environment. We base this idea on the almost every kind of organization is becoming dependent upon observation that many bugs are correlated with the execution envi- highly available systems. ronment, and therefore can be avoided by removing the “allergen” Unfortunately, software failures severely reduce system avail- from the environment. Rx requires few to no modifications to ap- ability. A recent study showed that software defects account for up plications and provides programmers with additional feedback for to 40% of system failures [37]. Memory-related bugs and concur- bug diagnosis. rency bugs are common software defects, causing more than 60% We have implemented Rx on Linux. Our experiments with four of system vulnerabilities [17]. For this reason, software compa- server applications that contain six bugs of various types show that nies invest enormous effort and resources on software testing prior Rx can survive all the six software failures and provide transparent to releasing software. However, software failures still occur dur- fast recovery within 0.017-0.16 seconds, 21-53 times faster than ing production runs since some bugs inevitably slip through even the whole program restart approach for all but one case (CVS). the strictest testing. Therefore, to achieve higher system availabil- In contrast, the two tested alternatives, a whole program restart ap- ity, mechanisms must be devised to allow systems to survive the proach and a simple rollback and re-execution without environmen- effects of uneliminated software bugs to the largest extent possible. tal changes, cannot successfully recover the three servers (Squid, Previous work on surviving software failures can be classified Apache, and CVS) that contain deterministic bugs, and have only into four categories. The first category encompasses various fla- a 40% recovery rate for the server (MySQL) that contains a non- vors of rebooting (restarting) techniques, including whole program deterministic concurrency bug. Additionally, Rx's checkpointing restart [27, 54], micro-rebooting of partial system components system is lightweight , imposing small time and space overheads. [13, 14], and software rejuvenation [30, 26, 8]. Since many of these techniques were originally designed to handle hardware failures, Categories and Subject Descriptors most of them are ill-suited for surviving software failures. For ex- ample, they cannot deal with deterministic software bugs, a major D.4.5 [Operating Systems]: Reliability cause of software failures [18], because these bugs will still occur even after rebooting. Another important limitation of these meth- General Terms ods is service unavailability while restarting, which can take up Design, Experimentation, Reliability to several seconds [57]. For servers that buffer significant amount of state in main memory (e.g. data buffer caches), it requires a long period to warm up to full service capacity [11, 58]. Micro- rebooting [14] addresses this problem to some extent by only re- Permission to make digital or hard copies of all or part of this work for booting the failed components. However, it requires legacy soft- personal or classroom use is granted without fee provided that copies are ware to be reconstructed in a loosely-coupled fashion. not made or distributed for profit or commercial advantage and that copies The second category includes general checkpointing and recov- bear this notice and the full citation on the first page. To copy otherwise, to ery. The most straightforward method in this category is to check- republish, to post on servers or to redistribute to lists, requires prior specific point, rollback upon failures, and then re-execute either on the permission and/or a fee. SOSP'05, October 23–26, 2005, Brighton, United Kingdom. same machine [24, 43] or on a different machine designated as the Copyright 2005 ACM 1­59593­079­5/05/0010 ...$5.00. “backup server” [27, 6, 11, 12, 58, 3, 61]. Similar to the whole c ACM, 2005. This is a minor revision of the work published in SOSP 2005, http://doi.acm.org/10.1145/1095809.1095833 program restart approach, these techniques were also proposed to 1.2 Our Contributions deal with hardware failures, and thereby suffer from the same limi- In this paper, we propose a safe (not speculatively “fixing” the tations in addressing software failures. Progressive retry [59] is an bug) technique, called Rx, to quickly recover from many types of interesting improvement over these approaches. It reorders mes- software failures caused by common software defects, both deter- sages to increase the degree of non-determinism. While this work ministic and non-deterministic. It requires few to no changes to proposes a promising direction, it limits the technique to message applications' source code, and provides diagnostic information for reordering. As a result, it cannot handle bugs unrelated to mes- postmortem bug analysis. Our idea is to rollback the program to sage order. For example, if a server receives a malicious request a recent checkpoint when a bug is detected, dynamically change that exploits a buffer overflow bug, simply reordering messages the execution environment based on the failure symptoms, and then will not solve the problem. The most aggressive approaches in the re-execute the buggy code region in the new environment. If the checkpointing/recovery category include recovery blocks [42] and re-execution successfully pass through the problematic period, the n-version programming [5, 4, 45], both of which rely on different new environmental changes are disabled to avoid imposing time implementation versions upon failures. These approaches may be and space overheads. able to survive deterministic bugs under the assumption that dif- Our idea is inspired from real life. When a person suffers from ferent versions fail independently. But they are rarely adopted by an allergy, the most common treatment is to remove the allergens software companies due to prohibitive costs. An alternative to N- from their living environment. For example, if patients are allergic version programming is data diversity that tries to execute multiple to milk, they should remove diary products from the diet. If pa- copies of the same program, each with a different form of the in- tients are allergic to pollen, they may install air filters to remove put [2]. While proposing an inspiring idea, this work focuses on the pollen from the air. Additionally, when removing a candidate al- theoretical framework instead of the practical aspects. In particu- lergen from the environment successfully treats the symptoms, it lar, it does not answer how to apply the idea transparently without allows diagnosis of the cause of the symptoms. Obviously, such modifying the application and without causing major performance treatment cannot and also should not start before patients shows degradation during normal execution. allergic symptoms since changing living environment requires spe- The third category comprises application-specific recovery mech- cial effort and may also be unhealthy. anisms, such as the multi-process model, exception handling, etc. In software, many bugs resemble allergies. That is, their man- Some multi-processed applications, such as the old version of the ifestation can be avoided by changing the execution environment. Apache HTTP Server and the CVS server, spawn a new process According to a previous study by Chandra and Chen [18], around for each client connection and therefore can simply kill a failed 56% of faults in Apache depend on execution environment 1. There- process and start a new one to handle a failed request. While capa- fore, by removing the “allergen” from the execution environment, it ble of surviving certain software failures, this technique has several is possible to avoid such bugs. For example, a memory corruption limitations. First, the new process will most likely fail again for bug may disappear if the memory allocator delays the recycling deterministic bugs at the same place given the same request (e.g. a of recently freed buffers or allocates
Recommended publications
  • 2010-3-19:Layout 1.Qxd
    Vol. 3 No. 24 Mar. 19, 2010 Founder’s Day previews InsideASU See page 4. THE PRESIDENT’S ASU to hold Honors Day CORNER Convocation on March 26 With the theme of “Honor- dean of the ASU Graduate entation of ing the Best and the Brightest,” School from September 1997 to the Civil Albany State University will September 1999. Rights recognize the outstanding aca- In October 1999 he joined Movement demic achievement of students Indiana University as a scholar in Albany and present scholarships during and executive director of the and South- the annual Honors Day Convo- Organization of American His- west Geor- cation set for 10 a.m. Friday, torians. In his role with the gia. Dr. Everette J. Freeman March 26, in the HPER Gym- OAH, Dr. Formwalt supervised Dr. Spring is for nasium. a staff of 20 and collaborated Formwalt Lee Formwalt During the Honors Day with numerous national histori- graduated renewal Convocation, the Teacher of the cal and humanities organiza- cum laude with a bachelor’s de- Year, Researcher of the Year tions. His successes include gree in history from the When it comes to our and Staff Person of the Year increasing membership by 20 Catholic University of America success as a university, it’s awards will also be presented. percent, increasing the annual in 1971. He earned a master’s vital that we understand the The keynote speaker for the budget by 67 percent, raising degree in history from the Uni- importance of reaching be- Honors Day Convocation will more than $1 million with the versity of Massachusetts in yond the confines of our be Dr.
    [Show full text]
  • Grade 7: Module 1: Unit 2 Overview This Work Is Licensed Under a Creative Commons Attribution-Noncommercial-Sharealike 3.0 Unported License
    Grade 7: Module 1: Unit 2 Overview This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License. Exempt third-party content is indicated by the footer: © (name of copyright holder). Used by permission and not subject to Creative Commons license. GRADE 7: MODULE 1: UNIT 2: OVERVIEW Case Study: Survival in Sudan In this second unit, students are introduced to the concept of theme in a novel. As students will analyze how the author of A Long Walk to Water both used and they complete A Long Walk to Water, students will continue to collect textual elaborated on historical facts. Part 1 of the end of unit assessment (which takes evidence to answer the question “How do individuals survive in challenging place over two lessons) is the first draft of a literary analysis essay requiring textual environments?” In addition, students will be reading informational texts that support to discuss the topic of survival in Southern Sudan during and after the provide more information about the context of the novel. Close reading of the second civil war in the 1980s. Part 2 of the end of unit assessment is the final draft selected informational text and novel will prepare students for the mid-unit of the student essay. assessment and the two-part end of unit assessment. For the mid-unit assessment, Guiding Questions And Big Ideas • How do individuals survive in challenging environments? • How do culture, time, and place influence the development of identity? • How does reading from different texts about the same topic build our understanding? • How does juxtaposing multiple characters help authors develop and contrast their points of view? • Individual survival in challenging environments requires both physical and emotional resources.
    [Show full text]
  • Extensions of Remarks
    September 26, 1977 EXTENSIONS OF REMARKS 30991 EXTENSIONS OF REMARKS WILD AND SCENIC RIVER one classification, or is it possible to have a to accommodate the existing and permissible DESIGNATION combination of river classifications? levels of recreational use. Generally, fee ac­ A. It is possible to have portions of a river quisition would be confined to land needed classified as either wild, scenic or recreational to provide access and fac111t1es to the gen­ HON. MAX BAUCUS depending on the character of each river eral public and to protect the river and section. resource values which would otherwise be OF MONTANA 3. Q. Could less than the entire river be in Jeopardy from less-than-fee control. The IN THE HOUSE OF REPRESENTATIVES included? remainder of the land within the boundary Monday, September 26, 1977 A. Yes, but generally a river segment could be controlled by scenic easements and, would have to be at least 25 miles long. A when acceptable to the Secretary of the Mr. BAUCUS. Mr. Speaker, in his en­ shorter stretch that has outstanding quali­ Interior, by adequately enforced local zoning vironmental message of May 22, 1977, fications might, however, be included in the regulations. President Carter recommended the in­ national wild and scenic rivers system. 8. Q. How do scenic easements work? clusion of portions of the Madison and 4. Q. How may a river be included into the A. Scenic easements are essentially agree­ Yellowstone Rivers in Montana into the national wild and scenic rivers system? ments between the Federal Government and A. Two ways are possible.
    [Show full text]
  • Summer Reading Adventures for Students Entering Third Grade At
    Summer Reading Ideas for Students Entering Third Grade at Concord Hill School Fiction Abbott, Tony. The Hidden Stairs and the Magic Carpet. Eric and his two friends, Neal and Julie, discover a secret doorway in Eric's basement that leads to the rainbow stairs. The stairs reach down into the wondrous world of Droon - a land where all kinds of amazing things occur. (Secrets of Droon series) Angelberger, Tom. Fake Mustache: or, how Jodie O'Rodeo and her wonder horse (and some nerdy guy) saved the U.S. Presidential election from a mad genius criminal mastermind. Lenny Flem Jr. is the only one standing between his evil-genius best friend, Casper, and world domination as Casper uses a spectacularly convincing fake mustache and the ability to hypnotize to rob banks, amass a vast fortune, and run for president. Applegate, Katherine. The One and Only Ivan. When Ivan, a gorilla who has lived for years in a down-and-out circus-themed mall, meets Ruby, a baby elephant that has been added to the mall, he decides that he must find her a better life. Applegate, Katherine. Wishtree. Every May, neighbors tie their wishes to the old red oak tree. This year, with the threat of being taken down looming, Red knows it must help its neighbors, both human and animal, as they confront the hatred and prejudice being directed at the new family in the little blue house. Auch, Mary Jane. I Was a Third Grade Science Project. While trying to hypnotize his dog for the third grade science fair, Brian accidentally makes his best friend Josh think he’s a cat.
    [Show full text]
  • Life on the Pamlico 2013
    A Publication of Beaufort County Community College LIFE ON THE PAMLICO Cultural Studies HUM 120 Suzanne Stotesbury EDITOR James E. Casey DESIGNER Amber Revels COPY EDITOR 2013 !!! elcome to the 2013 issue of Life on the Pamlico.New and exciting things are happen- ingW with our publication, and we are happy to share them with you! !Students in my Cultural Studies class at Beaufort County Community College this Spring semester have worked very hard writing biographies and stories of local interest for this year’s edition. Over the course of the semester, they have learned and implemented in- terview and research skills to bring the very best to this edition of our publication. ! A new addition to the Life on the Pamlico repertoire is video, an addition suggested by our designer James Casey. Our first “preview video” using interviews the students conducted has been added to our homepage and additional videos of some interviews have also been posted. It is the sta#’s desire to include more multimedia elements in future editions. ! Students wrote stories on a wide variety of topics this year. Inside, readers will learn about the life of a family of fisherman from Belhaven, Washington business owners who bring a di#erent type of cultural flair to the area, and how one octogenarian couple contin- ues to build a thriving relationship in Pinetown. A successful saxophonist shares a story of his unique relationship with his instrument, and the tales of farmers, teachers, and home- makers who have lived in Eastern North Carolina have all been preserved by the articles written by the students in this course.
    [Show full text]
  • Supplementary Budget Estimates 2010-2011
    Senate Standing Committee on Environment, Communications and the Arts Answers to Senate Estimates Questions on Notice Supplementary Estimates Hearings October 2011 Broadband, Communications and the Digital Economy Portfolio Australian Broadcasting Corporation Question No: 133 Program No. ABC Hansard Ref: Page 78 (18/10/2011) Topic: Revenue – Sports Programming Senator Birmingham asked: Senator BIRMINGHAM: In terms of advertising and sponsorship revenue that is derived on the Australia Network, what proportion of that comes from sports programming? Mr Scott: I would have to take that on notice. Senator BIRMINGHAM: Is it fair to say that it is a substantial amount? Mr Scott: I think there will be times in the year when we run sporting events that generate significant attention and there will be some advertising revenue that goes around that, but I do not have the precise details. I could take that on notice. Answer: Revenue generated by sales of advertising and sponsorship of sporting events broadcast on Australia Network represents approximately 22 per cent of total revenues earned in the year-to- date from 1 July 2011 to 1 November 2011. This figure will vary from year to year depending upon the sport broadcast. Senate Standing Committee on Environment and Communications Answers to Senate Estimates Questions on Notice Supplementary Budget Estimates Hearings October 2011 Broadband, Communications and the Digital Economy Portfolio Australian Broadcasting Corporation Question No: 134 Program: ABC Hansard Ref: Page 80 (18/10/2011) Topic: Breakdown of Programs Senator Singh asked: Senator SINGH: Thank you for your opening tribute to those colleagues that were lost on the fateful day.
    [Show full text]
  • October 2020
    FREE! OCTOBER 2020 All in the Head: Animal Telepathy Plus Halloween 2020 Horse Costumes, Fall Treat Ingredients, NFR and Cowboy Christmas Update, Paddy Melon Dangers, and more! VALLEY HORSE NEWS is a monthly All Breed Equine Publication. We are distributed in Nevada, Utah, Arizona and Southern California. Pick up a FREE copy at a tack, feed, or western wear store near you! PAGE 02 • VALLEY HORSE NEWS • ISSUE 319 • OCTOBER 2020 Callie Klein HORSE HEAVEN Hey you! Western Dressage | Classical Dressage Natural Horsemanship | Centered Riding Removal Service 24/7 Get the word out with your Certified Pro Instructor | Clinician business card... 702-326-9440 Rudy Cell: 702-580-2894 CallieKlein.com Here! Increase Your Deb Cell: 702-538-3211 Confidence & Enjoyment! SHADES 4 Post Canopy Horse Shades. Easy and quick GALA STUD RANCH to assemble. 18’x18’x10’ all galvanized 11 Acres, 12 pastures with daily turnout 3 Barns, oversized stalls with in & outs, Arena, ½ mile bridle path. construction $1150 each. Highly experienced Horseman Owner/Manager and a live in onsite caretaker. 5 minutes from the airport. Free delivery in Las Vegas. Now accepting applications commencing January 2020! 702-433-6074 www.galastudranch.com Ph: 702.912.1461 Miss Rodeo M & C H a y Nevada Quality Alfalfa & Timothy Hay Miss Rodeo Nevada Association Matt Morrison 1409 Big Valley Lane, Las Vegas, NV 775-237-5510 Serving the Southwest [email protected] 89081- [email protected] www.mchaynevada.com since 1992! WWW.MISSRODEONEVADA.COM Eureka, NV-Diamond Valley TERRI GAMBOA
    [Show full text]
  • Off the New S
    THE MAGAZINE OF INTERNATIONAL ECONOMIC POLICY 888 16th Street, N.W., Suite 740 Washington, D.C. 20006 Phone: 202-861-0791 • Fax: 202-861-0790 www.international-economy.com [email protected] OFF THE NEW S “Better Than the Bundesbank” utgoing ECB President Jean- to hear some congratulations … This fig - Claude Trichet argues that the ure is better than any ever obtained in Ocentral bank’s delivery of price [Germany] over a period of thirteen years stability under his presidency has been in the past fifty years.” superior even to the Bundesbank’s over Trichet adds that the ECB’s “inde - the past fifty years. pendence is inflexible…May I remind you “We have delivered price stability that in 2004 and 2005, [even Germany] over the first twelve, thirteen years of the asked for a weakening of the S tability and Jean-Claude Trichet euro! Impeccably! I would like very much Growth Pact?” Draghi’s “Constâncio Problem” hen eurozone heads of government were easy. For starters, he will be confronted with the debating who should be the successor to question of whether to continue the policy of unlim - WJean-Claude Trichet, many in the ited ECB purchases of Italian sovereign debt. Draghi German press ridiculed the notion of Italian Central probably has no choice but to continue those pur - Bank head Mario Draghi as president of the chases, but the exercise no doubt will entail a sig - European Central Bank, suggesting he would be an nificant degree of personal discomfort. According to agent for Italian political interests. Those in the pol - several of his colleagues, however, Draghi’s most icy world who know Draghi well believe such crit - difficult challenge will be to maintain order on the icism to be ridiculous.
    [Show full text]
  • Middle School Summer Re Ading 2020
    MIDDLE SCHOOL SUMMER READING 2020 GRADE 6-8 All middle school students are encouraged to read over the summer. Below you will find a list of recommended books to choose from. While the titles in this list are all age appropriate and have been selected specifically for middle school students from 10-13 years of age, these selections span a diverse and inclusive range of reading levels, maturity levels, and cultural areas for middle grade children. Books marked as "middle grade" are appropriate for all middle school students. Books marked as "upper grades" or "high school/young adult crossover" are appropriate for grades 7 and up. We encourage parents to take an active role in helping children choose the books that are the best fit for them and their families. Common Sense Media: Age Based Media Reviews for Families (commonsensemedia.org) is an excellent resource to assist parents in identifying any potentially sensitive areas for their families and determining a “just right” book. The Bridge Home by Padma Venkatraman Fiction: realistic Interest Level: Middle grade From the publisher: "Four determined homeless children make a life for themselves in Padma Venkatraman's stirring middle-grade debut. Life is harsh on the teeming streets of Chennai, India, so when runaway sisters Viji and Rukku arrive, their prospects look grim. Very quickly, eleven-year-old Viji discovers how vulnerable they are in this uncaring, dangerous world. Fortunately, the girls find shelter--and friendship--on an abandoned bridge that's also the hideout of Muthi and Arul, two homeless boys, and the four of them soon form a family of sorts.
    [Show full text]
  • A Real Canadian Success Story
    summer 2007 The Alliance of Canadian Cinema, Television and Radio Artists A reAl CAnAdiAn success story: See story Corner GAs page 9 Contact ACTRA… ACTRA national office ACTrA Performers’ rights society 300-625 Church st I Toronto ON I M4Y 2G1 tel: (416) 489-1311/1-800-387-3516 fax: (416) 489-8076 email: [email protected] I email: [email protected] email: [email protected] (srd – sound recording division) I www.actra.ca union of B.C. Performers 300 – 856 Homer st I Vancouver BC I V6B 2W5 tel: (604) 689-0727 I fax: (604) 689-1145 email: [email protected] I www.ubcp.com ACTRA Calgary 304 – 1300 8 Street SW I Calgary AB I T2R 1B2 tel: (403) 228-3123 I fax: (403) 228-3299 email: [email protected] I www.actracalgary.com ACTRA edmonton c/o 304 – 1300 8 Street SW I Calgary AB I T2R 1B2 tel: 1-866-913-3123 I fax: (403) 228-3299 email: [email protected] I www.actraedmonton.com ACTRA saskatchewan 212-1808 smith st I regina sK I S4P 2N4 tel: (306) 757-0885 I fax: (306) 359-0044 email: [email protected] I www.actra.ca/sask ACTRA Manitoba 203 – 245 mcDermot Ave I Winnipeg mB I R3B 0S6 tel: (204) 339-9750 I fax: (204) 947-5664 email: [email protected] www.actra.ca/winnipeg ACTRA toronto Performers 200-625 Church st I Toronto ON I M4Y 2G1 tel: (416) 928-2278 I fax: (416) 928-0429 The Actors’ Fund of Canada email: [email protected] I www.actratoronto.com Emergency financial help for entertainment industry professionals ACTRA ottawa The Arts Court I 170 – 2 Daly Ave I Ottawa ON I K1N 6E2 “I felt so blessed and grateful that the tel: (613) 565-2168 I fax: (613) 565-4367 Fund was there when I needed it.” email: [email protected] I www.actraottawa.ca “I have been an actor for many years and was enjoying a pretty ACTRA Montreal successful career.
    [Show full text]
  • “You Are with Someone Who Is a Fighter”: Constructing a Model of Transformation Which Can Occur in Surviving Breast Cancer
    University of San Diego Digital USD Dissertations Theses and Dissertations 2003 “You are with Someone Who is a Fighter”: Constructing a Model of Transformation which Can Occur in Surviving Breast Cancer Helen Hays Eckmann EdD University of San Diego Follow this and additional works at: https://digital.sandiego.edu/dissertations Part of the Leadership Studies Commons Digital USD Citation Eckmann, Helen Hays EdD, "“You are with Someone Who is a Fighter”: Constructing a Model of Transformation which Can Occur in Surviving Breast Cancer" (2003). Dissertations. 707. https://digital.sandiego.edu/dissertations/707 This Dissertation: Open Access is brought to you for free and open access by the Theses and Dissertations at Digital USD. It has been accepted for inclusion in Dissertations by an authorized administrator of Digital USD. For more information, please contact [email protected]. “YOU ARE WITH SOMEONE WHO IS A FIGHTER”: CONSTRUCTING A MODEL OF TRANSFORMATION WHICH CAN OCCUR IN SURVIVING BREAST CANCER A Dissertation Presented to the Faculty of University of San Diego In Partial Fulfillment of the Requirements for the Degree Doctor of Education in Organizational Leadership by Helen Hays Eckmann Spring, 2003 Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. ii ©2003 by Helen Hays Eckmann Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. ACKNOWLEDGEMENTS First, I acknowledge my husband, Jim, who has encouraged me and taught me about leadership, courage, ethics and the value of hard work by the way he lives and the way he loves me. Thank you to my chair, Dr. Kathleen Collins, for encouraging me to write both what I know and what I think.
    [Show full text]
  • March 21, 2012 • Vol
    The WEDNESDAY, MARCH 21, 2012 • VOL. 24, NO. 23 $1.25 Did you freeze at KLONDIKE Thaw di Gras? SUN Rangers Receive Service Awards (Above) Six and 12-year ranger veterans. Rangers assemble for the Operation Mate Graduation. See Page 6. Photos by Dan Davidson in this Issue Max’s has all the Trek Over the Top 3 The Happy Writer 7 Larry's Reading 20 Easter candy It took him 19 years to come in first Why is this man smiling? What brought all these people to the place Library? you could ever want! See & Do in Dawson 2 School Carnivale Pix 5 Reconciliation Musings 15 Mann Lecture 17 Uffish Thoughts 4 CO2 Warning 9 TV Guide 10-14 Cruikshank Lecture 19 We will be closed April 1st Teed Off About the Golf Club 5 TV Guide 10-14 Neufeld Lecture 16 Kids' Corner 22 P2 WEDNESDAY, MARCH 21, 2012 THE KLONDIKE SUN SEEDY SATURDAY: What to Saturday, March 31 from 9:30 a.m. to 4 p.m. Includes lunch, PERCY DE WOLFE MEMORIAL RACE: snacks, and guest speaker John Lenart. Bring seeds for the seed swap! March 22-24. www.thepercy.com AND Call the Rec Dept. for more information on programming, 993-2353. Visit SEE DO www.cityofdawson.ca for a link to sign up for the monthly e-newsletter to or stay current! in DAWSON now: The Westminster Hotel Live entertainment in the lounge on Friday and Saturday, 10 p.m. to close. MoreThe Downtown live entertainment Hotel in the Tavern on Fridays from 4:30 p.m.
    [Show full text]