DOCSLIB.ORG

Controlling a Mindstorms Robot Using Image Processing on Android Devices

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Controlling a Mindstorms Robot Using Image Processing on Android Devices Bachelor Thesis Controlling a Mindstorms Robot using Image Processing on Android Devices Shasindran Poonudurai Martikel-Nr: 700461 Studiengang Mechatronik Fakültät Technik Hochschule Reutlingen Betreuer: Prof.-Dr. Stefan Mack Prof.-Dr. Jens Weiland Contents List of Figures ........................................................................................................................................ 4 Acknowledgements .............................................................................................................................. 6 Chapter 1: .............................................................................................................................................. 7 Introduction ............................................................................................................................................ 7 1.1 Lego Mindstorms NXT ............................................................................................................... 9 1.1.1 NXT Intelligent Brick ........................................................................................................... 9 1.1.2 The Motors ......................................................................................................................... 10 1.1.3 The Sensors ...................................................................................................................... 11 1.2 Image Processing for Mobile Robots .................................................................................... 13 1.3 Android and Smartphone ........................................................................................................ 14 1.3.1 Mobile Operating System (OS) ....................................................................................... 15 1.3.2 Smartphone Hardware ..................................................................................................... 15 1.3.3 Development Environment for Apps .............................................................................. 16 1.3.4 Creating an Android Application Project ....................................................................... 17 1.3.5 Android Activity Lifecycle ................................................................................................. 19 1.4 OpenCV ..................................................................................................................................... 23 1.4.1 Computer Vision ............................................................................................................... 23 1.4.2 What is OpenCV? ............................................................................................................. 26 1.4.3 OpenCV Structure ............................................................................................................ 27 1.5 System Design ......................................................................................................................... 28 1.6 Example Applications outside NXT-Projects. ...................................................................... 30 Chapter 2: ............................................................................................................................................ 31 2.0 Lego NXT System ........................................................................................................................ 31 2.1 Communication via LCP commands ..................................................................................... 31 2.1.1 General protocol architecture .......................................................................................... 32 2.2 Bluetooth Connection with Lego NXT ................................................................................... 33 Chapter 3: ............................................................................................................................................ 39 3.0 OpenCV for Android .................................................................................................................... 39 3.1 OpenCV Java API .................................................................................................................... 40 3.2 OpenCV Native ......................................................................................................................... 41 3.3 OpenCV Tutorial 0: Android Camera .................................................................................... 42 3.5 Object Detection via Color Segmentation ............................................................................ 57 3.5.1 Color and Color Models ................................................................................................... 57 2 3.5.2 Image Acquisition and Image Enhancement ................................................................ 59 3.5.3 Pixel Classification ............................................................................................................ 60 3.5.4 Image Labeling .................................................................................................................. 60 3.5.5 Feature Extraction ............................................................................................................ 61 Chapter 4: ............................................................................................................................................ 63 4.0 Controlling NXT via Android Smartphone ................................................................................ 63 4.1 Implementation of NXT Sensors ............................................................................................ 65 4.2 Application ................................................................................................................................. 67 4.2.1 Controlling via Collision Avoidance ................................................................................ 69 4.2.2 Controlling Via Image Processing .................................................................................. 71 4.2.3 Test and Optimization ...................................................................................................... 73 Chapter 5: ............................................................................................................................................ 75 5.0 Outlook .......................................................................................................................................... 75 Summary .............................................................................................................................................. 76 References .......................................................................................................................................... 77 3 List of Figures Figures 1. 1: Components of LEGO Mindstroms NXT autonomous Robot ................................. 8 Figures 1. 2: Components of Lego Mindstorms NXT 2.0 [1] .......................................................... 9 Figures 1. 3: NXT Intelligent Brick and Components .................................................................... 10 Figures 1. 4: Structure of NXT Servomotor [1] ............................................................................... 10 Figures 1. 5: The Android App Project wizard in Eclipse ............................................................. 18 Figures 1. 6: The Activity Lifecycle of an Android application [8] ............................................... 20 Figures 1. 7: An illustration of the Activity lifecycle, expressed as a step pyramid. [9] ............ 21 Figures 1. 8: Comparison between a human‘s eye and a digital camera. [12] ......................... 24 Figures 1. 9: To a computer, the eagle’s eye is just a grid of numbers. .................................... 25 Figures 1. 10: The basic structure of OpenCV [11] ....................................................................... 27 Figures 1. 11:. System Design ......................................................................................................... 29 Figures 2.1: Communication block diagram.[15] ........................................................................... 21 Figures 2.2 : General protocol architecture[15] .............................................................................. 32 Figures 2.3: Bluetooth protocol package[15] .................................................................................. 35 Figures 3. 1: The illustration of software stacks for Android application that use OpenCV for Android[19] .......................................................................................................................................... 39 Figures 3. 2: Android application using the Java API[20] ............................................................. 40 Figures 3. 3 Android application using the Android NDK[20] ....................................................... 41 Figures 3. 4: UML (Unified Modeling Language) Class Diagram of Tutorial 0 .......................... 44 Figures 3. 5: Graph frame rate against Image Size ...................................................................... 53 Figures 3. 6: Graph frame rate against Image Processing Methods. ......................................... 54 Figures 3. 7: Graph frame rate against illuminance ...................................................................... 55 Figures 3. 8: The basic steps of Image processing to detect an object via
Load more

Recommended publications
  • COURSE CURRICULUM Module Name Credit Units YEAR 1 Level
    COURSE CURRICULUM Module Name Credit Units YEAR 1 Level 1.1 (22.5 hours per week) Career & Professional Preparation l 1.5 Computer Programming 4 Electrical Technology 4 Engineering Mathematics 1 5 Engineering Mechanics 4 Innovation Toolkit: Acquiring the Skills ^ 2 Sports & Wellness ^ 2 Level 1.2 (26 hours per week) Manufacturing Technology & Practice 4 Electronics Technology 4 Engineering Materials 4 Engineering Mathematics 2 5 Automation in a Mechatronic World 3 Communication & Contemporary Issues ^ 4 Innovation Toolkit: Applying the Skills ^ 2 Notes: ^ For more details on Interdisciplinary Studies (IS) electives, please log on to www.np.edu.sg/is/ IS Modules The School of Interdisciplinary Studies (IS) delivers a broad-based curriculum, which nurtures a new generation of professionals with multidisciplinary skills and an innovative and entrepreneurial spirit to meet the challenges of a knowledge economy. IS offers both prescribed modules and electives to challenge boundaries. Prescribed modules develop students’ competencies in core areas such as Communication, Innovation and Enterprise, Culture and Communication, and Personal Mastery and Development, while elective modules provide insights into Arts and Humanities, Business, Design, and Science and Technology. COURSE MODULES LEVEL 1.1 Career & Professional Preparation I This module helps to give students a foundational introduction to their three-year diploma course curriculum and how it prepares them for industry. It will help them to embark on their three-year course with the end in mind, through guided reflection of their personal characteristics, and producing an overall game plan for their future education and career goals. The module aims to deepen students’ commitment to the sector that the course prepares them for.
    [Show full text]
  • Richer Connections to Robotics Through Project Personalization
    Advances in Engineering Education SUMMER 2012 Richer Connections to Robotics through Project Personalization MELANIE VELTMAN VALERIE DAVIDSON and BETHANY DEYELL University of Guelph Guelph, Ontario, Canada ABSTRACT In this work, we describe youth outreach activities carried out under the Chair for Women in Science and Engineering for Ontario (CWSE-ON) program. Specifi cally, we outline our design and implementation of robotics workshops to introduce and engage middle and secondary school students in engineering and computer science. Toward the goal of increasing the participation of women in science and engineering, our workshop design incorporates strategies presented in work by Rusk et al. (2008) on broadening participation in robotics: 1. focusing on themes, not just challenges; 2. combining art and engineering; 3. encouraging story-telling; and 4. organizing exhibitions, rather than competitions (Rusk et al., 2008, page 1) We discuss three workshop themes designed to highlight creativity and provide choices to par- ticipants. Our “Wild in the Rainforest” workshops make use of the PicoCrickets robotics kits and software used and described by Rusk et al. (2008). We also present Lego Mindstorms workshops themed “So You Think Your Robot Can Dance” and “A Day at the Park”. Our workshops are presented by female role models with academic backgrounds in science and engineering. Although workshop periods are fairly short (60-90 minutes), participants learn that robots have perception, cognition, and action – and are tasked with designing and programming to highlight these abilities. We present the results of our workshops through images and videos of the teams’ creations. Workshop evalu- ation data provided by participants demonstrate that our approach results in rich connections to engineering and technology for participants of both genders.
    [Show full text]
  • NXT User Guide Introduction
    NXT User Guide Introduction WELCOME TO LEGO® MINDSTORMS® EDUCATION LEGO® MINDSTORMS® Education is the next generation in educational robotics, enabling students to discover Science, Technology, Engineering and Mathematics in a fun, engaging, hands-on way. By combining the power of the LEGO building system with the LEGO MINDSTORMS Education technology, teams of students can design, build, program, and test robots. Working together on guided and open-ended engineering projects, the team members develop creativity and problem-solving skills along with other important mathematics and science knowledge. Students also become more skilled in communication, organization and research, which helps prepare them for future success in higher levels of schooling and in the workplace. The next technology - now. LEGO MINDSTORMS Education features an advanced 32-bit computer- controlled NXT brick, Interactive Servo Motors, Sound, Ultrasonic and other sensors, Bluetooth communication and multiple downloading capabilities. The icon-based LEGO MINDSTORMS Education NXT Software is built on the LabVIEW™ software from National Instruments, an industry standard with applications in many engineering and research fi elds. Curriculum. Inspiration. Support. The LEGO MINDSTORMS Education website www.MINDSTORMSeducation.com is your main resource for curriculum, training, product information and support. Our partners provide a strong network of information, technical advice, and teacher support as well. Carnegie Mellon Robotics Academy is our partner for developing curriculum materials and activities. Tufts University Center for Engineering Education Outreach (CEEO) is our partner for product development, workshops and conferences. In addition, local support is provided by our trade partners. If you are interested in a competitive challenge, check our website to fi nd out more about the FIRST LEGO LEAGUE.
    [Show full text]
  • Environment Mapping Using the Lego Mindstorms NXT and Lejos NXJ
    Environment Mapping using the Lego Mindstorms NXT and leJOS NXJ Gerardo Oliveira 1, Ricardo Silva 1, Tiago Lira 1, Luis Paulo Reis 1,2 1 FEUP – Faculdade de Engenharia da Universidade do Porto, Portugal 2 LIACC – Laboratório de Inteligência Artificial e Ciência de Computadores da Universidade do Porto, Portugal Rua Dr. Roberto Frias, s/n 4200-465 Porto, Portugal {ei04106, ei03087, ei04085, lpreis}@fe.up.pt Abstract. This paper presents a project of simultaneous localization and mapping (SLAM) of an indoor environment focusing on the use of autonomous mobile robotics. The developed work was implemented using the Lego Mindstorms NXT platform and leJOS NXJ as the programming language. The NXJ consists of an open source project which uses a tiny Java Virtual Machine (JVM) and provides a very powerful API as well the necessary tools to upload code to the NXT brick. In addition, the leJOS NXJ enables efficient programming and easiness of communication due to its support of Bluetooth technology. Thus, exploiting the mobile robotics platform flexibility plus the programming language potential, our goals were successfully achieved by implementing a simple subsumption architecture and using a trigonometry based approach, in order to obtain a mapped representation of the robot's environment. Keywords: Lego Mindstorms, NXT, leJOS, NXJ, Java, Robotics, Mapping, Subsumption Architecture, Behavior-Based, Client-Server. 1 Introduction One of the major problems in the field of robotics is known as SLAM (Simultaneous Localization and Mapping) [3], consisting of a technique used by robots and autonomous vehicles to build up a map within an unknown environment while at the same time keeping track of their current position.
    [Show full text]
  • Cult of Lego Sample
    $39.95 ($41.95 CAN) The Cult of LEGO of Cult The ® The Cult of LEGO Shelve in: Popular Culture “We’re all members of the Cult of LEGO — the only “I defy you to read and admire this book and not want membership requirement is clicking two pieces of to doodle with some bricks by the time you’re done.” plastic together and wanting to click more. Now we — Gareth Branwyn, editor in chief, MAKE: Online have a book that justifi es our obsession.” — James Floyd Kelly, blogger for GeekDad.com and TheNXTStep.com “This fascinating look at the world of devoted LEGO fans deserves a place on the bookshelf of anyone “A crazy fun read, from cover to cover, this book who’s ever played with LEGO bricks.” deserves a special spot on the bookshelf of any self- — Chris Anderson, editor in chief, Wired respecting nerd.” — Jake McKee, former global community manager, the LEGO Group ® “An excellent book and a must-have for any LEGO LEGO is much more than just a toy — it’s a way of life. enthusiast out there. The pictures are awesome!” The Cult of LEGO takes you on a thrilling illustrated — Ulrik Pilegaard, author of Forbidden LEGO tour of the LEGO community and their creations. You’ll meet LEGO fans from all walks of life, like professional artist Nathan Sawaya, brick fi lmmaker David Pagano, the enigmatic Ego Leonard, and the many devoted John Baichtal is a contribu- AFOLs (adult fans of LEGO) who spend countless ® tor to MAKE magazine and hours building their masterpieces.
    [Show full text]
  • Lego Mindstorms Segway Project
    AGH - UNIVERSITY OF SCIENCE AND TECHNOLOGY Lego Mindstorms Segway Project Authors of project: Łukasz Bondyra, Paweł Górka, Jakub Tutro, Krzysztof Wesołowski Under the supervision of: Adam Piłat Ph.D. Documentation drawn up by: Łukasz Bondyra WEBSITE: http://home.agh.edu.pl/~ap/segway 2009-04-20 Lego Mindstorms Segway Project Basic Lego Mindstorm project was inspired by Yorihisa Yamamoto. It was developed in the academic research club INTEGRA, working in the Electrical faculty in the AGH – University of Science and Technology. The Lego Mindstorms project is part of the bigger one, which aims to create a Segway human transporter machine. The following works were made: I. Installation of necessary software. All applications need to be installed/extracted to non – space directories. 1. Cygwin 1.5.25-15 - a Linux - like environment for Windows which enables to run some Linux applications in Windows environment. It includes GCC compilator. INSTALATION: Devel Default -> “make: The GNU version of the ‘make’ utility” must be marked. IMPORTANT: Cygwin has to be 1.5.x or newer version. WEBSITE: http://www.cygwin.com 2. GNU ARM toolchain 4.0.2 - a distribution of GCC (GNU Compiler Collection) for ARM core which supports an ARM7 CPU in the NXT INSTALATION: “Floating point unit” doesn’t have to be marked IMPORTANT: Using other version of GCC may cause unexpected errors. WEBSITE: http://www.gnuarm.com/bu-2.16.1_gcc-4.0.2-c-c++_nl-1.14.0_gi-6.4.exe 3. MINDSTORMS NXT Driver v1.02 - This software installs/updates the LEGO MINDSTORMS NXT driver, which enables windows to recognize the NXT.
    [Show full text]
  • LEGO MINDSTORMS NXT Programming
    LEGO MINDSTORMS NXT Programming Bernhard Buchli Andreas Schranzhofer Bernhard Buchli, [email protected], ETZ G 75, +41 44 63 27038 Andreas Schranzhofer, [email protected], ETZ G 77, +41 44 63 20454 09/29/10 Andreas Schranzhofer / Bernhard Buchli 1 NXT Tutorial ± Outline . Software Installation . get the USB ± Stick Folder ¹PPSª . "Hello World!" on NXT . ¹Sensor and Motorª on NXT . References, Documents, Links 09/29/10 Andreas Schranzhofer / Bernhard Buchli 2 Software Installation . NXT connects via USB (or Bluetooth) to PC . Driver available at: http://mindstorms.lego.com/support/updates/ . Programming Environments . Mindstorms NXT Software . Robolab (LabVIEW) . Lejos, RobotC, BricxCC) . Default: BricxCC http://bricxcc.sourceforge.net/ 09/29/10 Andreas Schranzhofer / Bernhard Buchli 3 Starting BricxCC . Connect NXT to the PC . Turn on NXT . Pop-Up Dialog Properties: . port: USB . brick type: NXT . firmware: Standard 09/29/10 Andreas Schranzhofer / Bernhard Buchli 4 Hello World! . C-like programming language: NXC (Not Excactly C) . The obligatory "Hello Worldª: #include "NXCDefs.h" task main() { ClearScreen(); PlayTone(440, 200); TextOut(0, LCD_LINE3, "Hello World!"); Wait(1000); PlayTone(440, 200); Wait(200); } 09/29/10 Andreas Schranzhofer / Bernhard Buchli 5 Compile Upload 09/29/10 Andreas Schranzhofer / Bernhard Buchli 6 The LEGO NXT 09/29/10 Andreas Schranzhofer / Bernhard Buchli 7 Sensor and Motor #include "NXCDefs.h" #define SPEED 70 task main() { int touch; SetSensor(S1, SENSOR_TOUCH); while (true) { touch = SENSOR_1; if (touch == 1) { OnFwd(OUT_A, SPEED); } else { Off(OUT_A); } } } 09/29/10 Andreas Schranzhofer / Bernhard Buchli 8 Mindstorms NXT Software 09/29/10 Andreas Schranzhofer / Bernhard Buchli 9 Lego Digital Designer 09/29/10 Andreas Schranzhofer / Bernhard Buchli 10 Mike©s Lego Cad 09/29/10 Andreas Schranzhofer / Bernhard Buchli 11 References .
    [Show full text]
  • PROJECT No 1: LEGO SEGWAY Or Legway Build Your Own Legway!
    PROJECT No 1: LEGO SEGWAY or LegWay Build your own LegWay! You can find many self balancing NXT robots on the web, but what does it take to make your own Segway? This page won't tell you all the details about self balancing robots, but instead it provides simple step-by-step instructions to creating your own Segway. What will you make? You can create your own LegWay (shown above) during this block week course and program it to move, avoid obstacles and keep its balance. It should balances on two wheels as it drives around any flat hard surface (even sloped surfaces) while avoiding walls and other objects. What do you need? • The HiTechnic Gyro Sensor • A MINDSTORMS NXT set • The programming software that comes with your NXT set The LegWay can be built with Any NXT set. Whether you have You can build the segway with the NXT #8527 set, the NXT 2.0 #8547 , or even the NXT this set plus a Gyro Sensor Education #9797, you can build the Anyway with just the pieces you have. The same goes for the programming software: it doesn't matter which version you have. Building the LegWay Once you've collected everything you need, you are ready to build your LegWay. Follow the figures below and follow the step-by-step building instructions. Make sure that you carefully connect the cables as shown. STEP No. 1: STEP No. 2: STEP No. 3: STEP No. 4: STEP No. 5: STEP No. 6: STEP No. 7: Loading the program The final task if for you to program the robot to behave as expected (i.e., balance on two wheels as it drives around any flat hard surface, and avoids walls and other objects).
    [Show full text]
  • THE EVENT ISSUE Inside: Brickfest® LEGO® World LEGO Fest and More!
    Epic Builder: Anthony Sava THE EVENT ISSUE Inside: BrickFest® LEGO® World LEGO Fest and more! Also: Interviews with Jørgen Vig Knudstorp, Women who Steven Canvin, and Knud Thomson Build with LEGO Building Instructions LEGO Inside Tour AND MORE! LEGO Serious Play Now Build A Firm Foundation in its 4th ® Printing! for Your LEGO Hobby! Have you ever wondered about the basics (and the not-so-basics) of LEGO building? What exactly is a slope? What’s the difference between a tile and a plate? Why is it bad to simply stack bricks in columns to make a wall? The Unofficial LEGO Builder’s Guide is here to answer your questions. You’ll learn: • The best ways to connect bricks and creative uses for those patterns • Tricks for calculating and using scale (it’s not as hard as you think) • The step-by-step plans to create a train station on the scale of LEGO people (aka minifigs) • How to build spheres, jumbo-sized LEGO bricks, micro-scaled models, and a mini space shuttle • Tips for sorting and storing all of your LEGO pieces The Unofficial LEGO Builder’s Guide also includes the Brickopedia, a visual guide to more than 300 of the most useful and reusable elements of the LEGO system, with historical notes, common uses, part numbers, and the year each piece first appeared in a LEGO set. Focusing on building actual models with real bricks, The LEGO Builder’s Guide comes with complete instructions to build several cool models but also encourages you to use your imagination to build fantastic creations! The Unofficial LEGO Builder’s Guide by Allan Bedford No Starch Press ISBN 1-59327-054-2 $24.95, 376 pp.
    [Show full text]
  • Redalyc.Application of Color Sensor Programming with LEGO
    Scientia Et Technica ISSN: 0122-1701 [email protected] Universidad Tecnológica de Pereira Colombia Viedma Ariza, Dayana; Meza Palacio, Aldair; Pertuz Aragón, Isaac; Medrano Pulido, Cristian; Acosta Logreira, Elizabeth; Roldán Mckinley, Javier Application of color sensor programming with LEGO-Mindstorms NXT 2.0 to recreate a simplistic plague detection scenario 6 Scientia Et Technica, vol. 22, núm. 3, septiembre, 2017, pp. 268-272 Universidad Tecnológica de Pereira Pereira, Colombia Available in: http://www.redalyc.org/articulo.oa?id=84954626006 How to cite Complete issue Scientific Information System More information about this article Network of Scientific Journals from Latin America, the Caribbean, Spain and Portugal Journal's homepage in redalyc.org Non-profit academic project, developed under the open access initiative Scientia et Technica Año XXII, Vol. 22, No. 3, septiembre de 2017. Universidad Tecnológica de Pereira. ISSN 0122-1701 268 Application of color sensor programming with LEGO-Mindstorms NXT 2.0 to recreate a simplistic plague detection scenario Aplicación de programación de sensor de color con LEGO-Mindstorms NXT 2.0 para recrear un escenario simplista de detección de plaga Dayana Viedma Ariza 1, Aldair Meza Palacio 1, Isaac Pertuz Aragón 1, Cristian Medrano Pulido 1, Elizabeth Acosta Logreira 2, Javier Roldán Mckinley 3 1: Semillero DIMER Group, Mechanical Engineering, Universidad del Atlántico, Barranquilla, Colombia 2: Semillero Go-Innovations, Industrial Engineering, Universidad del Atlántico, Barranquilla, Colombia 3: DIMER Research Group, Mechanical Engineering, Universidad del Atlántico, Barranquilla, Colombia [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] Abstract — A hands-on assignment framed under the learning by on rose using Open CV [6] and severity of the damage on the project approach was assigned trying to offer an engaging theme coffee leaves using Matlab [7], among others.
    [Show full text]
  • BASIC ROBOT BUILDING with LEGO Mindstorms NXT 2.0
    BASIC ROBOT BUILDING with LEGO Mindstorms NXT 2.0 John Baichtal 800 East 96th Street, Indianapolis, Indiana 46240 USA ii Basic Robot Building with LEGO Mindstorms NXT 2.0 Basic Robot Building with Editor-in-Chief LEGO Mindstorms NXT 2.0 Greg Wiegand Executive Editor Copyright © 2013 by John Baichtal Rick Kughen All rights reserved. No part of this book shall be reproduced, stored in a retrieval system, or transmitted by any means, electronic, mechanical, Development Editor photocopying, recording, or otherwise, without written permission from Rick Kughen the publisher. No patent liability is assumed with respect to the use of the information contained herein. Although every precaution has been Managing Editor taken in the preparation of this book, the publisher and author assume Sandra Schroeder no responsibility for errors or omissions. Nor is any liability assumed for damages resulting from the use of the information contained herein. Project Editor Seth Kerney ISBN-10: 0-7897-5019-8 ISBN-13: 978-0-7897-5019-8 Copy Editor Chuck Hutchinson Library of Congress Cataloging-in-Publication data is on fi le. Indexer Printed in the United States of America Ken Johnson First Printing: December 2012 Proofreader Trademarks Paula Lowell All terms mentioned in this book that are known to be trademarks or Technical Editor service marks have been appropriately capitalized. Que Publishing cannot James F. Kelley attest to the accuracy of this information. Use of a term in this book should not be regarded as affecting the validity of any trademark or service mark. Publishing Coordinators Warning and Disclaimer Cindy Teeters Romny French Every effort has been made to make this book as complete and as accurate as possible, but no warranty or fi tness is implied.
    [Show full text]
  • The VU-LEGO Real Time Target: Taking Student Designs To
    AC 2011-2476: THE VU-LEGO REAL TIME TARGET: TAKING STU- DENT DESIGNS TO IMPLEMENTATION James Peyton Jones, Villanova University James Peyton Jones is Director of the Center for Nonlinear Dynamics & Control and Professor of Electri- cal & Computer Engineering at Villanova University Connor W McArthur, Villanova University Connor McArthur is an undergraduate at Villanova Unversity studying Computer Engineering and Com- puter Science. Tyler A Young, villanova University Tyler Young is a senior Computer Engineer and research assistant at Villanova University. Page 22.1516.1 Page c American Society for Engineering Education, 2011 The VU­LEGO Real Time Target: Taking Student Designs to Implementation J.C. Peyton Jones, C. McArthur, T. Young Center for Nonlinear Dynamics & Control, Villanova University Abstract The use of embedded / mechatronic systems in teaching is being revolutionized by a) the advent of increasingly powerful yet low-cost computational devices and sensors, and b) by modern Automatic Code Generation tools which allow these devices to be programmed directly from high-level designs - without the difficulties traditionally associated with low level embedded system programming. This paper describes progress on a National Science Foundation, MathWorks and Nokia sponsored project aimed at exploiting these developments for practical use and benefit in the classroom. Specifically, the paper describes a new toolchain which enables students to access the hardware capabilities of the 32-bit LEGO NXT brick from within the Matlab / Simulink environment, and to automatically generate and cross-compile the necessary code for real time autonomous implementation. LEGO hardware I/O is represented in the Simulink design mode as blocks for accessing motors, encoders, push-buttons, ultrasound sensors, light sensors and more.
    [Show full text]