Table of Contents 1.0 Project Overview 1.1 Introduction/Project Vision 1.2 Project Description 2.0 Project Platform(s) 3.0 Functionality 3.1 Explanation of Functionality 3.2 Example of Functionality 3.2.1 Translating Names of Items 3.2.2 Translating Conversations 3.2.3 Translating Text 3.3 Technology 4.0 Text and Graphic Requirements 4.1 General Look and Feel 4.2 Basic Content Description 4.3 Typographic Requirements 4.4 Type and Font Selection 4.5 Type Style Guide 5. Project Summary 6. Works Consulted 1 Nicole Dupuis Typography for Interactivity Professor Norbert Florendo Typography For Interactivity DGM 6217 Final Project Paper 1.0 Project Overview 1.1 Introduction/Project Vision The intended user will be an individual who wants an immersive language experience. The user could potentially be an individual who cannot learn a language immersively based on constraints of location or an individual who is in a new environment and wants to learn the local language quickly. The project is intended to improve knowledge of a language quickly and efficiently. 1.2 Project Description Bravado is a eyewear AR (augmented reality) accessory that translates the surrounding text, item names and conversation around the user. Bravado is intuitive in nature and will translate the surrounds based on technology that will capture what the user is looking at. The name Bravado comes from a Spanish term “bravata” meaning “brave”. I believe the application will be able to give a user some much confidence that they will be able to communicate in foreign environment bravely and confidently. 2.0 Project Platform(s) The clip on accessory will be fully synced to Google Translate via bluetooth or wifi.The device software is based off of Google Translate; if Google Updates it will be reflected in Bravado. Bravado will clip onto the arm of one side of the user’s eye glasses while a bone conduction attachment can be attached on the other side (for translation via sound) (“Bravado”, n.d.). 3.0 Functionality 3.1 Explanation of Functionality Bravado will be fully intuitive and based off of eye sensing and gyroscope technology. The attachment will be powered with a lithium ion battery that will be charged via a usb port. The visual part will be made with a LCoS prism, similar to the Google Glass prototype, but 2 removable. The device will be paired with Google Translate (IOS app) via bluetooth and wifi. A frontwards facing camera will capture the surroundings and translate objects that are in direct line of the user's view. The device will locate the user's eye movement from an inward facing camera to accurately estimate what the user is looking at and translate either the object, word, or sentence the user is looking at. The user will also translate conversation if the setting on the application is selected to be on. The microphone will then translate the conversation to the chosen language and then the user can then speak in their native language and translate it via the device. The translation will show up visually on the prism and can be pronounced the bone conduction attachment. 3.2 Example of Functionality 3.2.1 Translating Names of Items The user will simply look at the object that they will want to know the translation for and Bravado will determine the name of the object, run the name or word of the object through google and return the translation in both the native language and selected language next to the object. 3.2.2 Translating Conversations The user will simply focus on the person who is initiating the conversation and Bravado will identify the language spoken and the translate it through Google into the language preference the user has selected. 3.2.3 Translating Text The user will look at the text they want to translate (such as a historical plaque or street sign) and Bravado will determine properly what text they are looking at. Bravado will then determine what the text says, natively and then return a translation into the user's prefered language. 3.3 Technology Before most head mounted displays or HDMs simply projected an image or symbol onto the wearer’s visor or reticle. The image would appear static in the user’s view and would not adjust to the users position. Today, HDMs now incorporate a positioning system that tracks the user’s head position and angle so that the image is in harmony with the user’s environment. Eye trackers besides for gyroscopes aid determining what the user is looking at and determines what the display on the screen. The screens are made of partly silvered mirrors, it can reflect artificial images and let real images across the lens of the user’s view (“Head-mounted display”, 2017). 3 Prism in 2012 Google first introduced “Project Glass” which would help you “explore and share your world”. This prototype of an AR device had an interactive viewing area over the frame of the right eye. As of 2014, the device could not overlay the digital information over physical locations. Though I am not trying to recreate Google Glass, their idea and design are on the edge of AR technology today. By applying their current technology, making it more accessible and focusing it down to just language, I am trying to create a solution that many people have faced during schooling, travel, family gatherings and everyday interaction. The technology google has incorporated in its prototypes are proven to be reliable and able to complete tasks without a massive load on battery or time. (Strickland, J., July 29, 2017) The type of “screen” that other AR, glasses compatible companies are using is Liquid crystal on silicon or LCoS. It is a “miniaturized reflective active-matrix liquid-crystal display or "microdisplay" using a liquid crystal layer on top of a silicon backplane.”. To go into further detail, “in a “In a LCoS display, a CMOS chip controls the voltage on square reflective aluminum electrodes buried just below the chip surface, each controlling one pixel.” LCoS were initially developed for larger projection screens but are now being used for smaller sized, lower power consumption devices such as Google Glass. These smaller devices are often used with ferroelectric liquid crystals (FLCoS) which are faster than other types of liquid crystals and produce high quality images. Google Glass is know to use a near-eye LCoS display and chip from Himex Technologies. (“Liquid crystal on silicon” June, 15, 2017) 4.0 Text and Graphic Requirements 4.1 General Look and Feel The overall visual style of this project is clean and simple and to use fonts that the reader can easily read with speed so that the user can learn a language without any barriers. For branding purposes, I have chosen contrasting oranges and blues (orange usually conveys confidence). To illustrate the “average” user, I have created a persona named Ingrid to highlight the traits and trends the users would have. 4.2 Basic Content Description Using similar technology as Google Glass, the resolution will be 640x360. Headers will be 28 pixels, body text will be 24 pixels and will be scrollable with eye motion if the text is too long for the screen resolution. The goal is to display small amounts of translated information so that the user can quickly absorb the information and move normally in their environment (“What’s inside…”, n.d.) 4 4.3 Typographic Requirements Roboto is the main font used by Google Translate and other Google apps. Roboto though does not support character based languages such as Chinese and Japanese. To support such languages, Google uses Noto which Bravado will also incorporate for consistency. Since I am using Europa for headers, Noto will be used as a substitute as well (P., n.d.). For the purposes of this project, Noto is not shown. 5 4.4 Type and Font Selection Below are the two fonts that are used throughout the application 6 4.5 Type Style Guide 5. Project Summary What influenced my project was being surrounded by students, friends and family who have the difficulty of learning a new language. There are many times where I had to stop and manually look up a word in a different language which took time that could be used to converse with someone. It would of been much better in terms of time and frustration to have the word magically appear and then know what context to use the word in. I have also struggled to learn my family’s native language of Italian since there are very few speakers left. If I had the ability to practice seamlessly and instantly, I believe I could of retained the language more and learned the language in a more timely fashion. 7 6. Works Consulted Bravado. (n.d.). Retrieved June 19, 2017, from http://www.dictionary.com/browse/bravado ​ ​ Head-mounted display. (2017, June 18). Retrieved June 19, 2017, from https://en.wikipedia.org/wiki/Head-mounted_display https://www.google.com/search?q=google+glasses+view&source=lnms&tbm=isch&sa=X&ved= 0ahUKEwjxyd6F7N7UAhVKWz4KHenOCz4Q_AUICygC&biw=1078&bih=631#imgrc=hP lJX9rPmPqOkM: ​ https://www.google.com/search?q=google+glasses+view&source=lnms&tbm=isch&sa=X&ved= 0ahUKEwjxyd6F7N7UAhVKWz4KHenOCz4Q_AUICygC&biw=1078&bih=631#imgrc=TN rcoPZHCnBtTM: ​ Liquid crystal on silicon. (2017, June 15). Retrieved June 19, 2017, from https://en.wikipedia.org/wiki/Liquid_crystal_on_silicon P. (n.d.). Roboto font does not cover Chinese and Japanese signs · Issue #110 · podlove/podlove-subscribe-button. Retrieved June 29, 2017, from https://github.com/podlove/podlove-subscribe-button/issues/110 Strickland, J.