1. INTRODUCTION

The computer mouse was invented in 1960s and it went through many revisions regarding its functionality and features since then. According to folks from Celluon who came up with EvoMouse, it is the evolution of the computer mouse which allows you to emulate the mouse with gestures of your hand. The EvoMouse works on a similar principle as the Mouse less interface we wrote about last year, but its design is more polished and it looks like a small digital animal. Its two sensors which form the eyes of the animal project an area in which your hands can function as if you really were using a mouse. The EvoMouse is the evolution of the computer mouse. Meet EvoMouse Pet, a dog-shaped device that turns any surface into a touchpad. Tracking your fingers, it lets you do anything a regular mouse can do, and then some. The EvoMouse works on nearly any flat surface and requires very little space. It tracks effortlessly to your comfortable and natural movements. With the EvoMouse, you can perform common mouse operations using only your fingers. You can control the cursor, click and select, double-click, right-click and drag with hand gestures.

- 1 -

2. HISTORY

2.1 EARLY MOUSE

The first functional mouse was actually demonstrated by Douglas Engelbart, a researcher from the Stanford Research Institute, back in 1963. The respective peripheral was far away from what we know today as “mice,” given the fact that it was manufactured from wood and featured two gear-wheels perpendicular to each other, the rotation of each single wheel translating into motion along one of the respective axis.

It’s not exactly very clear where the name “mouse” originates, since, apparently, the name came from the fact that the device had a “tail” behind it, connecting it to a computer and a display and was the idea of Bill English, a colleague of Douglas Engelbart’s and the person who actually built the prototype device.

Engelbart's product was not the first pointing device, though. In fact, it seems that the first such product, the trackball, was invented a lot earlier, namely at some point in 1953, by Tom Cranston, Fred Longstaff and Kenyon Taylor from the Royal Canadian Navy, as part of the secret military project DATAR. The name “trackball” comes from the fact that the respective device actually used a standard Canadian five-pin bowling ball.

- 2 -

Fig: 2.1 Earlier Mouse’s

- 3 -

2.2 MECHANICAL MOUSE

German company Telefunken published on their early ball mouse, called "Rollkugel" (German for "rolling ball"), on October 2, 1968. Telefunken's mouse was then sold commercially as optional equipment for their TR - 440 computers, which was first marketed in 1968. Telefunken did not apply for a patent on their device. Bill English, builder of Engelbart's original mouse, created a ball mouse in 1972 while working for Xerox PARC. It is also called as Roller ball mouse.

The ball mouse replaced the external wheels with a single ball that could rotate in any direction. It came as part of the hardware package of the Xerox Alto computer. Perpendicular chopper wheels housed inside the mouse's body chopped beams of light on the way to light sensors, thus detecting in their turn the motion of the ball. This variant of the mouse resembled an inverted trackball and became the predominant form used with personal computers throughout the 1980s and 1990s. The Xerox PARC group also settled on the modern technique of using both hands to type on a full-size keyboard and grabbing the mouse when required.

Fig.2.2 Mechanical mouse, shown with the top cover removed

The ball mouse has two freely rotating rollers. They are located 90 degrees apart. One roller detects the forward – backward motion of the mouse and other the left – right motion. Opposite the two rollers is a third one (white, in the photo, at 45 degrees) that is spring - loaded to push the

- 4 - ball against the other two rollers. Each roller is on the same shaft as an encoder wheel that has slotted edges; the slots interrupt infrared light beams to generate electrical pulses that represent wheel movement. Each wheel's disc, however, has a pair of light beams, located so thata given beam becomes interrupted, or again starts to pass light freely, when the other beam of the pair is about halfway between changes

Simple logic circuits interpret the relative timing to indicate which direction the wheel is rotating. This incremental rotary encoder scheme is sometimes called quadrature encoding of the wheel rotation, as the two optical sensor produce signals that are in approximately quadrature phase. The mouse sends these signals to the computer system via the mouse cable, directly as logic signals in very old mice such as the Xerox mice, and via a data-formatting IC in modern mice. The driver software in the system converts the signals into motion of the mouse cursor along X and Y axes on the computer screen.

The ball is mostly steel, with a precision spherical rubber surface. The weight of the ball, given an appropriate working surface under the mouse, provides a reliable grip so the mouse's movement is transmitted accurately.

Fig.2.3 Mechanical Mouse

Operating an optic-mechanical mouse:

1. Moving the mouse turns the ball. 2. X and Y rollers grip the ball and transfer movement

- 5 -

3. Optical encoding disks include light holes. 4. Infrared LEDs shine through the disks. 5. Sensors gather light pulses to convert to X and Y vectors.

2.3 OPTICAL MOUSE

Optical mice make use of one or more light-emitting diodes (LEDs) and an imaging array of photodiodes to detect movement relative to the underlying surface, rather than internal moving parts as does a mechanical mouse. A laser mouse is an optical mouse that uses coherent (laser) light.

The earliest optical mice detected movement on pre-printed mouse pad surfaces, whereas the modern optical mouse works on most opaque surfaces; it is unable to detect movement on specular surfaces like glass. Laser diodes are also used for better resolution and precision. Battery powered, wireless optical mice flash the LED intermittently to save power, and only glow steadily when movement is detected.

Fig.2.4 Optical Mouse

Often called "air mice" since they do not require a surface to operate. It uses a tuning fork or other accelerometer to detect rotary movement for every axis supported. The most common models (manufactured by Logitech and Gyration) work using 2 degrees of rotational

- 6 - freedom and are insensitive to spatial translation. The user requires only small wrist rotations to move the cursor.

Usually cordless, they often have a switch to deactivate the movement circuitry between use, allowing the user freedom of movement without affecting the cursor position. A patent for an inertial mouse claims that such mice consume less power than optically based mice, and offer increased sensitivity, reduced weight and increased ease-of-use. In combination with a wireless keyboard an inertial mouse can offer alternative ergonomic arrangements which do not require a flat work surface, potentially alleviating some types of repetitive motion injuries related to workstation posture.

Fig.2.5 Wireless optical mouse

2.4 LASER MOUSE

The laser mouse uses an infrared laser diode instead of a LED to illuminate the surface beneath their sensor. As early as 1998, Sun Microsystems provided a laser mouse with their Sun SPARC station servers and workstations. However, laser mice did not enter the mainstream market until 2004, when Paul Machine at Logitech, in partnership with Agilent Technologies, introduced its MX 1000 laser mouse. This mouse uses a small infrared laser instead of a LED and has significantly increased the resolution of the image taken by the mouse. The laser enables around 20 times more surface tracking power to the surface features used for navigation compared to conventional optical mice.

- 7 -

Fig.2.6 Structure of Laser mouse

Glass laser (or Glaser) mice have the same capability of a laser mouse but can also be used on top of mirror or transparent glass with few problems.

In August 2009, Logitech introduced mice with two lasers, to track on glass and glossy surfaces better. These mice are considered as effective, sensitive and accurate devices as they support better tracking ability. With its user – friendly interface, this mouse is used by those users, who perform highly skilled jobs. One of the positive outcomes of this mouse is its energy efficient component that consumes lesser electricity when in use.

Fig.2.7 Laser Mouse

- 8 -

2.5 GYROSCOPIC MOUSE

There are a number of computer pointing devices (in effect a mouse) on the market that have gyroscopes inside them allowing you to control the mouse cursor while the device is in the air! They are also wireless so are perfect for presentations when the speaker is moving around the room. The gyroscope inside tracks the movements of your hand and translates them to cursor movements.

Fig.2.8 Gyroscopic mouse

2.6 3D MOUSE

Also known as bats, flying mice, or wands, these devices generally function through ultrasound and provide at least three degrees of freedom. Probably the best known example would be 3D connexion / Logitech's Space Mouse from the early 1990s. In the late 1990s, Kantek introduced the 3D Ring Mouse. This wireless mouse was worn on a ring around a finger, which enabled the thumb to access three buttons. The mouse was tracked in three dimensions by a base station. Despite a certain appeal, it was finally discontinued because it did not provide sufficient resolution.

- 9 -

Fig: 2.9 3D Mouse

A recent consumer 3D pointing device is the Remote. While primarily a motion-sensing device (that is, it can determine its orientation and direction of movement), Remote can also detect its spatial position by comparing the distance and position of the lights from the IR emitter using its integrated IR camera. The obvious drawback to this approach is that it can only produce spatial coordinates while its camera can see the sensor bar.

A mouse-related controller called the Space Ball has a ball placed above the work surface that can easily be gripped. With spring-loaded centring, it sends both translational as well as angular displacements on all six axes, in both directions for each. In November 2010 a German Company called Axsotic introduced a new concept of 3D mouse called 3D Spheric Mouse. This new concept of a true six degree-of-freedom input device uses a ball to rotate in 3 axes without any limitations.

- 10 -

Fig.2.10 Working with 3D Mouse

- 11 -

3.EVO MOUSE

3.1 INTRODUCTION

The EvoMouse is the evolution of the computer mouse. It is the latest and portable device which is the most cutting version of the mouse today. Evo Mouse is a dog – shaped device that a dog-shaped device that functions differently and not like the other mice. It turns any surface into a touchpad. With the Evo Mouse, you can perform common mouse operations by using only your fingers. It works on nearly any flat surface and requires very little space. It tracks effortlessly to your comfortable and natural movements.

Fig.3.1 EvoMouse

The Celluon Evo Mouse is easy and convenient to set up and use. It can connect wirelessly via Bluetooth or by using standard USB port with any device like smart phones, tablets, laptops, computers, etc. It works with almost any desktop or laptop computer. The Evo Mouse changes the way to interact with the computer by allowing you to use natural hand movements and gestures in order to control the on – screen cursor.

- 12 -

Fig.3.2 Connected to Laptop

The mouse, sometimes it is your best friend and sometimes it is the carpal tunnel inducing,

Hand cramping pain in the buttocks, but what if it didn’t have to give you those cramps? What if users. But despite challengers such as the trackball, the WOW-PEN Joy, the Ergo Slider Plus, the Orbita Mouse and the Air Mouse – just to name a few – the mouse has maintained its dominance while remaining largely unchanged since its unveiling in 1968. Now there’s another

Instead of forcing your hand to conform to the position it wants you in, it would let you use your

Natural hand, in whatever way you want?

With the plethora of mouse alternatives available or in development you’d be forgiven for thinking the humble computer mouse was some kind of torturous device inflicted upon computer alternative cursor relocation device set to hit the market called the evoMouse that turns just about any surface into a virtual track pad with your finger as the flat pointer.

3.2 TECHNOLOGY USED

In the Celluon Evo Mouse device, the technology is basically made up of two principle components:

 3D Electronic Perception Sensor Chips  Image Processing Software

- 13 -

3.2.1 3D Electronic Perception Technology:

The company launched publicly at PC Forum in 2002, announcing its CMOS-based single chip 3D image sensing technology. Described as “electronic perception technology”, the company promotes its technology as enabling everyday machines and digital devices with the ability to “see.”

In 2002, at Demo Mobile the company announced its first application, a projection keyboard for mobile devices. In this application, a keyboard made of light is projected onto a flat surface, the user types on the flat surface, and Canesta’s electronic perception technology translates finger movements into keystrokes in the device. The company subsequently licensed the technology to Celluon of Korea.

The company later focused on the automotive applications of its technology, securing investment from Honda, and promoting its technology at public automotive industry forums such as Convergence 2006. Interior occupant sensing for advanced airbag deployment and rear obstacle detection are two example applications.

The company recently turned its attention to the video game space where its technology forms the basis of a unique input mechanism that enables new immersive game experiences.

On October 29, 2010, it was announced that would acquire Canesta for an undisclosed amount, stating that their partnership would assist in the development of natural user interfaces and spread the adoption of their technology into a wider array of products. Microsoft had developed a similar motion controller for its 360 game console. Canesta is a fabless semiconductor company founded in April 1999 by Cyrus Bamji, Abbas Rafii, and Nazim Kareemi. The company manufactures CMOS-based single chip 3D sensors, which can be used as part of input systems for electronic devices. On October 29, 2010, Canesta announced that it would be acquired by Microsoft for an undisclosed amount. Canasco was formed as an asset holding company of Canesta to transition and wind down Canesta.

Electronic Perception Technology (EPT) is a low cost, single chip imagining technology that enables electronic components to form a 3D map of their surroundings and see what their

- 14 - users are doing. One of the first applications is “Virtual keyboard”, a system that projects a laser keyboard onto a table and detects which keys the user is pressing by watching their hands and sensing which spots on the table their fingers are touching.

By sending out pulses of light and timing how long it takes for the reflection to return to the sensor, EPT systems can determine depth. EPT systems can accurately determine brightness and distinguish objects from one another.

In a manner similar to radar, where the range to a remote object is calculated through various methods, Canasta's chips develop 'distance maps' to points in the image of a nearby object, and hand this information to an on-chip processor running the imaging software. That software further refines the 3D representation of the image before sending it off chip for application- specific processing. The chips do this repeatedly, generating over 50 frames of 3D information per second.

Canesta’s time-of-flight technology consists of an array of pixels where every pixel can independently determine the distance to the object it sees. This array is in effect a massively parallel LIDAR on a single CMOS chip. At the heart of the technology is a proprietary silicon photo collection structure in each pixel that allows accurate measurement of the arrival time of the collected photons. This photo collection structure is substantially immune to CMOS surface defects that ordinarily adversely affect time of flight operation. This enables time of flight ranging using a low cost CMOS process.

Using Canesta technology a 3D time-of-flight camera can be constructed from a Canesta CMOS time of flight sensor, an imaging lens to focus the light from the scene onto the sensor and an LED or laser diode based light source controlled by the sensor to illuminate the scene with near infrared light.

- 15 -

Fig.3.3 Example of EPT

3.2.2 Image Processing:

Image Processing is any form of signal processing for which the input is an image, such as a photograph or video frame; the output of an image processing may be either an image or a set of characteristics or parameters related to an image. Most image processing techniques involve treating an image as a two – dimensional signal and applying standard signal processing techniques to it. Image processing usually refers to the digital image processing, but optical and analog image processing are also possible.

An image processing operation that is used to spatially filter an image. A convolution is defined by a kernel that is a small matrix of fixed numbers. The size of the kernel (3x3, 5x5, 7x7, 9x9) the numbers within it, and a single normalize value define the operation that is applied to the image.

The kernel is applied to the image by placing the kernel over the image to be convolved and sliding it around to center it over every pixel in the original image. At each placement the numbers (pixel values) from the original image are multiplied by the kernel number that is currently aligned above it.

- 16 -

The operation, as defined by the kernel, is applied to all pixels in the original data matrix with the exception of those pixels that form the edge of the matrix. A new output matrix of the same size, but with different pixel values results.

The sum of all these products is tabulated and divided by the kernel's normalizer. This result is placed into the new image at the position of the kernel's center. The kernel is translated to the next pixel position and the process repeats until all image pixels have been processed.

As an example, a 3x3 kernel holding all 1's with a normalizer of 9 performs a neighborhood averaging operation. Each pixel in the new image is the average of its 9 neighbors from the original.

Image processing software

• CVIPtools (Computer Vision and Image Processing tools) • Intel Open Computer Vision Library • Microsoft Vision SDL Library • Matlab • Khoros

Fig.3.4 Image Processing

- 17 -

4. HOW IT WORKS...?

The EvoMouse pet looks like a small box with legs, almost like a crouching animal. It turns any flat surface into a virtual track pad with your finger as the pointer and there is no more pushing around a physical mouse. It sits right at the position where you would usually place a mouse and through its two infrared sensors that look like eyes, it allows the usual mouse functions. The two lasers coming out of this device track your fingers or pen which you use as mouse on the surface.

Fig.4.1 Pointing on EPT

Using the similar technology to projected laser keyboards, the EvoMouse lets you move your on-screen cursor without the use of a mouse. Just drag your finger over the area of projected light to move the cursor where you want it to be. However, just like the conventional mouse, this mouse functions. For instance, tap once with your finger which indicates a click, double tapping means double clicking, next finger tapping means right click and double finger tapping at once and dragging means scrolling the page. The EvoMouse also features multi-touch functionality including scroll, rotate and zoom, forward and back. The EvoMouse can even be used for handwriting recognition with your finger or a pen.

- 18 -

4.1 More Interesting

What’s even more interesting is that the EvoMOUSE can be connected wirelessly via Bluetooth or can be wired via USB. Yes, you heard it right! The EvoMOUSE is a USB peripheral so you don’t have to worry about charging it all the time. However, if you choose to use it wirelessly, you can have it running for two hours once charged.

Fig.4.2 Mouse connected Through USB

- 19 -

5. PRINCIPLE AND COMPONENTS

 The basic principles of EVO mouse: Celluon use the "TIME OF FLIGHT" principle to detect the motion of object.  Basic component of this technology: IR pulse emitter - you can see the rectangle at the bottom. IR TOF CMOS sensor: On the head of the cute shape between the two LEDs. (LEDs here are indicators of system in operation, not for TOF function.)

Fig. 5.1 Components of EvoMouse

- 20 -

6. FUNCTIONS OF EVO MOUSE

 Beyond conventional mouse functions such as cursor control, right and left clicking, dragging and double-clicking, the Evo Mouse offers multi touch capabilities, letting you rotate and zoom on images and scroll text using gestures.

Fig.6.1 Functions of EvoMouse

 Using your finger or even a pen to write in your own digital handwriting.

- 21 -

Fig.6.2 Digital Handwriting

 Using your finger or a pen you can paint on digital drawing sheet or in a paint program like paint or draw, etc.

- 22 -

Fig. 6.3 Paint or Draw

6.1 EVO MOUSE SPECIFICATIONS

 Evolution of the computer mouse.  Finger works as a pointer.  Works almost on any surface.  Little space needed.  Using your fingers you can control the cursor, click and select, double-click, right-click and drag with basic hand gestures.  Multi-touch functionality including scroll, rotate, zoom, forward and back.  Works with all desktop & laptop PC.  Evo Mouse can even be used for handwriting recognition with your finger or a pen.  It connects via Bluetooth or a standard USB port.

- 23 -

 If you choose to use it wirelessly, you can have it running for two hours once charged.

Fig.6.4 Mouse

- 24 -

7. COMPATIBILITY

In terms of compatibility, it works with PCs and laptops with Windows XP, Vista or Windows 7 as operating systems. Moreover, it works with your Windows Mobile, Blackberry and Symbian devices.

We say it is portable, and fits perfectly for people on-the-go. However, if you’re much of a gamer, it may take a little while before you master its functions and find it helpful.

Fig.7.1 Working with EvoMouse

- 25 -

8. ADVANTAGES AND DISADVANTAGES

Advantages:

 It’s small enough to take with you, and connects either wirelessly via Bluetooth or plugged in with a USB cable.  This device requires very little space.  Works as a multi touch mouse.  The best advantage of the EvoMOUSE is that you don’t use it like an ordinary PC or Mac mouse. Instead, the way it operates by letting your fingers do the moving naturally reduces the risk of repetitive stress injuries such as the dreaded Carpal Tunnel Syndrome

 We say it is portable, and fits perfectly for people on-the-go.

Disadvantages:

 Charging existing for only 2hours once charged.

- 26 -

9. APPLICATIONS

 This device works with Mac, phone, iPad, and iPod touch, windows, Android.  it works with PCs and laptops with Windows XP, Vista or Windows 7 as operating systems. Moreover, it works with your Windows Mobile, Blackberry and Symbian devices.  It takes input from virtual keypad i.e. recognizing keystrokes.

- 27 -

10. CONCLUSION

The evoMouse is presented by its creators as « the evolution of the mouse », as its name suggests. This is a small device that connects via USB or Bluetooth to a computer, which has laser sensors that detect movements by the user. This device can perform actions such as with an ordinary mouse, except that there is no mouse.

Actions similar to those made on a touch pad complement the opportunities for interaction with the device, which manages the multitouch and handwriting recognition.

To some extent, evoMouse recalls keyboards projection that allows, for some time now, to project a keyboard onto a surface to move a bulky device. According Celluon, such a device instead of a mouse brings not only new interactions with the computer, but also reduces tension in the wrist. Celluon has not yet announced pricing and availability for evoMouse, which will probably be put on the market this year.

- 28 -

BIBLOGRAPHY

1. http://celluon.com/products_em_overview.php 2. http://www.gizmag.com/celluon-evomouse/18137/ 3. http://blog.ziggytek.com/2011/03/17/cellulon-evomouse-the-next-generation-of-mousing- technology/ 4. http://www.pocket-lint.com/news/30734/evomouse-launches-pet-and-cube-variants 5. http://elechub.com/evo-mouse/ 6. http://techdunes.com/2012/01/14/evolution-in-computer-mouse-technology-evomouse/ 7. http://www.tomsguide.com/us/Celluon-evoMouse-Finger-Tracking-Infra-red,news- 5596.html 8. http://celluon.com/shop_evo_mouse.php

- 29 -