SOFTWARE DESIGN INVITATIONAL SUBMISSION PROPOSAL

Application Name: Live Book

Team Name: 3KC Return

Team Members (Name & School) 1) Prachaya Phaisanwiphatpong, Kasetsart University 2) Vasan Jiaramaneetwesin, Chulalongkorn University 3) Jatupon Sukkasem, Kasetsart University 4) Pathompol Saeng-Uraiporn, Kasetsart University

1. Short Description

Due to there are lots of people, especially World rural area peoples (781 millions), still do not have literacy skill. Live Book is software project aim to improve their literacy by enables them to directly learn reading, writing, listening and speaking from any given local books. With only putting any general text-book in front of Web Camera, the system will automatically capture paragraph on each pages, do character recognize, and transform each word into graphical new ones on screen, with attractive imaginary presenting its original description and vocabulary on paragraph, showing its meaning and teach them how to read it in the right way. Finally, learner can study any local books although they have no ability to read featly.

2. User Scenarios

1. Bob, unfortunately teen in poverty, his community contain lots of old second- handed book which is seemed very ancient and boring. Nothing gives him motivation to do reading until the librarian suggests him to turn those ancient books on library computer. Then, everything change! Live Book program digitize any boring text book into a new excited one. Bob is impressed by what inside his Book. He also gets guideline how to read and finish it at his home.

2. Frank, mid-aged uneducated merchant, never has an ability read and write effectively. He wants to learn to read newspaper but his son seems too busy with his full-time work. And, Frank does not want to bother his time either. Live Book is a solution for him. Frank can understand every newspaper from every single day by himself without bothering his son much. This way also improves his literacy skill too.

3. Tom, a newly parent, considers Computer & IT is very important to his kids but there is not any IT books for kid in his house. So he picks one of his university textbook in front of “Live Book program”. The screen will render its text into Computer component as graphical object. Tom’s kids will feel very excite and eager to learn new thing from simple vocabulary.

4. Alice, kindergarten kids, was bored with basic writing practice. So Alice’s mother convinces her to write word “ELEPHANT” in front of “Live Book program”. Then, Alice will see the real elephant one walking on the computer screen, which makes Alice try to write different words for seeing what next will be shown.

5. Bill Gates, the multi-millionaire, wants to make big charity by building many of libraries around rural area. Instead of containing only books and computer, Integrating Live Book Software will provide an unlimited ability for uneducated people to understand every single book in the library.

3. Functional and non-functional requirements

3.1 Functional Requirement

 Video Streaming Input: response for video streaming input. All of which need to be accurate and fast capture. o Implementation: Capture input streaming from each port to buffer memory. DirectX technology, included DirectPlay, is used to develop efficient input in a high level programming. o Requirement: fast and active, > 40 fps are preferred

 Recognizing: response for capture any text from given Bitmap, provide function as follow o Optical Character Recognizing (OCR) . Implementation: normalize bitmap and use vector pattern matching technique to identify each character . Requirement: fast and accurate, more than 90% of recognized word correct

 Matching: response for matching given words list to information database. o Implementation: comparing each given word to the sorted index of encyclopedia dictionary. Synonym word will also be considered o Requirement: fast and accurate matching to information source

 Filtering: is used to filter the difficulties of vocabulary due to learners’ skill and also prevent inappropriate word for such violence, drag or adult content, also to prevent innocent kids from harmful things. So “Live Book” is cleaned.

 Rendering: response for render graphical images corresponding to its text o Implementation: use Windows Presentation Foundation rendering for the fast and high performance graphic computing. 3D graphic rendering is also used. o Requirement: fast and high resolution graphic

 Searching: provide speech searching function to find specific word on pages by speech o Implementation: use Speech API (SAPI) to do and text-to-speech function o Requirement: fast and accurate word searches by speech

3.2 Non-Functional Requirement

On top of the mentioned basic quality, the developer also consider significant of the detail in parts to support the efficiency of “Live Book” so the best results will be archived as following:

 Attractive with Excite look and feel: The program has beautiful and attractive appearance which will help to attract the interest of the learner.  Active rendering: Visual and sound are clear, can play continuously, no interruption. Visual graphic will have equal quality and move forward together with the present continuous changing technology.  Knowledge based content: “Live Book” aims to provide children more knowledge, starting with basic vocabulary. Content representing on “Live Book” should be 100% knowledge enhancing. So we co-operating with Microsoft Encarta Encyclopedia

4. Summary of Application Components

 Detector Component: response for capturing image of book from camera. This component is attached to hardware device in order to retrieve raw data and send it to Analyzer Component.  Analyzer Component: response for analyzing raw data sent by Detector Component and returns the analyzed data to requesting component which include OCR (Optical Character Recognition) and HCR (Handwritten Character Recognition).  Translator Component: response for transforming any words into image or video relevant to its text.  Renderer Component: response for rendering 3D image of book with animated picture on the book.

5. Technologies/Resources Used in the Application

Core Technology  Microsoft Visual Studio 2005  Microsoft .NET Framework 3.0  SDK - Microsoft Windows Presentation Foundation (WPF)  Web Services Character and Speech recognized technology  OCR Module: to recognize word on the book.  Microsoft Speech API (SAPI) Supplement Content  Microsoft Encarta Integration  Wikipedia Integration

6. Architectural Overview

(Picture show: Architecture of overall “Live Book” project)

7. User Interface Prototype/Examples

(Picture show: example of “Live Book” project)