International Journal of Mathematics and Computer Applications Research (IJMCAR) ISSN 2249-6955 Vol. 3, Issue 2, Jun 2013, 175-182 ©TJPRC Pvt. Ltd. IMPLEMENTATION OF ANDROID BASED MOBILE PHONE CRAWLERS SRASHTI GUPTA1 & KUNAL GUPTA2 1Student, Amity University, Noida, Uttar Pradesh, India 2Assistant Professor, Amity University, Noida, Uttar Pradesh, India ABSTRACT As mobile applications become more difficult, precise development tools and frameworks as well as cost valuable testing techniques and tools will be necessary to assure the development of secure, high-quality mobile applications. This paper concentrates on the mobile crawling in Android platform, and represents a technique for rapid crawling of Android applications. The procedure is based on a crawler that automatically searches a model and obtains result that can be automatically executed. This technique is supported by a tool for both crawl the data and generating the result. In the paper we present an example of using the technique and the tool for crawl a file which has mp3, txt etc extension by using Android application that preliminary shows the effectiveness and usability of the proposed approach. By using that crawler system the data is secure and easy to handle in an organization. KEYWORDS: Android Application, Crawling, Mobile Phone Crawlers, Security INTRODUCTION The mobile progress community is at a tipping point. Mobile users insist more choice, more prospects to customize their phones, and more functionality. Mobile operators want to provide value-added content to their subscribers in a convenient and profitable way. Mobile developers want the liberty to develop the powerful mobile applications users demand with minimal roadblocks to victory. Finally, handset manufacturers want a steady, protected, and reasonable platform to power their devices [3]. Up until now particular mobile platform has sufficiently addressed the needs of all the parties. Enter Android, which is a possible game-changer for the mobile development community. An innovative and open platform, Android is well positioned to address the growing needs of the mobile marketplace. It proposes an alternative approach to Mobile crawling based on mobile phone crawlers. Crawler mobility permits for more difficult crawling algorithms and avoids some of the inefficiencies linked with the brute force strategies exercised by current crawlers. By looking at the common structure of traditional search engines, it recognized that their planning is strictly centralized while the data being accessed by search engine crawlers is extremely scattered. If here apply a stationary crawler, firstly it would download many pages from Mobile Phones, which are detached immediately because they do not meet the theme area of the search engine. Perceptibly, this behavior is not very attractive because network bandwidth is exhausted by downloading unrelated information. Here it illustrate mobility in the context of Mobile crawling as the capability of a crawler to transfer itself to every Mobile Phone of notice before assembling pages on that Phone. After finishing the collection process on a particular Phone, the crawler together with the collected data travels to the next Phone or to its Network. Mobile crawlers are managed by a crawler manager (CM) which supplies each crawler with a record of target Mobile Phones and monitors the position of each crawler. In addition, the crawler manager provides the necessary functionality for pull out the collected data from the crawler for use by the indexer. 176 Srashti Gupta & Kunal Gupta Figure 1: Architecture of Proposed Android Based Mobile Crawler Powerful Development Framework Easily optimize a single binary for phones, tablets, and other devices. Android gives each and everything to user which they needed to build best in class familiarity. It gives a single application representation that organize apps broadly to hundreds of millions of users diagonally a wide range of devices—from phones to tablets and beyond. Android tools for creating apps that look great and take benefit of the hardware capabilities available on each device [13]. It repeatedly adapts your User Interface (UI) to look its best on each device, while giving you as much control as you want over your UI on dissimilar device types. For Example, It can create single app binary that’s optimized for both phone and tablet form factors. It announce UI in lightweight sets of XML resources, one set for parts of the UI that are common to all form factors and other sets for optimizations precise to phones or tablets [14]. At run time, Android applies the correct resource sets based on its screen size, density, locale, and so on. To help you develop efficiently, Android Developer Tools offer a full Java IDE with superior features for developing, debugging, and packaging Android apps [2]. Using the IDE, you can expand on any available Android device or create virtual policies that emulate any hardware configuration. QUALITIES FOR MOBILE PHONE CRAWLER The main benefit of the mobile crawling approach is that it permits to allocate crawling functionality within a distributed system such as the Web. Particularly, the following four qualities plays major role in this system: Localized Data Access Due to the HTTP request/response pattern, downloading the contents from a Web server engross important overhead due to request messages which have to be sent for every mobile page separately. This approach still requires one HTTP request per document but there is no need to broadcast these requests over the system any longer. Using a mobile crawler we reduce the HTTP overhead by shifting the crawler to the supply of the data. The crawler can then issue all HTTP requests locally with respect to the HTTP server. Remote Page Selections Mobile crawlers utilize the query shipping approach of database systems because all the information desirable to identify the relevant data portion is transferred directly to the data source along with the mobile crawler. After the query has been performed remotely, only the query result is transferred over the network and can be used to establish the preferred index without requiring any extra analysis. Implementation of Android Based Mobile Phone Crawlers 177 Remote Page Filtering Remote page filtering enlarges the concept of remote page selection to the contents of a Web page [4]. The thought behind remote page filtering is to allow the crawler to control the granularity of the data it retrieves. Depending on the ratio of relevant to irrelevant information, important portions of network bandwidth are wasted by transmitting ineffectual data [11]. A mobile crawler defeats this problem since it can filter out all irrelevant page portions keeping only information which is applicable with respect to the search engine the crawler is working for. Remote Page Compressions In order to decrease the quantity of data that has to be transmitted back to the crawler organizer, it introduces remote page compression as another basic feature of mobile crawlers [2]. In order to decrease the bandwidth required to transfer the crawler along with the data it holds back to the search engine, the mobile crawler applies compression procedures to reduce its size earlier to transmission. SOFTWARE USED IN CRAWLING In this section be going to to present the software which is used in different mobile phone systems. The basic fundamental technologies are HTML, XHTML, WAP, WML, CSS, ECMA Script. Table 1: Browsers in Various Mobile Systems Browser Origin Used in Android browser Google Nexus BlackBerry Browser Research in Motion - Blazer Palm installed on all newer Palm Treos and PDAs Internet Explorer Mobile Microsoft Samsung newer versions Firefox for mobile Mozilla Nokia Maemo and for Android Acquired by Research in Motion - No longer supports Iris Browser Torch Mobile Inc. Windows Mobile or Linux Capable of reading HTML and reformat for small Opera Mobile Opera Software screens, installed on many phones NetFront ACCESS Co.,ltd - Obigo Browser Obigo AB 100% owned by Teleca AB PlayStation Portable web browser Sony Sony PSP Myriad Browser (Previously Myriad Group Acquired from Openwave in 2008 Openwave Mobile Browser) Nokia, Samsung, LG Electronics, KYOCERA and other Polaris Browser Infraware Inc. Smartphone and cellular phone in USA, China, Korea, etc Renders Flash 10, Ajax and Silverlight content. supports Skyfire Mobile Browser Skyfire Windows Mobile 5/6.x,Symbian S60 and Android. Safari Apple Inc on iPhone, iPod Touch and iPad on Samsung, LG Electronics and other smartphones and uZard Web Logicplant Co., Ltd. cellular phones in Korea Kindle Basic Web Amazon.com Blackberry WebOS Browser Palm - xScope xScope Mobile on android systems Table 1 record the compilation of various browsers in use by special Mobile phones systems from the mobile crawler using GPRS. 178 Srashti Gupta & Kunal Gupta A TECHNIQUE FOR ANDROID MOBILE PHONE CRAWLERS Figure 2: The Crawling Algorithm DEVELOPING APPLICATION FOR MOBILE PHONE CRAWLER Commonly Used Packages With Android, mobile developers no longer have to reinvent the controls. Instead, developers use recognizable class libraries exposed through Android’s Java packages to execute common tasks such as graphics, database access, network access, secure communications, and utilities (such as XML parsing) [13]. The Android packages include support for Common user interface widgets (Buttons, Spin Controls,Text Input) User interface layout Secure networking and Web browsing features (SSL,WebKit)