US 200501431.36A1 (19) United States (2) Patent Application Publication (10) Pub. No.: US 2005/0143136A1 Lev et al. (43) Pub. Date: Jun. 30, 2005 (54) MMS SYSTEM AND METHOD WITH Publication Classification PROTOCOL CONVERSION SUITABLE FOR MOBILE/PORTABLE HANDSET DISPLAY (51) Int. Cl." … H04B 1/38 (76) Inventors: Twsi Lev, Tel Aviv (IL); Ran (52) U.S. Cl. … 455/566 Avnimelech, Ramat Gan (IL) Correspondence Address: (57) ABSTRACT BLAKELY SOKOLOFF TAYLOR & ZAFMAN 12400 WILSHIRE BOULEVARD SEVENTH FLOOR An MMS communication system for displaying images on LOS ANGELES, CA 90025-1030 (US) a display terminal of a mobile or portable communication device, the system comprising: an input adapted to receive (21) Appl. No.: 10/482,566 pre-source information; a transmitter adapted to transmit the pre-source information; a server adapted to receive the (22) Filed: Feb. 18, 2005 transmitted pre-source information and further adapted to Related U.S. Application Data convert the pre-source information to source information suitable for display on the display terminal, and a source (60) Provisional application No. 60/299,745, filed on Jun. transmitter adapted to transmit the source information to the 22, 2001. display terminal. PANORAMA Patent Application Publication Jun. 30, 2005 Sheet 1 of 37 US 2005/0143136 A1 g 2. #3ºr H of 9.2 a 1. gE. 595 + 3 i i Patent Application Publication Jun. 30, 2005 Sheet 2 of 37 US 2005/0143136 A1 W/INV/EHONVd Patent Application Publication Jun. 30, 2005 Sheet 3 of 37 US 2005/0143136 A1 Patent Application Publication Jun. 30, 2005 Sheet 4 of 37 US 2005/0143136 A1 Patent Application Publication Jun. 30, 2005 Sheet 5 of 37 US 2005/0143136 A1 ·?ºspue?o,uopendepe9ãëULII• 5/37 Patent Application Publication Jun. 30, 2005 Sheet 6 of 37 US 2005/0143136A1 XOgOL19SMOJE dVNA EC1OW-i c)?| Patent Application Publication Jun. 30, 2005 Sheet 7 of 37 US 2005/0143136 A1 d.LWIS -•** …--*** !• Patent Application Publication Jun. 30, 2005 Sheet 8 of 37 US 2005/0143136A1 WEB Portal E-Mail Photo Sharing Site Module WEB PAGES Patent Application Publication Jun. 30, 2005 Sheet 9 of 37 US 2005/0143136 A1 To E-MAIL SERVER To SMS GATEWAY SMTP / POP3 SMS / PM / EMS MODULE MODULE PM / EMS SERVLETS || SERVLETS FIG.9 Patent Application Publication Jun. 30, 2005 Sheet 10 of 37 US 2005/0143136 A1 SMS CENTER SMS GATEWAY SMS RECEIVER (L) SENDER SERVLET DB SERVLET EMS/PM DECODER EMS / PM ENCODER MAS UTILITY SERVLETS EMS to/fromPM EMS+PM to/from WAP4-WEB EMS-FPM to/from E-MAIL FIG.10 Patent Application Publication Jun. 30, 2005 Sheet 11 of 37 US 2005/0143136 A1 E-MAIL SERVER ENCODER DECODER SERVLET SERVLET MAS UTILITY SERVLETS E-MAIL to/from PM+EMS E-MAIL to/from WAP FIG.11 Patent Application Publication Jun. 30, 2005 Sheet 12 of 37 US 2005/0143136 A1 Login Page Enter Phone First time users or people that forgot their password can get a new password by SMS. - Enter this page - Enter your phone number - System creates new user - System sends SMS. - Re-enter the login page, - User you new password Enter Phone Enter PasswordP Number - Hang Up. - Enter login page. - User password. - Create bookmark Authentication OK ? Main Page - Incoming Messages - Archives - Select "Try Again" - Go back to login page - Get new password if you fail again. (T / C-, \. Return to Login Refer to "Main Page" Page fiowchart Patent Application Publication Jun. 30, 2005 Sheet 13 of 37 US 2005/0143136 A1 MAS Main Page "Messages" Archive Main Page ----------- selected - get list of all archives w - display link for each Messages Main Page - get list of messages - display link for each "Archive1" selected Message Page - get message text - get message image - get phone type. - transcode image - create winni or html based on client Refer to "Send" flowchart Patent Application Publication Jun. 30, 2005 Sheet 14 of 37 US 2005/0143136 A1 Send Message Edit your text Enter Recipient's Number "Send as" selected y \ (~ \(^ "Send" selected Select message Refer to "Message Transfer" flowchart type Patent Application Publication Jun. 30, 2005 Sheet 15 of 37 US 2005/0143136 A1 WAP to WAP - Verify recipient's operator has this service. - Register recipient in user table - Register message in message table Patent Application Publication Jun. 30, 2005 Sheet 16 of 37 US 2005/0143136 A1 WAP to EMS or PM - Verify recipient's operator has this service. - Verify recipient can view this message. - If unknown, assume he can. - Register recipient in user table - Add this EMS / PM to his capabilities with low confidence. - Transcode to correct format. - Create EMS or PM string. - Send to SMS GW - Register message in message table Patent Application Publication Jun. 30, 2005 Sheet 17 of 37 US 2005/0143136 A1 WAP to E-Mail W - Take original and transcode to about 5K - Check that you have recipient's e-mail. - Create the e-mail message and send - Register the message Patent Application Publication Jun. 30, 2005 Sheet 18 of 37 US 2005/0143136 A1 Locate, cut Emphasize face features FIG.18 Patent Application Publication Jun. 30, 2005 Sheet 19 of 37 US 2005/0143136 A1 ignore grid, background Output Isolate sufficient range information (min, max values). Resize if possible Separate graphics by Determine Resize graph graph size content type Redraw boundaries Relocate label FIG.19 Patent Application Publication Jun. 30, 2005 Sheet 20 of 37 US 2005/0143136 A1 Output Separate strip to blocks Split line art and text FIG.20 Patent Application Publication Jun. 30, 2005 Sheet 21 of 37 US 2005/0143136 A1 Input No. I'm sure the problem is on your e?le Split line art €SIZe I?le and text FIG.21 Patent Application Publication Jun. 30, 2005 Sheet 22 of 37 US 2005/0143136 A1 Identify Emphasize different Tigray boundaries, surfaces silhouettes FIG.22 Patent Application Publication Jun. 30, 2005 Sheet 23 of 37 US 2005/0143136 A1 Patent Application Publication Jun. 30, 2005 Sheet 24 of 37 US 2005/0143136 A1 )º^ Patent Application Publication Jun. 30, 2005 Sheet 25 of 37 US 2005/0143136 A1 Patent Application Publication Jun. 30, 2005 Sheet 26 of 37 US 2005/0143136A1 Patent Application Publication Jun. 30, 2005 Sheet 27 of 37 US 2005/0143136 A1 &\()l) ?Beuu??u0?0040CI90B.H. SØ.Inquº.IUOQt3]depV Patent Application Publication Jun. 30, 2005 Sheet 28 of 37 US 2005/0143136 A1 | Patent Application Publication Jun. 30, 2005 Sheet 29 of 37 US 2005/0143136A1 uJOJ]e?aK?OIOu?00LOÐUOQ æIBUIS Patent Application Publication Jun. 30, 2005 Sheet 30 of 37 US 2005/0143136 A1 Watermarking Pixels in a group that should be flipped: • Flipping different pixels causes different amount of disruption. Low arris • Choose pixel with min. cost for flipping. ` High ?lipping Cost Morphological rule. Flipping cost depends on neighbors ... Fi ºf Tº fº Fr.: ; ; : + Highest Flipping cost by morphology (neighbors) UCnGO Figure XX: Watermarking algorithm for B/W images (picture messages, WBMP) Multilayer Input Røsized 4GL Reduced º: § * . **: Original (52 layers) Reduced (8 layers) Figure XX: Layer reduction and its effect on the message appearance Patent Application Publication Jun. 30, 2005 Sheet 31 of 37 US 2005/0143136 A1 fa, 3 J Content Based Conversion Stock Charts: Remove superfluous information Maintain line solidity . Naïve ... “Transcoding &ptimal Adaptation Figure XX: content based conversion for charts (color Line-art) Content Based Conversion Cartoons: Different processing for text and drawings Ignore gray level information Naïve Maintain line solidity Transcoding -— CAT tº AT EVIL. H.R. GIRECTOR. AND I HAVE FIVE YEARS EXPERIENCE # As A DOT-COf A ?t PRESIDENT . Optimal Adaptation Maintain Text Figure XX: content based conversion for cartoons (B&W Line-art) Patent Application Publication Jun. 30, 2005 Sheet 32 of 37 US 2005/0143136 A1 Fº so [1 al Content Provider ...ANo I wave five Ytakº Ixpt Altrict as a bor-cor, PC Laptop -- ºf MPs Transcode [1b) original color image from camera Cell Pllone Forwards image Figure: cases where caching and smart-forwarding are required. Patent Application Publication Jun. 30, 2005 Sheet 33 of 37 US 2005/0143136 A1 Specifications Implementation: The caching and smart forwarding system is based on a web-caching mechanism – converted and original media objects are stored in a specially configured set of web-caches, and are retrieved by URI. The basic operation scenario is depicted in the figures below. MMISC CLIENT (5) XML Figure: Sequence of operations for a cached transaction Algorithmic Cache Sequence • For incoming object A (after SMF) + filtered Target Parameters calculate MD5 "C" plus target MIME type "D". • Perform HTTP HEAD request to check if in cache. request filename is "C" "D". • If not in cache, perform transcode, perform HTTP PUT for transcode result in cache. • Return URI. Figure: sequence of operations for caching Patent Application Publication Jun. 30, 2005 Sheet 34 of 37 US 2005/0143136A1 - Fij 24 Algorithmic SMF Sequence . For incoming object A calculate MD5, extract internal hash "C", MIME type "D" from SQL database (indexed query). • If new object, put in database as original content, perform HTTP PUT for original object in cache. • If existing object, perform HTTP HEAD request to check if in cache. Object filename is “C"."D". Update last requested counter. • If in cache, return URI. • If not in cache, put the new input object A as file with the original Content hash Value "C" as the file name. Figure: sequence of operations for smart-forwarding Hash Database • Any SQL database can be used, e.g. MySQL. • Single indexed table (index on key value)/ double indexed table (last requested update). - • Periodic cleanup required of least accessed objects. • Table can reside in RAM – e.g.