(12) United States Patent (10) Patent No.: US 8,417,833 B1 Amdahl (45) Date of Patent: Apr
Total Page:16
File Type:pdf, Size:1020Kb
USOO841 7833B1 (12) United States Patent (10) Patent No.: US 8,417,833 B1 Amdahl (45) Date of Patent: Apr. 9, 2013 (54) METACODEC FOR OPTIMIZING NETWORK 1992, A ck 3. 3. al et al. 375,240 DATA COMPRESSION BASED ON - - aO . COMPARISON OF WRITE AND READ RATES 4,971.407 A 11/1990 Hofman (Continued) (75) Inventor: s Carl Amdahl, Los Gatos, CA FOREIGN PATENT DOCUMENTS EP O929 173 A2 7, 1999 (73) Assignee: F5 Networks, Inc., Seattle, WA (US) EP O947 104 B1 11, 2002 (Continued) (*) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 OTHER PUBLICATIONS U.S.C. 154(b) by 601 days. Cheng, J.M., et al. "A fast, highly reliable data compression chip and algorithm for storage systems.” IBM, vol. 40, No. 6, Nov. 1996, 11 (21) Appl. No.: 11/564,805 pg.S. (22) Filed: Nov. 29, 2006 (Continued) Primary Examiner — Alina N Boutah (51) as is (2006.01) Assistant Examiner — Clarence John G06F I3/00 (2006.015 (74) Attorney, Agent, or Firm — Frommer Lawrence & G06F 3/28 (2006.01) Haug LLP: John W. Branch H04F 2/28 (2006.01) (57) ABSTRACT (52) U.S. Cl. ........ 709/247; 370/389: 711/167; 711/168; 711/169: 711/170: 711/171: 711/172: 711/173 A method, system, and apparatus are directed towards selec ... s s s f389: tively compressing data for transmission over a network. In (58) Field of Classification Search .......... 370/389; one embodiment, a sending network device and receiving 709/247; 711/ 167 173 network device negotiates different compression modes to See application file for complete search history. communicate data between them. An initial compression mode may be selected based on a network bandwidth. The (56) References Cited sending network device then reads data, and compresses using the selected compression mode. The compressed data U.S. PATENT DOCUMENTS may then be written out. Ratios of compression and the write 4,021,782 A 5/1977 Hoerning times are then employed to selectively adjust the compression 4,054,951 A 10, 1977 Jackson et al. 4,316,222 A 2, 1982 Subramaniam mode for Subsequent data compressions. In one embodiment, 4,386,416 A 5, 1983 Giltner et al. a compression ratio is also employed to determine whether to 4,593,324 A 6, 1986 Ohikubo et al. employ the selected compression mode, or to reduce the level 4,626,829 A 12/1986 Hauck of compression by using a different compression mode. The 4,701,745 A 10, 1987 Waterworth et al. 4,862,167 A 8/1989 Copeland, III receiving network device having received information about 4,876,541 A 10, 1989 Storer the selected compression mode, then employs that compres 4,890.282 A 12/1989 Lambert et al. sion mode to decompress the received data. 4,891,643 A 1/1990 Mitchell et al. 4,897,717 A 1/1990 Hamilton et al. 21 Claims, 6 Drawing Sheets s Cienfevice 83. Traffic 06 Management device (Md. US 8,417,833 B1 Page 2 U.S. PATENT DOCUMENTS OTHER PUBLICATIONS 4,988.9985,003,307 A 3/19911, 1991 WhitingO’Brien et al. Simpson, W. &“The 8 Point-To-Pointinf-Try-Pri Protocol (PPP).”s RFC 1661, Jul. 5,016,009 A 5/1991 Whiting et al. 1994, 54 pgs. 5,109,433 A 4, 1992 Notenboom Schneider, K., et al. “PPP for Data Compression in Data Circuit 5,126,739 A 6/1992 Whiting et al. Terminating Equipment (DCE).” RFC 1976, Aug. 1996, 10 pgs. 5,146,221 A 9/1992 Whiting et al. Castineyra, I., et al. “The Nimrod Routing Architecture.” RFC 1992, 5,150,430 A 9, 1992 Chu Aug. 1996, 27 pgs. 5,155.484 A 10/1992 Chambers, IV “Direct Access Storage Device Compression and Decompression 5,167,034 A 11/1992 MacLean, Jr. et al. Data Flow.' IBM Technical Disclosure Bulletin, vol. 38, No. 11, Nov. 5,212,742 A 5, 1993 Normile et al. 1995, pp. 291-295. 357.6 A I tal “Drive Image Professional for DOS, OS/2, and Windows.” WSDC 5,280,6004.- : W A 1/1994 VanC MarenCla. et al. Dowload Guide, http://wsdcds01.watson.ibm.com/WSDC.nsf. 5,293,388 A 3, 1994 Monroe et al. Guides/Download/Applications-Drivelmage.htm, accessed Nov. 22. 5.333,212 A 7/1994 Ligtenberg 1999, 4pgs. 5,341,440 A 8, 1994 Earl et al. "Drive Image Professional.” WSDC Download Guide, http:// 5,367,629 A 11/1994 Chu et al. wisdcds01.watson.ibm.com/wsdc.nsf/Guides/Download. Applica 5,379,036 A 1, 1995 Storer tions-Drivelmage.htm, accessed May 3, 2001, 5 pgs. 5,410,671 A 4/1995 Elgamal et al. Electronic Engineering Times, Issue 759, Aug. 16, 1993, 37 pgs. 5,414.425 A 5/1995 Whiting et al. ALDC1-5S Adaptive Lossless Data Compression, IBM Micro 5,463,390 A 10/1995 Whiting et al. electronics, May 1994.2 pgs. 5,479,587 A 12/1995 Campbell et al. ALDC1-20S–Adaptive Lossless Data Compression, IBM Micro 5.488.364 A 1, 1996 Cole electronics, May 1994, 2 pgs. 5.488.483. A 1, 1996 Murayama ALDC1-40S–Adaptive Lossless Data Compression, IBM Micro 5,504.842 A 4, 1996 Gentile electronics, May 1994, 2 pgs. 5.539,8655,506,944 A 4,7, 1996 GentilGentile ALDC-MACRO-Adaptive Lossless Data Compression, IBM - - - ce Microelectronics, May 1994.2 pgs. 5.544.2905,542,031 A 7,8, 1996 GentileDouglass et al. Craft, David J., “Data& 8 Compression Choice No Easy Call.”s Computer 5,546,395 A 8/1996 Sharma et al. Technology Review, Jan.1994.2 pgs. s 5,546,475 A 8, 1996 Bolle et al. Data Compression Applications and Innovations Workshop.” Pro 5,553,160 A 9, 1996 Dawson ceedings of a Workshop held in conjunction with the IEEE Data 5.559.978. A 9/1996 Spilo Compression Conference, Mar. 31, 1995, 123 pgs. 561 5.287 A 3, 1997 Fu et al. IBM Microelectronics Comdex Fall 1993 Booth Location, 1 pg. 5,638.498 A 6/1997 Tyler et al. IBM Technology Products Introduces New Family of High-Perfor 5,646,946 A 7, 1997 VanderMeer et al. mance Data Compression Products.” IBM Coporation, Somers, NY. 5,768.445 A 6, 1998 Troeller et al. Aug. 16, 1993.6 pgs. 5,768,525 A 6, 1998 Kralowetz et al. Zebrose, Katherine L., “Integrating Hardware Acclerators into 5,774,715 A 6/1998 Madany et al. Internetworking Switches.” Telco Systems, 10 pgs. 5,805,932 A 9, 1998 Kawashima et al. Readme, Powerquest Corporation, 6 pgs. 5,850,565 A 12/1998 Wightman et al. Costlow, Terry “Sony designs faster, denser tape drive.” Electronic 5,874,907 A 2, 1999 Craft Engineering Times, May 20, 1996, 2 pgs. 5,884,269 A 3, 1999 Cellier et al. Electronic Engineering Times, Issue 767, Oct. 11, 1993, 34pgs. 5,892,847 A 4/1999 Johnson “IBM Announces New Feature for 3480 Subsystem.” Tucson Today, 5,909,250 A 6, 1999 Hardiman vol. 12, No. 337, Jul 25, 1989, 1 pg. 5,951,623 A 9/1999 Reynar et al. Craft, D.J. "A fast hardware data compression algorithm and some 5.991,515 A 11, 1999 Fall et al. algorithmic extensions.” IBM Journal of Research and Development, 6,070,179 A 5, 2000 Craft vol. 42, No. 6, Nov. 1998, 14pgs. 6,138,156 A 10, 2000 Fletcher et al. “Magstar and IBM 3590 High Performance Tape Subsystem Tech 6,178.489 B1 1/2001 Singh nical Guide.” IBM, Nov. 1996, 288 pgs. 6,314,095 B1 1 1/2001 Loa Gailly, J., gzip The data compression program”. Edition 1.2.4 for 6,349,150 B1* 22002 Jones ........................ 382,238 Gzip Version 1.2.4, pp. 1-13, Jul. 1993. Can be found at http://www. 6,473,458 B1 102002 Shimizu et al. gnu.org/software gzip/manual/html mono? gzip.html. 6,477,201 B1 1 1/2002 Wine et al. “Gzip Wikipedia, the free encyclopedia'. Wikipedia, pp. 1-4. Dec. 6,728,785 B1 4, 2004 Jungck 6, 2005. Can be found at http://en.wikipedia.org/wiki/Gzip. 6,763,031 B1 7/2004 Gibson et al. Gailly, J., “Invoking gzip, pp. 1-2, Jul. 1993. Can be found at 6,775,235 B2 8, 2004 Datta et al. http://www.math.utah.edu/docs/info/gzip 4.html#SEC7. 6,879,631 B1 4/2005 Schultz et al. “Data compression Wikipedia, the free encyclopedia'. Wikipedia, 6,882,753 B2 4, 2005 Chen et al. pp. 1-7. Dec. 6, 2005. Can be found at http://en.wikipedia.org/wiki/ : R 38. R al 1 Data compression algorithm. 2002fO156946- W A1* 10, 2002 MEO1 etala. T10/33 Roelofs, Greg, zlib A Massively Spiffy Yet Delicately Unobtrusive . Compression Library (Also Free, Not to Mention Unencumbered by 2004/O103215 A1 5, 2004 Ernst et al. Patents), pp. 1-5, Last updated on Aug. 7, 2005. Can be found at 2005, 0008017 A1 1/2005 Datta et al. http:/www. zib net 2008.0025298 A1 ck 1/2008 Lev-Ran et al. .............. 370,389 Krintz, Chandra. .and . M. Sucu, Sezgin, "Adaptive on-the-Fly Compres FOREIGN PATENT DOCUMENTS sion (Abstract). EEE Computer Society, vol. 17. No. 1, pp. 1-2, Jan. E. i. 3: A. 58. 2006.DLAbsToc.jsp?resourcePath=/dl/trans/td.&toc=comp/trans/td/ Can be found at http://cs.dl2.computer.org/persagen/ EP 1434 437 A2 6, 2004 2006/01/11 toc-Xml&DOI=101109 TPDS.