BENCHMARKING ARM-BASED APPLICATION INTEGRATED SYSTEMS By SETH WILLIAMS Bachelor Science in Electrical Engineering Oklahoma State University Stillwater, Oklahoma 2011 Submitted to the Faculty of the Graduate College of the Oklahoma State University in partial fulfillment of the requirements for the Degree of MASTER OF SCIENCE IN ELECTRICAL ENGINEERING December, 2011 BENCHMARKING ARM-BASED APPLICATION INTEGRATED SYSTEMS Thesis Approved: Dr. James Stine Thesis Adviser Dr. Sohum Sohoni Dr. Weihua Sheng Dr. Sheryl Tucker Dean of the Graduate College ii TABLE OF CONTENTS Chapter Page TABLE OF CONTENTS .................................................................................................. III LIST OF TABLES ............................................................................................................. V LIST OF FIGURES .......................................................................................................... VI I. INTRODUCTION ........................................................................................................... 1 Objectives .................................................................................................................... 2 Contributions ............................................................................................................... 3 Summary ...................................................................................................................... 4 II. BACKGROUND ............................................................................................................ 5 ARM ............................................................................................................................ 6 History and Marketing .......................................................................................... 6 Features and Expansions ...................................................................................... 8 Processors ........................................................................................................... 10 Architecture ........................................................................................................ 14 Integrated Systems ..................................................................................................... 17 System-on-a-Chip ............................................................................................... 18 System-in-Package ............................................................................................. 18 Package-on-Package ........................................................................................... 19 Beagle Board ............................................................................................................. 21 Specifications ..................................................................................................... 22 Interface and Extensions ..................................................................................... 22 OMAP3530 and POP Memory ........................................................................... 25 Benchmarks ............................................................................................................... 29 Standard Benchmark Qualities ........................................................................... 29 Misuse ................................................................................................................. 30 Prolific Benchmarks ........................................................................................... 32 III. IMPLEMENTATION ................................................................................................. 34 Beagle Board Setup ................................................................................................... 35 Setting up Ubuntu for the Beagle Board ............................................................ 36 MiBench .................................................................................................................... 36 Composition ....................................................................................................... 37 iii Execution ............................................................................................................ 38 Research Focuses ....................................................................................................... 39 Benchmark Criteria ............................................................................................ 40 IV. RESULTS ................................................................................................................... 41 Benchmark Research ................................................................................................. 42 Possible Benchmarks .......................................................................................... 42 Existing Benchmark Results ............................................................................... 45 MiBench results ......................................................................................................... 50 Automotive/Industrial ......................................................................................... 51 Network .............................................................................................................. 53 Consumer ............................................................................................................ 53 Office .................................................................................................................. 55 Security ............................................................................................................... 56 Telecommunication ............................................................................................ 57 V. CONCLUSIONS .......................................................................................................... 59 Analysis ..................................................................................................................... 60 Are Application Processors Distinct? ................................................................. 60 Is Testing the Core Enough? .............................................................................. 62 Are Current Benchmarks Adequate? .................................................................. 62 What is the Future Trend? .................................................................................. 63 Future Work ............................................................................................................... 64 Summary .................................................................................................................... 65 BIBLIOGRAPHY ............................................................................................................. 66 GLOSSARY ..................................................................................................................... 71 ACRONYMS .................................................................................................................... 73 APPENDICES .................................................................................................................. 75 Appendix A: Partition Geometry ............................................................................... 75 Appendix B: MiBench Details .................................................................................. 76 Appendix C: Cortex-A comparisons ......................................................................... 78 iv LIST OF TABLES Table Page Table 1: ARM Versions and Families ............................................................................................. 7 Table 2: Instruction Set Options .................................................................................................... 14 Table 3: OMAP Interfaces and Beagle Board Connectors ............................................................ 24 Table 4: OMAP3530 Parametrics [30] ......................................................................................... 26 Table 5: MiBench Categories ........................................................................................................ 37 Table 6: TI OMAP3530DCBB72 [30] vs. AMD Turion TM 64 X2 Mobile Dual-Core [76] ......... 51 Table 7: Automotive & Industrial Benchmark Descriptions ......................................................... 76 Table 8: Consumer Benchmark Descriptions ................................................................................ 76 Table 9: Office Benchmark Descriptions....................................................................................... 77 Table 10: Network Benchmark Descriptions ................................................................................. 77 Table 11: Security Benchmark Descriptions ................................................................................. 77 Table 12: Telecommunications Benchmark Descriptions ............................................................. 77 Table 13: Cortex-A Comparisons .................................................................................................. 79 v LIST OF FIGURES Figure Page Figure 1: ARM Processor Categories by Capability [21] .............................................................. 11 Figure 2: ARM Processors and Features [21] ............................................................................... 13 Figure