Compilation and Hardware Support for Approximate Acceleration Thierry Moreau, Adrian Sampson, Andre Baixo, Mark Wyse, Ben Ransford, Jacob Nelson, Hadi Esmaeilzadeh (Georgia Tech), Luis Ceze and Mark Oskin University of Washington
[email protected] Theme: 2384.004 1 Thierry Moreau Approximate Computing Aims to exploit application resilience to trade-off quality for efficiency 2 Thierry Moreau Approximate Computing 3 Thierry Moreau Approximate Computing ✅ Accurate ✅ Approximate ❌ Expensive ✅ Cheap 4 Thierry Moreau 5 Thierry Moreau 6 Thierry Moreau 7 Thierry Moreau Neural Networks as Approximate Accelerators CPU Esmaeilzadeh et al. [MICRO 2012] 8 Thierry Moreau Neural Acceleration float foo (float a, float b) { AR F … NPUM P G return val; approximation acceleration } 9 Thierry Moreau Neural Acceleration compiler-support float foo (float a, float b) { AR F … NPUM P G return val; approximation acceleration } ACCEPT* *Sampson et. al [UW-TR] 10 Thierry Moreau Neural Acceleration compiler-support HW-support float foo (float a, float b) { AR F … NPUM P G return val; approximation acceleration } ACCEPT SNNAP* *Moreau et. al [HPCA2015] 11 Thierry Moreau Neural Acceleration compiler-support HW-support float foo (float a, float b) { AR F … NPUM P G return val; approximation acceleration } ACCEPT SNNAP 3.8x speedup and 2.8x efficiency - 10% error 12 Thierry Moreau Talk Outline Introduction Compiler Support with ACCEPT SNNAP Accelerator design Evaluation & Comparison with HLS 13 Thierry Moreau Compilation Overview code 1. Region detection annotation 14 Thierry Moreau Compilation Overview ACCEPT code region detection 1. Region detection & program annotation instrumentation 15 Thierry Moreau Compilation Overview ACCEPT code region detection 1. Region detection & program annotation instrumentation back prop.