Variation Among Processors Under Turbo-‐Boost

Variation Among Processors Under Turbo-‐Boost

Variation Among Processors Under Turbo-Boost Bilge Acun, Ph.D. Candidate Department of Computer Science University of Illinois at Urbana-Champaign This talk is based on the publicaon: Bilge Acun, Phil Miller, Laxmikant Kale. ICS 2016. 1 “Variaon Among Processors under Turbo Boost in HPC Systems”. Motivation: Performance Variation 16% Performance Only 1% VariaEon on Variaon on Edison, Blue Waters! Cab, Stampede! ��������������������������� ���� ���� �������� ���� ��� ���� ������ ���� ���� ���� ���� Acun, Miller, Kale. “Variaon Among Processors under Turbo ���� Boost in HPC Systems” [ICS 2016] �������������������� �� ���� ���� ���� ���� ���� ���� ���� ���� 2 ������� • 16K cores running local DGEMM kernel of Intel-MKL What is Dynamic Overclocking? • Processor changes the frequency opportunis3cally since it cannot run at the highest limit all the 3me. • E.g. Intel Turbo Boost Technology • Factors effec3ng the dynamic frequency: • Type of the workload • Number of ac3ve cores • Current consump3on �������������������������� • Power consump3on ��� • Temperature Acun, Miller, Kale. “Variaon Among Processors under Turbo Boost in HPC Systems” [ICS 2016] ��� ��������������� �������� ���� ���� 3 �� ���� ���� ���� ���� ���� ���������� Motivation: Frequency Variation ������������������������������ ���� ������ ��������������� ���� ��� ��������������� ���� �������� ��������������� ���� ���� ���� �������������� ���� ���� Acun, Miller, Kale. “Variaon Among Processors under Turbo ���� ���� ���� ���� ���� ���� �� ���� ���� Boost in HPC Systems” [ICS 2016] ��������������� 4 Edison: Intel Ivy Bridge Stampede, Cab: Intel Sandy Bridge Motivation: Frequency Variation • Distribu3on of steady-state frequencies on Edison Acun, Miller, Kale. “Variaon Among Processors under Turbo Boost in HPC Systems” [ICS 2016] 5 Why there is variation? ���������������������������� ���� ��� ��� ��� ���� ��� ��� ��� ��� ��� ���� ��� ���� ��� �� �� ���� �� �� ��� ���� Acun, Miller, Kale. “Variaon ��������������� ��������������� ��� Among Processors under Turbo �� ���� Boost in HPC Systems” [ICS 2016] � �� �� �� �� 6 �������� Is it caused by temperature? ������������������������������������� ����������������������������������� ���� ������� ��� ����������� ����������� ��� ����������� ����������� ��� ��� Acun, Miller, Kale. “Variaon Among Processors under Turbo �� Boost in HPC Systems” [ICS 2016] ������������������������������ �� �� �� �� �� �� �� �� �� �� �� �� �� �� �������������� 7 �������������� Is it caused by temperature? ������������������������������������� ����������������������������������� ���� ������� ��� ����������� ����������� ��� ����������� ����������� ��� ��� Acun, Miller, Kale. “Variaon Among Processors under Turbo �� Boost in HPC Systems” [ICS 2016] ������������������������������ �� �� �� �� �� �� �� �� �� �� �� �� �� �� �������������� �������������� 8 Is it caused by power? Acun, Miller, Kale. “Variaon Among Processors under Turbo { Fast processors’ power are Boost in HPC Systems” [ICS 2016] similar to uniform Slow and variable processors distribu3on have higher power 9 What can we do about it? 1. Disable Turbo-Boost 2. Replacing the slow chips 3. Selec3vely idling the cores 4. Dynamic load balancing Acun, Miller, Kale. “Variaon Among Processors under Turbo Boost in HPC Systems” [ICS 2016] 10 Solution 1: Disable Turbo-Boost? Acun, Miller, Kale. “Variaon Among Processors under Turbo Boost in HPC Systems” [ICS 2016] u Naïve-DGEMM slows down more compared to MKL because it was running at higher frequency with Turbo Boost. 11 u Jacobi2D suffers less from disabling Turbo-Boost because it’s memory intensive. Solution 2: Replace the chips? ������������������������������������ ��� ��� �� �� ��������� ����������� �� ����������� �������� �� ������ Acun, Miller, Kale. “Variaon Among Processors under Turbo �� Boost in HPC Systems” [ICS 2016] �� ���� ���� ���� ���� ���� ���� ���� ���� ���� �������������������������� 12 Solution 3: Idling the cores? �������������������������������� ������ ������ ��������� ������ ����������� ������ �������� ������ ������ ������ ������ Acun, Miller, Kale. “Variaon ������ Among Processors under Turbo Boost in HPC Systems” [ICS 2016] ��������������������� ������ �� ��� ���� ���� ���� ���� ���� ���� ���� ���� 13 ������������������������������������ Solution 4: Speed-Aware Load Balancing! • Run3me tracks processor speeds dynamically +LBTestPESpeed • Balance the workload with taking into account the speed �������������������������� ��� ������� ��� ������������������� ��� Acun, Miller, Kale. “Variaon �� Among Processors under Turbo Boost in HPC Systems” [ICS 2016] ������������������� �� 14 ������ �������� Summary & Conclusion So#ware can do a lot more if the desired support and access is given. Acun, Miller, Kale. “Variaon Among Processors under Turbo Boost in HPC Systems” [ICS 2016] 15 Future Work • Variaon analysis on newer generaon processors • Variaon in memory operaons Acun, Miller, Kale. “Variaon Among Processors under Turbo Boost in HPC Systems” [ICS 2016] 16 .

View Full Text

Details

  • File Type
    pdf
  • Upload Time
    -
  • Content Languages
    English
  • Upload User
    Anonymous/Not logged-in
  • File Pages
    16 Page
  • File Size
    -

Download

Channel Download Status
Express Download Enable

Copyright

We respect the copyrights and intellectual property rights of all users. All uploaded documents are either original works of the uploader or authorized works of the rightful owners.

  • Not to be reproduced or distributed without explicit permission.
  • Not used for commercial purposes outside of approved use cases.
  • Not used to infringe on the rights of the original creators.
  • If you believe any content infringes your copyright, please contact us immediately.

Support

For help with questions, suggestions, or problems, please contact us