Jakob Engblom, PhD, Product Management Engineer, Simics team, Intel, Stockholm, Sweden 2019-05-22 Computer Architecture - Uppsala - 2019-05-22 4 My Background Jakob Engblom . Datavetenskap, Uppsala: D92 . PhD, Computer Systems, Uppsala . Product Management Engineer, Intel System Simulation team , Sweden – Previously at IAR, Virtutech, Wind River . Intel Software Evangelist – Simulation . https://software.intel.com/en-us/meet-the- developers/evangelists/team/jakob- engblom . http://engbloms.se/jakob.html Computer Architecture - Uppsala - 2019-05-22 5 What Does Intel Do? • Processors • Intel® Xeon® Phi™ • SSD • Ethernet • Chipsets • Intel® Xeon® • 3D XPoint™ • WiFi • Processors • Intel® Optane™ • Bluetooth • Chipsets • GNSS • Accelerators • 5G Laptop and Server Storage Connectivity desktop • SoC-FPGA • Movidius • Processors • Development tools • FPGA • Nervana • Gateways • Compilers • FPGA-CPU • MobilEye • Connectivity • Simulation solutions • Xeon • Linux & Windows drivers • FPGAs • UEFI & BIOS FPGA AI etc. IoT Software Computer Architecture - Uppsala - 2019-05-22 6 What I do: Product Management Market communications (“PR”) Engineering Product Management Customer Support Sales Computer Architecture - Uppsala - 2019-05-22 7 What’s In a Processor? What’s in a ”Computer”? (Main) Processor cores . Run user-visible OS and applications Main memory - RAM Graphics and display Audio and media processing . Camera, microphone, speakers, image processing, ... Storage – ”Disk” . SATA, NVMe, M.2., SCSI, PCIe, ... Input and output . Local devices: USB, Thunderbolt, Serial, Bluetooth, ... Remote: Ethernet, WiFi, ... Computer Architecture - Uppsala - 2019-05-22 9 Once Upon a Time... The PROCESSOR was the essential part of a system It measured the goodness of the machine in terms like . Megahertz . Instructions per cycle . Cache size The supporting chips did some basic stuff to make the processor do its job... A better computer meant a better processor (mostly) Computer Architecture - Uppsala - 2019-05-22 10 2009: Intel® Core™ i7 Processor: Still a Processor Intel® Core™ i7-960 Processor (2009) . http://hexus.net/tech/reviews/cpu/1618 7-intel-core-i7-x58-chipset-systems-go- . The processor chip is a processor with fsb-invited/?page=3 minimal connections to the rest of the system . Cores + cache . Memory controller – just moved on-chip! . Intel QuickPath Interconnect (QPI) – link to the rest of the system Computer Architecture - Uppsala - 2019-05-22 11 2009: Intel® X58 Express Chipset IOH (I/O Hub) . QPI to processor (on the previous slide) . Graphics card interface . Connection to ICH10 ICH10 (I/O Controller Hub) . DMI link to the IOH . Main IO chip . SATA, Audio, USB, PCIe, Ethernet Computer Architecture - Uppsala - 2019-05-22 12 2018: Intel® Core™ i9 Processor: Lots of Other Stuff Intel® Core™ i9-9900K Processor (2018): . High-end eight-core desktop processor On the chip: . Graphics + media block bigger than four processor cores – 3D graphics, display, video decode, ... “System Agent” - Memory controller & IO about 2 processor cores https://en.wikichip.org/wiki/intel/core_i9/i9-9900k . L3 cache (2MB per core) not very large Computer Architecture - Uppsala - 2019-05-22 13 2017: Intel® Z370 Chipset Compared to Core i7-960, 7th and 8th gen processors have added: . Integrated PCI Express (PCIe), version 3 . Integrated GPU, multiple displays, video decoding hardware, … . Secure boot and other security functions (not shown) . DMI 3.0 connection has about 160x the bandwidth of the QPI from 2009 Intel® Z370 chipset is a single chip (PCH, Platform Controller Hub): . 24 Additional PCIe version 3 lanes . USB 3 and USB 2, 14 ports total . Storage connections: SATA, eSATA, RAID, PCIe/NVMe, Intel® Optane™ Memory, eMMC, SDXC, … . Advanced sound processing, including onboard DSP . Management Engine (ME) . Programming guide is 1700+ pages long! Additional functions added on PCIe . Wireless module: Wifi, Bluetooth, GNSS, … Computer Architecture - Uppsala - 2019-05-22 14 Pure CPU chip: IO and Cache Dwarf the Cores Intel® Core™ i7-6950K Processor (2016): . Memory controller as big as 5 cores! – Four (4) channels of DDR4 2400! . ”Queue, Uncore, and I/O” bigger than the 25MB L3 cache http://www.anandtech.com/show/10337/the-intel-broadwell-e-review- core-i7-6950x-6900k-6850k-and-6800k-tested-up-to-10-cores Computer Architecture - Uppsala - 2019-05-22 15 Note that these instructions Innovation: The Instruction Set Itself are virtually useless unless there is also supporting software libraries, SDKs, and compilers. People will not use them on their own Instruction set architecture are Recent Intel examples: without help. evolving a quick pace . Intel® Core™ i7-4xxx Processor: . Better instructions = many times faster – AVX2 vector processing computations on specific tasks – BMI1, BMI2 bit-manipulation instructions – https://software.intel.com/en- us/blogs/2017/01/09/resetting-the-lowest-n- Main trends: set-bits . Vector compute = more math per cycle – SMAP - Supervisor Mode Access Prevention – TSX – Transactional memory . Virtualization = faster, more efficient, more capable virtual machines . Intel® Core™ i7-5xxx Processor – RDSEED – Hardware random-number seed . Cryptography = crypto on CPU not on accelerator . Intel® Core™ i7-6xxx Processor – SGX – Software Guard Extensions . Security = better SW-SW protection Computer Architecture - Uppsala - 2019-05-22 17 Example of the effect of ISA: AVX Without AVX: With AVX and AVX512: Source: https://www.anandtech.com/show/13400/intel-9th-gen-core-i9-9900k-i7-9700k-i5-9600k-review Computer Architecture - Uppsala - 2019-05-22 18 Example: Instruction Set Flags - CPUID See feature flags & instructions Software should check feature availability before executing them . CPUID instruction is crucial! . Software adopt dynamically to the machine it is running on Using Intel® Xtreme Tuning Utility . https://downloadcenter.intel.com/do wnload/24075/Intel-Extreme-Tuning- Utility-Intel-XTU- Computer Architecture - Uppsala - 2019-05-22 19 Innovation Area: Networking Ethernet speeds keep increasing Network interfaces add intelligence . 10GbE on Base-T: 2006 . Packet processing offload . 100GbE on Base-T: 2010 . Integrated switches . 40GbE & 25GbE . Virtualization – one physical interface appears as multiple virtual interface WiFi speeds keep increasing directly connected to virtual machines Cellular 4G/LTE/5G speeds keep – Intel® VT-d for VM access to hardware increasing – PCIe SR-IOV for multiple virtual devices in a single physical device = more bytes going in and out than ever before! Computer Architecture - Uppsala - 2019-05-22 20 Innovation Area: Connectors USB Type C m.2 connector . Multiple interfaces in one connector . Multiple interfaces in – USB one connector – Thunderbolt – PCIe – HDMI – SATA – Displayport – USB – Power – I2C, Serial, PCM, ... More flexible computer design More compact SSDs Small ports = thinner machines Add-in other functions More user friendly like modems Computer Architecture - Uppsala - 2019-05-22 21 Summary Innovation in computing today is Buying a better machine: really in the platform capabilities . Faster disk and interface: – Once it was spinning disk on IDE Transistor budget being used to: – Then, SSD on SATA . Integrate previously separate functions – Now, SSD on M.2. PCIe NVMe onto processor die . More and faster external IO – Memory controller, GPU, IO, … – USB 3, USB 3.1 Type C, Thunderbolt, … . Add new functions to the platform . Higher display resolution, multiple displays, high dynamic range (HDR), … without increasing number of chips . Better network connectivity . Add new instructions to resolve software – WiFi standards, cellular standards, Bluetooth, bottlenecks Bluetooth Low Energy (BLE), … Computer Architecture - Uppsala - 2019-05-22 22 What makes a system Tick? Answer: Firmware Inside the processor, PCH, and other chips are many small programmable cores . Any semi-complicated subsystem has a programmable core inside The software running on these cores is called firmware . It is not hardware . But it is not as soft as software . Firmware – long-standing name for close-to-hardware software http://www.ganssle.com/book.htm Disclosure: I wrote a chapter in the book Computer Architecture - Uppsala - 2019-05-22 24 Example: SSD Intel® Solid-State Drive Toolbox . Looking at the Intel® 600p M.2. PCIe NVMe drive in one of my PCs . Note the ”firmware revision” – There is a processor (or several) in there! – Updates are available to download and install Computer Architecture - Uppsala - 2019-05-22 25 Example: Keyboard with 32-bit Processor The tech specs for the Corsair* Gaming K95 keyboard: . ”32-bit ARM* Processor” . ”Display Controller” Conclusion: . If it is ”smart” or capable of acting independently, it has firmware in it http://www.corsair.com/en-us/corsair-gaming-k95-rgb- mechanical-gaming-keyboard-cherry-mx-red *Other names and brands may be claimed as the property of others Computer Architecture - Uppsala - 2019-05-22 26 Example: Functionality Upgrades via Firmware Sony* Playstation* 4 (PS4) HDMI controller upgraded from HDMI 1.4 to 2.0 to support HDR - using a firmware update! Hardware had the bit-pushing ability needed, but not the protocol and copy-protection bits http://arstechnica.com/gaming/2016/09/whats-up-with- ps4s-surprise-firmware-update-is-4k-around-the-corner/ Computer Architecture - Uppsala - 2019-05-22 28 ”Russian Dolls” Applications Memory Operating system Main Main core core The operating system and user sees a device on Timer Crypto the PCIe bus, with memory-mapped IO