EE16A: Designing Information Devices and Systems I

Elad Alon, Babak Ayazifar, Gireeja Ranade, Vivek Subramanian, Claire Tomlin What Is This Class All About?

• You’ll be learning some of the most critical ideas and techniques used to design and make systems/products like these work! 2 EE16A Course Structure

• Organized in to modules – Lectures within each module closely tied in to labs

• Four key modules: – Imaging – Touchscreen – Locationing – Wireless communications

3 Module Content

• Imaging: • Topics: QV, Vectors, matrices, bases, systems of equations, inverses • Lab: Single-pixel imager • Touchscreen • Topics: IVRCQ, charge sharing, voltage division, op-amps • Lab: Home-made R and C touchscreens • Locationing • Topics: Correlation, orthogonality, least squares • Lab: Acoustic “GPS” • Wireless communications • Topics: Frequency domain, LTI systems, sampling, filtering • Lab: Wireless light switch hack

4 Instructor Team

Gireeja Ranade Elad Alon

Babak Ayazifar Claire Tomlin Vivek Subramanian

5 Instructor Office Hours

• Elad Alon – Tues./Thurs. 10-11am, 519 Cory

• Gireeja Ranade – Mon. 6:30-7:30, Tues. 3:30-4:30, Rooms TBA

• Babak Ayazifar – Tues. 4-6pm, 517 Cory

• Vivek Subramanian – Tues. 11:30am-12:30pm, Thurs. 6pm-7pm, 513 Sutardja Dai

• Claire Tomlin – TBA 6 GSIs and Readers

GSIs • Paroma Varma – Office hours: Wed. 3-4pm • Vasuki Swamy – Office hours: Wed. 11am-12pm • GSI #3 TBA

• (Note GSI office hours begin next week)

Readers and Lab Assistants • Ajeya Cotra, Leah Dickstein, CJ Geering, Ena Hariyoshi, Scout Heig, Vikram Iyer, Chengming Liao, Ninad Munshi

7 Class Websites

• Will be using piazza as main means of communication – Be sure to enroll! – https://piazza.com/class/i4ukt4bqz5i5hn

• Will also be setting up a separate course website on inst.eecs.berkeley.edu – Will provide link later this week

8 Discussions

• Planning to hold two separate discussions – “Main” discussion no Wed. focused on material review and exercises – Optional discussion on Fri. focused on homework for the week

• Note new discussion schedule: – Wed. 9-10am 3113 Etecheverry (Paroma) – Wed. 1-2pm 241 Cory (Vasuki) – Fri. 1-2pm 293 Cory (Paroma) – Fri. 2-3pm 299 Cory (Vasuki)

9 Discussions cont’d

• You can choose which discussions to attend – For now, independent of what you signed up for – But, if we end up with large imbalances, we will revert to what you signed up for

• For this week only, Wed. and Fri. discussions will be identical – Will complete first problem of HW0 (Python install) live, so be sure to attend!

10 Labs

• All held in 140 Cory

• Rotation: Fri., Mon., Tues.

• Stick to the one you signed up for

• Check-offs will happen at the end of the lab session

• Labs begin Fri. Jan. 30th

11 Workload

• 10 (+ 1) homeworks – HW0 will be handed out this Thurs., but will not count towards your final grade

• 4 multi-part labs

• 2 midterms – Midterm 1: Thurs. Feb. 19th, evening – Midterm 2: Thurs. Apr. 9th, evening

• Final exam – Mon. May 11th, 11:30am-2:30pm

12 Grading Policy

• Homeworks: 15% • Labs: 20% • Midterms: 30% • Final: 35%

13 Homework Procedures

• Homeworks will be handed out on Thurs., due the following Thurs. at 5pm – Will set up a drop-off box in Cory; electronic submission accepted/encouraged – If we notice drop in Thurs. lecture attendance, we will shift the deadline to 8am

• Homework “party” will be held Mondays 6-8pm in Cory – Strongly encourage you to attend and get started in advance

14 Homework Procedures

• We will use “self-grading” for the homeworks – Effective way to make sure you look at the solutions! – Solutions and rubric will be handed out Thurs. 5pm – You will submit your self-grades by Mon. 6pm – Readers will check your grading

– Don’t even think about cheating…

15 Final Note #1: EE16B Pilot

• You are all automatically in!

• Will be offered Fall 2015 – You will have plenty of time to decide – But if you figure out you won’t/can’t enroll, please let us know in advance

16 Final Note #2

• This will be a very challenging course sequence, and we will be covering a lot of ground – We have carefully selected which topics to cover and how to cover them – But everything we cover will be done in a rigorous and deep fashion

• If you really learn the material, you can immediately apply it to many real-world problems – I.e., you can get a job, do some research, be a maker, …

• Buckle up and enjoy the ride!

17 What Makes up the “EE” in EECS: Making Information Devices and Systems Interface with and Influence the Real World

Why learn this? What can we do with it?

18 Physical underpinnings

Learning how to design “switches”

Understanding the physics of electron energetics and movement

Using simple components to realize complex systems

19 Mathematical / Algorithmic Underpinnings

Understanding and modeling real systems and real effects in the physical world, e.g., noise

20 An example system: iPad Air 2

• Runs apps, but: – How is it charged / discharged? – What makes the display tick? – How does the Wi-Fi work? – How does it sense touch on the touch screen? – How does it sense motion? – How do the “brains” operate?

… and how can I learn stuff so I can work on such cool technology?

21 Inside an iPad Air 2

Physical world interaction: “Brains”: the main camera Display / touch screen board Communication: Antenna

Energy: Battery

User interface device: home button

Physical world interaction: speakers 22 The Camera

Goal: Convert light into electrical signals

Get color spatial distribution by using an array of “light” detectors, each under a color filter

Each pixel takes the energy of incoming photons and produces charge, which is then read out by scanning through the rows and columns of the array 23 Camera: “Physical” Guts

Note: Aptina, a major supplier of imagers, is in Santa Clara EE117: Electromagnetics

EE118: Optical Engineering

EE140: Analog Circuits

EE141 Digital Circuits

EE130: Semiconductor Device Physics

EE143: Microfabrication 24 Cameras: “Mathematical” Guts

Focus/exposure preprocessing white-balancing Control

Post-processing Color transform demosaic

Compression 25 Power of Digital Signal Processing

DSP

26 Cameras: Compression • Compression of 40x without perceptual loss of quality.

• Example of slight overcompression: DSP difference enables x60 compression!

27 Computational Photography

DSP

Now implemented in smart phones (HDR)

*www.hdrsoft.com

28 Courses That Teach You How to Do This

• EE120: Signals and Systems • EE121: Introduction to Digital Communication Systems • EE122: Introduction to Communication Networks • EE123: Digital Signal Processing • EE126: Probability and Random Processes • EE129: Neural and Nonlinear Information Processing • EE144: Fundamental Algorithms for Systems Modeling, Analysis, and Optimization • EE145B: Medical Imaging Signals and Systems

29 Wi-Fi module

Circuits: EE140: Analog EE142: RF

Antenna: EE117: Electromagnetics Communications: EE121: Digital Comm. Systems EE122: Comm. Networks EE123: Digital Signal Processing

Jobs: There is a HUGE and vibrant communication and design base in the US: Qualcomm, Broadcom, Apple, etc… 30 Main Board

Cirrus Logic: Audio chip

Maxim: Amplifier

Micron RAM: The “Operating Memory”

NXP NFC Chip for Bosch: Accelerometer ApplePay.

Apple A8X: The “Brains” of the iPad Air 2 Hynix Flash Memory: The Texas Instruments “Storage” Touch Screen Controller 31 What about that Accelerometer?

MEMS: EE147

Controls: EE128

The suspended section moves under acceleration, and the surround circuitry senses the position electrically to figure out the acceleration along each access

32 Another cool MEMS Sensor: Gyroscope

How does this work?

The MEMS version using a vibrating mass to generate the inertial forces 33 The A8X

• Designed in Cupertino and fabricated in Taiwan; a multi-core application processor

Circuits: EE141/CS150

Embedded Systems: EE149

34 The Global Semiconductor Food Chain

Design is the key! We still do a LOT of design here in the US, and in particular in silicon valley 35 Not Just Traditional “IT”…

• Robotics, self driving cars • Medical applications, surgery, treatment of tumors

36 The “smart” grid

37 Controls and Robotics: Courses

• EE125: Introduction to Robotics • EE128: Feedback Control Systems • EE145L: Introductory Electronic Transducers Laboratory • EE149: Introduction to Embedded Systems • EE192: Mechatronics

38