This section give you some background on historic and modern computing technology.
Computer Organization and Design
Chapter 1
Computer Organization and Design
Sections 1.1, 1.2, 1.3
Before diving into anything, I’d like you to take about an hour to watch the Turing Lecture given by John Hennessy and David Patterson. It’s a relatively long video (and the longest I’ll ask you to watch), but it’s packed full of interesting historical information and future prognostications by two preeminent computer architecture researchers. The Turing Award is the “Nobel Prize of Computer Science.” It’s given once a year “for major contributions of lasting importance to computing.”
In 2017, the Turing Award was given to two computer architects, John Hennessy and David Patterson (who happened to write your book as well!). They gave a lecture with the International Symposium on Computer Architecture or ISCA the premiere venue for computer architecture research. Given that their audience was computer architecture researchers, I don’t expect you to understand everything in the lecture. However, it’s great overview of the past, present, and future of the field of computer architecture. We will come back again and again to the themes presented in this lecture.
What surprised you the most in the Turing Lecture?
What questions do you have? The audience was mostly computer architecture researchers, so I’m sure there are many things that didn’t make sense and/or didn’t have enough context. I’m happy to go into more depth on anything!
Computer Organization and Design
Sections 1.4, 1.5
Now, let’s briefly look at computing architecture history and see how we got to where we are today. This video describes a brief history of computer architecture and modern process technology.
And, to give this further context, here’s an interview with someone who was actually there! This is an interview with Jean Bartik, one of the first programmers.
You all have probably heard of Moore’s Law which doesn’t say “processors get twice as fast every 18 months”. Instead, Moore’s Law is an economic, not technical, argument that we’ll be able to find a way to manufacture twice as many transistors per chip every 12-24 months. This video discusses Moore’s Law and the driver of Moore’s Law, Dennard Scaling.
If you are interested, you can read the original paper by Moore from 1965. It’s a quick read, and it’s interesting to see what a visionary was thinking about back in the 60’s!
On the opposite end, there’s a good New Your Times article about the end of Moore’s Law (subscription or campus VPN required) based on the paper “Dark Silicon and the End of Multicore Scaling” by Hadi Esmaeilzadeh, Emily Blem, Renée St. Amant, Karthikeyan (Karu) Sankaralingam, and Doug Burger.
Now that we’ve discussed Moore’s Law and Dennard Scaling, I want to call your attention to a specific part of the Turing Lecture when Hennessy talks about what happens now that Moore’s Law is dead.
Hennessy talked about a paper called “There’s Plenty of Room at the Top”. If you’re interested to read more, you can download the PDF if you log into the Campus VPN.
Why do you think Python matrix multiply is over 60,000x slower than it could be? Why would the Python developers do such a bad job?
Computer Organization and Design
Sections 1.7, 1.8
First, let’s talk about how to reason about the energy and power of computer chips (also called CMOS or complementary metal-oxide semiconductor). In this video, I talk about some of the key contributing factors to the energy and power of these devices.
Finally, let’s look at the trends in the past ~50 years or so. Now that we have an idea of what contributes to the power dissipation of devices, we can see why today’s processors aren’t as much faster as last year’s designs as they used to be. This video talks about how power and energy relate, how transistors work, and brings in how this caused the end of Moore’s Law
What is the number of cores and frequency of the chip in your laptop or phone? Is it ‘faster’ or ‘slower’ than the high-performance chips in 2010 with 8 cores and running at 3 GHz?
What about today’s highest performance chips? How do they compare?
Use Canvas to complete the quiz