Parallel Architectures and Programming

Relevant xkcd #howifeelaboutml

Reading (154B)

Computer Organization and Design

Chapter 6

Reading (201A)

Computer Architecture: A Quantitative Approach

Chapter 4 and 5

Lecture from 3/4

Lecture from 3/9

Kinds of parallel architectures

Reading (154B)

Computer Organization and Design

Sections 6.1 and 6.3

In this section, we will start by discussing different kinds of parallel architectures.

This video discusses Flynn’s taxonomy and the different kinds of parallelism (from the perspective of software).

This video discusses different kinds of parallel architectures (from the perspective of hardware).

Shared memory architectures

Reading (154B)

Computer Organization and Design

Sections 6.5

Edition 1

Sections 6.4

Reading (201A)

Computer Architecture: A Quantitative Approach

5.1–5.3

IMPORTANT NOTE: If you notice that I got a haircut, it’s because I’m time traveling. These videos are from Winter quarter 2020. IT’S NOW BEEN AN ENTIRE YEAR!!

This video talks about shared memory vs message passing, and different synchronization primitives in a shared memory system.

This video talks about how to implement a barrier in a shared memory system. This implementation is going to be the motivation our next few videos about the hardware implementation of these system.

Discussion

General discussion

Discuss in the Discord app!
Or, on the web