Parallel Architectures and Programming

Relevant xkcd #howifeelaboutml

Reading

Computer Organization and Design

Chapter 6

Kinds of parallel architectures

Reading

Computer Organization and Design

Sections 6.1 and 6.3

In this section, we will start by discussing different kinds of parallel architectures.

This video discusses Flynn’s taxonomy and the different kinds of parallelism (from the perspective of software).

This video discusses different kinds of parallel architectures (from the perspective of hardware).

Shared memory architectures

Reading

Computer Organization and Design

Sections 6.4

IMPORTANT NOTE: If you notice that I got a haircut, it’s because I’m time traveling. These videos are from Winter quarter 2020. IT’S NOW BEEN AN ENTIRE YEAR!!

This video talks about shared memory vs message passing, and different synchronization primitives in a shared memory system.

This video talks about how to implement a barrier in a shared memory system. This implementation is going to be the motivation our next few videos about the hardware implementation of these system.

QUIZ Parallel architectures

Use Canvas to complete the quiz

Discussion

General discussion

Discuss in the Discord app!
Or, on the web