Task-parallel computing: Samuel’s tutorial
Summary: Samuel's tutorial on task-parallel computing.
Topics: Task parallelism, data parallelism, Moore's law, Dennard scaling, Amdahl's law, Gustafson's law
Slides: link (pdf)
References
- G. E. Moore, "Cramming more components onto integrated circuits" (1965)
- G. E. Moore, "Progress in digital integrated electronics", Electron devices meeting (1975)
- H. Ritchie and M. Roser, https://ourworldindata.org/technological-change
- K. Flamm, "Measuring Moore’s law: evidence from price, cost, and quality indexes", University of Chicago Press (2019)
- R. H. Dennard et al., "Design of ion-implanted MOSFET's with very small physical dimensions", IEEE Journal of solid-state circuits (1974)
- S. Borkar et al., "The future of microprocessors", Communications of the ACM (2011)
- M. Bohr, "A 30 year retrospective on Dennard's MOSFET scaling paper", IEEE Solid-State Circuits Society Newsletter (2007)
- G. M. Amdahl, "Validity of the single processor approach to achieving large scale computing capabilities", Proceedings of the Spring Joint Computer Conference (1967)
- J. Hennessy and D. Patterson, "Computer Architecture: A Quantitative Approach" (2017)
- J. Gustafson, "Reevaluating Amdahl's law", Comms. of the ACM (1988)
- T. Cormen et al., "Introduction to algorithms" MIT press (2022)
- M. Conway, "A multiprocessor system design", Fall Joint Computer Conference (1963)
- R. Blumofe et al., "Cilk: An efficient multithreaded runtime system", ACM SigPlan (1995)
- L. Lamport, "How to make a multiprocessor computer that correctly executes multiprocess programs", IEEE ToC (1979)