Task-parallel computing: Samuel’s tutorial

Summary: Samuel's tutorial on task-parallel computing.
Topics: Task parallelism, data parallelism, Moore's law, Dennard scaling, Amdahl's law, Gustafson's law
Slides: link (pdf)

  • G. E. Moore, "Cramming more components onto integrated circuits" (1965)
  • G. E. Moore, "Progress in digital integrated electronics", Electron devices meeting (1975)
  • H. Ritchie and M. Roser, https://ourworldindata.org/technological-change
  • K. Flamm, "Measuring Moore’s law: evidence from price, cost, and quality indexes", University of Chicago Press (2019)
  • R. H. Dennard et al., "Design of ion-implanted MOSFET's with very small physical dimensions", IEEE Journal of solid-state circuits (1974)
  • S. Borkar et al., "The future of microprocessors", Communications of the ACM (2011)
  • M. Bohr, "A 30 year retrospective on Dennard's MOSFET scaling paper", IEEE Solid-State Circuits Society Newsletter (2007)
  • G. M. Amdahl, "Validity of the single processor approach to achieving large scale computing capabilities", Proceedings of the Spring Joint Computer Conference (1967)
  • J. Hennessy and D. Patterson, "Computer Architecture: A Quantitative Approach" (2017)
  • J. Gustafson, "Reevaluating Amdahl's law", Comms. of the ACM (1988)
  • T. Cormen et al., "Introduction to algorithms" MIT press (2022)
  • M. Conway, "A multiprocessor system design", Fall Joint Computer Conference (1963)
  • R. Blumofe et al., "Cilk: An efficient multithreaded runtime system", ACM SigPlan (1995)
  • L. Lamport, "How to make a multiprocessor computer that correctly executes multiprocess programs", IEEE ToC (1979)