2: Introduction to Scalable Computing (1)
Plan:
- Parallelism and Scalability:
- A hot topic
- Scalability: "how-to"
- Computer Science Laws
- Amdahl's Law
- Gustafson-Barsis' law
- Scalability of Multicore Processors
- Technological motivations
- Amdahl's law and Multicore Processor
- Conclusions
Reading material:
(Papers can be found into the annotated
bibliography)
- Mitchell
D. Theys and Shoukat Ali and Howard Jay Siegel and Mani Chandy and Kai
Hwang and Ken Kennedy and Lui Sha and Kang G. Shin and Marc Snir and
Larry Snyder and Thomas Sterling. "What Are the Top Ten Most
Influential Parallel and Distributed Processing Concepts of the Past
Millenium?", Journal of Parallel and Distributed Computing, 2001 (61).
- Ahluwalia,
K. S.
(2007), Scalability design patterns, in 'Proceedings
of the 14th
Conference on Pattern Languages of Programs', ACM, New York, NY, USA,
pp.
2:1--2:8.
- Amdahl,
G. M.
(1967), Validity of the single processor approach to achieving large
scale
computing capabilities, in 'Proceedings of the
April 18-20, 1967, spring
joint computer conference', ACM, New York, NY, USA, pp. 483--485.
- Gray,
J. (2003),
'What next?: A dozen information-technology research goals', J.
ACM 50,
41--57.
- Gustafson,
J. L.
(1988), 'Reevaluating Amdahl's law', Commun. ACM 31,
532--533.
- Hill,
M. D.
& Marty, M. R. (2008), 'Amdahl's Law in the Multicore Era', Computer
41, 33--38.
- "The
free lunch is over: a fundamental turn toward concurrency in software",
H. Sutter, Dr. Dobb's Journal,
30(3), March 2005.
- Slides
(only for taking track of the arguments treated in the lesson)
- Some graphs and formulations are taken by the
Slides of R.Nicolescu "Parallel
Programming Speedup"
Possible personal project topics:
For the PhD students that
have to take the exam, from this lesson some possible arguments for the
personal project (small report and presentation in class) are available:- Reconciling Amdahl law and Gustafson-Barsi law: are they the same or really the opposite?
- A
more detailed presentation of the Hill-Marty result, with the analysys
of their limits and a critical evaluation of technological coefficients