On the speedup of distributed linear solvers
Zuberek, W.M. and Perera, T.D.P.
Proc. 5-th EUROSIM Congress on Modeling and Simulation,
Special Session on Modeling and Simulation of Distributed Systems and Networks;
Marne la Vallee, France, 6-10 September 2004, pp.222-223.
Abstract:
Speedup is usually defined as the ratio of the execution time of an application
on a single processor to the execution time of the same workload on an
N-processor system. The paper estimates the speedup of distributed iterative
solvers, analyzes the influence of difference communication schemes on the
speedup, and compares the estimates with the measurements of real distributed
programs.
Keywords:
Distributed computing, speedup, computation-to-communication ratio,
sparse systems of linear equations, iterative methods.
References:
-
O. Axelsson (1994). Iterative solution methods; Cambridge University
Press.
-
F. Berman, G. Fox, T. Hey (2003). Grid computing: making the global
infrastructure a reality; J. Wiley.
-
L. Erlander (2002). "Distributed computing: an introduction"; Extreme
Tech, April 4, 2002.
-
V.K. Garg (1998). Principles of distributed systems; Kluwer Academic
Publ.
-
A. Greenbaum (1997). Iterative methods for solving linear systems
(Frontiers in Applied Mathematics 17); SIAM.
-
W. Gropp, E. Lusk, A. Skjellum (1999). Using MPI: portable parallel
programming with the message-passing interface (2-nd ed.); MIT Press.
-
W. Hackbusch (1995). Iterative solution of large sparse systems of
equations (Applied Mathematical Sciences 95); Springer-Verlag.
-
S. Hamilton (1999). "Taking Moore's law into the next century"; IEEE
Computer Magazine, vol.32, no.1, pp.43-48.
-
R. Merritt (2003). "Intel, clusters on the rise in 'Top 500 Supercomputers'
list"; EE Times Online, November 18.
-
R.A. Saleh, K.A. Gallivan, M-C. Chang, I.N. Hajj, D. Smart, T.N. Trick (1989).
"Parallel circuit simulation on supercomputers";
Proceedings of the IEEE vol.77, no.12, pp.1915-1931.
-
M.R. Steed, M.J. Clement (1996). "Performance prediction of PVM programs";
Proc. 10-th Int. Parallel Processing Symposium (IPPS-96), pp.803-807.
-
J.A. Stankovic (1994). "Distributed computing"; in Distributed
computing systems, IEEE CS Press.
-
H. van der Vorst (1999), "Iterative methods for linear systems and
implementation on parallel computers"; in Iterative methods in
scientific computing; R.H. Chan, T.F. Chan, and G.H. Golub (eds.),
Springer-Verlag, pp.1-44.
-
B. Wilkinson (1996). Computer Architecture - Design and Performance
(2-nd ed.). Prentice Hall.
-
Beowulf home page is "www.beowulf.org".
-
ClimatePrediction home page is "www.climateprediction.net".
-
SETI@home home page is "setiathome.ssl.berkeley.edu".
Available in pdf
and postscript.
Full version of the paper available in
pdf.