Benchmarking the MRNet Distributed Tool Infrastructure: Lessons Learned
File(s)
Date
2004Author
Miller, Barton P.
Roth, Philip
Arnold, Dorian
Publisher
University of Wisconsin-Madison Department of Computer Sciences
Metadata
Show full item recordAbstract
MRNet is an infrastructure that provides scalable multicast and data aggregation functionality for distributed tools. While evaluating MRNet?s performance and
scalability, we learned several important lessons about benchmarking large-scale, distributed tools and middleware. First, automation is essential for a successful benchmarking effort, and should be leveraged whenever possible during the benchmarking process. Second, microbenchmarking is invaluable not only for establishing the performance of low-level functionality, but also for design verification and debugging. Third, resource management systems need substantial improvements in their support for running tools and applications together. Finally, the most demanding experiments should be attempted early and
often during a benchmarking effort to increase the chances of detecting problems with the tool and experimental methodology.
Permanent Link
http://digital.library.wisc.edu/1793/60394Citation
TR1503