Overview
This benchmark suite is intended as a tool for Java benchmarking
by the programming language, memory management and computer architecture communities. It consists of a set
of open source,
real world
applications with non-trivial memory loads. The suite is the culmination of over five years work at eight institutions, as part of the DaCapo research project, which was funded by a National Science Foundation ITR Grant, CCR-0085792.
Our suite evolves to maintain its relevance. It is therefore essential that
you cite the version number associated with the release in any use of
the benchmark, and as a courtesy to the developers, we ask that you please cite the paper from OOPSLA 2006 describing the suite:
Blackburn, S. M., Garner, R., Hoffman, C., Khan, A. M., McKinley, K. S., Bentzur, R., Diwan, A., Feinberg, D., Frampton, D., Guyer, S. Z., Hirzel, M., Hosking, A., Jump, M., Lee, H., Moss, J. E. B., Phansalkar, A., Stefanovic, D., VanDrunen, T., von Dincklage, D., and Wiedermann, B. The DaCapo Benchmarks: Java Benchmarking Development and Analysis, OOPSLA '06: Proceedings of the 21st annual ACM SIGPLAN conference on Object-Oriented Programing, Systems, Languages, and Applications, (Portland, OR, USA, October 22-26, 2006) (pdf, BibTeX).
News
NEW Nov 19, 2008 In anticipation of the upcoming release, we have created a TODO list of work that needs to be done before the upcoming release. Please send email to the mailing list or directly to Steve Blackburn if you think you can help.
COMING SOON July 23, 2008 As part of the up-coming release, we are working hard on a first draft of a new workload based on the DayTrader app-server workload. Please contact Steve Blackburn directly if you are interested in contributing to the design and testing of this workload.
See news for a list of past news.
Plans
Since the release of dacapo-2006-10, we have been working toward the next major release of the suite, currently scheduled to appear in October 2008. We plan to make beta releases in the coming months.
- We are examining new benchmarks for potential inclusion in the next release. The first new benchmark to be proposed was SunFlow. We finished a first cut implementation in late 2006. Sunflow and all other candidate workloads are evaluated in our continuous regressions of our development head. This benchmark came to our attention via an external nomination.
- We have also started evaluating Apache Geronimo and its DayTrader benchmark. If there are other benchmarks people would like to be considered, please contact us via the mailing list.
- We are continually looking at improving and possibly removing existing workloads. Please use the mailing list if you have suggestions for improving the existing benchmarks.
- We are considering a new workload which will run multiple benchmarks concurrently (simulating a multi-application concurrent workload).
Feedback
We invite feedback on the suite from the community. Please use the researchers' mailing list.
License
Each of the constituent benchmarks
is open source or public domain. The original source for each of the benchmarks is
automatically downloaded by building our source distribution. The copyright information
for each benchmark is available via the -i option to the test harness.
The suite itself is available under the Apache license.
For questions or comments please use the researchers mailing list.
Copyright 2001-2008 by the DaCapo
Project,
All Rights Reserved.