HBench: Java: an application-specific benchmarking framework for Java virtual machines

Java applications represent a broad class of programs, ranging from programs running on embedded products to highperformance server applications. Standard Java benchmarks ignore this fact and assume a fixed workload. When an actual application's beha vior differs from that included in a standard benchmark, the benchmark results are useless, if not misleading. In this paper, we present HBench:Java, an application-specific benchmarking framework, based on the concept that a system's performance must be measured in the context of the application of interest. HBench:Java employs a methodology that uses vectors to characterize the application and the underlying JVM and carefully combines the two vectors to form a single metric that reflects a specific application' s performance on a particular JVM such that the performance of multiple JVMs can be realistically compared. Our performance results demonstrate HBench:Java' s superiority over traditional benchmarking approach...

• Type: Conference
• Year: 2000
• Where: JAVA
• Authors: Xiaolan Zhang, Margo I. Seltzer
• Keywords: Actual Application Beha, Application-specific Benchmarking Framework, JAVA 2000, Performance, Programming Languages