Hi Jonathan. I have to admit not having that much experience with Java benchmarking frameworks so I will defer to you on the matter of the suitability of different libraries.
I’m in the process of trying to package the Dropwizard Metrics library (https://github.com/dropwizard/metrics) which is actually a dependency for Dropwizard itself, and Caliper is a dependency for the metrics library. I agree that it would be nice to avoid duplicating functionality in the Debian archive but in this case I don’t think there is a way around it right now.