Recently, Egon Willighagen announced a project to develop an open benchmark suite for cheminformatics. Currently Egon, Rajarshi Guha, and myself have each created forks of the project on GitHub. After a brief period of quiet, things have started moving with incorporation of the Japex benchmarking framework. If you’re not familiar with Japex, it does for benchmarking what Ant does for building.