Filtering benchmarks based on tags about sandmark HOT 6 CLOSED

We could build this into the makefile as

$ make run_config TAGS="macro_bench"

and have a target called run_config which uses the environment variable TAGS to filter those tags.

Is there a way to accept more than one tag in that command?

from sandmark.

Is there a way to accept more than one tag in that command?

Perhaps this is not a good idea. It is unclear whether the filter with multiple tags should act as a conjunction or disjunction.

from sandmark.

See #196.

from sandmark.

Is there a way to accept more than one tag in that command?

This is a useful feature request, considering that we would like to classify benchmarks based on the family of algorithms as well. A researcher might be interested to run those benchmarks that are macro_benchmarks, for example, AND finish in less than 10s AND belong to graph algorithms.

from sandmark.

We can do conjunction by filtering the filtered file. See https://github.com/ocaml-bench/sandmark/pull/196/files#diff-b54b39f1afced2465e1f3641db9d5bbf4f3a7fcf890996dfedd3c197bcb7f8c7R66-R67. Disjunction is trickier.

Let's review and merge #196 first, given that we can already do conjunction, albeit externally.

from sandmark.

A researcher might be interested to run those benchmarks

Let's also wait until this researcher turns up :-)

from sandmark.