performance tests: define a baseline about js-ipfs-bitswap HOT 4 OPEN

Sounds about right. One thing that is needed for the baseline is the specs of the machine where the benchmarks are run, so we can still ~ follow the baseline on less/more powerful machines.

from js-ipfs-bitswap.

@victorbjelkholm Should the new CI infra-structure be able to handle this stability, or are we looking into some variance we need to deal with?

from js-ipfs-bitswap.

My thinking is that we should probably use some standard specs from an average laptop as the baseline, and we can spin up CI workers that are close to that.

from js-ipfs-bitswap.

Sounds good. Couchbase has a nice dashboard to easily spot regressions between builds: http://showfast.sc.couchbase.com/. Having something like that would be great. I know that's a separate discussion, but I thought this is a good place to bring it up.

from js-ipfs-bitswap.