Implement download throttling based on documents per timeunit about csaf_distribution HOT 4 CLOSED

Of course it is not really useful for a provider to restrict the number of document that can be downloaded in a certain time frame. So the checker should warn about it, if it could detect it (which is not always possible). The checker should issue a warning if this option is given so it is clear that it should not be necessary to avoid an automatic IP block.

from csaf_distribution.

This is implemented in the aggregator as per "feed" config option rate (gives the average upper limit of https operations per second).

Needs documentation:
@Fadiabb can you document all config parameters and the structure of the config file for the aggregator?

Also needs implementation for the checker. @Fadiabb is that also something for you?

from csaf_distribution.

Something is implemented, needs a check if documentation is there and everything is consistent.

from csaf_distribution.

Documented in https://github.com/csaf-poc/csaf_distribution/blob/main/docs/csaf_aggregator.md and https://github.com/csaf-poc/csaf_distribution/blob/main/docs/csaf_checker.md

Checked throttling on checker and a second provider, which worked in version: "0.9.3-13-g69c3030".

Documentation is consistent with rate = [files per second] where [files per second] is a positive number, e.g. "55.3"

from csaf_distribution.