Option to not use md5 for file dependencies. about doit HOT 2 CLOSED

It would be nice to add a way plug a different implementation for check if a file changed (not only being able to disable MD5).

I see this could be done in 3 different levels.

• globally on DOIT_CONFIG
• on task level with a new attribute
• for a each file_dep

Did you actually measure it? I would like to see some benchmarks (or your code is open source?)

md5 is never computed for targets, where you get this from?

Another problem is that I think doit is calculating the md5 of same file more than once per run.

from doit.

It would be nice to add a way plug a different implementation for check if a file changed (not only being able to disable MD5).

Yes, indeed !

Did you actually measure it? I would like to see some benchmarks (or your code is open source?)

No the code is not open source. A little test with a 'echo' action and a 8.5Gb file takes roughly ~40sec.

md5 is never computed for targets, where you get this from?

My bad, I looked at the code a few days ago and I didn't remember correctly. So yes, it is computed only for file_dep.

from doit.