redirect multiprocess hangs sometimes for large batch file on windows 2012 server about gamadv-xtd3 HOT 10 CLOSED

I'll have to take a look at this
Gam uses a pool of subprocesses; when one finishes, gam assigns the next task to it. When all tasks have been assigned, gam waits for all process to finish and then exits. If one child process hung you'd expect to see one parent and one child, not a bunch of children. Let me see what I can ad in the way of additional debugging.

from gamadv-xtd3.

Otherwise i can just chunk the input file to see if that makes it more stable.

from gamadv-xtd3.

Call me on Google Hangouts or send a Meet invitation.

[email protected]

from gamadv-xtd3.

This won't solve the problem but is a simplification and considerably reduces the size of test.csv

$ more test.csv
group
[email protected]
[email protected]
$ gam redirect stdout stdout.txt multiprocess redirect stderr stderr.txt multiprocess csv text.csv gam print group-members group ~group
Using 2 processes...

from gamadv-xtd3.

I will change the csv file per your suggestion. Since the error occures intermittent it might take a while before i can see a change.

from gamadv-xtd3.

Changing to the CSV form only simplifies your data, behind the scenes it is the same processing, so it is not going to solve the problem. I don't yet see where the hang comes from.

from gamadv-xtd3.

ok, I will also split up the file in smaler parts to see if i can connect the hang to a specific group.

from gamadv-xtd3.

just a wild guess: https://bugs.python.org/issue37424 scroll down to "https://bugs.python.org/issue37424"

from gamadv-xtd3.

I don't think that's it; anyway if you have a current version GAM is using Python 3.8.1.
Is there any change you can temporarily install GAM on Linux/MacOS so we can see if this is a Windows issue.

from gamadv-xtd3.

This should be fixed in 5.08+

from gamadv-xtd3.