Deadlock/livelock/etc. prevention about hvm HOT 5 CLOSED

normal_join is just a function that waits for a thread to complete its assigned reduction. So, as long as it terminates, normal_join will eventually return too. Note that once normal_join is called, the thread that called it doesn't have any more work to do.

from hvm.

Yes, that's exactly how I understood it. Sorry I wasn't specific enough in my description.

What I meant is that there is a fixed number of threads (workers) and they get some work "over the time" (but maybe this is another misunderstanding on my side of the source code and all the work is scheduled up-front in a fixed manner without any dependency on "time" unlike e.g. in work stealing scenarios) whether each thread gets to normal_join there is a guarantee there is no more work to schedule.

from hvm.

The scheduler is very primitive see here. Each thread is only assigned a redex, and then it just waits. A task scheduler is one of the improvements we'd like to make if we manage to scale this project.

from hvm.

Then I'd recommend a work-stealing scheduler. Ideally one optimized for micro tasks (the state of the art is still Weave - you can easily skip the binary generation and use only the generated C code as Nim is just a clever transpiler).

from hvm.

Yep, something like that is very high on my dream wishlist!

from hvm.