Comments (4)
Hi,
sidenote: the threads are set with the -p
flag. But I suppose you have done that, otherwise you should have gotten a 'unrecognized argument' error.
What -p
does is to set the number of worker threads that run the comparisons of matrix pairs. If you set e.g. -p 6
and watch your top
you should see that after the 'launching workers' log six new processes spawn, irrespective of "NUMEXPR_MAX_THREADS".
That being said, I am not sure where the "NUMEXPR_MAX_THREADS" warning is coming from, and I get it too, so I'll investigate.
from chess.
indeed -p
I am sending the jobs to the cluster and set -p 8 and the SLURM command accordingly. Since jobs don t get killed, I assumed either this is a weird warning or no multithreading occurs. I'll try running local but this is a minor aspect anyway.
from chess.
Hi, I am experiencing the same issue as @cgirardot on a PBS cluster. No matter what value I set with -p
I will always get the same message.
2020-11-02 10:37:31,485 INFO Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8. 2020-11-02 10:37:31,485 INFO NumExpr defaulting to 8 threads.
I am also inspecting the run in at interactive node and I notice that there is only one chess process running.
The same message gets printed when I run chess extract
. Maybe that could be a hint to the issue?
Thanks,
Nikos
from chess.
Hi @sidiropoulos, thank you for reporting this. NumExpr is used in PyTables, which is again used in FAN-C (see https://fan-c.readthedocs.io/en/latest/fanc-executable/fanc_basic.html#numexpr-threadpool-configuration). The message refers to multi-threading in NumExpr only, not in chess
in general.
As the message is confusing, we remove it with the 0.3.5 patch.
Chess itself uses multi-threading for the actual matrix-comparisons, as I said above. If you set -p
> 1 then you should observe in your system monitor process viewer that new chess processes spawn after the "INFO Launching workers" log message.
from chess.
Related Issues (20)
- chess --version doesn't work?
- CNV bias in normalization HOT 2
- Conditions for conservation analysis of syntenic blocks HOT 5
- Nan Continued HOT 2
- No valid region pairs found? HOT 1
- Different resolution produce different result HOT 1
- Should the users be concerned about the problem raised in the new Contradictory Results bioRxiv preprint? HOT 2
- conservation analysis when only a few syntenic blocks are available HOT 3
- speed up the chess run HOT 1
- error of the chess extract HOT 3
- issue of normalized/chess extract HOT 1
- error on running chess sim HOT 2
- error when running extract on .hic files HOT 1
- something different from plotting HOT 9
- _pickle.PicklingError HOT 2
- chess extract error: operands could not be broadcast together with shapes HOT 1
- data_range parameter not specified - error HOT 7
- Chess sim output .tsv file explained HOT 1
- Normalization of .hic files HOT 1
- Deprecated parameters in scikit-image & scikit-learn
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chess.