Comments (6)
Hi Frank,
Unfortunately, most pyod models are not compatible with GPU computation. XGBOD itself actually would not benefit from GPU too much as the most expensive part is generating additional features, i.e. running a few unsupervised outlier detection algorithms.
We did consider to enable GPU: https://pyod.readthedocs.io/en/latest/todo.html in the future, but for now it is still on the todo list and not decided when/how to do it efficiently.
Best,
Yue
from pyod.
Thanks a lot. However, I wonder whether this tool can be used under big data enviroment in the future?
from pyod.
I am using the MO-GAAL and I was hoping to benefit from GPU but it is only 25% faster for the training. Is it expected? I am wondering if I am doing something wrong somewhere ^^
from pyod.
I am using the MO-GAAL and I was hoping to benefit from GPU but it is only 25% faster for the training. Is it expected? I am wondering if I am doing something wrong somewhere ^^
Hi TimotheeGr, can you tell me how you enabled training on GPU for MO-GAAL ?
from pyod.
if you are using the old version tensorflow (<=1.15), then make sure you installed tensorflow-gpu.
for newer version tensorflow, that is automatic.
Given GPU is being used (search google "tensorflow not using gpu" if not), mo_gaal's usage is automatic. We get the consent from the paper author so that is based on their code.
from pyod.
After my question above I checked that the GPU was used with nvidia-smi
and it is only used at 7-10% level which probably explains why it is not a big improvement.
(But I am quite a beginner on this)
from pyod.
Related Issues (20)
- How to save the results of the evaluate_print
- Mention newly added MLflow support in docs
- The number of non-zero elements in projection vector for LODA
- AttributeError: module 'numpy' has no attribute 'float'. HOT 1
- IForest feature contribution for a given outlier HOT 3
- 计算异常概率时会有除数为0的问题 HOT 1
- may you clarify what is difference between pyod and TODS HOT 3
- Memory not Freed on line 131 of mo_gaal.py
- Update contamination without retraining HOT 4
- ValueError: node array from the pickle has an incompatible dtype HOT 1
- ABOD missing support for kernels
- ABOD weighting schemes / not matching the definition? HOT 1
- ROD models: RuntimeWarning: invalid value encountered in divide
- Which algorithms support ‘Semi-supervised Novelty Detection’?
- Support SHAP for model explanation
- Default parameter inconsistent with docs
- different results depending on time-span HOT 2
- saved model size
- Model prediction in Autoencoder does not support adjusting batch size
- False positive warning when manipulating pandas dataframes
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pyod.