Comments (6)
Have you installed this before? You are welcome to install packages in your own $HOME or $WORK directories, or alternatively if there is a pre-existing container with the desired tensorflow variant you can convert docker containers to singularity and run them on the system.
from hpcfund.
Yes, I did the installation locally for myself. I may try to do the same on the cluster. I just thought that, maybe, this could be of interest of other people, in that case it would be probably better to have a centralized installation.
from hpcfund.
Definitely agree! Happy to work on a shared installation, but just wanted to make sure you were able to progress without it. I'll put it on the TODO list and hopefully you might be able to help test a centralized install.
from hpcfund.
I tried to install the package following the instruction for Ubuntu, here https://rocm.docs.amd.com/en/latest/how_to/tensorflow_install/tensorflow_install.html but it seems that there is the need to do something at the system level. All I got is " Cannot dlopen some GPU libraries." One suggestion is to install rocm-dkms, rocm-libs and rccl (don't know if it works)
from hpcfund.
Just a head's up that we have made a shared install of the rocm variant of tensorflow available on the cluster. To access from a default login, issue:
module load tensorflow
At at that point, you should be able to import, e.g:
[atest@login1 ]$ python3
Python 3.9.14 (main, Jan 9 2023, 00:00:00)
[GCC 11.3.1 20220421 (Red Hat 11.3.1-2)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow
2023-09-19 11:32:21.641493: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: SSE3 SSE4.1 SSE4.2 AVX AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
>>>
Hopefully you can give it a try and let us know if you encounter unexpected issues.
from hpcfund.
Thank you!
I did jut a few basic checks and everything seems to work as expected. I will post here if any issues arise while computing more complicated things.
from hpcfund.
Related Issues (11)
- Singularity module HOT 5
- Internet down at HPC? HOT 3
- cannot submit jobs to mi1008x HOT 2
- Profiling the node(s) HOT 8
- some nodes in mi1008x are down HOT 1
- Inquiry of increasing the job time limit HOT 2
- Installing CP2K using Spack: Failure
- Experiments on some nodes are 10x slower than other HOT 1
- launching HIP compiler HOT 5
- 2815415 Segmentation fault HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hpcfund.