dod-advana / gamechanger-ml Goto Github PK

GAMECHANGER Machine Learning Repo

License: MIT License

Makefile 0.02% Python 79.26% Dockerfile 0.59% Shell 1.92% Jupyter Notebook 18.21%

dod policy-as-code ml machine-learning python nlp natural-language-processing transformer mlops

gamechanger-ml's Issues

Source code does not have script `run_train_models` as described by README

In the section "Train Models" of README.md, these scripts are not in the source code, directory gamechangerml/train/scripts.

run_train_models

Excerpt:

For query expansion:
python -m gamechangerml.train.scripts.run_train_models --flag {MODEL_NAME_SUFFIX} --saveremote {True or False} --model_dest {FILE_PATH_MODEL_OUTPUT} --corpus {CORPUS_DIR}

Missing the steps git add, git commit, git push?

Unavailable model jbook_qexp_20220131

As of 2023, September 24,

The model jbook_qexp_20220131 is unavailable on https://github.com/dod-advana/gamechanger-data/releases

Possible options:

Revert it back to jbook_qexp_20201217 as it is available on https://github.com/dod-advana/gamechanger-data/releases
Upload the the model jbook_qexp_20220131 to an accessible place on public internet.

Code location:

gamechangerml/api/utils/pathselect.py:47

CC: @jram930 @JaredJRoss

`faiss-gpu` installation fails

pip install -r lock.requirements.txt' fails when attempting to install faiss-gpu`

Relevant error message:

Collecting faiss-cpu==1.7.1.post2
  Using cached faiss-cpu-1.7.1.post2.tar.gz (41 kB)
  Preparing metadata (setup.py) ... done
Collecting faiss-gpu==1.7.1.post2
  Downloading faiss-gpu-1.7.1.post2.tar.gz (40 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.3/40.3 KB 524.9 kB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
  WARNING: Generating metadata for package faiss-gpu produced metadata for project name faiss-cpu. Fix your #egg=faiss-gpu fragments.
Discarding https://files.pythonhosted.org/packages/17/76/47d0cc8161f4bf988583a2839bb1e56baf09d6b80cfa472b9eba4d5f543b/faiss-gpu-1.7.1.post2.tar.gz#sha256=877478752c03678fd9b9553e4ffadca82cd337bba9bb6a939aa1c6ea561a7a58 (from https://pypi.org/simple/faiss-gpu/): Requested faiss-cpu from https://files.pythonhosted.org/packages/17/76/47d0cc8161f4bf988583a2839bb1e56baf09d6b80cfa472b9eba4d5f543b/faiss-gpu-1.7.1.post2.tar.gz#sha256=877478752c03678fd9b9553e4ffadca82cd337bba9bb6a939aa1c6ea561a7a58 (from -r lock.requirements.txt (line 23)) has inconsistent name: filename has 'faiss-gpu', but metadata has 'faiss-cpu'
ERROR: Could not find a version that satisfies the requirement faiss-gpu==1.7.1.post2 (from versions: 1.5.3, 1.6.0, 1.6.1, 1.6.3, 1.6.4, 1.6.4.post2, 1.6.5, 1.7.0, 1.7.1, 1.7.1.post1, 1.7.1.post2)
ERROR: No matching distribution found for faiss-gpu==1.7.1.post2

Sync up with gamechanger-data on what version it uses

Currently, the version that gamechanger-data uses to build docker in dev_tools/requirements/rhel8.locked.requirements.txt fails. See issue 285 on gamechanger-data.

If gamechanger-data updates the mentioned above file to use more recent gamechanger-ml version, not v1.8.0 or v2.0.0 as it also fails, the file requirements.txt of this repo, gamechanger-ml needs to be updated to synchronize/deconflict versions dependency with the above file rhel9.locked.requirements.txt to have a successful build. Again, see issue 285

References:

dod-advana/gamechanger-data#285

dod-advana / gamechanger-ml Goto Github PK

gamechanger-ml's Issues

Source code does not have script `run_train_models` as described by README

Unavailable model jbook_qexp_20220131

`faiss-gpu` installation fails

Sync up with gamechanger-data on what version it uses

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent