Giter VIP home page Giter VIP logo

vae-kpca-hdbscan's People

Contributors

makbari1997 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

Forkers

ngnquanq

vae-kpca-hdbscan's Issues

FileNotFoundError on train_loop()

Current Behavior

In the training of the VAE model, I encountered an error on line 112 that prevented me from loading the model's weights.

model.load_weights(os.path.join('artifacts', config['dataset'], 'vae', 'vae.h5'))

Last commit is:
7ce718c

The error message is:

Traceback (most recent call last):
  File "/content/drive/MyDrive/masoud/vae/main.py", line 135, in <module>
    run(config)
  File "/content/drive/MyDrive/masoud/vae/main.py", line 102, in run
    train_loop(
  File "/content/drive/MyDrive/masoud/vae/model/train.py", line 50, in train_loop
    model.save_weights(filepath=path, overwrite=True, save_format='h5')
  File "/usr/local/lib/python3.10/dist-packages/keras/utils/traceback_utils.py", line 67, in error_handler
    raise e.with_traceback(filtered_tb) from None
  File "/usr/local/lib/python3.10/dist-packages/h5py/_hl/files.py", line 567, in __init__
    fid = make_fid(name, mode, userblock_size, fapl, fcpl, swmr=swmr)
  File "/usr/local/lib/python3.10/dist-packages/h5py/_hl/files.py", line 237, in make_fid
    fid = h5f.create(name, h5f.ACC_TRUNC, fapl=fapl, fcpl=fcpl)
  File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
  File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
  File "h5py/h5f.pyx", line 126, in h5py.h5f.create
FileNotFoundError: [Errno 2] Unable to create file (unable to open file: name = 'artifacts/persian_atis/vae/vae.h5', errno = 2, error message = 'No such file or directory', flags = 13, o_flags = 242)

Context (Environment)

My config is:

{
    "dataset" : "persian_atis",
    "seq_length" : "max",
    "finetune" : true,
    "finetune_epochs" : 60,
    "train_epochs" : 350,
    "batch_size" : 16,
    "vae_learning_rate" : 0.00002,
    "bert_freeze_layers" : 11,
    "bert" : "bert-base-multilingual-uncased",
    "activation" : "tanh",
    "vector_dim" : 768,
    "latent_dim" : 36,
    "encoder" : [512, 256, 128, 64],
    "decoder" : [64, 128, 256, 512, 768],
    "ood_threshold" : 0.2
}

and I am running the code on Google Colab.

ValueError after fine-tuning

Current Behavior

After fine-tuning the model, I encountered an error on line 80 that prevented me from saving the model's weights.

bert.layers[0].set_weights(classifier.layers[0].get_weights())

Last commit is:
7ce718c

The error message is:

ValueError: Layer bert weight shape (105879, 768) is not compatible with provided weight shape (30522, 768).

Context (Environment)

My config is:

{
    "dataset" : "persian_atis",
    "seq_length" : "max",
    "finetune" : true,
    "finetune_epochs" : 60,
    "train_epochs" : 350,
    "batch_size" : 16,
    "vae_learning_rate" : 0.00002,
    "bert_freeze_layers" : 11,
    "bert" : "bert-base-multilingual-uncased",
    "activation" : "tanh",
    "vector_dim" : 768,
    "latent_dim" : 36,
    "encoder" : [512, 256, 128, 64],
    "decoder" : [64, 128, 256, 512, 768],
    "ood_threshold" : 0.2
}

and I am running the code on Google Colab.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.