zahlii / colab-tf-utils Goto Github PK
View Code? Open in Web Editor NEWAutomatically backup keras/tensorflow models from Google's Colab service to your GoogleDrive based on a keras callback!
License: GNU General Public License v3.0
colab-tf-utils's People
Contributors
Stargazers
Watchers
Forkers
zeroxy carsondahlberg stefoe rbozydar fitrialif rusiaaman zxshinxz shubhampachori12110095 lbcommer ryandam georgemuralkh hiromi-nee jeffleo aascode bbruhh yangjinhuang95 xiftai yearofthewhopper 38438-38438-org tuyennt12colab-tf-utils's Issues
Skipping upload because path function returned no path.
I am getting this error many times. Sometimes, after 10-12 epochs, it begins uploading but sometimes it doesn't upload anything. Any idea ?
Save full model
exec(compile(contents+"\n", file, 'exec'), glob, loc)
File "/Users/georgezagraid/Projects/AI/Projects/binary_LSTM/load_model.py", line 69, in <module>
model = load_model(os.path.join(os.path.dirname(__file__),"models/RNN_Final_0.62.model"))
File "/anaconda3/lib/python3.6/site-packages/tensorflow/python/keras/engine/saving.py", line 229, in load_model
model = model_from_config(model_config, custom_objects=custom_objects)
File "/anaconda3/lib/python3.6/site-packages/tensorflow/python/keras/engine/saving.py", line 306, in model_from_config
return deserialize(config, custom_objects=custom_objects)
File "/anaconda3/lib/python3.6/site-packages/tensorflow/python/keras/layers/serialization.py", line 64, in deserialize
printable_module_name='layer')
File "/anaconda3/lib/python3.6/site-packages/tensorflow/python/keras/utils/generic_utils.py", line 173, in deserialize_keras_object
list(custom_objects.items())))
File "/anaconda3/lib/python3.6/site-packages/tensorflow/python/keras/engine/sequential.py", line 293, in from_config
layer = layer_module.deserialize(conf, custom_objects=custom_objects)
File "/anaconda3/lib/python3.6/site-packages/tensorflow/python/keras/layers/serialization.py", line 64, in deserialize
printable_module_name='layer')
File "/anaconda3/lib/python3.6/site-packages/tensorflow/python/keras/utils/generic_utils.py", line 193, in deserialize_keras_object
function_name)
ValueError: Unknown layer:name
Getting this error when loading model with
from tensorflow.keras.models import load_model
Is it possible to save full model?
IndexError: list index out of range
IndexError Traceback (most recent call last)
<ipython-input-22-543c5fbe3f75> in <module>()
166 epochs=EPOCHS,
167 validation_data=(validation_x, validation_y),
--> 168 callbacks=[utils.GDriveCheckpointer(compare,path)],
169 )
170
/content/utils.py in __init__(self, compare_fn, filepath_fn, save_optimizer)
161 super(GDriveCheckpointer, self).__init__()
162
--> 163 self.saver = GDriveSync()
164
165 self.compare_fn = compare_fn
/content/utils.py in __init__(self)
46
47 self.drive_service = build('drive', 'v3')
---> 48 self.default_folder = self.find_items('Colab Notebooks')[0]
49
50 def find_items(self, name):
IndexError: list index out of range
Code:
def compare(best, new):
return best.losses['val_acc'] < new.losses['val_acc']
def path(new):
if new.losses['val_acc'] > 0.5:
return 'RNN_Final_{0}.model'.format(new.losses['val_acc'])
# Train model callbacks=[tensorboard, checkpoint],
history = model.fit(
train_x, train_y,
batch_size=BATCH_SIZE,
epochs=EPOCHS,
validation_data=(validation_x, validation_y),
callbacks=[utils.GDriveCheckpointer(compare,path)]
)
Have no Idea why I'm getting this error.
Previously in code loaded GD service to load files, maybe this is hot spot:
auth.authenticate_user()
gauth = GoogleAuth()
gauth.credentials = GoogleCredentials.get_application_default()
drive = GoogleDrive(gauth)
f1 = drive.CreateFile({'id': 'id'})
f1.GetContentFile('file.csv')
Would be grateful for any help.
NotFoundError: Container localhost does not exist.
Hi, I am trying to use the code snippet for creating the callback but getting this error ->
NotFoundError: Container localhost does not exist. (Could not find resource: localhost/RMSprop_2/iterations)
Please can you help me?
ImportError: No module named utils
two types of errors when I tried to execute
- ImportErrorTraceback (most recent call last)
in ()
7 import sys
8 import os
----> 9 import utils
10 import keras
ImportError: No module named utils
and when i run again it was showing
ModuleNotFoundError Traceback (most recent call last)
in ()
7 import sys
8 import os
----> 9 import utils
10 import keras
ModuleNotFoundError: No module named 'utils'
Syntax error while importing utils
I get the following error:
File "utils.py", line 62
def upload_file_to_folder(self, local_file, folder: GDriveItem = None):
^
SyntaxError: invalid syntax
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.