Giter VIP home page Giter VIP logo

thecaduceus / multi-cloud-transfer-tool Goto Github PK

View Code? Open in Web Editor NEW
304.0 6.0 136.0 1.42 MB

The most advanced yet simple Jupyter Notebook to transfer/manage your data from/to any cloud remotely based on Rclone and other engines.⚡

Home Page: https://thecaduceus.eu.org/Multi-Cloud-Transfer-Tool

Jupyter Notebook 100.00%
rclone google-colab 7zip file-sharing google-colaboratory jupyter-notebook extact-files rclone-colab aria2 yt-dlp

multi-cloud-transfer-tool's People

Contributors

thecaduceus avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

multi-cloud-transfer-tool's Issues

Some suggestions during use

image
When I use the magnetic link to download, I can't view the download progress
Nor can colleagues perform other youtube download tasks
Can it be considered Aria2Ng for management Or add a download interface
So we can download both magnetic links and Youtube Videos

Bug Report

Hello Brother, Using your collab notebook happily.. But I've faces a bug regarding pack/unpack feature.
For using this feature It requires there should be no space involved in the name of folder or file which we want to unzip or zip (path should not contain any white space).
For Copy it is not required.. please address this bug if possible

[Issue] Packing & Extraction

-### Why it show "Given Source path not exist!" ?

s31 4

s31 1
s31 3

  • What's happened with previous "Connect To Cloud Accounts" feature ? New version tiring

Using Service Accounts with GDrive remote disables it to be properly mounted

I'm trying to use my service accounts folder (followed the guide), but I'm able only to properly mount the remote drive in case I do not provide the service account file on rclone config. If I do, I press Mount, the folder shows up on the left side directory tree , but there's no droplist showing the drive's folders, it simply shows nothing.
Do you have any ideas what might be going wrong here? Thanks in advance.

Heroku Support

Can you make this project "MCT Tool" heroku deployable??

Fatal error: mount not ready

Hi. I got this error when trying to mount my rclone remotes. This code block takes 1 minute to run (while before it took me a few seconds). I checked the config file again, it works fine with remotes.

Enter Rclone remote name to continue:
abc
Select Action: 1 = Mount and 0 = Unmount:
1
2023/03/15 08:22:51 Fatal error: mount not ready
Mounted: /content/drives/abc

Script Working ??

Is this script working ?

I tried add-on : direct download link feature it's not working
Screenshot_2024-03-01-15-43-03-896_com kiwibrowser browser

Screenshot_2024-03-01-15-43-09-712_com kiwibrowser browser

Download only specific files

Hi!, I'm trying to download torrent to google drive using colab. However, I only want to download 1, 2 videos in a big torrent of 40 videos. Is there a way to make it only download the specific videos that I want, instead of downloading everything?

rclone.conf file not found

Hello,

I'm in the process of configuring the online MCT tool, and I've encountered an issue while attempting to upload my rclone.conf configuration file. When I try to execute the command I get the following output:

rclone.conf(n/a) - 2000 bytes, last modified: n/a - 100% done
Saving rclone.conf to rclone.conf
/bin/bash: line 1: rclone: command not found
/bin/bash: line 1: rclone: command not found
Saved: rclone.conf [file] -> Runtime
/bin/bash: line 1: rclone: command not found
/bin/bash: line 1: rclone: command not found
Saved: rclone.conf [file] -> MyDrive

Has anyone else used the online MCT tool? Have you encountered the same problem or do you have any suggestions on how to resolve it? I would greatly appreciate any assistance or guidance on what I could check to address this situation.

Update:
There is just a problem with the localization of the rclone.conf file. After uploading it and starting the "Connect To Cloud Accounts" module I get the following error message: An exception has occurred, use %tb to see the full traceback. SystemExit: Not Found: rclone.conf [file].

Transfer speed drastically dropping

Transfer speed started around 60MB/s, but later it just drops to this level, 1MB/s or less or just a bit more. Sometimes even less than 1KB/s is hit. Is there any specific reason for that?

image

download quata is exceeded

How to avoid this problem?
iam using !rclone copy command. because folder contains huge amount of files. daily limit of google drive is 750gb. but this problem shows up even when less than 100gb complete.
iam using these flags --stats-one-line -vv --stats 5s --tpslimit 25 --tpslimit-burst 10 --bwlimit 38M --max-transfer 600G
can you suggest any changes for avoiding this problem?
quata excedded

folder transfer

when i transfer a folder with 2000 files to another google drive, i get error.
at that time the ram goes above 12gb terribly high and then the error occurs
Untitled
Untitledu

Why the videos I downloaded are not automatically merged into one file

image

[download] Downloading video 8 of 57
[youtube] kgEgOi32CE0: Downloading webpage
[youtube] kgEgOi32CE0: Downloading android player API JSON
[info] kgEgOi32CE0: Downloading 1 format(s): 303+251
[download] Destination: A pot of wine among watermelon fields.So…The life of watermelons and grapes瓜间一壶酒,西瓜和葡萄的一生?丨Liziqi [kgEgOi32CE0].f303.webm
[download] 100% of 406.72MiB in 01:41
[download] Destination: A pot of wine among watermelon fields.So…The life of watermelons and grapes瓜间一壶酒,西瓜和葡萄的一生?丨Liziqi [kgEgOi32CE0].f251.webm
[download] 100% of 19.21MiB in 00:08
[Merger] Merging formats into "A pot of wine among watermelon fields.So…The life of watermelons and grapes瓜间一壶酒,西瓜和葡萄的一生?丨Liziqi [kgEgOi32CE0].webm"
ERROR: Postprocessing: Conversion failed!
[download] Downloading video 9 of 57
[youtube] kPIzBRPezY4: Downloading webpage
[youtube] kPIzBRPezY4: Downloading android player API JSON
[info] kPIzBRPezY4: Downloading 1 format(s): 303+251
[download] Destination: Finally, a different title! “The life of okra and bamboo fence, LOL这次可算有点不一样的标题了!秋葵,和竹筒路的一生嘻嘻丨Liziqi [kPIzBRPezY4].f303.webm
[download] 100% of 360.37MiB in 01:31
[download] Destination: Finally, a different title! “The life of okra and bamboo fence, LOL这次可算有点不一样的标题了!秋葵,和竹筒路的一生嘻嘻丨Liziqi [kPIzBRPezY4].f251.webm
[download] 100% of 17.58MiB in 00:09
[Merger] Merging formats into "Finally, a different title! “The life of okra and bamboo fence, LOL这次可算有点不一样的标题了!秋葵,和竹筒路的一生嘻嘻丨Liziqi [kPIzBRPezY4].webm"
ERROR: Postprocessing: Conversion failed!
[download] Downloading video 10 of 57
[youtube] oi38cQMORQY: Downloading webpage
[youtube] oi38cQMORQY: Downloading android player API JSON
[info] oi38cQMORQY: Downloading 1 format(s): 303+251
[download] Destination: The life of cucumbers黄瓜的一生丨Liziqi Channel [oi38cQMORQY].f303.webm
[download] 100% of 403.08MiB in 01:26
[download] Destination: The life of cucumbers黄瓜的一生丨Liziqi Channel [oi38cQMORQY].f251.webm
[download] 100% of 18.37MiB in 00:11
[Merger] Merging formats into "The life of cucumbers黄瓜的一生丨Liziqi Channel [oi38cQMORQY].webm"
ERROR: Postprocessing: Conversion failed!

Can I set the default to download the highest quality MP4 format file

Google Account: Connection Error `DEBUG_MODE` Required!

From time to time I get this error while using the script and even refreshing the browser or closing the session does not solve the problem:

An exception has occurred, use %tb to see the full traceback.

SystemExit: NoteBook is out-dated! Please update your Notebook to ['shell-init: error retrieving current directory: getcwd: cannot access parent directories: Transport endpoint is not connected', 'v4.1.2'], for getting latest new features.

/usr/local/lib/python3.7/dist-packages/IPython/core/interactiveshell.py:2890: UserWarning: To exit: use 'exit', 'quit', or Ctrl-D.
  warn("To exit: use 'exit', 'quit', or Ctrl-D.", stacklevel=1)

Can't Select the Clouds

last night it's still fine but now it can't shows the list of the clouds and I can't choose the clouds that I want to mount in colab, any how to fix this?
54321

Q: About Connect to Cloud Accounts

What's happened with previous Connect to Cloud Accounts feature ?
26.png

Optional
I am facing problem when Connect to Cloud Accounts section on smartphone. Because I didn't find Enter key on smartphone. It's working like 'Tab' on Colab.
Screenshot_20220906-010344_GitHub.jpg

Google Photos Error

I am investigating a small issue, where sometimes user are able to mount Google Photos using Rclone but not able to fetch Data from it!

unzip unrar

can you say unzip unrar command in google colab?

Configuration disappeared

Hello and many thanks for this tool!

Yesterday I installed everything correctly and even the transfers went great, but today reconnecting the mounted drives are gone. Only the sample_data folder is present. What happened?

"Transport endpoint is not connected"

I want to copy files from Google Drive to Microsoft OneDrive, but during the process, the remotes just unmount on their own thus unsuccessfully copying the files. I tried to copy with and without using the Time Out Preventer, but same results. Hoping you can help me, thank you very much!

1-1
1-3
1-4
1-5

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.