iw4p / telegram-cloud Goto Github PK

View Code? Open in Web Editor NEW

196.0 4.0 34.0 389 KB

Download and upload files via your Telegram account up to 2 GB

Home Page: https://pypi.org/project/telegram-cloud/

License: MIT License

Python 100.00%

telegram telegram-cli telegram-bot telegram-api telegram-group python

telegram-cloud's Introduction

Telegram-cloud (A.K.A tgcloud)

telegram-cloud

Searching in groups, private channel and chats, Download and upload files via telegram and Using your telegram account as free cloud storage.

Uploader, Downloader, Crawler, Bot 50MB limitation bypasser. (Maybe can wash the dishes someday)

Upload file upto 2 GB
Download file from every conversation, group, channel, ...
Crawling! search by name or caption for a specific file to download it

You can also:

Use it for multiple accounts, download from one Telegram account and upload that on another account, there is no difficulty
download files with file_id
Send regular and silent messages to any user, channel or chat

Hmm what is this?

It's a python package for Telegram messenger, which can give you an ability to download, upload, and more options to do with your Telegram account on CLI.

Installation

telegram-cloud requires Python3 and Telethon as requirment.

$ pip3 install telegram-cloud

Also can be found on pypi

How can I use it?

install the package by pip package manager.
after installing, type tglogin on your terminal
Now you need to get api_id and api_hash from here Telegram from Telethon document:

Before working with Telegram’s API, you need to get your own API ID and hash: Login to your Telegram account with the phone number of the developer account to use. Click under API Development tools. A Create new application window will appear. Fill in your application details. There is no need to enter any URL, and only the first two fields (App title and Short name) can currently be changed later. Click on Create application at the end. Remember that your API hash is secret and Telegram won’t let you revoke it. Don’t post it anywhere!
After that you able to call tgcloud on your terminal.

Commands

telegram-cloud is currently working with the following commands.

args	help
--mode / -m	Two modes for specify what you want, Available modes: download - upload
--name / -n	A Name you choose while tglogin-ing and use for specify the current user you work on it
--username / -u	Target username that you want to send file, type `me` if you want to get it on your `saved messages`
--path / -p	For download mode: pass simple directory path like "/Users/nima/Desktop/Iwanttoescapefrom/"
--path / -p	For upload mode: pass file path like "/Users/nima/Desktop/Iwanttoescapefrom/Iran.zip"
--caption / -c	For download mode: pass the name of file or caption to crawl and download
--caption / -c	For upload mode: write the caption to see it under your file

tgutil accepts these arguments:

args	help
--name / -n	A Name you choose while tglogin-ing and use for specify the current user you work on it
--username / -u	Target username's chat that you want to edit/delete message on it, type `me` if you want to get it on your `saved messages`
--mode { edit, editall, delete, deleteall }	Choose what you need to do, delete/edit last message or deleteall/editall
--text	the text that you are looking for to do operation on it
--newtext	the new text that you want to be replaced with current text, can be used for `edit` and `editall`

tgsend accepts these arguments:

args	help
--name / -n	A Name you choose while tglogin-ing and use for specify the current user you work on it
--username / -u	Target username that you want to send file, type `me` if you want to get it on your `saved messages`
--format { text, markdown, html }	How to parse message body. Default is `text`
--no-link-preview	Disable web link preview card for this message
--silent	Disable audible notification
--stdin	Read message text from stdin

tginfo accepts these arguments:

args	help
--name / -n	A Name you choose while tglogin-ing and use for specify the current user you work on it
--username / -u	Target username that you want to fetch info, type `me` if you want to get it on your `saved messages`
--search / -s	search specific extension or text

Need more examples?

Are you done with tglogin? so come with me.

Unix based operating systems

Download a music from my saved messages and save it on /Users/nima/Desktop/:

$ tgcloud -m download -n nima -u me -p "/Users/nima/Desktop/" -c "sad but true"

$ tgcloud --mode download --name nima --username me --path "/Users/nima/Desktop/" --caption "sad but true"

Upload a banner with caption to my saved messages:

$ tgcloud -m upload -n nima -u me -p "/Users/nima/Desktop/banner.png" -c "Help me"

$ tgcloud --mode upload --name nima --username me --path "/Users/nima/Desktop/banner.png" --caption "Help me"

Upload a pdf to an telegram ID:

$ tgcloud -m upload -n nima -u @autisticbruh -p "/Users/nima/Desktop/file.pdf" -c "Help me"

Search and download a zip from telegram chat_id group:

$ tgcloud -m download -n nima -u -1001240213443 -p "/Users/nima/Desktop/" -c "best memes"

Send a silent text message to a chat group:

$ tgsend -n anightshade -u -1001240213443 --silent "Panda eats shoots and leaves"

Send a fortune cookie to yourself via stdin:

$ tgsend -n anightshade -u me --stdin

Search all PDFs inside a telegram conversation:

$ tginfo -n testSession -u me -s ".pdf

Edit the last hello text message on your saved message to bye:

$ tgutil -n nimnim -u me --mode edit --text "hello" --newtext "bye"

Edit all hello text messages on your saved message to bye:

$ tgutil -n nimnim -u me --mode editall --text "hello" --newtext "bye"

Delete the last hello text message on your saved message:

$ tgutil -n nimnim -u me --mode delete --text "hello"

Delete all hello text messages on your saved message:

$ tgutil -n nimnim -u me --mode deleteall --text "hello"

Get info for all Media inside a telegram conversation:

$ tginfo -n testSession -u me

not Unix (Lol I mean windows)

Just like unix but CAREFUL about paths, your path must not end with \ !! Download all PDFs from your saved messages and save it on C:\Users\Nima\Desktop:

$ tgcloud -m download -n nima -u me -p "C:\Users\Nima\Desktop" -c ".pdf"

What is file_id?

from Telegram Doc:

When working with the API, it is sometimes necessary to send a relatively large file to the server. For example, when sending a message with a photo/video attachment or when setting the current user’s profile picture.

You can upload a file to Telegram once, and send it again to others or do things with file_id. So when you upload a file, you can see the file_id. So now what? If you have a Telegram bot and you have 50MB limitation for uploading and send to users, you can bypass this limitation by this trick and upload files upto 2 GB and pass it by file_id or message_id or...

Good to know

The config file can be found on ~/.telegram-cloud/ (Also ~\.telegram-cloud\ in windows) Each login make *.session file which is located there and it cause script for logged-in user works globally. Inside telegram-cloud-config.ini, you can find api_hash and api_id and name you've entered by tglogin

To do

Star History

Issues

Feel free to submit issues and enhancement requests or contact me via vida.page/nima.

Contributing

Please refer to each project's style and contribution guidelines for submitting patches and additions. In general, we follow the "fork-and-pull" Git workflow.

Fork the repo on GitHub
Clone the project to your own machine
Update the Version in Setup.py
Commit changes to your own branch
Push your work back up to your fork
Submit a Pull request so that we can review your changes

NOTE: Be sure to merge the latest from "upstream" before making a pull request!

Python + Telethon

See Telethon

Contributors 🤝

Special thanks to Contributors

@anightshade: For adding tgsend and fixing bugs! @anightshade: For adding Command line option to select format for the file caption. @rany2: For fixing uploading path and files @anightshade: For adding option to disable weblink preview in message

LICENSE

telegram-cloud's People

Contributors

Stargazers

Watchers

telegram-cloud's Issues

it shows Task was destroyed but it is pending! and exit

I used like this command in win10:
e:\telegram_download\tgcloud -m download -n nima -u test -p "e:\telegram_download@test" -c ".pdf"

it worked perfectly but suddenly shows these and exited:

Traceback (most recent call last):
File "e:\telegram_download\lib\runpy.py", line 194, in run_module_as_main
return run_code(code, main_globals, None,
File "e:\telegram_download\lib\runpy.py", line 87, in run_code
exec(code, run_globals)
File "E:\telegram_download\Scripts\tgcloud.exe_main.py", line 7, in
File "e:\telegram_download\lib\site-packages\telegramcloud_main.py", line 60, in cli
client.loop.run_until_complete(main())
File "e:\telegram_download\lib\asyncio\base_events.py", line 616, in run_until_complete
return future.result()
File "e:\telegram_download\lib\site-packages\telegramcloud_main.py", line 50, in main
await client.download_media(message, args.path)
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 367, in download_media
return await self._download_document(
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 771, in _download_document
result = await self.download_file(
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 467, in download_file
async for chunk in self.iter_download(
File "e:\telegram_download\lib\site-packages\telethon\requestiter.py", line 74, in anext
if await self._load_next_chunk():
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 61, in _load_next_chunk
cur = await self._request()
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 71, in _request
result = await self.client._call(self._sender, self.request)
File "e:\telegram_download\lib\site-packages\telethon\client\users.py", line 77, in _call
result = await future
telethon.errors.rpcerrorlist.FileReferenceExpiredError: The file reference has expired and is no longer valid or it belongs to self-destructing media and cannot be resent (caused by GetFileRequest)
Task was destroyed but it is pending!
task: <Task pending name='Task-11' coro=<MTProtoSender._send_loop() running at e:\telegram_download\lib\site-packages\telethon\network\mtprotosender.py:422> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x000001E5F6B61040>()]>>
Task was destroyed but it is pending!
task: <Task pending name='Task-12' coro=<MTProtoSender._recv_loop() running at e:\telegram_download\lib\site-packages\telethon\network\mtprotosender.py:459> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x000001E5F6BBBA90>()]>>
Task was destroyed but it is pending!
task: <Task pending name='Task-9' coro=<Connection._send_loop() running at e:\telegram_download\lib\site-packages\telethon\network\connection\connection.py:159> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x000001E5F6B61130>()]>>
Task was destroyed but it is pending!
task: <Task pending name='Task-10' coro=<Connection._recv_loop() running at e:\telegram_download\lib\site-packages\telethon\network\connection\connection.py:177> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x000001E5F6BB6C10>()]>>

无法查询/下载私人频道内的文件

可以使用tgsend给私人频道发送消息，但是却无法使用tginfo，tgcloud去查询和下载频道内的文件，请问这是怎么
回事

Can I download several types of files?

For example, both pdf and zip in one command? or even any file .?

Is it possible to download video files with caption as a name.

I want to download all video files from my telegram group with CAPTION as a NAME instead of file name. Is it possible to do that. If its possible then what code should i use.

Thank You

Use Kotatogram

It's possible to use Kotatogram to upload? Kotatogram with option Upload Speed Boost it's very fast.

Can I have the Caption of files too?

Is it possible to generate an html file with link to the downloaded file and with the caption and description from the main channel file?

Uploading file from stdin

I'm trying to do this but there seems to be some kind of protection to prevent me from upload non-regular files. Could this be removed?

$ tar -I zstd -c -C testfolder . | tgcloud -n d -u me -p /proc/self/fd/0 -m upload --caption testfolder.tar.zst
Something went wrong, make sure the directory path is valid.
tar: -: Wrote only 4096 of 10240 bytes
tar: Error is not recoverable: exiting now

Is there any download speed limitation from Telegram Cloud or it is unlimited?

of course I must use vpn from my country (And really I don't know why) to connect to telegram, But I feel Telegram cloud has a speed limitation itself, Is it true?
Is it for Download/Upload?

可以利用这个库实现一个真正的无限制telegram-drive

这个库虽然实现了1.5GB的文件的上传与下载，但是我们可以通过文件切分与合并的方式来突破这个限制。因为，每个文件上传后都会返回一个file_id，我们可以将拆分后的子文件块的file_id记录下来，等下载的时候基于这些file_id来下载与合并，最终得到源文件。
另外，我们还需要一个文件管理系统来管理这些文件。每个源文件在文件管理系统都有一个独一无二的路径，并且每个文件还有一系列的file_id组成。基于此就可以实现一个telegram-cloud-drive。并且由于telegram无审查，文件传输速度无限制，文件大小无限制，这个telegram-cloud-drive将可以与Google drive相媲美。不知作者可否有兴趣？
filebrowser是个不错的文件管理库。

New Error in file Download mode.

The file is still there, but Telegrm-cloud can not download more than 23%.

.
..
...
Downloaded 35389440 out of 149803769 bytes: 23.62%
Downloaded 35651584 out of 149803769 bytes: 23.80%
Traceback (most recent call last):
File "e:\telegram_download\lib\runpy.py", line 194, in run_module_as_main
return run_code(code, main_globals, None,
File "e:\telegram_download\lib\runpy.py", line 87, in run_code
exec(code, run_globals)
File "E:\telegram_download\Scripts\tgcloud.exe_main.py", line 7, in
File "e:\telegram_download\lib\site-packages\telegramcloud_main.py", line 56, in cli
client.loop.run_until_complete(main())
File "e:\telegram_download\lib\asyncio\base_events.py", line 616, in run_until_complete
return future.result()
File "e:\telegram_download\lib\site-packages\telegramcloud_main.py", line 46, in main
await client.download_media(message, args.path, progress_callback=download_callback)
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 367, in download_media
return await self._download_document(
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 771, in _download_document
result = await self.download_file(
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 467, in download_file
async for chunk in self.iter_download(
File "e:\telegram_download\lib\site-packages\telethon\requestiter.py", line 74, in anext
if await self._load_next_chunk():
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 61, in _load_next_chunk
cur = await self._request()
File "e:\telegram_download\lib\site-packages\telethon\client\downloads.py", line 71, in _request
result = await self.client._call(self._sender, self.request)
File "e:\telegram_download\lib\site-packages\telethon\client\users.py", line 77, in _call
result = await future
telethon.errors.rpcerrorlist.FileReferenceExpiredError: The file reference has expired and is no longer valid or it belongs to self-destructing media and cannot be resent (caused by GetFileRequest)
Task was destroyed but it is pending!
task: <Task pending name='Task-11' coro=<MTProtoSender._send_loop() running at e:\telegram_download\lib\site-packages\telethon\network\mtprotosender.py:422> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x000002BBD406A9A0>()]>>
Task was destroyed but it is pending!
task: <Task pending name='Task-12' coro=<MTProtoSender._recv_loop() running at e:\telegram_download\lib\site-packages\telethon\network\mtprotosender.py:459> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x000002BBD40A4A90>()]>>
Task was destroyed but it is pending!
task: <Task pending name='Task-9' coro=<Connection._send_loop() running at e:\telegram_download\lib\site-packages\telethon\network\connection\connection.py:159> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x000002BBD406A4C0>()]>>
Task was destroyed but it is pending!
task: <Task pending name='Task-10' coro=<Connection._recv_loop() running at e:\telegram_download\lib\site-packages\telethon\network\connection\connection.py:177> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x000002BBD406ADC0>()]>>

Group ID can not be found in download.

tgcloud -m download -n x -u -123456789 -p "/Users/me/Desktop/" -c "test"

When I use this command with a groupID I get a error message.

Uploading with the same groupID works and uploading and downloading to me works as well. Am I doing anything wrong?

Thank you for the help!

Awesome tool!

Additional Info:

groupID is replaced
OS = macOS

The error message:

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.7/bin/tgcloud", line 10, in <module>
    sys.exit(cli())
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/telegramcloud/__main__.py", line 71, in cli
    client.loop.run_until_complete(main())
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/base_events.py", line 579, in run_until_complete
    return future.result()
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/telegramcloud/__main__.py", line 45, in main
    async for message in client.iter_messages(entity=username, search=args.caption):
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/telethon/requestiter.py", line 58, in __anext__
    if await self._init(**self.kwargs):
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/telethon/client/messages.py", line 26, in _init
    self.entity = await self.client.get_input_entity(entity)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/telethon/client/users.py", line 432, in get_input_entity
    await self._get_entity_from_string(peer))
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/telethon/client/users.py", line 570, in _get_entity_from_string
    'Cannot find any entity corresponding to "{}"'.format(string)
ValueError: Cannot find any entity corresponding to "-123456789"

Uploads to Telegram keeps lots of old copies. Need a way to remote-delete & ideally remote-rename files

We uploaded fredNotes.txt in total five times, adding changes each time,
expecting the old remote Telegram file to be overwritten each time.

fred@linuxpc:~/python3$ ls -alt *.txt*
-rw-rw-r-- 1 fred fred 13612 Mar 13 18:03 fredNotes.txt

Then we download expecting just one file, the latest fredNotes.txt
Instead five files get returned...

fred@linuxpc:~/python3$ ls -alt *.txt*
-rw-rw-r-- 1 fred fred 13597 Mar 13 18:27 'fredNotes (4).txt'
-rw-rw-r-- 1 fred fred 13597 Mar 13 18:27 'fredNotes (3).txt'
-rw-rw-r-- 1 fred fred 13597 Mar 13 18:27 'fredNotes (2).txt'
-rw-rw-r-- 1 fred fred 13596 Mar 13 18:27 'fredNotes (1).txt'
-rw-rw-r-- 1 fred fred 13612 Mar 13 18:27  fredNotes.txt
fred@linuxpc:~/python3$

This could get out of hand!

Upload code used:

      sFullPathAndFile = os.path.abspath(os.getcwd())+'/fredNotes.txt'
      sCmd = '~/.local/bin/tgcloud -m upload -n frednotetotg -u me -p ' + sFullPathAndFile + ' -c "fileid"'
      process = subprocess.Popen(['bash', '-c', sCmd], stdout=subprocess.PIPE)         
      sout, err = process.communicate()

Assuming no upload switch is available e.g. 'overwrite-old-files'=True or 'don't-keep-old-versions' we could work with a delete with, ideally, a rename feature (cp fredNotes.txt fredNotes.txt.old) just to keep one previous version on Telegram
Anyone know if possible to add remote-delete and ideally remote-rename to https://github.com/iw4p/telegram-cloud/ ?

Is there any option to synch a directory and a channel?

I just want to download the files that I have not downloaded before, while now the script re-downloads the file with a new name. maybe Because there may be two files with the same name but different in size and content, Can You add an option for solve this problem to synchronize the downloaded directory and channel content?

Telegram export function itself has not this option too and export files again and again with new names.

Is it possible to add this method for upload files too?

can I have a list of files in the channel?

Ability to get a list of available files before the download step, for example, get a list that says how many zip files and how many photos and how many pdf and etc.

Is it possible to group files when uploading?

Hi. I have a questions. Is it possible to group files when uploading?

I mean something like this:

Maybe it isn't because of at this time is not possible to upload several files at the same time using your tool.

Whatever. I have another question. Is it possible to upload several files, not at the same time, but one by one as a queue and then group them? (Lol) It will be very great to have an option like this.

Thanks in advance for your work and your help.

Attempt 6 at connecting failed: TimeoutError:

I am sure that APP_ID and API_HASH is true. Whats more, the internet can work correctly. After I input tglogin -> APP_ID -> API_HASH , it raised Attempt 6 at connecting failed: TimeoutError: . I have no idea to solve it, whats wrong with it?

How can I have unicode character in command?

I want to use utf8 characters in my directory name, how?
tgcloud -m download -n nima -u test -p "E:\telegram_download\تست" -c ".pdf"

What happens to files > 2GB

I was writing a script to upload my large files, but I was wondering what would happen if I input a file bigger than 2GB. Would the file split by itself and upload, or do I need to split it ahead of time? Thanks in advance!

I ValueError: Could not find the input entity for <telethon.tl.types.PeerChannel ....

I had Telethon-1.16.4,
but installed pip install telegram_cloud-1.0.3-py3-none-any.whl

I want to download all pdf files of an public channel thus I used:

at first: e:\telegram_download\tglogin
...
Traceback (most recent call last):
File "e:\telegram_download\lib\shutil.py", line 788, in move
os.rename(src, real_dst)
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'nima.session' -> 'C:\Users\user/.telegram-cloud/nima.session'

and then used :
E:\telegram_download>tgcloud -m download -n nima -u -1001085852697 -p "E:\telegram_download" -c "test"
Traceback (most recent call last):
File "e:\telegram_download\lib\runpy.py", line 194, in run_module_as_main
return run_code(code, main_globals, None,
File "e:\telegram_download\lib\runpy.py", line 87, in run_code
exec(code, run_globals)
File "E:\telegram_download\Scripts\tgcloud.exe_main.py", line 7, in
File "e:\telegram_download\lib\site-packages\telegramcloud_main.py", line 60, in cli
client.loop.run_until_complete(main())
File "e:\telegram_download\lib\asyncio\base_events.py", line 616, in run_until_complete
return future.result()
File "e:\telegram_download\lib\site-packages\telegramcloud_main.py", line 42, in main
target_chat = await client.get_entity(int(username))
File "e:\telegram_download\lib\site-packages\telethon\client\users.py", line 268, in get_entity
inputs.append(await self.get_input_entity(x))
File "e:\telegram_download\lib\site-packages\telethon\client\users.py", line 442, in get_input_entity
raise ValueError(
ValueError: Could not find the input entity for <telethon.tl.types.PeerChannel object at 0x00000144D495DF70>. Please read https://docs.telethon.dev/en/latest/concepts/entities.html to find out more details.

Is there any Counter/Indicator/Gauge for processing step?

Please show in some way what the current process is and how much is left, This can be for the current file and as well as all the remaining files.

upload video

would you add a feature for upload video as video no document of file

How to download photos?

This might be a bit of a dumb question but how do you exactly download photos that are not a file and have no caption? when I do -c ".jpg" it only downloads the photos that are files.
Also it's only downloading at 1Mbps, why might this be?

Speed issue.

I ran several tests on my virtual server with 2 gigabit internet, and I came to the conclusion that the speed problem is in telethon itself. I wrote a small benchmark: https://gist.github.com/mishailovic/3bc25bb644642acf371e732f2dafa52f and the pyrogram speed was almost three times faster.

Pyrogram stats: speed - 168.88 Mbps, time - 71 s
Telethon stats: speed - 55.85 Mbps, time - 215 s

I think it would be nice to rewrite the scripts in pyrogram.