I faced a problem

Twspace-dl

A python module to download twitter spaces.

Screensots

GUI

CLI

Requirements

ffmpeg if not using portable binaries.
A logged in user's cookies file exported from Twitter in the Netscape format.

Install

GUI

Use this if you're not sure.

From portable binaries

Windows

From source

pip install git+https://github.com/HoloArchivists/twspace-dl@gooey

CLI

From portable binaries

Windows

From PyPI

pip install twspace-dl

From source

pip install git+https://github.com/HoloArchivists/twspace-dl

Usage

twspace_dl -i space_url -c COOKIE_FILE

With binaries

Windows

.\twspace_dl.exe -i space_url -c COOKIE_FILE

Features

Here's the output of the help option

usage: twspace_dl [-h] [-v] [-s] [-k] [-l] -c COOKIE_FILE
                  [-i SPACE_URL | -U USER_URL] [-d DYN_URL] [-f URL] [-M PATH]
                  [-o FORMAT_STR] [-m] [-p] [-u] [--write-url URL_OUTPUT] [-e]

Script designed to help download twitter spaces

options:
  -h, --help            show this help message and exit
  -v, --verbose
  -s, --skip-download
  -k, --keep-files
  -l, --log             create logfile
  -c COOKIE_FILE, --input-cookie-file COOKIE_FILE
                        cookies file in the Netscape format. The specs of the
                        Netscape cookies format can be found here:
                        https://curl.se/docs/http-cookies.html. The cookies
                        file is now required due to the Twitter API change
                        that prohibited guest user access to Twitter API
                        endpoints on 2023-07-01.

input:
  -i SPACE_URL, --input-url SPACE_URL
  -U USER_URL, --user-url USER_URL
  -d DYN_URL, --from-dynamic-url DYN_URL
                        use the dynamic url for the processes(useful for ended
                        spaces) example: https://prod-fastly-ap-northeast-
                        1.video.pscp.tv/Transcoding/v1/hls/zUUpEgiM0M18jCGxo2e
                        SZs99p49hfyFQr1l4cdze-Sp4T-
                        DQOMMoZpkbdyetgfwscfvvUkAdeF-
                        I5hPI4bGoYg/non_transcode/ap-northeast-1/periscope-
                        replay-direct-prod-ap-northeast-1-public/audio-
                        space/dynamic_playlist.m3u8?type=live
  -f URL, --from-master-url URL
                        use the master url for the processes(useful for ended
                        spaces) example: https://prod-fastly-ap-northeast-
                        1.video.pscp.tv/Transcoding/v1/hls/YRSsw6_P5xUZHMualK5
                        -ihvePR6o4QmoZVOBGicKvmkL_KB9IQYtxVqm3P_vpZ2HnFkoRfar4
                        _uJOjqC8OCo5A/non_transcode/ap-northeast-1/periscope-
                        replay-direct-prod-ap-northeast-1-public/audio-
                        space/master_playlist.m3u8
  -M PATH, --input-metadata PATH
                        use a metadata json file instead of input url (useful
                        for very old ended spaces)

output:
  -o FORMAT_STR, --output FORMAT_STR
  -m, --write-metadata  write the full metadata json to a file
  -p, --write-playlist  write the m3u8 used to download the stream(e.g. if you
                        want to use another downloader)
  -u, --url             display the master url
  --write-url URL_OUTPUT
                        write master url to file
  -e, --embed-cover     embed user avatar as cover art

Format

You can use the following identifiers for the formatting

%(title)s
%(id)s
%(start_date)s
%(creator_name)s
%(creator_screen_name)s
%(url)s
%(creator_id)s

Example: [%(creator_screen_name)s]-%(title)s|%(start_date)s

Known Errors

Changing ID3 metadata in HLS audio elementary stream is not implemented....

This is an error in ffmpeg that does not affect twspace_dl at all as far as I know.

Service

To run as a systemd service please refer to https://github.com/HoloArchivists/twspace-dl/blob/main/SERVICE.md

Docker

Run once

docker run --rm -v .:/output holoarchivists/twspace-dl -i space_url

Run as monitoring service

Download the docker-compose.yml, .env, monitor.sh files and put them in a folder named twspace-dl.
Edit .env and fill in the Twitter username you want to monitor.
Put a cookies file into the folder and named it cookies.txt.
docker-compose up -d

	else:
	twspace = Twspace.from_space_url(args.input_url)
	twspace_dl = TwspaceDL(twspace, args.output)

	if args.from_dynamic_url:
	twspace_dl.dyn_url = args.from_dynamic_url
	if args.from_master_url:
	twspace_dl.master_url = args.from_master_url

	@cached_property
	def dyn_url(self) -> str:
	"""Returns the dynamic url i.e. the url used by the browser"""
	space = self.space
	if space["state"] == "Ended" and not space["available_for_replay"]:
	logging.error(
	(
	"Can't Download. Space has ended, can't retrieve master url. "
	"You can provide it with -f URL if you have it."
	)
	)
	raise ValueError("Space Ended")
	headers = {
	"authorization": (
	"Bearer "
	"AAAAAAAAAAAAAAAAAAAAANRILgAAAAAAnNwIzUejRCOuH5E6I8xnZz4puTs"
	"=1Zv7ttfk8LF81IUq16cHjhLTvJu4FA33AGWWjCpTnA"
	),
	"cookie": "auth_token=",
	}
	media_key = space["media_key"]
	response = requests.get(
	"https://twitter.com/i/api/1.1/live_video_stream/status/" + media_key,
	headers=headers,
	)
	try:
	metadata = response.json()
	except Exception as err:
	raise RuntimeError("Space isn't available", space.source) from err
	dyn_url = metadata["source"]["location"]
	return dyn_url

	@cached_property
	def master_url(self) -> str:
	"""Master URL for a space"""
	master_url = re.sub(
	r"(?<=/audio-space/).*", "master_playlist.m3u8", self.dyn_url
	)
	return master_url

holoarchivists / twspace-dl Goto Github PK

twspace-dl's Introduction

Twspace-dl

Screensots

Requirements

Install

GUI

From portable binaries

From source

CLI

From portable binaries

From PyPI

From source

Usage

Windows

Features

Format

Known Errors

Service

Docker

Run once

Run as monitoring service

twspace-dl's People

Contributors

Stargazers

Watchers

Forkers

twspace-dl's Issues

Describe your issue

Reproduction steps

Potential fixes

Recommend Projects

Recommend Topics

Recommend Org