derat / nitter-rss-proxy Goto Github PK
View Code? Open in Web Editor NEWMoved to codeberg.org/derat/nitter-rss-proxy
Home Page: https://codeberg.org/derat/nitter-rss-proxy
License: BSD 3-Clause "New" or "Revised" License
Moved to codeberg.org/derat/nitter-rss-proxy
Home Page: https://codeberg.org/derat/nitter-rss-proxy
License: BSD 3-Clause "New" or "Revised" License
rss from nitter:
<title>The Exp 68 crew started the new week investigating astrobiology and keeping up with cargo operations and equipment maintenance. https://go.nasa.gov/3n9KoOA</title> dc:creator@Space_Station The Exp 68 crew started the new week investigating astrobiology and keeping up with cargo operations and equipment maintenance. [go.nasa.gov/3n9KoOA](https://go.nasa.gov/3n9KoOA)]]>
Mon, 20 Mar 2023 22:02:01 GMT
https://twitter.com/Space_Station/status/1637937566308528128#m
https://twitter.com/Space_Station/status/1637937566308528128#m
rss from nitter-rss-proxy
The Exp 68 crew started the new week investigating astrobiology and keeping up with cargo operations and equipment maintenance. content:encodedThe Exp 68 crew started the new week investigating astrobiology and keeping up with cargo operations and equipment maintenance. [go.nasa.gov/3n9KoOA](https://go.nasa.gov/3n9KoOA)
]]></content:encoded>
@Space_Station
https://twitter.com/Space_Station/status/1637937566308528128
Mon, 20 Mar 2023 22:02:01 +0000
There are many extra characters while rendering the results. I tried with all the 3, "atom", "json", "rss" and its not as same as nitter. Can we have the same results as nitter rss gives ?
I could get only first 20 tweets. Is there an option to set a date range to get the tweets?
It looks like Twitter sometimes uses /i/web/status/<id>
URLs that get rewritten incorrectly.
When I look at a retweet of https://twitter.com/_x_takes_/status/1612900253677621251 in Feedly, it contains the broken link https://nitter.net/twitter.com/web/status/1612900253677621251
and the first image from the original tweet.
The original tweet looks like this in https://nitter.mask.sh/_x_takes_/rss
:
<item>
<title>twitter.com/i/web/status/161…</title>
<dc:creator>@_x_takes_</dc:creator>
<description><![CDATA[<p><a href="https://nitter.net/i/web/status/1612900253677621251">nitter.net/i/web/status/161…</a></p>
<img src="https://nitter.mask.sh/pic/media%2FFmIsDwJWQAAJWl8.jpg" style="max-width:250px;" />]]></description>
<pubDate>Tue, 10 Jan 2023 19:52:41 GMT</pubDate>
<guid>https://nitter.mask.sh/_x_takes_/status/1612900253677621251#m</guid>
<link>https://nitter.mask.sh/_x_takes_/status/1612900253677621251#m</link>
</item>
It seems like some Nitter instances use their own hostnames in these URLs rather than nitter.net
, but the URL structure is otherwise the same.
Here's what it looks like after the proxy converts it to a JSON feed (this is from a different Nitter instance that uses its own hostname):
{
"id": "https://twitter.com/_x_takes_/status/1612900253677621251",
"url": "https://twitter.com/_x_takes_/status/1612900253677621251",
"title": "twitter.com/i/web/status/161…",
"content_html": "\u003cp\u003e\u003ca href=\"https://nitter.bird.froth.zone/twitter.com/web/status/1612900253677621251\"\u003enitter.bird.froth.zone/twitter.com/web/status/161…\u003c/a\u003e\u003c/p\u003e\u003cbr\u003e\u003cimg src=\"https://pbs.twimg.com/media/FmIsDwJWQAAJWl8?format=jpg\" style=\"max-width:250px;\" /\u003e",
"summary": "twitter.com/i/web/status/161…",
"date_published": "2023-01-10T19:52:41Z",
"author": {
"name": "@_x_takes_"
}
},
Nitter seems like it may not handle Twitter's weird /i/web/
URLs properly: https://nitter.net/i/web/status/1612900253677621251
returns an error, while https://twitter.com/i/web/status/1612900253677621251
seems to produce the same content as https://twitter.com/_x_takes_/status/1612900253677621251
.
I have successfully deployed my nitter-rss-proxy using Dockerfile, the experience is very, very good!
However, since the service is exposed to the public network, I would like to add access control, such as an access key-based approach similar to RSSHub, to verify authentication parameters when requesting through the proxy.
Hi,
thanks for this, it would be great if you can support docker image.
thanks
<p> in feeds from twitter for spaces
Config: format := flag.String("format", "atom",Feed format to write ("atom", "json", "rss")
)
With all the feed formats it is giving one or the other invalid characters
Eg:
<p>Minister <a href="
I tried to deploy dockerfile to Railway, But no way to respond successfully anyway. Hope to provide a Railway instance for reference.
I'm sorry to interrupt again.
Hope that the nitter link in the text can also be processed to the original Twitter link. Like username and other tweet link.
It'd be nice if quoted tweets were inlined in items. https://github.com/derat/twittuh/blob/main/parse.go has code that I wrote to do this when scraping HTML timelines, but I'm not sure how it'd work with Nitter. I might need to stare at https://github.com/zedeus/nitter/blob/master/src/routes/rss.nim to see if there's a way to request a single tweet by ID, or figure out if there's some other endpoint that can be used for this.
(I should probably give it a bit of time to see if Twitter continues to exist before working on this.)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.