pauldotknopf / twitter-dump Goto Github PK

Hi, would it be possible for you to include a (boolean?) attribute that stores if a tweet has media attached to it? It would be even better if the attribute was a direct link to the media.

Thanks!

I used this to install dotnet:

sudo snap install --classic dotnet-sdk
:
SDK Version: 5.0.302
:

Installation dotnet tool install --global TwitterDump worked.

But running your example gives:

$ twitter-dump search -q "(from:realDonaldTrump)" -o trump.json
A fatal error occurred. The required library libhostfxr.so could not be found.
If this is a self-contained application, that library should exist in [/home/tange/.dotnet/tools/.store/twitterdump/0.4.0/twitterdump/0.4.0/tools/netcoreapp3.1/any/].
If this is a framework-dependent application, install the runtime in the global location [/usr/share/dotnet] or use the DOTNET_ROOT environment variable to specify the runtime location or register the runtime location in [/etc/dotnet/install_location].

The .NET runtime can be found at:
  - https://aka.ms/dotnet-core-applaunch?missing_runtime=true&arch=x64&rid=ubuntu.20.04-x64&apphost_version=5.0.8

OS: Ubuntu 20.04
dotnet --version: 5.0.302

I try running build.sh. It fails:

$ bash build.sh 
/home/tange/tmp/twitter-dump/build/scripts/Build.csproj(3,3): error MSB4019: The imported project "/home/tange/tmp/twitter-dump/build/scripts/Buildary/Build.proj" was not found. Confirm that the expression in the Import declaration "Buildary/Build.proj" is correct, and that the file exists on disk.

The build failed. Fix the build errors and run again.

Did you forget to add build/scripts/Buildary/Build.proj to git?

Hello, I have used your tool which is awesome, thank you. I'm French with a windows in french, So the cast of the date of the tweet throw an error. It's just needed to add "Culture = System.Globalization.CultureInfo.InvariantCulture" to the dateTimeConverter.

i can't find adaptive.json in the Network capture.. but i manage to use guide.json instead though.

On Twitter, a search for from:jordancurve filter:nativeretweets shows retweets by me. However, that search returns 0 results with twitter-dump (though from:jordancurve works fine).

Would it be possible to add a wait timer when rate limit is reached, This issue is popping up only recently since twitters new mangement

What does this really mean:

  -o, --output         Required. (Default: stdout)

I think it would make sense to make -o optional and default to stdout.

How do I successfully authorize twitter-dump? Am I in the wrong folder? Using the wrong command? etc

I get this error whenever I try to run the program:

16:55:14 WRN] Request exception BadRequest {"errors":[{"message":"Bad Authentication data","code":215}]}

Clearly it's working but something's wrong with how it's authenticating. Can I provide the key a different way?

Thanks for this app! It generally worked well in small tests on my Mac and a Windows machine.

I got into a few "TooManyRequests" error with the error code 88. At that point tweet collection just stopped and no json file was created/saved. Is there any way to save the tweets already collected?

What dependencies do I need to install? I have dotnet installed on my machine but get "command not found: dotnet" when I try to install this. Do I have to clone your repo?

What is the syntax for '-q'?

Is is documented in some Twitter API?

After running for some time, I always get this error.

Unhandled exception. System.Net.Http.HttpRequestException: Error while copying content to a stream.
---> System.IO.IOException: Received an unexpected EOF or 0 bytes from the transport stream.
at System.Net.Security.SslStream.ReadAsyncInternal[TReadAdapter](TReadAdapter adapter, Memory1 buffer) at System.Net.Http.HttpConnection.FillAsync() at System.Net.Http.HttpConnection.CopyToContentLengthAsync(Stream destination, UInt64 length, Int32 bufferSize, CancellationToken cancellationToken) at System.Net.Http.HttpConnection.ContentLengthReadStream.CompleteCopyToAsync(Task copyTask, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionResponseContent.SerializeToStreamAsync(Stream stream, TransportContext context, CancellationToken cancellationToken) at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer) --- End of inner exception stack trace --- at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer) at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
at TwitterDump.Twitter.g__MakeRequest|2_0(<>c__DisplayClass2_0& ) in /home/pknopf/git/twitter-dump/src/TwitterDump/Twitter.cs:line 205
at TwitterDump.Twitter.RetryGet(HttpClient client, String url) in /home/pknopf/git/twitter-dump/src/TwitterDump/Twitter.cs:line 233
at TwitterDump.Twitter.GetTweets(String url, Dictionary2 headers, String& nextCursor) in /home/pknopf/git/twitter-dump/src/TwitterDump/Twitter.cs:line 120 at TwitterDump.Twitter.SearchTweets(String query, Dictionary2 headers, Nullable1 pageSize, Nullable1 maxResults) in /home/pknopf/git/twitter-dump/src/TwitterDump/Twitter.cs:line 71
at TwitterDump.Program.Search(SearchOptions options) in /home/pknopf/git/twitter-dump/src/TwitterDump/Program.cs:line 65
at TwitterDump.Program.<>c.