Comments (5)
I don't know. You know, in December and January I actually thought about. But I declined this idea for several reasons.
Images files metadata editing has an ugly environment. To make it more convenient and neat, I need to use another library. And it's not a Microsoft library. I used this library for video files before in another program. It also has the ability to do the same for images. In January or February, I tried to implement this in SCrawler, but I didn't figure out how it works. It works very poorly with images and is not native.
So, in order to do what you want, I need the time and desire to learn this library and its functions. Currently I have neither the time nor the desire.
Btw, in your picture, except Title and Tags, all other selected fields are fields of this data type only (jpg, jpeg, png). I mean Title and Tags are generic fields that are in every Windows file.
from scrawler.
Oh, I didn’t realise it was that involved/complicated. Hopefully a Microsoft library is made in the future, or a simpler solution is found. Again, it’s not a major issue/necessity but just a nice-to-have feature.
A potential simpler solution could be to write those parameters into individual .txt or .json files within the same directory as the videos/images (e.g. FUvqw6qWAAEW0gj.jpg & FUvqw6qWAAEW0gj.json). This would allow for even more data to be scraped/saved (i.e. comments, retweets, likes, tags etc.).
Also, I thought I’d list the possible types of metadata in that screenshot. I didn’t know metadata fields changed based on file type. In all seriousness though, I agree with you that Title and Date acquired are the only useful fields anyway.
Thanks for considering it :)
from scrawler.
A potential simpler solution could be to write those parameters into individual .txt or .json files within the same directory as the videos/images (e.g. FUvqw6qWAAEW0gj.jpg & FUvqw6qWAAEW0gj.json).
It's easy. This I can do.
i.e. comments, retweets, likes, tags etc.
Comments - definitely NO! Retweets, likes? What for? What valuable information do you expect from them? Title, description, date - yes, this is important information. But likes, retweets....
Thanks for considering it :)
You are welcome. I've added the label "future" to this issue, so maybe I'll come back to it someday.
Btw, did you like SCrawler on this site? 😊
from scrawler.
Comments - definitely NO! Retweets, likes? What for? What valuable information do you expect from them? Title, description, date - yes, this is important information. But likes, retweets....
As I said, title and date are the only useful information I need... I cannot speak for others and their needs. However, other crawlers such as Instaloader have the option to save comments, likes etc. so some must find it valuable. I was simply highlighting how .json files may be a better solution since you aren't limited to the standardised metadata fields and thus, can potentially store more information IF required.
from scrawler.
Btw, I forgot to say, the date is already in the user settings folder, in the Username_Data.xml file. This is not json, but xml is no worse.
from scrawler.
Related Issues (20)
- More verbose logging? HOT 7
- [REQUEST] Plans for bypassing reddit's api restriction? HOT 2
- How do I install it? HOT 1
- OF angel hub nothing downloads and passes by HOT 5
- Twitter Cookie Error HOT 1
- [BUG] Automation rule stops running/doesn't seem to work as intended [Reddit] HOT 3
- [REQUEST] Snapchat support HOT 1
- Can't download any pictures etc from twitter HOT 17
- [BUG] Twitter Download Invalid JSON primitive HOT 1
- [REQUEST] User iteration in automation HOT 5
- Fault Bucket type 0 when opening via Flash Drive HOT 1
- Not able to fetch saved posts for Reddit acc HOT 5
- [BUG] PH downloads have multiple little pauses throughout the video HOT 5
- Auto Update Scrawler Batch File HOT 2
- OnlyFans error 400 or 401 since latest update HOT 1
- Need help - Understanding reddit integration HOT 2
- Stories (user) downloading wrong aspect ratio for some users HOT 1
- JustForFans not downloading all media HOT 1
- Instragram Partial Rip HOT 4
- Not all instagram reels are being downloaded HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from scrawler.