pedrofonsecadev / urlpilgrim Goto Github PK
View Code? Open in Web Editor NEWA NODE CLI program to search for URLs inside multiple or individual files and check their STATUS as well as check URLs directly.
License: MIT License
A NODE CLI program to search for URLs inside multiple or individual files and check their STATUS as well as check URLs directly.
License: MIT License
Do you mind updating the README to make it clear to npm users?
Package-lock.json is on Github, and it is causing a bug when installing the program on wsl2.
I would like to add some cases for the module.
Hi I would like to work on this issue.
When I test the tool for this https://wiki.cdot.senecacollege.ca/wiki/Planet_CDOT_Feed_List url/html file the tool is testing for non-links
As you can see in the image
The tool is trying to test for Woosle and Wissmann which are not links.
This could be because the parser is going line by line instead of testing the complete document.
because in the link above there are urls that are on multiple lines.
Check out
https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/String/match
The match command creates an array of all matches in a string
404
Add a -j, --json, and/or \j flag, which causes the program to output JSON.
This is just an option but the async await is much slower the .then().catch
but you can turn your await fetch to fetch().then.catch()
It will be a fire and forget it method and is much quicker, I have forked your repo and shown a potential option to quicken checking links
https://github.com/zg3d/URLpilgrim/blob/master/urlFunctions/urlFuncs.js#L17-L40
The downfall is that you Ora spinner won't work anymore but we can find a potential fix to it.
The above method quicken the tool by a great margin and might be a great addition.
Flags to filter results.
Make sure that the program exits with an appropriate error code. If there are no errors (all links are good), exit with 0. Otherwise, exit with a non-zero exit code.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.