Comments (3)
sebbalex
commented on September 17, 2024
1
We should also consider
administrations:
Whenever the entry that is going to be removed is the only one who belongs to an administration we should remove it as well. This will avoid to have administrations with no software listed.
@libremente thoughts?
never mind administrations data calculation (as specified in PR) is totally stateless and every time are built from scratch.
from publiccode-crawler.
sebbalex
commented on September 17, 2024
We should also consider administrations:
Whenever the entry that is going to be removed is the only one who belongs to an administration we should remove it as well. This will avoid to have administrations with no software listed.
@libremente thoughts?
from publiccode-crawler.
sebbalex
commented on September 17, 2024
It would be nice to have an option to be passed to the crawler via command line to automagically perform the operation described in 2.
As of #140 we got now:
bin/crawler delete [URL] delete software from Elasticsearch using its code hosting URL specified in publiccode.url
from publiccode-crawler.
Related Issues (20)
- **[suggestion]** We could log also the name/id of the publisher not found in the whitelist? HOT 1
- Vitality for metarepos is off HOT 1
- Use err.Message() in order to return only the error message instead all the error stack
- Rename the repo to publiccode-crawler HOT 1
- Drop Elasticsearch as state and use the API HOT 1
- [meta] The crawler shouldn't know about IndicePA (ipa) HOT 1
- Check for regressions in CI HOT 2
- The docker image is too big
- Make the crawler even more generic HOT 4
- Path to the list of third-party repositories HOT 1
- Improve the printed output HOT 1
- Add the helm chart to the repo HOT 1
- Crashes when publiccode.yml is a symlink or a directory
- Make the crawler work when there's no config.toml
- Must create a new software entity in the API even if the publiccode.yml is invalid
- Enable all the linters
- Flat vitality index HOT 3
- Give more insights about the vitality index
- Add tests for the vitality index calculation?
- Why vitality is computed via a cloned repo? HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from publiccode-crawler.