Comments (7)
Got down to 44 seconds. Pull request at #116
from nist-data-mirror.
I am creating a pull request from my fork where I cannot create issues.. I was expecting to be able to create a properly named branch after creating this issue. Apparently this is not how it is done. I will submit a proper pull request in a few days.
from nist-data-mirror.
"master" as of now takes 50 minutes on my Windows 10 machine. Initial experiments with appropriate buffering gives a run time of 2-3 minutes.
from nist-data-mirror.
I noticed a performance issue too. Moving from one VM to another, the disk must be configured differently since running the mirror went from about 5 minutes to 45 minutes and seems to be mostly due to the lack of I/O buffering.
Thanks @trandersen-ufst for your PR. I came here to submit the same thing.
from nist-data-mirror.
@sellersj You're welcome. Now a month later we ended up not using this but instead saving the dataDirectory of a normal dependency-check:check run in a SNAPSHOT Maven artifact which can then be unpacked when needed for "almost-offline" usage in our CICD build server. As the download+update bit is then decoupled from the actual check, we expect this to be very robust.
from nist-data-mirror.
PR #116 merged so I think that this is resolved. I tested it with the 1.6.0 release and it was much faster.
from nist-data-mirror.
Fantastic! Thanks for testing.
from nist-data-mirror.
Related Issues (20)
- Docker container doesn't mirror all files HOT 1
- k8s deprecation 'networking.k8s.io/v1beta1' in v1.22
- NistDataMirror.java has hardcoded Windows file separators HOT 2
- Unable to build with IBM Java 8 HOT 2
- GitHub action - Unable to access jarfile nist-data-mirror.jar HOT 1
- Cron running twice
- nvdcve-1.1-2013.json.gz corrupt with nist-data-mirror 1.6.0 HOT 7
- Some downloads fail with ZipException HOT 2
- Unable to run nist-data-mirror on OpenShift HOT 3
- release 1.4.0 compiled against newer jdk HOT 2
- Docker Image 1.4.0 is throwing "Permission denied" issues HOT 1
- Allow to add volume and configure DNS in HELM chart. HOT 3
- HELM Chart - Allow http proxy values to be supplied through values.yaml. HOT 1
- Don't start the update process if one is already running HOT 1
- Introduce a logger HOT 1
- json 1.0 feeds no longer supported? HOT 5
- No .jar file for release 1.5.0 in releases HOT 1
- Using proxy with account
- java.io.EOFException: Unexpected end of ZLIB input stream HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nist-data-mirror.