keeps / dbptk-enterprise Goto Github PK

Description:
On Windows, I have followed the steps on https://visualization.database-preservation.com/ to "Deploy using Docker App", so I have installed docker, docker-compose and docker-app, however I am not able to "render" the dbvtk because I am getting the follownig error when trying "To execute in a docker-compose":
"Error: cannot locate application "keeps/dbvtk-app:latest" in filesystem or registry: manifest unknown: manifest unknown".

I have also tried to simply do "docker pull keeps/dbvkt" or "docker pull keeps/dbvkt-app" and got: "Error response from daemon: pull access denied for keeps/dbvkt, repository does not exist or may require 'docker login".

Browser (Internet explorer, Chrome, Firefox, etc):

Browser version:

Steps required to reproduce the bug:

1. Install docker, docker-compose and docker-app
2. run PowerShell as admin and type "docker-app render keeps/dbvtk-app:latest | docker-compose -f - up"
3. If point 2 fails, test you can pull the repo on docker-hub. Within the same PowerShell type: "docker pull keeps/dbvtk" or "docker pull keeps/dbvtk-app"

Attach any related screenshots below.

If you try to load a database from siard into the DBPTK Enterprise that has lob folders additionally to siard file itself then these files will never reach the Enterprise...

For example you know that Sakila has text LOB in the table film_text in column description. But there is nothing here:

Log file of DBPTK Enterprise is also screaming that lobs can not be found.

Following the instructions here:
https://github.com/keeps/db-visualization-toolkit-docker

[pgoetz@frog ~]$ docker-app render keeps/dbvtk:latest | docker-compose -f - up Error: docker.io/keeps/dbvtk:latest: invalid media type "application/vnd.docker.distribution.manifest.v2+json" for bundle manifest ERROR: Top level object in 'None' needs to be an object not '<class 'NoneType'>'.

Following the instructions provided here:
https://github.com/keeps/db-visualization-toolkit-docker

[pgoetz@frog ~]$ docker-app inspect keeps/dbvtk:latest Error: docker.io/keeps/dbvtk:latest: invalid media type "application/vnd.docker.distribution.manifest.v2+json" for bundle manifest

Hi db-visualization-toolkit-docker. I have succeed in running the docker-compose up command. Everything seems to be working, but when I try to access "http://localhost:8080" i get an "Unexpected Error" saying "[NullPointerException] html is null". What to do?

I have the DBPTK Enterprise with CAS (Miguel-s prepared combo) and I am using it for preparing 26GB database for browsing.

It started preparation and last time I checked it had worked about 8 hours about 30% was finished. The log was empty so no error messages were there.

Now today it says that 73% is done but when I see the log folder then there are 4 MB log file which is filled with one repeating error:
2021-08-27 00:00:00,946 [http-nio-8080-exec-6] WARN o.a.c.c.C.[.[.[.[dispatcherServlet] - Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [org.apache.solr.common.SolrException: Could not load collection from ZK: dbv-activity-logs] with root cause org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /collections/dbv-activity-logs/state.json at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1565) at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1551) at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:798) at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:391) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.getDocCollection(BaseCloudSolrClient.java:1219) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:871) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138) at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.addLogEntry(DatabaseRowsSolrManager.java:250) at com.databasepreservation.common.server.ConfigurationManager.addLogEntry(ConfigurationManager.java:434) at com.databasepreservation.common.utils.ControllerAssistantUtils.registerAction(ControllerAssistantUtils.java:77) at com.databasepreservation.common.utils.ControllerAssistantUtils.registerAction(ControllerAssistantUtils.java:37) at com.databasepreservation.common.utils.ControllerAssistant.registerAction(ControllerAssistant.java:100) at com.databasepreservation.common.utils.ControllerAssistant.registerAction(ControllerAssistant.java:105) at com.databasepreservation.common.api.v1.CollectionResource.getProgressData(CollectionResource.java:217) at sun.reflect.GeneratedMethodAccessor385.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:244) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:392) at org.glassfish.jersey.servlet.ServletContainer.serviceImpl(ServletContainer.java:385) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:560) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:501) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:438) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:526) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:747) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:860) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1589) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) 2021-08-27 00:01:19,692 [http-nio-8080-exec-3] WARN c.d.c.s.i.DatabaseRowsSolrManager - Could not insert a document batch in collectiondbv-database-c86a54e0-2402-4ef0-ac56-392244f9b6de. Last response (if any): null org.apache.solr.common.SolrException: Could not load collection from ZK: dbv-database-c86a54e0-2402-4ef0-ac56-392244f9b6de at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1553) at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:798) at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:391) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.getDocCollection(BaseCloudSolrClient.java:1219) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:871) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177) at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.insertDocument(DatabaseRowsSolrManager.java:387) at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.addRow(DatabaseRowsSolrManager.java:160) at com.databasepreservation.modules.viewer.DbvtkExportModule.handleDataRow(DbvtkExportModule.java:134) at com.databasepreservation.model.modules.filters.IdentityFilter.handleDataRow(IdentityFilter.java:88) at com.databasepreservation.model.modules.filters.ObservableFilter.handleDataRow(ObservableFilter.java:123) at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.endElement(SIARD2ContentImportStrategy.java:374) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.xs.XMLSchemaValidator.endElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanEndElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.importContent(SIARD2ContentImportStrategy.java:184) at com.databasepreservation.modules.siard.in.input.SIARDImportDefault.migrateDatabaseTo(SIARDImportDefault.java:64) at com.databasepreservation.DatabaseMigration.migrate(DatabaseMigration.java:123) at com.databasepreservation.common.server.controller.SIARDController.convertSIARDtoSolr(SIARDController.java:706) at com.databasepreservation.common.server.controller.SIARDController.loadFromLocal(SIARDController.java:669) at com.databasepreservation.common.api.v1.CollectionResource.createCollection(CollectionResource.java:196) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:244) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:392) at org.glassfish.jersey.servlet.ServletContainer.serviceImpl(ServletContainer.java:385) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:560) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:501) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:438) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:526) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:747) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:860) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1589) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /collections/dbv-database-c86a54e0-2402-4ef0-ac56-392244f9b6de/state.json at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1565) at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1551) ... 87 common frames omitted 2021-08-27 00:01:20,694 [http-nio-8080-exec-3] ERROR c.d.m.s.i.c.SIARD2ContentImportStrategy - An error occurred while handling data row com.databasepreservation.common.exceptions.ViewerException: Could not insert a document batch in collection. Reason: Timeout reached while waiting for collection to be available. at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.insertDocument(DatabaseRowsSolrManager.java:420) at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.addRow(DatabaseRowsSolrManager.java:160) at com.databasepreservation.modules.viewer.DbvtkExportModule.handleDataRow(DbvtkExportModule.java:134) at com.databasepreservation.model.modules.filters.IdentityFilter.handleDataRow(IdentityFilter.java:88) at com.databasepreservation.model.modules.filters.ObservableFilter.handleDataRow(ObservableFilter.java:123) at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.endElement(SIARD2ContentImportStrategy.java:374) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.xs.XMLSchemaValidator.endElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanEndElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.importContent(SIARD2ContentImportStrategy.java:184) at com.databasepreservation.modules.siard.in.input.SIARDImportDefault.migrateDatabaseTo(SIARDImportDefault.java:64) at com.databasepreservation.DatabaseMigration.migrate(DatabaseMigration.java:123) at com.databasepreservation.common.server.controller.SIARDController.convertSIARDtoSolr(SIARDController.java:706) at com.databasepreservation.common.server.controller.SIARDController.loadFromLocal(SIARDController.java:669) at com.databasepreservation.common.api.v1.CollectionResource.createCollection(CollectionResource.java:196) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:244) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:392) at org.glassfish.jersey.servlet.ServletContainer.serviceImpl(ServletContainer.java:385) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:560) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:501) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:438) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:526) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:747) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:860) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1589) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) 2021-08-27 00:02:37,390 [http-nio-8080-exec-1] WARN o.a.c.c.C.[.[.[.[dispatcherServlet] - Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [org.apache.solr.common.SolrException: Could not load collection from ZK: dbv-activity-logs] with root cause org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /collections/dbv-activity-logs/state.json at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1565) at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1551) at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:798) at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:391) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.getDocCollection(BaseCloudSolrClient.java:1219) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:871) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138) at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.addLogEntry(DatabaseRowsSolrManager.java:250) at com.databasepreservation.common.server.ConfigurationManager.addLogEntry(ConfigurationManager.java:434) at com.databasepreservation.common.utils.ControllerAssistantUtils.registerAction(ControllerAssistantUtils.java:77) at com.databasepreservation.common.utils.ControllerAssistantUtils.registerAction(ControllerAssistantUtils.java:37) at com.databasepreservation.common.utils.ControllerAssistant.registerAction(ControllerAssistant.java:100) at com.databasepreservation.common.utils.ControllerAssistant.registerAction(ControllerAssistant.java:105) at com.databasepreservation.common.api.v1.CollectionResource.getProgressData(CollectionResource.java:217) at sun.reflect.GeneratedMethodAccessor385.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:244) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:392) at org.glassfish.jersey.servlet.ServletContainer.serviceImpl(ServletContainer.java:385) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:560) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:501) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:438) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:526) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:747) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:860) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1589) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) 2021-08-27 00:03:55,227 [http-nio-8080-exec-3] WARN c.d.c.s.i.DatabaseRowsSolrManager - Could not insert a document batch in collectiondbv-database-c86a54e0-2402-4ef0-ac56-392244f9b6de. Last response (if any): null org.apache.solr.common.SolrException: Could not load collection from ZK: dbv-database-c86a54e0-2402-4ef0-ac56-392244f9b6de at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1553) at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:798) at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:391) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.getDocCollection(BaseCloudSolrClient.java:1219) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:871) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177) at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.insertDocument(DatabaseRowsSolrManager.java:387) at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.addRow(DatabaseRowsSolrManager.java:160) at com.databasepreservation.modules.viewer.DbvtkExportModule.handleDataRow(DbvtkExportModule.java:134) at com.databasepreservation.model.modules.filters.IdentityFilter.handleDataRow(IdentityFilter.java:88) at com.databasepreservation.model.modules.filters.ObservableFilter.handleDataRow(ObservableFilter.java:123) at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.endElement(SIARD2ContentImportStrategy.java:374) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.xs.XMLSchemaValidator.endElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanEndElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.importContent(SIARD2ContentImportStrategy.java:184) at com.databasepreservation.modules.siard.in.input.SIARDImportDefault.migrateDatabaseTo(SIARDImportDefault.java:64) at com.databasepreservation.DatabaseMigration.migrate(DatabaseMigration.java:123) at com.databasepreservation.common.server.controller.SIARDController.convertSIARDtoSolr(SIARDController.java:706) at com.databasepreservation.common.server.controller.SIARDController.loadFromLocal(SIARDController.java:669) at com.databasepreservation.common.api.v1.CollectionResource.createCollection(CollectionResource.java:196) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:244) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:392) at org.glassfish.jersey.servlet.ServletContainer.serviceImpl(ServletContainer.java:385) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:560) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:501) at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:438) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:526) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:747) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:860) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1589) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /collections/dbv-database-c86a54e0-2402-4ef0-ac56-392244f9b6de/state.json at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1565) at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1551) ... 87 common frames omitted

• Add -Djavax.xml.parsers.DocumentBuilderFactory=org.apache.xerces.jaxp.DocumentBuilderFactoryImpl
• Replace -Djavax.xml.parsers.SAXParserFactory value with org.apache.xerces.jaxp.SAXParserFactoryImpl

keeps/dbvtk:v2.8.0 database validation at web UI is giving error:
[JavaScriptException] (TypeError) : Cannot read properties of null (reading 'nf')

spring.log:
WARN 1 --- [http-nio-8080-exec-8] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [org.glassfish.jersey.server.ContainerException: java.lang.UnsupportedClassVersionError: org/eclipse/collections/impl/list/mutable/primitive/LongArrayList has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0] with root cause
..
ERROR 1 --- [http-nio-8080-exec-3] Uncaught : [127.0.0.1] Uncaught Exception: (TypeError) : Cannot read properties of null (reading 'xf')
java.lang.Throwable: null
at Unknown.td(DefaultMethodCallback.java:52)
at Unknown.Vzb(AbstractRequestCallback.java:67)
at Unknown.N8b(Request.java:227)
at Unknown.d9b(RequestBuilder.java:412)
at Unknown.anonymous(XMLHttpRequest.java:329)
at Unknown.XYb(Impl.java:299)
at Unknown.$Yb(Impl.java:351)
at Unknown.anonymous(Impl.java:78)

We're interested in the idea of using a tool such as PrestoDB to explore our SIARD files. One way to achieve this would be to connect Presto to DBPTK.

Is it possible to use DBPTK enterprise via an API? It looks like there's a REST API but I could not find any documentation for it.

Alternatively perhaps we could create a Thrift specification with DBPTK and use the PrestoDB thrift connector?

How do I install RODA and wy do I need it to set userpermissions to sertain databases in dbptk-enterprice?

Kindly!
Hans

Hello,

When trying to run docker-compose up, we get access forbidden when trying to pull the cas-file docker image.
I believe it is related to this change 3b47e3d#diff-034aa0ff3e6f391b9a43795ac0f48b842a2ce2abdc1de092eb4ed7ba8adb7c97L29-R35, where you change from building the image locally, to pulling from remote.

I'm having trouble understanding how to install this program. I am also trying to make an automated install with MECM so any tips would be helpful. Thank you.

How do I "Open a terminal within deploys/development folder" and "Run docker-compose up". Do I do these in the docker app somehow, or on the command line?

Trying out RODA and DBPTK, and want some basic authentication.

Can DBPTK authenticate using RODA? How? Tried to follow this, changing
ui.filter.internal.enabled = true
ui.filter.internal.server = http://localhost:8082
I just get a dialog box saying I need to authenticate, but nothing more happens.

I have roda running on http://localhost:8082 and dbptk running on http://localhost:8081
I also see there is a plugin called roda-dbptk-plugin - is it necessary here, and how to use it?

This is the most critical issue at the moment. I can not browse database bigger than Sakila.
I cleaned the machine, I have plenty of space and RAM but DBPTK Enterprise is not working.

solr_1 | Caused by: java.lang.OutOfMemoryError: Java heap space
solr_1 |
dbptke_1 | 2021-08-24 12:17:26.937 WARN 1 --- [nio-8080-exec-4] c.d.c.s.index.DatabaseRowsSolrManager : Could not insert a document batch in collectiondbv-database-b49692d4-5b2f-4834-ae68-bb5e435c145c. Last response (if any): null
dbptke_1 |
dbptke_1 | org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://172.18.0.2:8983/solr/dbv-database-b49692d4-5b2f-4834-ae68-bb5e435c145c: Server error writing document id 24981989 to the index
dbptke_1 | at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:665)
dbptke_1 | at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
dbptke_1 | at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
dbptke_1 | at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
dbptke_1 | at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
dbptke_1 | at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143)
dbptke_1 | at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906)
dbptke_1 | at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838)
dbptke_1 | at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
dbptke_1 | at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177)
dbptke_1 | at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.insertDocument(DatabaseRowsSolrManager.java:387)
dbptke_1 | at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.addRow(DatabaseRowsSolrManager.java:160)
dbptke_1 | at com.databasepreservation.modules.viewer.DbvtkExportModule.handleDataRow(DbvtkExportModule.java:134)
dbptke_1 | at com.databasepreservation.model.modules.filters.IdentityFilter.handleDataRow(IdentityFilter.java:88)
dbptke_1 | at com.databasepreservation.model.modules.filters.ObservableFilter.handleDataRow(ObservableFilter.java:123)
dbptke_1 | at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.endElement(SIARD2ContentImportStrategy.java:374)
dbptke_1 | at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source)
dbptke_1 | at org.apache.xerces.impl.xs.XMLSchemaValidator.endElement(Unknown Source)
dbptke_1 | at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanEndElement(Unknown Source)
dbptke_1 | at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source)
dbptke_1 | at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
dbptke_1 | at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
dbptke_1 | at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
dbptke_1 | at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
dbptke_1 | at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
dbptke_1 | at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
dbptke_1 | at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.importContent(SIARD2ContentImportStrategy.java:184)
dbptke_1 | at com.databasepreservation.modules.siard.in.input.SIARDImportDefault.migrateDatabaseTo(SIARDImportDefault.java:64)
dbptke_1 | at com.databasepreservation.DatabaseMigration.migrate(DatabaseMigration.java:123)
dbptke_1 | at com.databasepreservation.common.server.controller.SIARDController.convertSIARDtoSolr(SIARDController.java:706)
dbptke_1 | at com.databasepreservation.common.server.controller.SIARDController.loadFromLocal(SIARDController.java:669)
dbptke_1 | at com.databasepreservation.common.api.v1.CollectionResource.createCollection(CollectionResource.java:196)
dbptke_1 | at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
dbptke_1 | at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
dbptke_1 | at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
dbptke_1 | at java.lang.reflect.Method.invoke(Method.java:498)
dbptke_1 | at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
dbptke_1 | at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
dbptke_1 | at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
dbptke_1 | at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219)
dbptke_1 | at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
dbptke_1 | at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469)
dbptke_1 | at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391)
dbptke_1 | at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80)
dbptke_1 | at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)
dbptke_1 | at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
dbptke_1 | at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
dbptke_1 | at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
dbptke_1 | at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
dbptke_1 | at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
dbptke_1 | at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
dbptke_1 | at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232)
dbptke_1 | at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)
dbptke_1 | at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:392)
dbptke_1 | at org.glassfish.jersey.servlet.ServletContainer.serviceImpl(ServletContainer.java:385)
dbptke_1 | at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:560)
dbptke_1 | at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:501)
dbptke_1 | at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:438)
dbptke_1 | at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dbptke_1 | at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dbptke_1 | at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
dbptke_1 | at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
dbptke_1 | at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dbptke_1 | at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dbptke_1 | at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114)
dbptke_1 | at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104)
dbptke_1 | at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
dbptke_1 | at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dbptke_1 | at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dbptke_1 | at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
dbptke_1 | at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
dbptke_1 | at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)

2021-08-24 12:17:25,931 [http-nio-8080-exec-4] ERROR o.a.s.c.s.impl.BaseCloudSolrClient - Request to collection [dbv-database-b49692d4-5b2f-4834-ae68-bb5e435c145c] failed due to (500) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://172.18.0.2:8983/solr/dbv-database-b49692d4-5b2f-4834-ae68-bb5e435c145c: Server error writing document id 24981989 to the index, retry=0 commError=false errorCode=500

Refers to: keeps/dbptk-ui#267

Add to docker-compose a CAS service with whitelist authentication, configure DBPTKE and provide some documentation.

Hi,

I have cloned the master branch, downloaded the .yml file and run the docker-compose up within the project folder... but it results in solr failing at some point with the following cause:

solr_1 | 2020-03-14 22:50:07.045 ERROR (qtp176683244-19) [c:dbv-databases s:shard1 r:core_node2 x:dbv-databases_shard1_replica_n1] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Error CREATEing SolrCore 'dbv-databases_shard1_replica_n1': Unable to create core [dbv-databases_shard1_replica_n1] Caused by: solr.NestPathField
solr_1 | at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1136)
solr_1 | at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:92)
solr_1 | at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:360)
solr_1 | at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:396)
solr_1 | at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:180)
solr_1 | at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
solr_1 | at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
solr_1 | at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
solr_1 | at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
solr_1 | at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395)
solr_1 | at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341)
solr_1 | at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602)
solr_1 | at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
solr_1 | at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
solr_1 | at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
solr_1 | at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
solr_1 | at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
solr_1 | at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588)
solr_1 | at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
solr_1 | at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
solr_1 | at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
solr_1 | at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
solr_1 | at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557)
solr_1 | at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
solr_1 | at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
solr_1 | at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
solr_1 | at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
solr_1 | at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
solr_1 | at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
solr_1 | at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
solr_1 | at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
solr_1 | at org.eclipse.jetty.server.Server.handle(Server.java:502)
solr_1 | at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364)
solr_1 | at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
solr_1 | at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
solr_1 | at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
solr_1 | at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
solr_1 | at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
solr_1 | at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
solr_1 | at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
solr_1 | at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
solr_1 | at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
solr_1 | at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
solr_1 | at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
solr_1 | at java.base/java.lang.Thread.run(Thread.java:834)
solr_1 | Caused by: org.apache.solr.common.SolrException: Unable to create core [dbv-databases_shard1_replica_n1]
solr_1 | at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1208)
solr_1 | at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1097)
solr_1 | ... 44 more
solr_1 | Caused by: org.apache.solr.common.SolrException: Could not load conf for core dbv-databases_shard1_replica_n1: Can't load schema managed-schema: Plugin init failure for [schema.xml] fieldType "nest_path": Error loading class 'solr.NestPathField'
solr_1 | at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:97)
solr_1 | at org.apache.solr.core.CoreContainer.getConfigSet(CoreContainer.java:1236)
solr_1 | at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1183)
solr_1 | ... 45 more
solr_1 | Caused by: org.apache.solr.common.SolrException: Can't load schema managed-schema: Plugin init failure for [schema.xml] fieldType "nest_path": Error loading class 'solr.NestPathField'
solr_1 | at org.apache.solr.schema.IndexSchema.readSchema(IndexSchema.java:590)
solr_1 | at org.apache.solr.schema.IndexSchema.(IndexSchema.java:180)
solr_1 | at org.apache.solr.schema.ManagedIndexSchema.(ManagedIndexSchema.java:105)
solr_1 | at org.apache.solr.schema.ManagedIndexSchemaFactory.create(ManagedIndexSchemaFactory.java:173)
solr_1 | at org.apache.solr.schema.ManagedIndexSchemaFactory.create(ManagedIndexSchemaFactory.java:45)
solr_1 | at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:75)
solr_1 | at org.apache.solr.core.ConfigSetService.createIndexSchema(ConfigSetService.java:119)
solr_1 | at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:92)
solr_1 | ... 47 more
solr_1 | Caused by: org.apache.solr.common.SolrException: Plugin init failure for [schema.xml] fieldType "nest_path": Error loading class 'solr.NestPathField'
solr_1 | at org.apache.solr.util.plugin.AbstractPluginLoader.load(AbstractPluginLoader.java:182)
solr_1 | at org.apache.solr.schema.IndexSchema.readSchema(IndexSchema.java:481)
solr_1 | ... 54 more
solr_1 | Caused by: org.apache.solr.common.SolrException: Error loading class 'solr.NestPathField'
solr_1 | at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:557)
solr_1 | at org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:626)
solr_1 | at org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:591)
solr_1 | at org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:584)
solr_1 | at org.apache.solr.schema.FieldTypePluginLoader.create(FieldTypePluginLoader.java:90)
solr_1 | at org.apache.solr.schema.FieldTypePluginLoader.create(FieldTypePluginLoader.java:53)
solr_1 | at org.apache.solr.util.plugin.AbstractPluginLoader.load(AbstractPluginLoader.java:152)
solr_1 | ... 55 more
solr_1 | Caused by: java.lang.ClassNotFoundException: solr.NestPathField
solr_1 | at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:471)
solr_1 | at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:588)
solr_1 | at java.base/java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:899)
solr_1 | at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
solr_1 | at java.base/java.lang.Class.forName0(Native Method)
solr_1 | at java.base/java.lang.Class.forName(Class.java:398)
solr_1 | at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:541)
solr_1 | ... 61 more

Which I believe is the cause of the embedded Tomcat also failing to start: org.springframework.context.ApplicationContextException: Unable to start web server; nested exception is org.springframework.boot.web.server.WebServerException: Unable to start embedded Tomcat

Before running the docker-compose up I also made sure there are no other containers, it is a clean environment.

I really appreciate any help as I stuck at this point.

Many thanks in advance,
Dom

I haven't succeeded to run a flawless docker-compose up command.
I get a long list of steps that run okay, and a lot of warnings and errors but I am not skilled enough to understand what is wrong.
report.txt

Hi,

I have deployed my copy of dbvtk, but when browsing to localhost:8080 I am prompt with this page:

There is nothing I can do in this page. Am I missing some setting or is there a different URL I should navigate to?

I've also tried to click on the Login, but the link is apparently broken.

Thanks a lot in advance for your help,
Dom

Move it from https://github.com/keeps/db-visualization-toolkit

Readme should also contain deploy instruction for docker copyed from the base repo

The link to the Database Visualization Toolkit github page provided here:
https://github.com/keeps/db-visualization-toolkit/blob/master/README.md

https://github.com/keeps/db-preservation-toolkit-docker

gives a 404 error. The github repo is actually located here:

https://github.com/keeps/db-visualization-toolkit-docker

# curl -X POST "http://localhost:8080/api/v1/database" -H "accept: text/plain" -H "Content-Type: application/json" -d "database.siard"
{"type":"error","message":"AuthorizationException: Remote exception caused by AuthorizationDeniedException: The user 'guest' does not have all needed permissions"}

I have tried the following, but no luck.
curl -u admin:admin ..

Regards
Raul

=> ERROR [overlay 8/8] RUN cd cas-overlay && ./gradlew clean build --parallel --no-daemon && ./gradlew 15.7s

[overlay 8/8] RUN cd cas-overlay && ./gradlew clean build --parallel --no-daemon && ./gradlew createKeystore:
#0 1.083 To honour the JVM settings for this build a single-use Daemon process will be forked. See https://docs.gradle.org/7.6/userguide/gradle_daemon.html#sec:disabling_the_daemon.
#0 1.874 Daemon will be stopped at the end of the build
#0 2.074 Configuration on demand is an incubating feature.
#0 15.07
#0 15.07 FAILURE: Build failed with an exception.
#0 15.07
#0 15.07 * What went wrong:
#0 15.08 A problem occurred configuring root project 'cas'.
#0 15.08 > Could not resolve all files for configuration ':classpath'.
#0 15.08 > Could not find gradle.plugin.com.google.cloud.tools:jib-gradle-plugin:3.3.1.
#0 15.08 Searched in the following locations:
#0 15.08 - file:/root/.m2/repository/gradle/plugin/com/google/cloud/tools/jib-gradle-plugin/3.3.1/jib-gradle-plugin-3.3.1.pom
#0 15.08 - https://repo.maven.apache.org/maven2/gradle/plugin/com/google/cloud/tools/jib-gradle-plugin/3.3.1/jib-gradle-plugin-3.3.1.pom
#0 15.08 - https://plugins.gradle.org/m2/gradle/plugin/com/google/cloud/tools/jib-gradle-plugin/3.3.1/jib-gradle-plugin-3.3.1.pom
#0 15.08 - https://repo.spring.io/milestone/gradle/plugin/com/google/cloud/tools/jib-gradle-plugin/3.3.1/jib-gradle-plugin-3.3.1.pom
#0 15.08 Required by:
#0 15.08 project :

I installed DBPTK Enterprise on Ubuntu. Successfully loaded one siard and used it.
Then tried to load another siard (that worked nicely on DBPTK Desktop) then in the middle of loading there were some error message and after that DBPTK Enterprise is useless.

I am not sure where to find logs via Docker so I used command:
sudo docker logs -t --since 10m a4e098dcf0ac
(I think these should be last 10 minute logs)

There are something like:
2021-02-02T08:12:23.088931335Z org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://XXX.YY.ZZ.ZZ:8983/solr/dbv-database-dd08a065-9af7-4ee0-b859-e894ad4500ba: Server error writing document id 23676501 to the index
2021-02-02T08:12:23.088938208Z at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:665)
2021-02-02T08:12:23.088944490Z at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
2021-02-02T08:12:23.088950702Z at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
2021-02-02T08:12:23.088956673Z at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
2021-02-02T08:12:23.088962674Z at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
2021-02-02T08:12:23.088968495Z at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143)
2021-02-02T08:12:23.088974477Z at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906)
2021-02-02T08:12:23.088980748Z at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838)
2021-02-02T08:12:23.088986730Z at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
2021-02-02T08:12:23.088992701Z at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177)
2021-02-02T08:12:23.088998462Z at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.insertDocument(DatabaseRowsSolrManager.java:380)
2021-02-02T08:12:23.089017257Z at com.databasepreservation.common.server.index.DatabaseRowsSolrManager.addRow(DatabaseRowsSolrManager.java:153)
2021-02-02T08:12:23.089023549Z at com.databasepreservation.modules.viewer.DbvtkExportModule.handleDataRow(DbvtkExportModule.java:127)
2021-02-02T08:12:23.089029640Z at com.databasepreservation.model.modules.filters.IdentityFilter.handleDataRow(IdentityFilter.java:88)
2021-02-02T08:12:23.089035652Z at com.databasepreservation.model.modules.filters.ObservableFilter.handleDataRow(ObservableFilter.java:123)
2021-02-02T08:12:23.089041583Z at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.endElement(SIARD2ContentImportStrategy.java:374)
2021-02-02T08:12:23.089048736Z at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:609)
2021-02-02T08:12:23.089054858Z at com.sun.org.apache.xerces.internal.impl.xs.XMLSchemaValidator.endElement(XMLSchemaValidator.java:859)
2021-02-02T08:12:23.089060789Z at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1782)
2021-02-02T08:12:23.089066790Z at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2967)
2021-02-02T08:12:23.089072832Z at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602)
2021-02-02T08:12:23.089078703Z at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112)
2021-02-02T08:12:23.089084704Z at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505)
2021-02-02T08:12:23.089090705Z at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:842)
2021-02-02T08:12:23.089096486Z at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:771)
2021-02-02T08:12:23.089102427Z at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
2021-02-02T08:12:23.089108208Z at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
2021-02-02T08:12:23.089114009Z at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643)
2021-02-02T08:12:23.089119920Z at com.databasepreservation.modules.siard.in.content.SIARD2ContentImportStrategy.importContent(SIARD2ContentImportStrategy.java:184)
2021-02-02T08:12:23.089125981Z at com.databasepreservation.modules.siard.in.input.SIARDImportDefault.migrateDatabaseTo(SIARDImportDefault.java:64)
2021-02-02T08:12:23.089131853Z at com.databasepreservation.DatabaseMigration.migrate(DatabaseMigration.java:123)
2021-02-02T08:12:23.089137663Z at com.databasepreservation.common.server.controller.SIARDController.convertSIARDtoSolr(SIARDController.java:697)
2021-02-02T08:12:23.089143615Z at com.databasepreservation.common.server.controller.SIARDController.loadFromLocal(SIARDController.java:660)
2021-02-02T08:12:23.089155186Z at com.databasepreservation.common.api.v1.CollectionResource.createCollection(CollectionResource.java:188)
2021-02-02T08:12:23.089161338Z at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-02-02T08:12:23.089167780Z at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-02-02T08:12:23.089173751Z at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-02-02T08:12:23.089179572Z at java.lang.reflect.Method.invoke(Method.java:498)
2021-02-02T08:12:23.089185293Z at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
2021-02-02T08:12:23.089191405Z at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
2021-02-02T08:12:23.089197376Z at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
2021-02-02T08:12:23.089203347Z at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219)
2021-02-02T08:12:23.089209408Z at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
2021-02-02T08:12:23.089215440Z at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469)
2021-02-02T08:12:23.089221491Z at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391)
2021-02-02T08:12:23.089227412Z at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80)
2021-02-02T08:12:23.089233253Z at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)
2021-02-02T08:12:23.089239154Z at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
2021-02-02T08:12:23.089244875Z at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
2021-02-02T08:12:23.089250676Z at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
2021-02-02T08:12:23.089256427Z at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
2021-02-02T08:12:23.089262138Z at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
2021-02-02T08:12:23.089267858Z at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
2021-02-02T08:12:23.089273649Z at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232)
2021-02-02T08:12:23.089279360Z at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)
2021-02-02T08:12:23.089285141Z at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:392)
2021-02-02T08:12:23.089290811Z at org.glassfish.jersey.servlet.ServletContainer.serviceImpl(ServletContainer.java:385)
2021-02-02T08:12:23.089297484Z at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:560)
2021-02-02T08:12:23.089309066Z at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:501)
2021-02-02T08:12:23.089315087Z at org.glassfish.jersey.servlet.ServletContainer.doFilter(ServletContainer.java:438)
2021-02-02T08:12:23.089320848Z at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
2021-02-02T08:12:23.089326829Z at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
2021-02-02T08:12:23.089332630Z at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
2021-02-02T08:12:23.089338591Z at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
2021-02-02T08:12:23.089344392Z at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
2021-02-02T08:12:23.089350233Z at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
2021-02-02T08:12:23.089356084Z at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114)
2021-02-02T08:12:23.089362035Z at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104)
2021-02-02T08:12:23.089367937Z at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
2021-02-02T08:12:23.089373757Z at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
2021-02-02T08:12:23.089379598Z at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)

So if you want to understand in more detail what happened then you should tell me where to get you more information.

Tomorrow I will clean up this mess and try again, so all logs will be vanished in 24 hours.