java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded about database HOT 4 OPEN

On Fri, Jul 1, 2022 at 05:55 Simon Gelfand ***@***.***> wrote: Getting this error while running the wikidata runUpdater.sh java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded I don't see where I can set this config to a higher number — Reply to this email directly, view it on GitHub <#232>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AATW7YE5N7UKD2HL4ARPFQLVR3TDVANCNFSM52MUWT7Q> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

On Fri, Jul 1, 2022 at 6:16 AM Simon Gelfand ***@***.***> wrote: I just have the log from the debug mode: 12:46:53.179 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q103933897.ttl?flavor=dump&nocache=1656679613179 12:46:53.186 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 95 ms 12:46:53.187 [update 7] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for ***@***@***.***|1703581390 12:46:53.187 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q111804028.ttl?flavor=dump&nocache=1656679613187 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms 12:46:53.214 [update 5] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for ***@***@***.***|1703581419 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q94562706.ttl?flavor=dump&nocache=1656679613214 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 327 ms 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 106 ms 12:46:53.228 [update 1] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for ***@***@***.***|1703581359 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q5896227.ttl?flavor=dump&nocache=1656679613228 12:46:53.228 [update 0] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for ***@***@***.***|1703581428 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q50093816.ttl?flavor=dump&nocache=1656679613228 12:46:53.230 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 110 ms 12:46:53.231 [update 6] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for ***@***@***.***|1703581371 12:46:53.231 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q103933898.ttl?flavor=dump&nocache=1656679613231 12:46:53.269 [update 3] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 216 ms 12:46:53.271 [update 9] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 142 ms 12:46:53.279 [update 2] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 202 ms 12:46:53.281 [update 8] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 108 ms 12:46:53.298 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 111 ms 12:46:53.300 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 121 ms 12:46:53.322 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 94 ms 12:46:53.332 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms 12:46:53.355 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 127 ms 12:46:53.395 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 180 ms 12:46:53.424 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Processing 80 IDs and 15199 statements 12:46:53.467 [main] DEBUG o.w.q.rdf.tool.rdf.client.RdfClient - Completed in 42 ms 12:46:53.606 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Sending query 4331986 bytes 12:47:03.497 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 1, will retry 12:47:08.990 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 2, will retry 12:47:16.425 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 3, will retry — Reply to this email directly, view it on GitHub <#232 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AATW7YBMQDG3KSW53IAOFGLVR3VUNANCNFSM52MUWT7Q> . You are receiving this because you commented.Message ID: ***@***.***>

On 1 Jul 2022, 18:19 +0300, Bryan Thompson ***@***.***>, wrote: Ok. That is in the wikidata integration. You want to check with them. Bryan On Fri, Jul 1, 2022 at 6:16 AM Simon Gelfand ***@***.***> wrote: > I just have the log from the debug mode: > > 12:46:53.179 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching > rdf from > https://www.wikidata.org/wiki/Special:EntityData/Q103933897.ttl?flavor=dump&nocache=1656679613179 > 12:46:53.186 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 95 > ms > 12:46:53.187 [update 7] DEBUG org.wikidata.query.rdf.tool.Updater - > Processing data for ***@***@***.***|1703581390 > 12:46:53.187 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching > rdf from > https://www.wikidata.org/wiki/Special:EntityData/Q111804028.ttl?flavor=dump&nocache=1656679613187 > 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 > ms > 12:46:53.214 [update 5] DEBUG org.wikidata.query.rdf.tool.Updater - > Processing data for ***@***@***.***|1703581419 > 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching > rdf from > https://www.wikidata.org/wiki/Special:EntityData/Q94562706.ttl?flavor=dump&nocache=1656679613214 > 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 327 > ms > 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 106 > ms > 12:46:53.228 [update 1] DEBUG org.wikidata.query.rdf.tool.Updater - > Processing data for ***@***@***.***|1703581359 > 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching > rdf from > https://www.wikidata.org/wiki/Special:EntityData/Q5896227.ttl?flavor=dump&nocache=1656679613228 > 12:46:53.228 [update 0] DEBUG org.wikidata.query.rdf.tool.Updater - > Processing data for ***@***@***.***|1703581428 > 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching > rdf from > https://www.wikidata.org/wiki/Special:EntityData/Q50093816.ttl?flavor=dump&nocache=1656679613228 > 12:46:53.230 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 110 > ms > 12:46:53.231 [update 6] DEBUG org.wikidata.query.rdf.tool.Updater - > Processing data for ***@***@***.***|1703581371 > 12:46:53.231 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching > rdf from > https://www.wikidata.org/wiki/Special:EntityData/Q103933898.ttl?flavor=dump&nocache=1656679613231 > 12:46:53.269 [update 3] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 216 > ms > 12:46:53.271 [update 9] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 142 > ms > 12:46:53.279 [update 2] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 202 > ms > 12:46:53.281 [update 8] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 108 > ms > 12:46:53.298 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 111 > ms > 12:46:53.300 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 121 > ms > 12:46:53.322 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 94 > ms > 12:46:53.332 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 > ms > 12:46:53.355 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 127 > ms > 12:46:53.395 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 180 > ms > 12:46:53.424 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - > Processing 80 IDs and 15199 statements > 12:46:53.467 [main] DEBUG o.w.q.rdf.tool.rdf.client.RdfClient - Completed > in 42 ms > 12:46:53.606 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Sending > query 4331986 bytes > 12:47:03.497 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request > failed: java.util.concurrent.ExecutionException: > java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, > attempt 1, will retry > 12:47:08.990 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request > failed: java.util.concurrent.ExecutionException: > java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, > attempt 2, will retry > 12:47:16.425 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request > failed: java.util.concurrent.ExecutionException: > java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, > attempt 3, will retry > > — > Reply to this email directly, view it on GitHub > <#232 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AATW7YBMQDG3KSW53IAOFGLVR3VUNANCNFSM52MUWT7Q> > . > You are receiving this because you commented.Message ID: > ***@***.***> > — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>