Failed to load metadata pointer when connecting about duckdb HOT 4 OPEN

Hi guys,

We also encountered the same error in a process mining application that handles a large volume of events.

In our case, the application ingests data online. As the data is updated at the source (ERPs and other applications), it is sent to the database via a pipeline.

This means there are read and write operations happening concurrently (although not exactly at the same time, as DuckDB has some architectural restrictions in this regard).

After several days of normal operation, we received this same error.

There was nothing we could do; it seems the DuckDB file was indeed corrupted. We had to recreate the database.

We are also using version 0.10.2.

It is a much more stable and complete version than the previous ones, but this problem is new to us.

Is there anything we can do to mitigate this problem?

Thanks for your attention.

from duckdb.

Hi @jovanglig and @kannenberg, can you please try to upgrade to v1.0.0 and observe whether the problem still persists? The new version has several fixes and may have already fixed the issue described here.

from duckdb.

Also, if you have a corrupted database file that you can share with us, please email it to [email protected]. This can help us analyze the problem more quickly.

from duckdb.

I had this issue with a 1.0.0-created and -modified database. I can't share it because it contains company confidential information.

from duckdb.