Doc out of order issue from Lucene 8.10.1 about lucene HOT 7 OPEN

Hi @SaiSatwik
Are you running a some sort of test?

from lucene.

Hi @mkhludnev

No. We have seen this issue in a VM where single node opensearch deployment is running. Due to this issue opensearch index went into RED state, leading to failure in any query on this index.

from lucene.

Pardon. I had a wrong clue about a change in test framework occurring later. Now, looking into the version you mention, I realized, it's wrong. Have no idea. Don't you have index sorting configured?

from lucene.

@mkhludnev , we do not have index sorting configured. But, could you please help me understand how can this issue could be related to index sorting configuration?

from lucene.

honestly, have no idea. How many docs you have in this index? May it exceed 2bns?

from lucene.

No. It would be hardly in thousands (max 50k).

from lucene.

This log is scary: out-of-order doc IDs, doc freq greater than total term freq, there is a major issue here. Are you doing something exotic on this index? Can you replicate this bug consistently? If so, does it still replicate if you use a more modern JDK (trying to check if there could be a JDK bug). Or can you run with assertions enabled and see if it reports a problem earlier?

from lucene.