Postprocessing col/row refinement before alignment! about table-transformer HOT 2 OPEN

Hi, thanks for bringing this up, it's a great point.

If I understand you correctly, this situation can happen when two predicted columns are non-overlapping but stacked vertically, one above the other. Is that correct?

This situation seems like it would happen rarely or never for a model that is performing very well on a particular test dataset. But if the model is not performing well, and this situation did happen, then just thinking about it, yes it does seem to me like the current post-processing code could have an undesired outcome.

Can you share the GriTS score you had before and after making the change? An improvement of 0.01 is actually pretty significant. Because models that perform very well can already have GriTS scores above 0.98, I do suspect this improvement will only happen for models whose performance is less than desired on the test data. But until table structure recognition is completely solved, that's a valid case to consider!

Best,
Brandon

from table-transformer.

If I understand you correctly, this situation can happen when two predicted columns are non-overlapping but stacked vertically, one above the other. Is that correct?

Yup, that's right. It can also happen for rows stacked horizontally but not overlapping.

Can you share the GriTS score you had before and after making the change?

Before Change: Grits_Top: 0.9161 Grits_loc: 0.7638
After Change: Grits_Top:0.9257 Grits_loc: 0.7707
The test set consists of 1500 samples.

Thanks for taking note of this! Let me know if a PR is needed to add these changes, would be happy to open one.

from table-transformer.