Error fetching large schema (The content length [49287161] exceeds the maximum allowed content length [10485760]) about airbyte HOT 4 CLOSED

Did you try to specify the schema in the connector configuration? As if you keep all the user has access it will retrieve the SYS schema with thousands of tables. Another workaround is to create a specific user and split tables to have limit access.

from airbyte.

Did you try to specify the schema in the connector configuration? As if you keep all the user has access it will retrieve the SYS schema with thousands of tables. Another workaround is to create a specific user and split tables to have limit access.

Yes, I specified the schema. The problem is that, this schema contains thousands of tables. We are working on creating specific user with limited access, but the problem is that we don't know yet all the table we will need, and the communication with database administration is problematic for now and takes very long. We will be trying this scenario, but if there is any opportunity to fix it without creating multiple users - would be helpful tho.

from airbyte.

What you are running into is the 10MB limit for HTTP requests on the Micronaut server that stores catalogs. We cannot guarantee the Airbyte platform will run well with a nearly 50MB catalog, but if you'd like to try, you can set MICRONAUT_SERVER_MAX_REQUEST_SIZE to something higher than your catalog's size.

If you're using helm charts to deploy you'll want to add something like:

        - name: MICRONAUT_SERVER_MAX_REQUEST_SIZE
          value: "52428800"

Please report back if / when you hit another issue, or if it goes well! This is an interesting test case for us, if not fully supported.

from airbyte.

We aren't supporting this, so I'm closing it.

from airbyte.