Optimize the extension to prevent partition rebalancing from occurring. about azure-functions-eventhubs-extension HOT 4 CLOSED

This is an important fix for us. This particular issue has impacted production reliability for an architecture we have that relies on EventHub. We raised a ticket with Microsoft support, and found through review and trial/error that this patch is our only viable solution, other than a potential replatforming away from EventHub. Hoping this change can be added to a release quickly.

from azure-functions-eventhubs-extension.

@soninaren can you elaborate on the exact ask? We've improved checkpointing for the Event Hubs extension in version 5.0+. Can you please try this and see if it improves upon the required scenarios?

from azure-functions-eventhubs-extension.

@cachai2, I believe this came from a CRI. The function app had been subjected to several partition rebalancing process. Upon further investigation i found out that this was caused because of the way function app was generating the container + blob name.

This if further explained by the

The container name for the event hub and function host start with the same prefix. So it is possible that all the blob operations are happening on the same partition server, increasing the chance of partition rebalancing operation.

These are the only details i remember as this issue is quite old. I would suggest to further investigate and close this if this is believed to have been already addressed.

from azure-functions-eventhubs-extension.

Close as no enough info.

from azure-functions-eventhubs-extension.