(New Construct): LangServ Support about generative-ai-cdk-constructs HOT 8 OPEN

Thank you for the suggestion @tech4life87 ! Do you mind describing a few things for us:

1. At a high level, how do you propose deploying and running LangServe on AWS? (i.e. what resources, services, etc.)
2. Is a LangServe construct related to or enhanced by existing constructs, and if so, how?
3. At a high level, do you propose that users should be able to make custom REST APIs with LangServe, and if so, what would be the "entrypoint" for providing their Chains and Runnables?

from generative-ai-cdk-constructs.

@laithalsaadoon I just updated the issue with these details.

from generative-ai-cdk-constructs.

Hi @tech4life87 , thank your for this suggestion, looks very interesting !

1. Do you have an idea of the interface for this construct ?
2. Could you walk me through the developer workflow for this construct ?

from generative-ai-cdk-constructs.

@tech4life87 any update on this one ?

from generative-ai-cdk-constructs.

@krokoko

1. Yes I have an idea of how this would work from my previous work on the same thing.

2. From a developer experience/flow perspective there are two possible paths and I am open to refining it.

   1. Developer imports the constructs which default to pulling the container from a public ecr repo.
   2. They do local development and local testing.
   3. during CDK deploy the container is packaged and deployed to ECS.

   options2:

   1. Developer create a local langserve application.
   2. The developer then does local development and testing.
   3. Using the local Dockefile the construct packages the code and deploys to ECS.

   I open to ideas of what other developers have done to improve dev experience when it comes to fargate based constructs.

from generative-ai-cdk-constructs.

great @tech4life87 , thanks ! I see you mentioned you may be able to implement this feature, would you be able to create a draft of this construct in a branch ?

from generative-ai-cdk-constructs.

great @tech4life87 , thanks ! I see you mentioned you may be able to implement this feature, would you be able to create a draft of this construct in a branch ?

Yes I will start working on it

from generative-ai-cdk-constructs.

Thank you @tech4life87 ! I will assign the ticket to you for now

from generative-ai-cdk-constructs.