Support streaming openai outside Node (ie. without axios) about langchainjs HOT 9 CLOSED

Update to the latest version with npm install langchain@latest and try again

from langchainjs.

npm view langchain version still shows the same version (0.0.44) but it is working now, thanks!

Is there an example of how to send the response of the ChatOpenAI streamed back to the client from the cf workers?

Edit: I got it working here, in case someone is interested: https://gist.github.com/alberduris/32e4ad5827cb01c28022ded982bfd8bc

from langchainjs.

Could you provide a bit more context of what's the desired outcome?

from langchainjs.

The official openai library (which we use) uses axios to make http requests.
Axios off-the-shelf doesn't work in non-node environments.
For non-streaming output we already use an axios adapter (https://github.com/hwchase17/langchainjs/blob/main/langchain/src/util/axios-fetch-adapter.js) to make it work outside Node. This issue is about updating that adapter to support the SSE responses that OpenAI uses for streaming

from langchainjs.

Is it possible now to make streaming OpenAI requests, for example, on Cloudflare Workers? If so, how?

from langchainjs.

To set up Cloudflare Workers see #212 (comment)
To set up streaming see https://js.langchain.com/docs/modules/models/llms/additional_functionality#streaming-responses

from langchainjs.

It's not working. I have followed those instructions and (after fixing several process is not defined errors) I'm still getting the ✘ [ERROR] Uncaught (in response) TypeError: adapter is not a function error as described https://github.com/fern-openai/openai-node/issues/7 and openai/openai-node#30 (comment).

from langchainjs.

Which version of langchain are you using?

from langchainjs.

Which version of langchain are you using?

From your package.json specification:

  "dependencies": {
    "langchain": "^0.0.35"
  }

I get:

> npm view langchain version
$ 0.0.44

from langchainjs.