Comments (2)
This is due to start event is not coming in hosted server.
For some reason first few events are missing. so you will miss connected and start event.
So the following code won't execute
if (msg.event === 'start') {
streamSid = msg.start.streamSid;
callSid = msg.start.callSid;
streamService.setStreamSid(streamSid);
gptService.setCallSid(callSid);
// Set RECORDING_ENABLED='true' in .env to record calls
recordingService(ttsService, callSid).then(() => {
console.log(`Twilio -> Starting Media Stream for ${streamSid}`.underline.red);
ttsService.generate({partialResponseIndex: null, partialResponse: 'Hello! I understand you\'re looking for a pair of AirPods, is that correct?'}, 0);
});
}
One workaround I found
You can pass the callSid from body as a param in wss link here
And here you can pass a second param (ws, req)
use req
to get params and callSid
wss://${process.env.SERVER}/connection/${req.body.callSid}
app.ws('/connection/:callSid', (ws,req) => {
const {callSid} = req.params;
...
use callSid to set gpservice callSid
and in media event you will get streamSid set it in streamService
something like this
else if (msg.event === 'media') {
if (!streamService.streamSid) {
streamService.setStreamSid(msg.streamSid);
recordingService(ttsService, callSid).then(() => {
console.log(`Twilio -> Starting Media Stream for ${streamSid}`.underline.red);
ttsService.generate({partialResponseIndex: null, partialResponse: 'Hello! I understand you\'re looking for a pair of AirPods, is that correct?'}, 0);
});
}
transcriptionService.send(msg.media.payload);
}
from call-gpt.
Hello, @BhargabSixthSens
I have the same result, I make the connection and it completes and connects but it is silent on the gpt side.
from call-gpt.
Related Issues (20)
- Interruption handling.
- no response HOT 4
- Giving a Knowledge Base for the Bot HOT 2
- Please create another option for speech to text using Deepgram Aurora HOT 3
- Just added typescript support for the repo and typed most of the files HOT 4
- Got the repo kinda working HOT 12
- Different TTS models HOT 5
- how i can run this code and voice call to gpt HOT 2
- i get this error anyone can tell me how can i solve this! HOT 4
- Wrong inputs in function call HOT 1
- Deepgram for TTS HOT 3
- <Record> Flag on TwiML not working. HOT 1
- Getting this error a lot on latest code - tested -June 8 HOT 2
- Could you please provide the config for vercel deployment HOT 2
- application error has occurred
- Media Stream `start` event is not coming for deployed server[ Tried both [fly.io/ec2]
- Improve AI Voice Agent Response Time by Utilizing WebSocket for Streaming Audio HOT 2
- VPS instead of using ngrok
- services functions in call gpt
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from call-gpt.