Noise of typing not working well about deepfilternet HOT 12 CLOSED

I was under the impression that DepFilterNet can't be used for real-time inference i.e for streaming usecases (20ms chunk as input). I was surprised to see your comment Now I can do the real-time inference process with buffer size=1. Was I under any misconception ?

from deepfilternet.

Hi,

I think you can look paper of Deepfilternet2, and other streaming method "google-research" in Github.
Now I can do frame-in-frame-out for DeepFilterNet, but if you want to deploy to embedded device, you need to quantize
GRU by yourself (maybe use C/C++)

from deepfilternet.

Thank you so much aaronhsueh, this is news to me ! My usecase is just deploying on a web-app server. Do I need to do any preprocessing such as overlapp and add of the frames before I input to the DeepFilternet or just chunking the full length audio signal to 20ms is sufficient ?

from deepfilternet.

following

from deepfilternet.

@aaronhsueh0506 can you share implementation of your realtime loop? Specifically fix of #76

from deepfilternet.

Hi,

I have tried to use small lr to solve typing noise.
So close this issue.

from deepfilternet.

Hi,

I think you can look paper of Deepfilternet2, and other streaming method "google-research" in Github. Now I can do frame-in-frame-out for DeepFilterNet, but if you want to deploy to embedded device, you need to quantize GRU by yourself (maybe use C/C++)

How did you manage to get rid of border effects in real-time mode? Did you modify convolutional layers?

from deepfilternet.

Hi,
I think you can look paper of Deepfilternet2, and other streaming method "google-research" in Github. Now I can do frame-in-frame-out for DeepFilterNet, but if you want to deploy to embedded device, you need to quantize GRU by yourself (maybe use C/C++)

How did you manage to get rid of border effects in real-time mode? Did you modify convolutional layers?

No, I did not modify CNN, because kernel is 3x3 for first layer and 1x3 for others in Deepfilternet2. Here you can queue a buffer with 3 frames, and you can get one time-stamp output mask and coefficients for DF.

from deepfilternet.

@aaronhsueh0506 thanks for the reply! Can I ask you, what frame size did you use for the streaming implementation, and did you use overlapped frames?

from deepfilternet.

@aaronhsueh0506 thanks for the reply! Can I ask you, what frame size did you use for the streaming implementation, and did you use overlapped frames?

20ms frame size and 50% overlap

from deepfilternet.

Thank you!

from deepfilternet.

No, I did not modify CNN, because kernel is 3x3 for first layer and 1x3 for others in Deepfilternet2. Here you can queue a buffer with 3 frames, and you can get one time-stamp output mask and coefficients for DF.

@aaronhsueh0506 Can you share the implementation? I wasn't able to get this working. Thanks in advance :)

from deepfilternet.