Dimension of Zt about neural-audio-fp HOT 7 CLOSED

@kasireddygariDineshKumarReddy z(t) is of dimension d. In config file, EMB_SZ defines d.

from neural-audio-fp.

Do you mean each unit segment(lets say 1second of audio) is of dimension 128 or d

from neural-audio-fp.

Yes d=128.

from neural-audio-fp.

In NFP algorithm ,it was given that
Zk^(org) = g ◦ f (Sk)
Zk^( rep) = g ◦ f (M(Sk ))
and after loop completion
Z= {Z1^(org) , Z1^(rep) , ..., Z N/2^(org), Z N/2^(rep)}
Is Zk^(org) ,Zk^(rep) of 128 dimension or else Z which is combination of all these originals and replicas is of dimension 128?

from neural-audio-fp.

Z^k(*) is kth single element in training batch, and it has a shape (128,).
Z will have a shape (B, 128) where B is training batch size.

from neural-audio-fp.

Is Agumentation performed before feature extraction or after log mel spectrogram feature extraction?

from neural-audio-fp.

Most of the augmentations, such as mixing background noise, applying IR filters, and mixing speech (not covered in the paper) are processed in time-domain. In spectral domain, see more details: https://github.com/mimbres/neural-audio-fp/tree/main/model/fp/specaug_chain

from neural-audio-fp.