[feature request] Parallelized decoding example + option for encoder to add regular restart points about opus HOT 3 OPEN

If you are operating in CELT-only mode, there is also a slightly hidden encoder control: CELT_SET_PREDICTION (check celt.h). If you set this to 0, frames should be encoded independently.

from opus.

It's somewhat so. You're correct that parallel decoding requires restart points, and Opus doesn't have independently-coded blocks the way FLAC does. Each encoded packet depends on state from previous packets, except where an encoder explicitly inserts such a restart point.

However, the state dependence it designed to decay across of a few packets so it's possible for decoders to join in-progress streams, for example in conferencing applications. The file format spec recommends discarding 80ms of decoded audio after a seek to allow for decoder convergence.

So if your streams are long enough that inserting 80ms overlaps between parallel decode segments won't hurt performance, you should be able to split the stream and re-combine the decoded segments. The result won't be bit-identical, but it will be perceptually indistinguishable, which is all a lossy codec provides in any case.

from opus.

Got it. Just in case, I'll upgrade this issue to be a feature request for a few ideas:

• to add example programs of parallelized decoding with 2 modes: (1) without scanning for restart points, (2) with scanning for restart points

  • maybe also an example of parallelized encoding (even if not production-quality) experimented by @enzo1982 in https://github.com/enzo1982/superfast https://github.com/enzo1982/freac - introduces some overlap frames at the block boundaries (some discussion at enzo1982/freac#505)

• to add an option to libopus encoder supporting emitting restart points (I guess TBD if they should be emitted every N number of frames or if it should also take into account adaptive frame durations and be depending on actual audio time. Could the encoding mode changes be abused to have sth like restart points? The decoding mode itself wouldn't change, but the codec state would be reset (e.g. CELT->CELT "fake" switch). Maybe the already supported PLC machinery can be helpful for this? In a way regular restart points is related to missing context recovery

(in case I hack something around, I'll post it here but probably not very soon)

from opus.