Comments (10)
That SGTM. I intended to leave a path for that with this comment
Happy to have new issues filed for codec specific FEC features where demanded.
I've filed #244
from webcodecs.
In particular, we need good SVC support and Bernard mentioned that the "dependsOn" currently in https://github.com/pthatcherg/web-codecs/blob/master/webidl.txt isn't sufficient.
from webcodecs.
Are these coding modes a stable part of the codec specifications (i.e. unlikely to change in the future) or something that applications are able to customize using lower level encoders?
from webcodecs.
I believe they are stable (OPUS and VP9 certainly are), but it sounds like AV1 is very flexible so we need to figure out what modes people would want to use and which we can support.
from webcodecs.
At this point, the AV1 bitstream specification (including the list of scalability modes in Section 6.7.5) should be considered stable. The AV1 RTP payload specification is still work-in-progress.
K-SVC modes (which are a hybrid of SVC and simulcast) may not be expressable via "depends on" semantics. The L4T5_KEY_SHIFT mode is shown below:
from webcodecs.
The problem of SVC configuration has been addressed via the scalabilityMode
concept defined in WebRTC-SVC and metadata has been added to identify the layer a frame corresponds to. Together, these additions allow the application to change the scalabilityMode
, or to stop or re-start sending a layer. At this point, the only major feature not addressed is to allow target bitrates to be configured for each layer, as suggested by @Orphis in w3c/webrtc-svc#14 .
from webcodecs.
#187 addresses SVC. Simulcast currently is handled by creating separate encoders. In principle things like Opus FEC can be handled via codec configuration. So we seem to have addressed most of this, with the exception of things like FEC or RED (which can be handled in WASM)?
from webcodecs.
POR:
- SVC will be configurable (see #40)
- FEC will either be done by the app, or where codec-specific options exist, we will create code-specific config knobs
- Simulcast: out of scope, just spin up multiple encoders (or better yet, use SVC)
from webcodecs.
I don't think there's anything actionable remaining in this issue. SVC is tracked in #40. Simulcast in #44. And we've determined FEC is out of scope. Happy to have new issues filed for codec specific FEC features where demanded. Closing for now. Please reopen if I've overlooked anything.
from webcodecs.
Shouldn't we allow to configure opus in-band fec?
https://www.opus-codec.org/docs/html_api/group__encoderctls.html#ga5b67dc832aa46c1c2f35752c46380545
from webcodecs.
Related Issues (20)
- numberOfChannels/sampleRate check in AudioDecoderConfig/AudioEncoderConfig HOT 1
- Under what conditions should the ImageDecoder [[completed promise]] and ImageTrackList [[ready promise]] be rejected? HOT 3
- Spec differentiates between ImageDecoder initialization with unsupported non-image MIME type and an unsupported image MIME type HOT 2
- how to config videoEncoder that output frame is annexB not avcC? HOT 1
- `ImageDecoder` is `[SecureContext]` but related interfaces aren't HOT 2
- `ImageBufferSource` should be `[AllowShared]` HOT 1
- Announcement: Background Segmentation metadata entry to WebCodecs VideoFrame Metadata Registry HOT 2
- Why is the audio encoder output timestamp different from the input timestamp
- Video encoder bitrate control in case frame rate is not provided
- Video frames on demand HOT 1
- Error code: SIGSEGV HOT 3
- VideoFrame.timestamp and EncodedVideoChunk.timestamp HOT 6
- video encoder memory leaks HOT 1
- Include some frame info with `VideoDecoder` Errors? HOT 2
- VideoFrameMetadata is defined in WebCodecs and videoFrameCallback HOT 2
- Wrong chroma values in videoFrame.copyTo() on Intel MacOS HOT 1
- Attempting to configure an encoder with a bitrate of 0 should fail HOT 1
- display size is not set in Convert to RGB frame algorithm
- copyTo from planar to interleave should copy / convert all channels HOT 2
- Do Linear PCM AudioDecoders not work? HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from webcodecs.