tonarino / acoustic_profiler Goto Github PK

http://sourceware.org/systemtap/wiki/SystemtapDtraceComparison
https://www.bsdcan.org/2017/schedule/attachments/433_dtrace_internals.html#(8)

Stemmed from #12 (comment)

We discussed with @strohel and @PabloMansanet that UDP might be problematic in case we are sending events that can have a longer-lasting sound-effect and/or are important and hence shouldn't be dropped.

follow up of #40 (comment)

Collect examples of how our system could sound like and behave under varying conditions.

Follow-up to #11 (comment)

I got and idea for an empirical test to see how important would proper event timestamping be: extend #12 just a little to produce the click event at a steady and very high rate (e.g. 250 Hz, once every 4 ms), and then run it over long network like Tokyo -> Prague.

This may even turn out to be useful "hear the network jitter" probe on its own (which would depend on absence of timestamping as a twist).

• Event abstraction (Probe abstraction - or maybe a probe is just a binary talking the same IPC/wire protocol)
  • What a probe should report? How much a probe should know about the systhesis, and vise versa?
  • Jen: They should be relatively indepedent of each other. Imagining each event as a tuple (quality, timestamp)
• Network abstraction? (and/or make the sound synthesis a kinda “server”)
  • It might make sense to have this already, because probe may need to be run on a separate machine than where we want to play sound. Probe may need sudo to run, too.
  • Bincode-serialized events (or alike) over UDP?

When creating the ComposerClient it binds to localhost which may resolve to either IPv6 or v4 address. Then, when it tries to send data to the server and the server address is not the same IP version, it fails.

We want to bind the client to whatever address will work with the given server address.

Come up with abstraction for a "sound effect" that can be hooked up to an (aggregated) stream of events. And propose how to implement it (or do it right away 😉)

See #3 for ideas on how the final result should sound like.

Ideas/Resources:

• https://github.com/SamiPerttu/fundsp
• https://github.com/RustAudio/rodio
• MIDI synthesis? (control pitch, length, texture, …)

initialize the rust project and maybe a CI?

Explore implementing a probe using ptrace to hook into some process' syscalls

address #12 (comment)

Explore implementing a probe into the actor framework.

idea: add USDT (dtrace) probes into actor framework and then use dtrace for the actual runtime tracing