Toolset for making musical applications with Unity, Max and Ableton.

• Create examples for interacting with music and spatial environments.
• Explore patterns and initiate discussion for creating new kinds of musical interactions.
• Provide environments and tools for others to become interested in music creation.

OSC Address Router, Stepper, Slider, Dial, Position, Waves, Pads, Keys + more.

CNMAT-odot
Ableton
Max
Unity
SteamVR*
VRTK*

• included in repo.

VR Hardware: VRTK supports most VR headsets but this package has only been tested with the HTC Vive. Oculus and Daydream setup should be straight forward. Please file an issue with any problems encountered.

Optional: Envelop for Live

You should already have Ableton and Max installed. All other dependencies are free and open source.

1. Download o.dot from Github and place it in your Max packages directory. Typically found in Documents/Max 7/Packages. To check, go to Options -> File Preferences in Max.

2. Download and install Unity.

3. Clone or download the zip of this project and open it in Unity.

4. Run the scene. If you have errors, they will be shown in the Unity console.

5. Open Ableton and add the folder TheConductor_Max from this project to your Ableton places in the sidebar.

6. OSC defaults to running on port 9000 in Unity. You can change the ports and outgoing IP address on the [OSC] component in Unity and in each M4L patch.

7. Select the prefab in the Unity scene hierarchy that you would like to use and activate it.

8. Follow the instructions below for setting up each specific component.

Unity Attach: empty GameObject
Unity script for interacting with any OSC event. When a packet is received with the corresponding name, the callback event is called with a List<object> containing the OSC data.

Unity Attach: GameObject
Receive named midi events in Ableton from Unity collisions. The Midi Send Events script sends when the GameObject OnCollisionEnter event is triggered.

Unity Attach: GameObject or empty GameObject
Send named midi events to Unity from Ableton. Attach any public function to the Note on / off events in the inspector.

Unity Attach: VRTK_Controller
VRTK controller positions to XYZ live.dials. Map the controller positions to any value.

Unity Attach: GameObject with Transform
Attach to Unity GameObject and send its transform to XYZ live.dials. Useful for panning Envelop for Live sources.

Unity Attach: GameObject with UI Canvas child
Radial UI controller to live.dial. This component does not take a name but could be easily modified to do so based on other patterns in these tools.

Unity Attach: GameObject
Draw on 2D material to waveform~.

Unity Attach: empty GameObject
New instrument example with a wave picker, controller position and velocity to custom M4L device.

Unity Attach: GameObject(s)
Physics reactive cubes to Ableton drum rack.

Unity Attach: GameObject(s)
Interactive cube height transforms to multislider. Grab or select cubes with laser pointer. Can select multiple. Scale by amount is mutliplied by the height value. Example of scaling values for other object interpretations.

Unity Attach: GameObject with UI Canvas child
UI slider to to live.slider.

Unity Attach: GameObject
Virtual piano model sends midi duration and pitch. Represented by kslider.

Unity Attach: GameObject
Cube represenation of a stepper to live.step. Laser pointer controls on / off and touchpad controls velocity.

Unity Attach: empty GameObject
Envelop for Live is an open source audio production framework for spatial audio composition and performance. This component contains a spatial audio representation of the decoder for the their speaker installations. You can send positional values and audio levels from Max to Unity for 3d representations.

Many thanks to the work of others whose shoulders I stand on to build musical interfaces.

• OSC package by Jorge Garcia
• CNMAT for their research in music technology and providing o.dot.
• The Envelop team for all the inspiration and help.
• Icons for VR3DWave from the Noun project.
• The band Caspian for the project name. A tribute to their first album.