dreamo-italy / dreamo-engine-processingide Goto Github PK

Processing-side engine of the video generator

Processing 100.00%

visual art processing processing-visuals biometrics animations audio audio-analysis audio-visualizer

dreamo-engine-processingide's Introduction

Dreamo

Dreamo is a real-time, biosensor and music driven video generator. We designed it to be deeply customizable, but still approachable using the default configuration.

Visit dreamo-italy.io to learn more.

Repository for "Dreamo" project | Polytechnic of Turin |.

Current team Francesco Cretti, Giovanni Bologni, Nicola Ruffino, Andrea Gambedotti, Lorenzo de Luca.

Installing

Prerequisites

[Processing 3 or higher] (https://processing.org/download/)
"Minim" library installed on Processing ( Processing -> Sketch -> Import Library... -> Add Library... -> Search for "Minim" )
"ControlP5" library installed on Processing (same way as Minim)
"Grafica" library installed on Processing (same way as Minim)
Java 8 or higher

Windows

Download the latest unstable Dreamo release, with "Clone or Download"->"Download ZIP"

Documentation

If you want to know more about using Dreamo or developing code for Dreamo, keep reading this readme.

Video plotting

Here follows a generic description of the classes of the program:

Particle is the core visual-object class, from which a great number of different classes can be inherited (particles, stars, bubbles, squares...).
Scene includes an array of particles and manages their update and drawing on screen.
Stage includes an array of scenes and manages the passage from one scene to another.

Audio Managing

DSP is a static class containing digital signal processing methods
AudioManager manages the input stream properties
AudioProcessor manages the samples buffer and does common calculations (FFT, xcorr,...)
FeaturesExtractor is a superclass with utilities methods for features extractors
actual features extractor are inherited from FeaturesExtractor and contain the actual computational methods (ex: Dynamic, Timbre...)
Audio Decisor calculates the "status" of audio and extract parameters useful for graphic generation

By participating, you are expected to uphold this code. To learn more, you can write to [email protected]

dreamo-engine-processingide's People

Contributors

Stargazers

Watchers

dreamo-engine-processingide's Issues

Make color change easier in Lissajous2

In Scene Lissajous2, colors almost never change. Parameters should be tuned to make color palette change more frequent.

Linking strokeWeight() to an audio feature in Lissajous2

Linking strokeWeight() to an audio feature in Lissajous2.

Lower flickering in Scene Example

The polygons in Scene Example flicker too much, especially when the volume is low. Tune parameters to reduce the unwanted effect.

Add a "NAME" attribute to the class Scene

Add a "NAME" attribute to the class Scene which is printed on the console after any scene change. It would help a lot during a live performance.

Array out of bounds nel calcolo della roughness

C'è un errore nel metodo calcRoughness() in class_timbre.pde, riga 500.

Temporaneamente fixato da @Screeen nel commit 50f6a2 aggiungendo il controllo peak < 100 qui:

    if (largerThanPrevious && largerThanNext && largerThanNoiseFloor && peak < 100 ) 
    {
     peak++;
     peakValue[ peak - 1 ] = FFTcoeffs[i];
     freqValue[ peak - 1 ] = centerFreqHz(i);
    }

ma andrebbe verificato qual'è il vero problema e influisce sul calcolo della roughness.

@AndryFish hai scritto tu la funzione.

Any ideas?

Features timbriche con volume al minimo

Le features timbriche (centroide spettrale, complessità spettrale, COBE, EBF) hanno valori anomali.

Questo è probabilmente dovuto al fatto che i campioni in quel caso hanno valore molto piccolo (ordine di 10^-6) e non sono mai a 0.

Idee:

implementare un controllo del volume (c'è già) che sotto una certa soglia non calcola più l'FFT o la forza a zero.

Che ne pensi @Screeen ?

Posizionarei grafici sempre ai bordi

Ora i grafici di log delle features sono posizionati fissi, calcolando la posizione su uno schermo di 1280x750.

Quando uso l'app in full screen o imposto una dimensione diversa i grafici sulla destra stanno in mezzo al monitor, e danno fastidio.
Bisognerebbe parametrizzare il posizionamento in modo da rendere l'app responisve per qualsiasi monitor.

Sketch crashes when exiting Full Screen (Mac OSX)

When running Dreamo on Mac in full screen mode application crashes when exiting (ESC button).

Error message:

java.lang.IllegalStateException: Not on FX application thread; currentThread = JavaFX Application Thread at com.sun.javafx.tk.Toolkit.checkFxUserThread(Toolkit.java:236) at com.sun.javafx.tk.quantum.QuantumToolkit.checkFxUserThread(QuantumToolkit.java:423) at javafx.stage.Window.setShowing(Window.java:921) at javafx.stage.Window.hide(Window.java:947) at com.sun.javafx.stage.WindowPeerListener.closed(WindowPeerListener.java:100) at com.sun.javafx.tk.quantum.GlassWindowEventHandler.run(GlassWindowEventHandler.java:119) at com.sun.javafx.tk.quantum.GlassWindowEventHandler.run(GlassWindowEventHandler.java:40) at java.security.AccessController.doPrivileged(Native Method) at com.sun.javafx.tk.quantum.GlassWindowEventHandler.lambda$handleWindowEvent$423(GlassWindowEventHandler.java:151) at com.sun.javafx.tk.quantum.QuantumToolkit.runWithoutRenderLock(QuantumToolkit.java:389) at com.sun.javafx.tk.quantum.GlassWindowEventHandler.handleWindowEvent(GlassWindowEventHandler.java:149) at com.sun.glass.ui.Window.handleWindowEvent(Window.java:1266) at com.sun.glass.ui.Window.notifyDestroy(Window.java:1183)

Probably an error with FX2D rendering engine

Add command "Go to previous scene"

It's only possible to switch to the next scene, not to the previous one. We should add such feature and link it to a keyboard shortcut.

Hide/show GUI controls

Aggiungere la possibilità di nasconder o mostrare i controlli della GUI (controllo delle soglie e del gain).

Due opzioni:

vincolarli ai grafici delle features;
usare un comando indipendente;

Fade in/out attivo di default al cambio di scena

Implementare di default (se non è troppo dispendioso computazionalmente) il cross fade fra le particelle al cambio di scena.

Vedi scena ScenePlotter e Spirals