Software
Our system uses a layered signal modulation algorithm to detect resonance and synchronization moments. Modulators compare incoming signals to a median threshold, registering a signal as "1" if exceeded. Values update every 10 ms, transmitting state changes via OSC protocol. Synchronization amplifies signals, while dissonance weakens them. Detected events control machine pulse generation, ambient, and visualization. The system learns from past events, developing “intuition” to anticipate new ones.
Use of AI
A “machine time intuition” algorithm predicts event occurrences by analyzing past data. Our perceptron, with human and myxomycete modulators as neurons, processes signals based on biological rhythms, forming nonlinear, subjective time instead of fixed machine time. This approach explores subjective AI, where machines gain an adaptive perception of time.
Hardware
The ESP32-based modulators process signals from humans and myxomycetes. Human modulators are 3D-printed biodegradable hearts with pulse sensors. Myxomycete modulators consist of glass chambers with petri dishes, recording electrical activity through electrodes. Myxomycetes pulse every 45–120 sec, altering their membrane potential via Ca²⁺ consumption. All pulses transmit via Wi-Fi, triggering LED visualization. The machine pulse, synthesized from this data, manifests as ambient sound, projection, and fabric vibrations inside the heart-machine.