Rhythm as the intermediary of audio-visual fusions
The talk will present the outcome of the PhD Quasi-different. Rhythm as the intermediary of audio-visual fusions by Daniel von Rüdiger.
When the representational phenomena audio and video meet, they amalgamate into an audio-visual whole which is more than the sum of its parts. This can be expressed with the model-formula A + V = AV + x. The inquiry approaches the unknown x by tracing the congruencies of audio (A) and video (V) responsible for the development of audio-visual Gestalts (AV).
x can then be understood as the distance between audio and video. How big the gap is, can be described through reference-parameters between audio and video.
An appeal to multiple sensory modalities calls for an intermedia point of reference, which is found in the formal and analytical tool rhythm. Rhythm is perceived by multiple senses and its structures can result in temporal as well as spatial congruencies between auditive and visual objects. Therefore, rhythm is an intermediary of audio-visual fusions and used as a method to tackle questions on congruencies of audio and video.
As artistic research, the dissertation places itself at the intersection of theoretical findings and corporeal experience. Thus the text is intended to be received alongside the epistemic artefacts indicated by in-text video references.
Audio and video are understood as rhythmic instruments whose relationship to each other reveals itself in their being played together. Documenting, composing and performing serve as artistic practices for the cooperative and process-oriented production of audiovisual live performances as well as installative and cinematographic filmic works. In the video, the praxis focuses on physical movements of the body motivated by dance and work; in the case of audio, on musical compositions derived from loop-based structures. The implementation of self-generated documentary recordings from Papua New Guinea throughout thematicizes rhythm; not only on a structural but also on a semantic level.
As a finding three main reference-parameters (Character, Structure, Semantics), as well as numerous sub reference-parameters are suggested. The congruency of these reference-parameters is helping to judge an audio-visual fusion as dissonant or consonant.