Books by Alexander R Jensenius
Denne boken gir en helhetlig presentasjon av hvordan vi kan forstå musikkrelaterte bevegelser. Fo... more Denne boken gir en helhetlig presentasjon av hvordan vi kan forstå musikkrelaterte bevegelser. Forfatteren viser hvordan man kan studere slike bevegelser med utgangspunkt i et tverrfaglig teorigrunnlag. Det gis en innføring både i kvalitative og kvantitative metoder som brukes i forskningen innenfor feltet. Eksempler er tatt fra studier av musikere, dansere og folk som beveger seg til musikk. Boken viser hvordan kropp og bevegelse er en naturlig del av musikkopplevelsen, og det argumenteres for et større fokus på musikkrelaterte bevegelser i forskning og undervisning.
Papers by Alexander R Jensenius
Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion, 2018
This exploratory study investigates muscular activity characteristics of a group of audience memb... more This exploratory study investigates muscular activity characteristics of a group of audience members during an experimental music performance. The study was designed to be as ecologically valid as possible, collecting data in a concert venue and making use of low-invasive measurement techniques. Muscle activity (EMG) from the forearms of 8 participants revealed that sitting in a group could be an indication of a level of group engagement, while comparatively greater muscular activity from a participant sitting at close distance to the stage suggests performance-induced bodily responses. The self-reported measures rendered little evidence supporting the links between muscular activity and live music exposure, although a larger sample size and a wider range of music styles need to be included in future studies to provide conclusive results.
In this paper, we present a workshop of physical computing applied to NIME design based on scienc... more In this paper, we present a workshop of physical computing applied to NIME design based on science, technology, engineering, arts, and mathematics (STEAM) education. The workshop is designed for master students with multidisciplinary backgrounds. They are encouraged to work in teams from two university campuses remotely connected through a portal space. The components of the workshop are prototyping, music improvisation and reflective practice. We report the results of this course, which show a positive impact on the students’ confidence in prototyping and intention to continue in STEM fields. We also present the challenges and lessons learned on how to improve the teaching of hybrid technologies and programming skills in an interdisciplinary context across two locations, with the aim of satisfying both beginners and experts. We conclude with a broader discussion on how these new pedagogical perspectives can improve NIME-related courses
Empirical Musicology Review, 2021
Music researchers work with increasingly large and complex data sets. There are few established d... more Music researchers work with increasingly large and complex data sets. There are few established data handling practices in the field and several conceptual, technological, and practical challenges. Furthermore, many music researchers are not equipped for (or interested in) the craft of data storage, curation, and archiving. This paper discusses some of the particular challenges that empirical music researchers face when working towards Open Research practices: handling (1) (multi)media files, (2) privacy, and (3) copyright issues. These are exemplified through MusicLab, an event series focused on fostering openness in music research. It is argued that the "best practice" suggested by the FAIR principles is too demanding in many cases, but "good enough practice" may be within reach for many. A four-layer data handling "recipe" is suggested as concrete advice for achieving "good enough practice" in empirical music research.
Comparing Inertial And Optical Mocap Technologies For Synthesis Control
Proceedings of the SMC Conferences, Jul 6, 2011
ABSTRACT This paper compares the use of two different technologies for controlling sound synthesi... more ABSTRACT This paper compares the use of two different technologies for controlling sound synthesis in real time: the infrared marker-based motion capture system OptiTrack and Xsens MVN, an inertial sensor-based motion capture suit. We present various quantitative ...
Proceedings of the SMC Conferences, Aug 31, 2016
What type of motion capture system is best suited for studying dancing to electronic dance music?... more What type of motion capture system is best suited for studying dancing to electronic dance music? The paper discusses positive and negative sides of using camera-based and sensor-based motion tracking systems for group studies of dancers. This is exemplified through experiments with a Qualisys infrared motion capture system being used alongside a set of small inertial trackers from Axivity and regular video recordings. The conclusion is that it is possible to fine-tune an infrared tracking system to work satisfactory for group studies of complex body motion in a "club-like" environment. For ecological studies in a real club setting, however, inertial tracking is the most scalable and flexible solution.
Proceedings of the SMC Conferences, Jul 6, 2011
Simultaneous handling and synchronisation of data related to music, such as score annotations, MI... more Simultaneous handling and synchronisation of data related to music, such as score annotations, MIDI, video, motion descriptors, sensor data, etc. requires special tools due to the diversity of the data. We present a toolbox for recording and playback of complex music-related data. Using the Sound Description Interchange Format as a storage format and the Open Sound Control protocol as a streaming protocol simplifies exchange of data between composers and researchers.
Proceedings of the SMC Conferences, Jul 11, 2012
With musical applications in mind, this paper reports on the level of noise observed in two comme... more With musical applications in mind, this paper reports on the level of noise observed in two commercial infrared marker-based motion capture systems: one high-end (Qualisys) and one affordable (OptiTrack). We have tested how various features (calibration volume, marker size, sampling frequency, etc.) influence the noise level of markers lying still, and fixed to subjects standing still. The conclusion is that the motion observed in humans standing still is usually considerably higher than the noise level of the systems. Dependent on the system and its calibration, however, the signal-to-noise-ratio may in some cases be problematic.
In this paper we present the Dance Jockey System, a system developed for using a full body inerti... more In this paper we present the Dance Jockey System, a system developed for using a full body inertial motion capture suit (Xsens MVN) in music/dance performances. We present different strategies for extracting relevant postures and actions from the continuous data, and how these postures and actions can be used to control sonic and musical features. The system has been used in several public performances, and we believe it has great potential for further exploration. However, to overcome the current practical and technical challenges when working with the system, it is important to further refine tools and software in order to facilitate making of new performance pieces.
The paper reports on the development of prototypes of glassinstruments. The focus has been on dev... more The paper reports on the development of prototypes of glassinstruments. The focus has been on developing acousticinstruments specifically designed for electronic treatment,and where timbral qualities have had priority over pitch.The paper starts with a brief historical overview of glassinstruments and their artistic use. Then follows an overviewof the glass blowing process. Finally the musical use of theinstruments is discussed.
The paper presents research about implementing a full body inertial motion capture system, the Xs... more The paper presents research about implementing a full body inertial motion capture system, the Xsens MVN suit, for musical interaction. Three different approaches for stream-ing real time and prerecorded motion capture data with Open Sound Control have been implemented. Furthermore, we present technical performance details and our experience with the motion capture system in realistic practice.
The paper presents an analysis of the quality of motion data from an iPod Touch (4th gen.). Accel... more The paper presents an analysis of the quality of motion data from an iPod Touch (4th gen.). Acceleration and orientation data derived from internal sensors of an iPod is compared to data from a high end optical infrared marker-based motion capture system (Qualisys) in terms of latency, jitter, accuracy and precision. We identify some rotational drift in the iPod, and some time lag between the two systems. Still, the iPod motion data is quite reliable, especially for describing relative motion over a short period of time.
In this paper, we present a course of audio programming using web audio technologies addressed to... more In this paper, we present a course of audio programming using web audio technologies addressed to an interdisciplinary group of master students who are mostly novices in programming. This course is held in two connected university campuses through a portal space and the students are expected to work in cross-campus teams. The course promotes both individual and group work and is based on ideas from science, technology, engineering, arts and mathematics (STEAM) education, team-based learning (TBL) and project-based learning. We show the outcomes of this course, discuss the students’ feedback and reflect on the results. We found that it is important to provide individual vs. group work, to use the same code editor for consistent follow-up and to be able to share the screen to solve individual questions. Other aspects inherent to the master (e.g. intensity of the courses, coding in a research-oriented program) and to prior knowledge (e.g. web technologies) should be reconsidered. We co...
Journal of The Audio Engineering Society, 2020
In this article, we discuss the challenges and opportunities provided by teaching programming usi... more In this article, we discuss the challenges and opportunities provided by teaching programming using web audio technologies and adopting a team-based learning (TBL) approach among a mix of co-located and remote students, mostly novices in programming. The course has been designed for cross-campus teaching and teamwork, in alignment with the two-city master’s programme in which it has been delivered. We present the results and findings from: (1) students’ feedback; (2) software complexity metrics; (3) students’ blog posts; and (4) teacher’s reflections. We found that the nature of web audio as a browser-based environment, coupled with the collaborative nature of the course, were suitable for improving the students’ level of confidence about their ability in programming. This approach promoted the creation of group course projects of a certain level of complexity, based on the students’ interests and programming levels. We discuss the challenges of this approach, such as supporting smo...
This paper describes a comparative analysis of tracking quality in two infrared marker-based moti... more This paper describes a comparative analysis of tracking quality in two infrared marker-based motion capture systems: one older but high-end (Qualisys, purchased in 2009) and the other newer and mid-range (OptiTrack, purchased in 2019). We recorded performances by a string quartet with both systems simultaneously, using the same frame rate. Our recording setup included a combination of moving markers (affixed to musicians' bodies) and stationary markers (affixed to music stands). Higher noise levels were observed in Qualisys recordings of stationary markers than in OptiTrack recordings, as well as a greater spatial range, though OptiTrack recordings had a higher rate of outliers ("spikes" in the signal). In moving markers, increased quantity of motion was associated with increased betweensystem error rates. Both systems showed minimal withintrial drift but a reduction in recording accuracy and precision over the duration of the experiment. Overall, our results show that the older/high-end system (Qualisys) produced slightly lower-quality recordings than the newer/midrange system (OptiTrack). We discuss how our findings may inform researchers' interpretations of motion capture data, particularly when capturing the types of motion that are important for performing music.
INTIMAL is a physical-virtual system for relational listening, exploring the role of the body as ... more INTIMAL is a physical-virtual system for relational listening, exploring the role of the body as interface that keeps memory of place in migratory contexts. The system is developed to integrate the body movements of performers (and their voices) with an oral archive. The system has been informed and tested by nine Colombian migrant women in Europe in a telematic performance between the cities of Oslo, Barcelona and London. In the performance a "complex narrative" emerged, for both the improvisers and the audiences. In this paper, we describe the conditions of the narrative environment, and the embodied expressions that emerged. We reflect on how this distributed embodied expression-through technological mediated sound and movement interactions-might further aid processes of collective remembering and catharsis, in a context of conflict and gendered migration.
Exploring Sound-Motion Similarity in Musical Experience
Journal of New Music Research, 2016
People tend to perceive many and also salient similarities between musical sound and body motion ... more People tend to perceive many and also salient similarities between musical sound and body motion in musical experience, as can be seen in countless situations of music performance or listening to music, and as has been documented by a number of studies in the past couple of decades. The so-called motor theory of perception has claimed that these similarity relationships are deeply rooted in human cognitive faculties, and that people perceive and make sense of what they hear by mentally simulating the body motion thought to be involved in the making of sound. In this paper, we survey some basic theories of sound-motion similarity in music, and in particular the motor theory perspective. We also present findings regarding sound-motion similarity in musical performance, in dance, in so-called sound-tracing (the spontaneous body motions people produce in tandem with musical sound), and in sonification, all in view of providing a broad basis for understanding sound-motion similarity in music.
This project started with the observation that we manage to recognize a song by listening to only... more This project started with the observation that we manage to recognize a song by listening to only a second of it. What perceptual and musical features make this possible, and can such features be used in music analysis and music information retrieval? These questions can be broken down to two main problems: a) segregation of sensory input and b) recognition of musical features. The segregation of musical information from a complex soundscape is discussed with reference to theories of auditory scene analysis and music perception. A problem is that there is still no good way to make computers separate sound streams in a way similar to human perception. When it comes to the recognition process, the thesis focuses on what musical features make a song more or less recognizable. It is argued that a song is recognized quicker if there is some salient, or perceptually significant, feature present. Then it is shown how salience points can be analysed with reference to traditional musical parameters such as melody, harmony, rhythm and dynamics. This discussion leads to an acknowledgment of the significance of sound in music perception. Next, different methods of analysing, visualizing and synthesizing sound, or more specifically instrument timbre, is shown. Finally, theories of artificial neural networks are outlined, with an example of training a feedforward network with timbre. The success of this simulation is taken as an indication that connectionist models may resemble human perception. Throughout the thesis, several examples are shown of how the graphical programming environment MAX/MSP can be used experimentally in music analysis. The thesis concludes that investigating short term music excerpts might be interesting in music analysis. Due to the limitations of our short term memory, such short passages may reveal noteworthy aspects of music perception. It is also suggested that music theory could benefit from studying salience points and paying more attention to the sound of music.
The scientific program (keynotes, presentations, posters, demos) will be held at the University l... more The scientific program (keynotes, presentations, posters, demos) will be held at the University library, which is located at the centre of the University of Oslo campus.
Variabilitet som kilde til forståelse av ADHD
Uploads
Books by Alexander R Jensenius
Papers by Alexander R Jensenius