Affective Information Media Lab

Crossmodal interaction, enactive emergence, kinetic resonance, and the intersection of sound and touch.
Exploring how media can engage our affective senses, through practice-based research.

About Our Research →

About

Target
Objects, people, environments, places, etc.
Affective Info
Impressions, preferences, adjectives, onomatopoeia, etc.
Operation
Measure / Compare / Amplify / Reduce / Adjust
Means
Reproduce / Express through media & content

Our research is organized around four pillars, explored through artistic practice

01

Multimodal / Crossmodal Affectivity

Expanding and transforming experience through sensory interactions. We explore what new affective experiences emerge when different sensory modalities intersect.

02

Enactive Affectivity

Exploration and emergence of sensory delight and reflective curiosity through action. We design spaces where the experiencer's active engagement triggers unexpected affective experiences.

03

Digital Kineticism

Constructing fields where information and physical objects co-constitute through movement. Digital information manifests as physical motion, and physical motion generates information.

04

Hapsonic Art

Exploring the significance of touch in sound art. We investigate how various tactile submodalities — thermal, kinesthetic, and more — transform the acoustic experience.

Practice-based Research

The creative process itself serves as a research method — through iterative cycles of conception, design, implementation, and experiential evaluation, we generate insights that theoretical inquiry alone cannot reach.

Projects

Research projects

Fluid Music Interface with Thermal Feedback

Fluid Music Interface with Thermal Feedback

A fluid-mediated music interface incorporating warm/cold sensory feedback, creating an experience where thermal sensation and sound are coupled.

Pillars: Multimodal/Crossmodal Affectivity, Hapsonic Art

Marine

Marine

A sound installation combining elastic materials and vibrotactile feedback. The work aims to evoke a sense of vitality through soft materials and an immersive underwater-like experience via multisensory integration of vision, audition, and touch.

Pillars: Multimodal/Crossmodal Affectivity, Enactive Affectivity, Hapsonic Art

YouTube →
HeartBeater

HeartBeater

A multimodal heartbeat presentation device that conveys a sense of another person's presence and mental state. Presents heartbeats through multiple sensory channels such as sound, vibration, and light.

Pillars: Multimodal/Crossmodal Affectivity

YouTube →

Seminar Exercises

Becoming Aware of Affective Values Around Us

A group workshop exploring concepts that emerge from combining everyday objects with various impressions (onomatopoeia, adjectives, sensory qualities).

Generating Ideas for Expressing Affective Values

A group workshop brainstorming new expressions by combining everyday objects, places, and value-linked impressions.

Impression Evaluation and Comparison of Everyday Objects

Evaluating the kansei values of everyday objects using methods such as the Semantic Differential (SD) method.

Evaluating Emotions Evoked by Everyday Objects (SAM)

Quantitatively evaluating and comparing emotions evoked by everyday objects using SAM (Self-Assessment Manikin) across three dimensions: valence, arousal, and dominance.

Evaluating the Appeal of Spaces (PRS)

Evaluating and comparing the perceived restorativeness (appeal) of various everyday spaces using PRS (Perceived Restorativeness Scale).

Evaluating Preferences for Everyday Objects (Conjoint Analysis)

Quantitatively evaluating preferences for multiple attributes of everyday objects using conjoint analysis to reveal the magnitude of each attribute's influence on preference.

UX Evaluation of Everyday Products and Services

Evaluating and comparing the user experience of everyday products and services from multiple perspectives using UX evaluation methods.

Faculty

Musashi Nakajima

Musashi Nakajima

Faculty

Multimodal Interaction, Crossmodality, Sound Art, Kinetic Art

Publications

Papers, presentations, and exhibitions

Loading...

News

Announcements and events

Loading...