Everyday Evaluation
Impression Evaluation & Comparison of Everyday Things
Purpose
Evaluate the affective value of everyday things using the SD method and other approaches
Procedure
- Choose one subject of interest (objects, people, environments, places, etc.). Also consider why you chose that subject.
- Examples: perfume bottle shapes, anime character hairstyles, car exteriors...
- Decide on one or more pieces of affective information (impressions, adjectives, onomatopoeia, etc.) related to the subject.
- Examples: cuteness, sense of luxury, simplicity, strength, gentleness...
- Prepare multiple concrete examples of the subject for measurement and comparison (actual objects, images, videos, etc.).
- Create a Google Forms survey to quantify the affective information.
- Have seminar members take each other's surveys to collect responses.
- Compile the results into graphs.
- Analyze and discuss what you can observe from the graphs.
- Compile the subject, why you chose it, the affective information you focused on, the survey results, and your analysis into a slide presentation.
Schedule
| Step | Timing |
|---|---|
| Step 1-2 | Week 1 (Submission Form (1)) |
| Step 3-4 | Weeks 2-3 (Submission Form (2)) |
| Step 5 | Week 4 (During seminar time) |
| Step 6-8 | Week 5 (Submission Form (3)) |
Evaluating & Comparing Emotions from Everyday Things (SAM)
Purpose
Evaluate and compare emotions from everyday things on two axes --- valence and arousal --- using SAM (Self-Assessment Manikin)
Procedure
- Choose one category of subjects likely to evoke emotions (music, video, images, places, food, etc.).
- From that category, prepare 5 or more specific stimuli likely to evoke different emotions.
- Referring to the SAM survey sample, create a survey where participants rate "Valence" and "Arousal" for each stimulus on a 9-point scale.
- Have seminar members take each other's surveys.
- Calculate the mean valence and arousal values for each stimulus, and create a scatter plot on a 2D emotion space.
- Analyze and discuss what you can observe from the scatter plot.
- Compile into a slide presentation.
What is SAM?
SAM (Self-Assessment Manikin) is a method for evaluating emotions using illustrations (manikins) rather than words. It primarily evaluates emotions on two axes: Valence and Arousal. Its key feature is the ability to intuitively quantify subtle emotional differences that are difficult to express in words.
Evaluating & Comparing the Appeal of Spaces (PRS)
Purpose
Evaluate and compare the perceived restorativeness of everyday spaces and places using PRS (Perceived Restorativeness Scale)
Procedure
- Choose one category of spaces/places you want to evaluate.
- Select 4 or more specific spaces with different atmospheres and prepare photos or videos.
- Referring to the PRS reference paper, create a survey using question items related to the following 4 factors (7-point scale):
- Being Away (sense of escape from the everyday)
- Fascination (captivation)
- Coherence (unity)
- Compatibility (fit)
- Have seminar members take each other's surveys.
- Calculate the mean values for the 4 factors for each space, and visualize them as a radar chart.
- Analyze and discuss what you can observe from the chart.
- Compile into a slide presentation.
What is PRS?
PRS (Perceived Restorativeness Scale) is a scale that evaluates how much psychological recovery (refreshment) an environment or space provides. It is based on ART (Attention Restoration Theory) from environmental psychology.
Evaluating & Comparing Preferences for Everyday Things (Conjoint Analysis)
Purpose
Identify the factors that influence preferences for everyday things using simplified conjoint analysis
Procedure
- Choose one category of items whose preferences you want to analyze.
- List 2-3 attributes that are likely to influence preference, and set 2-3 levels for each attribute.
- Example (smartphone cases): Attribute A "Color" -> Black, White, Pastel pink / Attribute B "Material feel" -> Matte, Glossy, Transparent
- Create about 9 profiles (combinations of attributes and levels).
- Create a survey where participants rate their preference for each profile on a 5-point scale.
- Have seminar members take each other's surveys.
- Calculate the mean preference rating for each level of each attribute, and visualize them as bar graphs or similar.
- Analyze and discuss what you can observe from the graphs.
- Compile into a slide presentation.
What is Conjoint Analysis?
Conjoint analysis is a method for identifying which elements (attributes) among the multiple components of a product or service, and to what degree, influence preference.
UX Evaluation & Comparison of Everyday Products and Services
Purpose
Evaluate and compare the UX of everyday products and services from the perspectives of pragmatic and hedonic quality using UEQ-S
Procedure
- Choose one category of products/services whose UX you want to evaluate.
- Select about 3 specific products/services for comparison.
- Example (note-taking apps): Apple Notes, Notion, Google Keep
- Prepare simple tasks for participants to use each product/service.
- Referring to the UEQ-S survey sample, create a survey including UEQ-S questions for each item being compared.
- After participants complete the tasks, have them respond to the survey.
- Copy and paste the responses into the UEQ-S analysis sheet (make a copy before use) to calculate and visualize pragmatic and hedonic quality scores.
- Analyze and discuss what you can observe from the graphs.
- Compile into a slide presentation.
What is UEQ-S?
UEQ-S (User Experience Questionnaire - Short version) is a scale that simply evaluates the UX of products and services using 8 adjective pairs. It is divided into pragmatic quality (ease of use, efficiency) and hedonic quality (interest, attractiveness).