Skip to content

Everyday Evaluation

Impression Evaluation & Comparison of Everyday Things

Purpose

Evaluate the affective value of everyday things using the SD method and other approaches

Procedure

  1. Choose one subject of interest (objects, people, environments, places, etc.). Also consider why you chose that subject.
    • Examples: perfume bottle shapes, anime character hairstyles, car exteriors...
  2. Decide on one or more pieces of affective information (impressions, adjectives, onomatopoeia, etc.) related to the subject.
    • Examples: cuteness, sense of luxury, simplicity, strength, gentleness...
  3. Prepare multiple concrete examples of the subject for measurement and comparison (actual objects, images, videos, etc.).
  4. Create a Google Forms survey to quantify the affective information.
  5. Have seminar members take each other's surveys to collect responses.
  6. Compile the results into graphs.
  7. Analyze and discuss what you can observe from the graphs.
  8. Compile the subject, why you chose it, the affective information you focused on, the survey results, and your analysis into a slide presentation.

Schedule

StepTiming
Step 1-2Week 1 (Submission Form (1))
Step 3-4Weeks 2-3 (Submission Form (2))
Step 5Week 4 (During seminar time)
Step 6-8Week 5 (Submission Form (3))

Evaluating & Comparing Emotions from Everyday Things (SAM)

Purpose

Evaluate and compare emotions from everyday things on two axes --- valence and arousal --- using SAM (Self-Assessment Manikin)

Procedure

  1. Choose one category of subjects likely to evoke emotions (music, video, images, places, food, etc.).
  2. From that category, prepare 5 or more specific stimuli likely to evoke different emotions.
  3. Referring to the SAM survey sample, create a survey where participants rate "Valence" and "Arousal" for each stimulus on a 9-point scale.
  4. Have seminar members take each other's surveys.
  5. Calculate the mean valence and arousal values for each stimulus, and create a scatter plot on a 2D emotion space.
  6. Analyze and discuss what you can observe from the scatter plot.
  7. Compile into a slide presentation.

What is SAM?

SAM (Self-Assessment Manikin) is a method for evaluating emotions using illustrations (manikins) rather than words. It primarily evaluates emotions on two axes: Valence and Arousal. Its key feature is the ability to intuitively quantify subtle emotional differences that are difficult to express in words.


Evaluating & Comparing the Appeal of Spaces (PRS)

Purpose

Evaluate and compare the perceived restorativeness of everyday spaces and places using PRS (Perceived Restorativeness Scale)

Procedure

  1. Choose one category of spaces/places you want to evaluate.
  2. Select 4 or more specific spaces with different atmospheres and prepare photos or videos.
  3. Referring to the PRS reference paper, create a survey using question items related to the following 4 factors (7-point scale):
    • Being Away (sense of escape from the everyday)
    • Fascination (captivation)
    • Coherence (unity)
    • Compatibility (fit)
  4. Have seminar members take each other's surveys.
  5. Calculate the mean values for the 4 factors for each space, and visualize them as a radar chart.
  6. Analyze and discuss what you can observe from the chart.
  7. Compile into a slide presentation.

What is PRS?

PRS (Perceived Restorativeness Scale) is a scale that evaluates how much psychological recovery (refreshment) an environment or space provides. It is based on ART (Attention Restoration Theory) from environmental psychology.


Evaluating & Comparing Preferences for Everyday Things (Conjoint Analysis)

Purpose

Identify the factors that influence preferences for everyday things using simplified conjoint analysis

Procedure

  1. Choose one category of items whose preferences you want to analyze.
  2. List 2-3 attributes that are likely to influence preference, and set 2-3 levels for each attribute.
    • Example (smartphone cases): Attribute A "Color" -> Black, White, Pastel pink / Attribute B "Material feel" -> Matte, Glossy, Transparent
  3. Create about 9 profiles (combinations of attributes and levels).
  4. Create a survey where participants rate their preference for each profile on a 5-point scale.
  5. Have seminar members take each other's surveys.
  6. Calculate the mean preference rating for each level of each attribute, and visualize them as bar graphs or similar.
  7. Analyze and discuss what you can observe from the graphs.
  8. Compile into a slide presentation.

What is Conjoint Analysis?

Conjoint analysis is a method for identifying which elements (attributes) among the multiple components of a product or service, and to what degree, influence preference.


UX Evaluation & Comparison of Everyday Products and Services

Purpose

Evaluate and compare the UX of everyday products and services from the perspectives of pragmatic and hedonic quality using UEQ-S

Procedure

  1. Choose one category of products/services whose UX you want to evaluate.
  2. Select about 3 specific products/services for comparison.
    • Example (note-taking apps): Apple Notes, Notion, Google Keep
  3. Prepare simple tasks for participants to use each product/service.
  4. Referring to the UEQ-S survey sample, create a survey including UEQ-S questions for each item being compared.
  5. After participants complete the tasks, have them respond to the survey.
  6. Copy and paste the responses into the UEQ-S analysis sheet (make a copy before use) to calculate and visualize pragmatic and hedonic quality scores.
  7. Analyze and discuss what you can observe from the graphs.
  8. Compile into a slide presentation.

What is UEQ-S?

UEQ-S (User Experience Questionnaire - Short version) is a scale that simply evaluates the UX of products and services using 8 adjective pairs. It is divided into pragmatic quality (ease of use, efficiency) and hedonic quality (interest, attractiveness).