Workshop Schedule

The workshop takes place on Friday, May 7th 15:00-19:00 CEST. Participants log in to the workshop using Delegate Connect.

Welcome (15:00 – 15:15)

Opening presentation to outline the workshop motivation and goals.

Paper session 1 Current challenges and barriers of measuring UX in MR (15:15 – 16:20)

• Re-thinking evaluation methods (Chair: Valentin Schwind)
  • Patrick Harms: There Is No One Size Fits All: The Need for Evaluating MR Interaction Techniques (#6)
  • Anthony Steed: What We Measure in Mixed Reality Experiments (#16)
  • Skarbez, Whitton, Smith: Mixed Reality Doesn’t Need Standardized Evaluation Methods (#30)
• MR with special target groups: (Chair: Dmitry Alexandrovky)
  • Desai, Astell: Mixed reality technologies for people with dementia: Participatory evaluation methods (#25)
  • Wang, Healey, Qian, Wigington, Sun, Peng: Let’s Make A Story: Measuring MR Child Engagement (#29)
• Technical challenges of evaluation: (Chair: Denise Kahl)
  • Garcia, Ferris, Wadley: Evaluating the User Experience of Mobile VR (#3)
  • Satkowski, Büschel, Dachselt: Experiences with User Studies in Augmented Reality (#7)
  • Otiono, Qian, Seals, Nov, Shaer: Lessons From a Remote At-Home Evaluation of an Augmented Reality Application (#10)

Coffee break (10 min)

Paper session 2 - Future directions of measuring methods for UX in MR (16:30 – 18:00)

• Quantitative evaluation methods (Chair: Susanne Putze)
  • Toet, Mioch, Gunkel, Niamut, van Erp: Assessment of Presence in Augmented and Mixed Reality (#5)
  • Teresa Hirzle: Assessing Discomfort in Mixed Reality with Subjective Measures (#13)
  • Kocur, Henze, Schwind: The Extent of the Proteus Effect as a Behavioral Measure for Assessing User Experience in Virtual Reality (#21)
  • Kahl, Ruble, Krueger: Evaluating User Experience in Tangible Augmented Reality (#26)
• Mixed evaluation methods methods: (Chair: Elisa D. Mekler)
  • Seals, Olaosebikan, Otiono, Shaer, Nov: Using Internet Studies to Assess the Impact of Self-Focused Mixed Reality on Perception, Affect, and Behavior (#8)
  • Triantafyllidis, Li: Considerations and Challenges of Measuring Operator Performance in Telepresence and Teleoperation Entailing Mixed Reality Technologies (#12)
  • Drey, Rietzler, Rukzio: Questionnaires and Qualitative Feedback Methods to Measure User Experience in Mixed Reality (#23)
  • Piitulainen, Mekler: Towards the Evaluation of Kinesthetic Empathy in Virtual Reality (#31)
• Qualitative evaluation methods: (Chair: Jan Smeddinck)
  • Harth, Hofmann: Mixed Reality Methods for Analysis of Multimodal Human-Agent Interactions (#18)
  • Rodriguez, Puig: Open the microphone, please! Conversational UX Evaluation in Virtual Reality (#22)
  • Whitlock, Szafir: Immersive Design Reviews through Situated Qualitative Feedback (#34)
  • Alexandrovsky, Putze, Schülke, Malaka: Towards Low-burden Responses to Open Questions in VR (#35)

Coffee break (10 min)

Breakout Session (18:10 – 18:50)

In the breakout session, all participants will discuss in small groups of 3-4 people for 20 min. The groups will be assigned in advance according to the paper topics. During the breakout session, the participants should brainstorm and aggregate their discussions in mind maps and charts. After that, the groups will present their outcomes to the workshop and open the discussion.

Closing and wrap up (18:50 – 19:00)

Workshop results, including best practices, and experiences from the field trip will be documented. Remaining open questions will be wrapped up, follow-up activities will be discussed.