home
UX 리소스
home

As autonomy becomes more complex, it is increasingly important to measure the amount of trust exhibited by a human towards a machine, regardless of the level of trustworthiness of the machine. There are several challenges associated with current methods that rely primarily on self-report subjective ratings: 1) self-reports are dependent on the self- awareness of subjects and may not be reliable, 2) low sampling rates may not result in an adequate level of granularity for analysis for high tempo, highly dynamic scenarios, and 3) in high risk scenarios like air-to-air combat, subjects may be cognitively overloaded and unable to use the think aloud protocol, or their surveys may simply not be feasible or practical. To overcome these challenges, we were inspired by the “freeze on-line” approach of the Situation Awareness Global Assessment Technique (SAGAT) and modified it for use in an off-line video-based approach to avoid the high logistics costs of performing this assessment during flight or while in a flight simulation. Subjects were first recorded during flight. In an extended post-hoc video replay, time was frozen during predetermined events, and subjects were asked to report their thought process at the time. Their comments and other behaviors observed in the video were then recorded and coded by study staff after the debrief. We report on the development of the codebook and the resulting Inter Rater Reliability calculations.
Memo
Trustworthiness Level을 측정할 때 Self-reporting에 의존하는 현재 방법에는 문제점이 있음.
사람이 Machine에 대해 느끼는 Trust의 정도를 측정할 방법이 필요 → 현 방법 제안
Situation Awareness Global Assessment Technique (SAGAT)의 “Freeze on-line” approach에 영향
off-line video-based approach
VR 활용
Pilot Autonomy
Codebook Development
출처 HRI Trust Perception Scale (Schaefer, 2016), factors identified in (Hoff & Bashir, 2015)
Categories
Distance Threshold
Error Type
Forced Reliance
Look at autonomy for reason other than lack of trust
Meet Needs of Mission
Paddle
Predictable
Situational Risk Perception
Surprise
Thinking about Paddling
Transparency
Trust Level
Uncomfortable/Feeling Sick