Research Article

Design of Evaluation Areas Based on Type of Mobile-Based Virtual Reality Training Content

Table 1

Concepts of evaluation items for VR training contents by evaluation area.

ItemConcept

Learning area: items relevant to the learning and/or learner of VR training
ActivenessRefers to the degree to which the learner is able to take actions by oneself within the realized VR [27].
Learning satisfactionThe most universally used index for measuring learning efficacy. It reflects the extent to which positive educational experiences, such as concentration, relevance, and confidence, were experienced by the learner [11, 12].
FlowFlow is a psychological state wherein one becomes completely absorbed in a task, to the extent that one loses one’s sense of time, space, or even self [28]. The positive sensation wherein a learner is completely immersed in the VR-based learning activity and is thus experiencing it in an optimal manner [18].
InteractivityThe degree to which the learner is permitted to use the system to acquire or access information from the contents [29, 30].
Learning effectsRefers to task applicability (the degree to which the learner applies what they have learned when performing real-life tasks [31]) and mastery (the degree to which VR has contributed to the learner’s proficiency in the training subject).

Media area: items relevant to the media characteristics of VR training
Sensory ImmersionSensory immersion refers to the degree to which the learner experiences the visual/auditory simulation, namely the degree of virtuality as perceived by the learner [9].
UsabilityThe ease with which the learner can use the system [32], reflecting the degree of use satisfaction, efficiency, and efficacy conveyed by the experience of the VR environment [20].
(Media) SatisfactionSatisfaction with the medium is sometimes included as a component of usability. Specifically, it refers to the degree of satisfaction and enjoyment felt upon using a system [33].
ManipulabilityManipulability refers to the learner’s ability to manipulate the VR environment. The perceptual state where the learner feels that one is able to freely move and “manipulate” VR objects [9].
NavigabilityThis refers to the learner’s ability to freely explore and interact with the VR space. Navigability reflects the perceptual state where the learner feels that they are able to freely explore and “navigate” within the VR space [9].
PresencePresence refers to the user’s subjective perception of a sense of “being there” within virtual space [10]. It may also refer to the subjective psychological state wherein the user is unaware of experiencing things within a virtual environment [11].

Content quality area: key items relevant to the management of contents utilized in e-learning
Instructional designWhether by-level learning, selection of learning elements and materials, screen composition and layout, interface, and session implementation were adequately done [26].
Teaching and learning strategiesWhether teaching/learning strategies, elements of self-directed learning, and motivational strategies were adequately selected [26].
Learning contentsWhether the learning contents, organization, level of difficulty, and study load were adequately selected [26]