Table 3 Comparison of current VR frameworks since 2015.

From: Experiments as Code and its application to VR studies in human-building interaction

Framework

Platform

Experiments as Code

  

Doc.

Infrastructure

Data Collection

Data Assembly

Data Analysis

Managem.

Access

Protocol\(^{\dagger }\)

Multi-user Server

Immersive VR

Provisioning\(^{\dagger }\)

Deployment\(^{\dagger }\)

Prefab. tasks

Task config. files

Game engine code

Questionnaires

Remote Storage

Database

Analysis

Replay

Participants

Monitoring

github/bitbucket

Unity package

AGENT68

Any

      

\(\checkmark\)

\(\checkmark\)

         

bmlTUX75

Unity

      

\(\checkmark\)

\(\checkmark\)

      

\(\checkmark\)

\(\checkmark\)

 

EVE62

Unity

  

*

  

\(\checkmark\)

*

\(\checkmark\)

\(\checkmark\)

 

\(\checkmark\)

\(\checkmark\)

\(\checkmark\)

  

\(\checkmark\)

 

DeFINE77

Unity

  

\(\checkmark\)

   

\(\checkmark\)

\(\checkmark\)

\(\checkmark\)

\(\checkmark\)

\(\checkmark\)

    

\(\checkmark\)

 

Landmarks72

Unity

  

\(\checkmark\)

  

\(\checkmark\)

\(\checkmark\)

\(\checkmark\)

\(\checkmark\)

  

*

   

\(\checkmark\)

\(\checkmark\)

NVR-DeSciL63

Unity

 

\(\checkmark\)

     

\(\checkmark\)

 

\(\checkmark\)

   

\(\checkmark\)

\(\checkmark\)

  

OpenMaze80

Unity

  

*

   

\(\checkmark\)

        

\(\checkmark\)

 

Toggle Toolkit71

Unity

  

*

  

*

         

\(\checkmark\)

 

VO73

Unity

  

\(\checkmark\)

    

\(\checkmark\)

 

\(\checkmark\)

\(\checkmark\)

 

\(\checkmark\)

    

VRate81

Unity

  

\(\checkmark\)

   

\(\checkmark\)

 

\(\checkmark\)

        

VREVAL79

Unreal

  

\(\checkmark\)

  

\(\checkmark\)

  

\(\checkmark\)

  

\(\checkmark\)

    

-

VREX70

Unity

  

\(\checkmark\)

  

*

*

*

         

VR-Rides78

Unity

  

\(\checkmark\)

    

\(\checkmark\)

  

\(\checkmark\)

*

   

\(\checkmark\)

 

USE76

Unity

      

\(\checkmark\)

        

\(\checkmark\)

 

UXF69

Unity

  

\(\checkmark\)

   

\(\checkmark\)

\(\checkmark\)

 

\(\checkmark\)

\(\checkmark\)

    

\(\checkmark\)

\(\checkmark\)

  1. The features are grouped by correspondence to the six pillars taxonomy of the ExaC paradigm. Features are evaluated on the description of the frameworks in their accompanying paper. We also report the availability of the frameworks. The development of ExaCT aims to address gaps found in current VR frameworks to better align them with the specific requirements of each of the six experimental pillars identified.
  2. \(\checkmark\): Feature, *: Partial Feature, -: Not possible, \(^{\dagger }\): Never implemented.