I - CONTEXT:

1. Multimodal aspects:

Multimodality in the field of digital simulation refers to the implementation, in the production of meaning, of various combined modes of expression. hese include speech, gestures, static or moving images (interactive menus), haptic feedback and sound. Various multimodal methods have been used in the simulator to support the users and enable tem to interact with the virtual environment.

II - SIMULATION CONTENT:

 2. Control room and portals: 

The control room is the common thread running through the application. To add a little originality to the simulation, a set of three teleporters were placed in the room. These three teleporters act as a kind of interactive 3D menu. Once initialised (via a control panel) each teleporter will give access to a particular level and move the user to specific locations in the scene.

Note: This control room draws its inspiration from the "The lab" application developed by Steam for its HTC Vive headset, which offers a similar interactive menu for accessing the various scenes in their demo.

3. Main menu:

The main menu is available when the simulation is running. This menu has an opening animation and gives access to three panels containing a certain amount of information or functions.
1. The first panel lists all the commands and controls available in the simulation. 
2. Le deuxième quat à lui propose deux fonctions essentielles à savoir 
-    Revenir à la salle de contrôle, salle qui permet d’accéder à l’un des 3 niveaux disponibles (détaillé dans la partie 4). 
-    Effectuer un reset de la simulation.
3. The last panel simply gives access to the application's credits 
 

4. User aids:

Several user help interfaces have been placed throughout the scene. Their purpose is to guide the user and indicate the actions to perform or the positions to adopt in order to move forward in the various scenarios.
The user aids also include two holograms at hand level, which can be used to display instructions or commands depending on the situation.

Figure. Button action indicator

Figure. Overview of hand holograms

5. Safety equipment :

As a reminder of good safety practice in a factory and to help raise awareness among operators, 7 items of equipment most commonly encountered in industrial environments were added to the scene. 
As the equipment in question was not included in the model, we had to create most of it from scratch.

Below is the list of equipment added to the stage:

- Safety goggles (mandatory)
- Protective mask
- Gloves
- Safety shoes (mandatory)
- Safety helmet or cap (mandatory)
- Acoustic helmet
- Safety waistcoat 

6. Fire extinguishers and fire types:

Drawing on the expertise of a firefighter, we set up 3D models of the 4 types of extinguisher most commonly found in professional environments. Fires of different types with different origins (gas leaks, electrical malfunctions, flammable products, etc.) were placed throughout the scene. Operators immersed in the scene can thus familiarise themselves with and train in the use of each type of extinguisher to put out the fire for which they are suitable. 
 

III - DIFFERENT LEVELS

A set of three levels have been implemented in the simulation. Each of these levels has a different purpose.

1. Level - Equipment:

As a reminder, the aim of this level is to list the equipment that the operator must have in the workplace. The equipment level unfolds as follows: 
Once teleported into the changing room, the user will see an open locker in which he can view and retrieve the various items of equipment he needs to enter the factory. 
To do this, the user must use each piece of equipment one by one. If the equipment is close enough to the user, it is equipped automatically. Once all 7 items have been equipped, the operator's pass appears and it is then possible to enter the factory with the operator, using the cloakroom exit.

2. Level - Exploration:

This level can be played directly even if the previous level has not been completed (you can return to the control room at any time via the secondary menu to launch a level that has not yet been played). 
The aim of this level is simply to offer free navigation in the scene and allow you to discover the different elements of the factory. The teleporter that gives access to this level takes the user to an initial workstation where the robot (located in the middle of the safety cage) can be controlled using the oculus joysticks. To do this, the user must position himself at the level of the circle on the floor (Figure 31) and then follow the instructions displayed on his hands. 
It's at this level that the raycast teleportation function really comes into its own, if you want to cover great distances. 
Note, however, that you will need to follow the signs on the ground and take care when passing the pallet carrier.
 

3. Level - Risks:

As with the Exploration level, you'll need to respect pedestrian crossings and check that there are no pallet carriers when crossing the various roads through which vehicles pass. 
When the level is launched, a complete risk awareness scenario is accessible.

This scenario begins with a learning module designed to familiarise the user with the different types of fire and the associated fire extinguisher. 
The person immersed in the scene has to choose the extinguisher that corresponds to the class of fire he or she has to extinguish. A set of declared fires must be neutralised in this way in the scene.

Finally, a last module is available, which simply highlights the need not to obstruct or block access to an emergency stop button, always in a safety context.