Tutorial: CAVE Collaborative Console (CCC) with Voice Commands



Other CCC Links: General Description / Homepage / Examples: CE / CVGS-K12


Procedure: Demonstrate collaboration at two different SGI workstations
                    by loading an Inventor file into CCC shared space:


Start Up CCC on first computer



Octane: tensor.sv.vt.edu:

1.  Logon to tensor:      k12cvgs  password
2.  Open up two shell windows:

First shell window:
        1.  Find the ccc directory in the K12CVGS Account and move to it:   e.g. cd ccc3x
        2.  Start up limbo on tensor:   startCCC (Note: lower and upper case)
        3.  The following window should appear:

        4.  Enter the name you want to appear when running the session (or keep your default user name).
        5.  Leave the default collaboration world as limbo (the world you will meet and work in).
        6.  For "Connecting to" select: "no one, I will be the server"
        7.  Running on: select "CAVE".  This will select the parameters for allowing input from voice recognition.

Second shell window:
        1.  Find the ccc directory in your home directory:     cd ccc
        2.  Start up the voice command window:   throw -p grammar

The window should divide into a top ( INFO--- ) and bottom ( LOG---- ) half.


A CAVEsim window shown below should also appear.



 
 
 
 
 


Start Up CCC on second computer



Octane: viz8.sv.vt.edu:

1.  Logon to viz8:      k12cvgs  password
2.  Open up two shell windows:

First shell window:
        1.  Find the ccc directory inthe k12cvgs account on viz8 and move to it: e.g.    cd ccc3x
        2.  Start up limbo on viz8 now:   startCCC (Note: lower and upper case)
        3.  The following window should appear:

        4.  Enter the second person's name you want to appear when running the session (or keep the your default user name).
        5.  Leave the default collaboration world as limbo (the world you will meet and work in).
        6.  For "Connecting to" select: "computer named" and input: "tensor.sv.vt.edu"
        7.  Running on: select "CAVE".  This will select the parameters for allowing input from voice recognition.

Second shell window:
        1.  Find the ccc directory in the k12cvgs home directory and go to it:  e.g.  cd ccc3x
        2.  Start up the voice command window:   throw -p grammar
        The window should divide into a top and bottom half.

             A CAVEsim window should also appear.


Notice that each sees the other participants as "avatars".  To enhance awareness, other than seeing each other as avatars, let's load a: 1) participant list,  2) two-dimensional radar, and  3) three-dimensional radar.



In the second shell window on each computer type (or speak if you have voice recognition enabled)

INFO---------------------------------------------------------------------
computer show participant list please
computer show two-dimensional radar please
computer show three-dimensional radar please

LOG----------------------------------------------------------------------
 



This should generate an image at each computer showing a list, 2-D radar and 3-D radar.




Each participant loads their stick-person into this shared space.



In the second shell window on each computer type (or speak if you have voice recognition enabled)

INFO---------------------------------------------------------------------
computer load  filename please      (Note: an inventor file, filename.iv, must exist in the ccc directory)
 

LOG----------------------------------------------------------------------
 



This should generate an image at each computer showing each of the participants stick-person (*.iv file).



Each participant can independently move each others stick-person in the shared space



You may want to move robots around.  To do this move the pointer ("wand") until the pointer intersects the robot, which is indicated by a small rotating cube at the end of the wand, and then select the object by holding down the left mouse button.  You will notice that the object attaches itself to your wand so that when you move through space the selected object moves with you.  Moving objects within this shared space using the CAVEsim keyboard commands requires some practice.  Information on how to use the CAVEsimulator can be found in the CAVE User's Guide Version 2.6

 CAVE simulator controls are copied below FYI:



7.2 Simulated tracking

Simulated tracking is selected by the configuration option "TrackerType simulator".
The controls for moving the simulated head and wand are given below.

7.2.1 Head Controls

The simulated user's head can be moved and rotated within the CAVE using the arrow keys.
Note that the head is restricted to remain within the confines of physical CAVE. The
commands to control the head are:

     LEFT_ARROW ............ Move left
     RIGHT_ARROW ........... Move right
     UP_ARROW .............. Move forward
     DOWN_ARROW ............ Move backward
     SHIFT + UP_ARROW ...... Move up
     SHIFT + DOWN_ARROW .... Move down
     ALT + LEFT_ARROW ...... Rotate left
     ALT + RIGHT_ARROW ..... Rotate right
     ALT + UP_ARROW ........ Rotate up
     ALT + DOWN_ARROW ...... Rotate down
     P .......... Reset head and wand to initial positions

7.2.2 Wand Controls

The wand is controlled using the mouse. Moving the mouse while holding down the
appropriate key will move or rotate the wand. As with the head, the wand is restricted
to stay inside the CAVE. When the user's head is moved, the wand is moved with it. If
more than one wand is being simulated (using the SimulatorNumWands configuration
option), only one wand at a time may be controlled; the wand to control is selected
using the F keys (i.e. F1, F2, etc.).

The wand movement controls are as follows:

     CTRL + mouse movement ....... Move wand left/right/forward/back
     SHIFT + mouse movement ...... Move wand left/right/up/down
     ALT + mouse movement ........ Rotate wand left/right/up/down
     < and > .......... Roll wand (rotate about Z)
     HOME ....... Reset wand to be in front of user
     F1/F2/F3/... ................ Select wand 1/2/3/... as the current wand being controlled.

7.3 Simulated wand controls

The simulated wand controls (buttons & joystick) are selected by the configuration option
"Wand simulator".

Pressing the mouse buttons corresponds to pressing the wand buttons. Holding down the
spacebar while moving the mouse controls the joystick values. Note that the joystick
controls set the X and Y values based on the current position of the mouse on the screen,
rather than the mouse's relative movement (i.e. the top of the screen is Y=1.0, etc.). The
joystick is reset to (0,0) when the spacebar is released.

7.4 Simulated display

The simulated display is selected by using the "simulator" wall (or "simulator1" or
"simulator2") in the Walls configuration option.

There are three display modes for the simulator wall. In mode 0, it displays what would
be rendered on one of the CAVE walls; in mode 1, it displays a normal perspective view
of the application's environment from the position of the user's head; and in mode 2, it
displays a third-person view showing the user inside the CAVE.  The simulator views
can also show the position of the user's head and of the wand, the current frame rate, and
the outline of the physical CAVE, and can black-out the parts of the scene which would
not be visible due the lack of right, back, and ceiling walls.

The keyboard controls for these options are:

     0 ...... Switch to "wall-view" mode
     1 ...... Switch to user centered Perspective mode
     2 ...... Switch to Outside the CAVE mode
     D .......... Switch to "Desk mode" (for outline & blackout)
     C .......... Switch to "CAVE mode" (for outline & blackout)
     T .......... Toggle timing (frame rate) display
     W .......... Toggle display of wand
     U .......... Toggle display of user (head)
     INSERT ..... Toggle display of CAVE/Immersadesk outline
     DEL ........ Toggle blackout of right, rear, and ceiling walls
     H .......... Print help text

When in wall-view mode (mode 0), the following keys select which wall's display is
rendered:

     F ........ front wall
     L ........ left wall
     B ........ floor ("bottom")
     R ........ right wall
     D ........ Immersadesk (screen7)

When using the outside-the-CAVE view, you can move the viewpoint around with
the following controls:

     KEYPAD ARROWS (2,4,6,8) .... Rotate the viewpoint
     KEYPAD -/+ ................. Zoom in/out
     KEYPAD 5 ................... Reset the viewpoint
 


 
LIST OF VOICE COMMANDS
To: Issue  one of the following commands:
load or remove a model
  • computer load (model filename) please
  • computer unload (model name) please
jump to a position
or next to a participant

(For example, John)

  • computer move to John please, or
    computer translate to John please, or
    computer jump to John please, or
    computer teleport to John please, or
    computer port to John please
  • computer move/translate/jump/teleport/port to 1.0 1.0 1.0 please
show or hide 2D radar
  • computer show two-dimensional radar please
  • computer hide two-dimensional please
show or hide 3D radar
  • computer show three-dimensional radar please
  • computer hide three-dimensional please
show or hide Participant List
  • computer show all please
  • computer hide all please
show or hide 2D, 3D radar and
Participant List
  • computer show participant list please
  • computer hide participant list please
See through other user's eyes
(For example, John's eyes)
  • computer share John's view please
  • computer ownview please
attach or detach yourself
from another user
(For example, John)
  • computer tether to john please, or
    computer attach to john please
  • computer join to john please, or
    computer detach from john please
record, save, load or play a path
  • computer play file please
  • computer record file please
  • computer stop please
  • computer pause please
  • computer continue please
Enable or disable an avatar from moving through objects
  • computer enable collision please
  • computer disable collision please
Enable or disable gravity (avatar falls to the floor when in the air and stops moving)
  • computer enable gravity please
  • computer disable gravity please
Exit and close CCC
  • computer exit please


Ronald D.Kriz and Sanjiv Parikh
Virginia Tech
VT-CAVE
Created 10/8/99, Revised 01/23/99

<- BACK TO HOMEPAGE

http://www.sv.vt.edu/future/cave/software/ccc/tutorial/voice_tutorial.html