Example ER1-Socialbot Interaction

The following dialog exemplifies what you can do:

Bot: I am ready User: good morning, what is your name Action: none yet Bot: my name is Truman User: please move forward 7 inches Action: ER1 move forward 7 inches Bot: I have moved forward 7 inches User: please turn right 45 degrees Action: ER1 turns right 45 degrees Bot: I have turned right 45 degrees User: now please turn back Action: ER1 turns left 45 degrees Bot: I have turned back -45 degrees User: please open your hand Action: ER1 opens its gripper, assuming it was closed before Bot: I have opened my gripper hand Action: YOU hold up flashcard of tree User: please tell me what is this Bot: I see the tree 8.2 centimeters in front of me User: do you detect anything Bot: I detect an obstacle in front of me

Using with the ER1

You can link Socialbot to the ER1 robot by Evolution Robotics. You speak through the microphone. Socialbot processes your input and directs speech output through the ER1. You can make the ER1 turn, move, open and close its gripper arm, respond to obstacles detected by the IR sensors, and so on. Follow these steps to get started:

1. Launch ER1 Control Center and set to remove control (port 9000)
2. Confirm a message in the ER1 Control Center report window saying it is "listening" for remote control
3. Open Socialbot's config.txt file and set "robotics" to "yes" (if not already set.) Save and close.
4. Launch Socialbot. It will interact with the ER1's API and send the message "I am ready" to be spoken through the ER1. this may take a short as your computer loads voice/speech systems.
5. When you hear a bell (or sometimes two when first starting), begin speaking into the microphone. Your words will soon appear in the Socialbot window. Socialbot will generate a response to speak through the ER1.
6. Continue.

Scripting for the ER1

You can script behaviors for the ER1 robot. For example:

This behavior causes the ER1 robot to turn a specified number of degrees upon command. The behavior is read step-by-step. If the user inputs, "rotate 15 degrees" then here is what the behavior does:

1. matches the input with the grammar structure "rotate X degrees"
2. matches X to 15
3. sends a command to the ER1 robot to make the turn. Socialbot waits until the action is done before continuing.
4. optionally, we could add a command so it remembers for future reference that the last time it rotated, it did so by 15 degrees. (Not a necessary step, but adds value.)
5. selects output such as "I have turned 15 degrees"

In the event a behavior can't be executed, Socialbot stops the behavior and moves on to something else. A behavior might specify a routine of behaviors to be executed. Using the "action", anything that the ER1 API can understand is possible.

Legal Notice

The approach described here for the Socialbot scripting language is the exclusive property of Dario Nardi. It is illegal to use this approach for any purpose other than with Socialbot without the express consent of Dario Nardi.