We have an Oculus Rift (VR headset)connected to a robot that has a camera mounted on it. As you move your head, the robot will mimic your movement, allowing you to view the world around the robot as if you were actually there.


There are people in the world who are unable to go out and see the world. Perceive allows these people to see sights they normally would never be able to experience. This idea is using the progress made in VR and bringing it into the real world.

What it does:

Allows people to see through a robot's eyes in a VR headset.

How we built it:

We used a Raspberry Pi's camera to stream a video, connected the servos of the robot through an arduino, and had the Raspberry Pi talk through a client/side relation with a PC, where the Oculus Rift is connected. The Oculus rift sends rotation data to the Raspberry Pi, and the streamed data goes to the Oculus Rift.

Challenges we ran into:

Getting the Oculus Rift working on a computer was difficult, as many of our PCs could not run the software. Streaming the video directly into the Oculus rift was also difficult, as it is a 2d video needing to be placed in a 3d environment. Getting all of the pieces of hardware we needed to work together was verrry difficult.

Accomplishments that we're proud of:

Getting the Oculus to stream video and getting the rotational data from the Oculus into the Raspberry Pi. We are all very proud of the assistance we brought our team mates in learning, as well as to other teams that needed assistance.

What we learned:

All of us coming into this project had different specialties, and varying levels of skill. Through each other, we taught and learned how to code in python, to perform sever/client relations, splitting into 2 teams to work on separate tasks while still communicating, and we all learned more about the Oculus Rift and Raspberry Pis.

What's next:

We want to add a second camera to the bot, and stream each camera's video to a separate eye, allowing for a 3D effect. We also want to remove the input lag from the streamed video, and allow for a wireless connectiong.

Built with:

Python, Raspberry Pi, Arduino, Oculus Rift, sweat and tears.

Prizes we're going for:

$100 Amazon Gift Cards

Grand Prize

Oculus Go (32 GB)

Hexacopter Drone

Misfit Shine 2

Raspberry Pi Arcade Gaming Kit

Team Members

Travis Bender, Colin Strassburg, Alek Calcango, Catlin Pichette, John Domenichelli
View on Github