Object detection and Game Design
Description:
Two different projects pivoting from AR to Object detection Object detection- Using raspberry pi we built an end to end security system which detects threats and alerts. Game Design- We designed an AR zombie game using unity and ARCore.
Inspiration:
AR- the creative aspect it brings to the currently existing gameplay Object Detection- with increasing secuirty threats, we wanted a way to detect threats before they happen and alert people
What it does:
AR- it was suppose to be an online multiplayer zombie survival game in AR Object detection- uses computer vision and deep learning to detect gun threats in an area to alert security
How we built it:
AR- Unity and ARCore using c# through visual studio Object detection - Raspberry pi using python and tensorflow
Challenges we ran into:
Supported devices on ARCore still had a lot of bugs, the biggest one being not detecting planes which we needed to use to anchor objects to the physical world. The stock examples provided by ARcore had missing files which made some assets unable to compile, along with many other errors. Object detection- setting up the environment was extremely time consuming, and due to the size of our files the raspberry pi started to freeze. No proper support for raspberry pi, and the time associated with building and training the model.
Accomplishments that we're proud of:
AR- learned a lot about Unity 3D, ARCore, and ARkit. Object detection- learning about intel computation memory stick as well as detecting objects in real time and sending an email alert.
What we learned:
AR- learned a lot about Unity 3D, ARCore, and ARkit. Object detection- learning about intel computation memory stick and installing tensorflow in raspberry pi
What's next:
AR- wait for further support from ARCore, its currently on version 1.5 so there is much needed support in this area. Object detection - run the model using intel memory stick
Built with:
ARCore, Unity 3D, Visual Studio Raspberry pi, raspberry pi camera, tensorflow, intel memory stick
Prizes we're going for:
Intel® Movidius™ Neural Compute Stick
TBI Pro Gaming Headset
$100 Amazon Gift Cards
Grand Prize
Oculus Go (32 GB)
Misfit Shine 2
Raspberry Pi Arcade Gaming Kit