This mobile app is registered with restaurants who will place QR codes on their menus. The app scans the code and displays the dish in augmented reality! It also gives nutritional information.


Many restaurant menus don't display pictures of all/any of their dishes. I like to be able to see what I'm ordering beforehand so I was inspired to create an app that'll use augmented reality to show me the dishes ahead of time and display them on the table so I can see them properly.

What it does:

It uses QR codes that supporting restaurants will have in their menus to download 3D models from a database and display them on your table. It also displays the ingredients in each dish and it shares nutritional information such as calories and grams of protein so that users can maintain a healthy diet.

How we built it:

Using the Swift programming language and Xcode on a Mac. Firebase is used to hold the 3D Models and textures and nutritional data is taken from the USDA database.

Challenges we ran into:

I have never worked with Augmented Reality / 3D Modeling before so I head to learn a completely new style of app development in Swift. I also had to do research on QR codes and how they work as well as learn Apple's Vision API to detect them and read data from them. It took around 5 hours to figure this out.

Accomplishments that we're proud of:

I'm very proud of how I accomplished downloading 3D models from an external database and displaying them without having to store them on the device. I'm also proud of how I was able to learn a bunch of new APIs that I've never used before as well as learn some 3D modeling.

What we learned:

I learned about 3D modeling, which I have a new found respect for, as well as augmented reality. I'm excited to try my hand a bit more at these two new fields. I also learned how to use REST APIs which was completely new to me.

What's next:

What's next is to add an ingredient removal feature. So if you don't want something on your dish you can just uncheck it and it'll be removed from the 3D model.

Built with:

This was built in Swift using Xcode, as well as Firebase and the USDA database.

Prizes we're going for:

HAVIT RGB Mechanical Keyboard

Google Home Mini

$100 Amazon Gift Cards

Grand Prize

Oculus Go (32 GB)

Blu R2 Plus Smartphones

Team Members

Max Hubbard
View on Github