This mobile app is registered with restaurants who will place QR codes on their menus. The app scans the code and displays the dish in augmented reality! It also gives nutritional information.
Many restaurant menus don't display pictures of all/any of their dishes. I like to be able to see what I'm ordering beforehand so I was inspired to create an app that'll use augmented reality to show me the dishes ahead of time and display them on the table so I can see them properly.
It uses QR codes that supporting restaurants will have in their menus to download 3D models from a database and display them on your table. It also displays the ingredients in each dish and it shares nutritional information such as calories and grams of protein so that users can maintain a healthy diet.
Using the Swift programming language and Xcode on a Mac. Firebase is used to hold the 3D Models and textures and nutritional data is taken from the USDA database.
I have never worked with Augmented Reality / 3D Modeling before so I head to learn a completely new style of app development in Swift. I also had to do research on QR codes and how they work as well as learn Apple's Vision API to detect them and read data from them. It took around 5 hours to figure this out.
I'm very proud of how I accomplished downloading 3D models from an external database and displaying them without having to store them on the device. I'm also proud of how I was able to learn a bunch of new APIs that I've never used before as well as learn some 3D modeling.
I learned about 3D modeling, which I have a new found respect for, as well as augmented reality. I'm excited to try my hand a bit more at these two new fields. I also learned how to use REST APIs which was completely new to me.
What's next is to add an ingredient removal feature. So if you don't want something on your dish you can just uncheck it and it'll be removed from the 3D model.
This was built in Swift using Xcode, as well as Firebase and the USDA database.
HAVIT RGB Mechanical Keyboard
Google Home Mini
$100 Amazon Gift Cards
Oculus Go (32 GB)
Blu R2 Plus Smartphones