AR Cards
Description:
Our project entails the utilization of Apple's ARKit 2.0 to classify and recognize 2D images and display an AR UI on top of said content.
Inspiration:
We think ARKit is a very interesting platform and wanted to explore it.
What it does:
Our project uses ARKit's 2D Image Recognition Software to layer 3D virtual content on top of items such as business cards, school IDs, and even picture frames. We designed several features in our application that allowed consumers to utilize such items in a more practical way than ever before. Being able to glance videos, receive contact information, and respond to the card holder all with the touch of a button is something business cards have never been able to do before. And even better, There is quite the surprise when you check out the content that arrises when looking at the UMass $10 food cards given to us earlier this weekend :)
How we built it:
Using ARKit 2.0, SceneKit, SpriteKit, and AVKit, our team combined, text, images, videos, and audio in order to develop a completely immersive experience. All of which business cards and students ID's have never been able to do before. More specifically, we focused on building 3D content using a combination of SpriteKit and SceneKit that was then layered on top of the ARImageRecognition Anchor that was pinned to the photo as soon as the phone recognized the image. From there users were then able to interact with the SCNNodes, sending emails or texting the recipients while also receiving haptic feedback from the device for doing so. This was all tied together with scene kit animation in order to create a really awesome experience.
Challenges we ran into:
Narrowing down an idea early on and planning the scope of the project. We also did not pace ourselves as good as we should have, and burned ourselves out at the start.
Accomplishments that we're proud of:
Successfully designing an AR platform that can apply augmented reality to real world problems
What we learned:
How to utilize ARKit. How it works, and what possible applications it has. We also learned a lot about Hackathons as this was our first one.
What's next:
Taking it to the industrial level to optimize this with network and server side development.
Built with:
MacBook Pro's, Xcode, ARKit, CABasic Animation and Swift.
Prizes we're going for:
Arteck HB030 Portable Keyboard
$100 Amazon Gift Cards
Grand Prize
Oculus Go (32 GB)
Blu R2 Plus Smartphones
Misfit Shine 2