Ill-Pill
Description:
At some point in our life, I think we've all faced the situation where we have a bunch of pills and no clue as to what each one is or does, or what it contains and it's always a chore to find a good and reliable resource to get that information. The situation is even worse for the visually impaired population and people in their Golden years, so we wanted a solution that gives the power of information to the people and at the same time helps make our elderly and visually impaired population more independent. We have built an application which will help you identify the pill with just a click of it and also let you know the ingredients and use of the medicine. We also allow the user to use Alexa application to hear about the pill and order it as well online.
Inspiration:
At some point in our life, I think we've all faced the situation where we have a bunch of pills and no clue as to what each one is or does, or what it contains and it's always a chore to find a good and reliable resource to get that information. The situation is even worse for the visually impaired population and people in their Golden years, so we wanted a solution that gives the power of information to the people and at the same time helps make our elderly and visually impaired population more independent.
What it does:
Steps 1.) You've got a pill or tablet and a mobile or a laptop. Step) 2.) You take its picture and click next, and it uses magic to find the Information about the pill. Step 3.) You can also upload a picture of a pill and it'll give you the result in a similar manner. Step 4.) Use Here.com to locate nearby pharmacies. Step 5.) Know more about the pill from our Alexa App. We have made a web application as well as an android application for this purpose.
How we built it:
Gathered data from a bunch of resources online (_ italics _https:https://rxnav.nlm.nih.gov/index.html ) Refined the data to build a proper usable database using pandas from python. Used AWS API to detect the imprint on the pill Used OpenCV to identify the shape and color of the pill Matched those attributes in our database to find the information about the pill.
Challenges we ran into:
Frontend and Backend Integration and integration of payment gateway.
Accomplishments that we're proud of:
Pill imprint(text) detection works with an accuracy of 99% (coutesy of AWS API), Image shape and color cam also be identified fairly reliably.
What we learned:
How to use OpenCV for shape and colour detection and AWS API difficult to find text extraction.
What's next:
Identify the pill and tell what it's used for. Order it right away using your alexa app when you ask for it.
Built with:
Python, Android, Javascript, AWS, Google Cloud Services, Here.com, Pandas, HTML, CSS, Flask, Alexa SDK
Prizes we're going for:
HAVIT RGB Mechanical Keyboard
Google Home Mini
$100 Amazon Gift Cards
Raspberry Pis & PiHut Essential Kits
Grand Prize
Jetbrains Pro Software
Lutron Caseta Wireless Kit
Hacker gear & swag from HERE.com
Blu R2 Plus Smartphones
Misfit Shine 2
Raspberry Pi Arcade Gaming Kit
Fujifilm Instax Mini 26