Speech Recognition Code Editor
Description:
A desktop application that takes user voice input and converts it into code on the code editor.
Inspiration:
People experience difficulties with typing for various reasons: breaking arms and disabilities. But we believe that these obstacles shouldn't determine their ability to code. Thinking about making coding accessible and available to every user, we made this app happen!
What it does:
Our project allows the users to code without really typing anything on the keyboard, in other words, it converts their speech into the code and saves the output in java format.
How we built it:
We built it using Java API and Google Cloud Platform-Speech API
Challenges we ran into:
The hardest part for us is how to turn an audio file to text file. Since our teammates are mostly international students with accents, it makes us harder to recognize our words. Also, we do not have experience in NLP, so we need to do a lot of research.
Accomplishments that we're proud of:
Starting with no experience in this area of computer Science we were able to create a functioning project from scratch. Most of us didn't know each other before HackUmass, yet we were able to work as a team, delegating, sharing responsibilities and supporting each other. And the most important: even though this app is in early development stage, it has a great potential to help people by making coding accessible.
What we learned:
We learned a lot about using Java API and GCP and ways to use it in software development. We learned to work together as a team. We learned that with the right motivation impossible becomes doable.
What's next:
We will continue to work on transforming the text file to real code, which requires more precise algorithms, flexibility and special cases. We want to optimize the performance and improve the design as well as work on the user interface. We are going to make it an open-source app, so other interested people can contribute and make the app even better.
Built with:
Google Cloud Platform Speech-API and Java API
Prizes we're going for:
Arteck HB030 Portable Keyboard
HAVIT RGB Mechanical Keyboard
Google Home Mini
TBI Pro Gaming Headset
$100 Amazon Gift Cards
Grand Prize
Misfit Shine 2