Introduction

At TouchStone, we offer a unique and engaging approach to learning Braille, making it accessible and enjoyable for everyone. Our app combines the power of AI assistance with interactive quizzes to create a dynamic learning environment.

It gently guides you through the basics of Braille, including numbers, the alphabet, special characters, and everyday words you’re likely to encounter.

Furthermore, thanks to the integration of Gemini AI in our search feature, discovering the Braille translation for any word or letter is just a query away.

Gemini AI provides detailed textual explanations alongside visual representations, making your learning experience not only comprehensive but also visually engaging.

Idea behind TouchStone

The inspiration for TouchStone lies behind a shared passion for education and accessibility, alongside our interests in language and communication.

Our motivation to create a learning app for Braille stemmed from a memory shared by our peer as they reminisced about their childhood best friend, who happened to be visually impaired.

Despite their differences, they formed an inseparable bond exchanging handwritten notes in Braille by poking holes through pieces of paper. The friend created an entire cheat sheet of Braille representations that they knew in order to preserve that precious connection.

Role in TouchStone

For this team project I took lead in AI development and worked on the front end.

Stacks and Tech used

  • Gemini Studio A.I
  • Axios
  • Django
  • Python
  • React
  • React-Slick
  • React-Flip-Card
  • Slick-Carousel
  • Vite
  • Psycopg2-binary

UI Experience

landing
home page
alpha card
quiz-directory
matching quiz
qa-home-page

Challenges

Major Challenge on this Project

Embarking on this project with limited knowledge in A.I. posed a significant challenge. We had to rapidly educate ourselves while pushing the project forward within the tight two-week deadline. This learning curve was steep, but it greatly enriched our team's expertise and the quality of our application.

Researching Braille

Gathering reliable and consistent information on Braille was more challenging than anticipated. We encountered various encoding standards, such as Braille binary and ASCII code. Determining which method best suited our needs required thorough research and careful consideration, ensuring our project's accuracy and effectiveness.

What's Next For TouchStone

Ensuring full accessibility remains our primary focus for the next development phase of TouchStone. We plan to support connectivity with portable Braille devices, enabling tactile learners to interact directly through their smartphones.

Future enhancements for TouchStone include refining our Gemini AI with tuned models and structured prompts to achieve more accurate responses. We are committed to incorporating Responsible AI principles to ensure these responses are both reliable and appropriate.

Additionally, we aim to introduce a camera feature that utilizes OCR technology powered by Google AI. This will allow users to take a picture of any text document and receive instant Braille translations. We also plan to implement image detection technology, enabling users to photograph objects and receive their Braille descriptions.

Video Demo of TouchStone

Click here to read more about TouchStone