D1

SignMeUp – Real-Time American Sign Language (ASL) Recognition

Project Manager / Data Scientist (neuefische GmbH) · Sep 2023 – Dec 2023

Built a real-time ASL recognition prototype: an end-to-end machine-learning pipeline that extracts hand landmarks, classifies temporal gestures, and gives sign-language learners immediate feedback.

Technologies

PythonTensorFlow (Keras)LSTMMediaPipeOpenCVGoogle CloudScikit-LearnMLflow

Contributions

  • Project Leadership: Defined project scope, managed team communication, and delivered stakeholder presentations.
  • Model Development: Designed and optimized an LSTM neural network to classify temporal sequences of ASL gestures.
  • Data Engineering: Developed a pipeline for real-time landmark extraction, feature engineering, and data cleaning from video feeds.

Outcome

Delivered a functional prototype for real-time inference, enabling instant feedback for sign language learners.