D1

SignMeUp – Real-Time American Sign Language (ASL) Recognition

Project Manager / Data Scientist (neuefische GmbH) · Sep 2023 – Dec 2023

Machine learning pipeline and application prototype for real-time ASL gesture recognition, designed for integration into a digital sign language learning app.

Technologies

PythonTensorFlow (Keras)LSTMMediaPipeOpenCVGoogle CloudScikit-LearnMLflow

Contributions

  • Project Leadership: Defined project scope, managed team communication, and delivered stakeholder presentations.
  • Model Development: Designed and optimized an LSTM neural network to classify temporal sequences of ASL gestures.
  • Data Engineering: Developed a pipeline for real-time landmark extraction, feature engineering, and data cleaning from video feeds.

Outcome

Delivered a functional prototype for real-time inference, enabling instant feedback for sign language learners.