Skip to content

Latest commit

 

History

History
45 lines (34 loc) · 1.66 KB

File metadata and controls

45 lines (34 loc) · 1.66 KB

SignQuest: 2025 Apple Swift Student Challenge [Winner]

SignQuest is an interactive ASL (American Sign Language) alphabet learning app that helps users master ASL letter gestures through real-time hand gesture recognition, 3D model demonstrations, and gamified practice sessions.

Features

1. Sign School (Learning Module)

  • Guides users through mastering each ASL letter gesture
  • Provides structured, step-by-step learning with immediate feedback
  • Features both 2D camera-based gesture recognition and 3D hand model viewing
  • Offers detailed gesture instructions with textual descriptions and reference images

2. Word Play (Game Module)

  • Gamifies the learning process through interactive word-spelling challenges
  • Enhances engagement with visual feedback and celebratory animations for successful completions.

3. Hand Spell (Practice Module)

  • Enables users to practice spelling any word using ASL signs
  • Provides a text editor that converts signed gestures into text
  • Includes a built-in dictionary for quick and easy reference

Technical Features

  • SwiftUI
  • CoreML & CreateML
  • SceneKit & Reality Composer
  • AVFoundation & Vision

Requirements

  • Swift Playgrounds 4.0 or XCode 16.0 or later

Demo

Youtube

HomeScreen

homescreen

SignSchool Mode

signschool

3D Hand Model

3D model