P. Dreuw, J. Forster, T. Deselaers, and H. Ney. Efficient Approximations to Model-based Joint Tracking and Recognition of Continuous Sign Language. In IEEE International Conference on Automatic Face and Gesture Recognition (FG), pages 1-6, Amsterdam, The Netherlands, September 2008.
P. Dreuw, D. Rybach, T. Deselaers, M. Zahedi, and H. Ney. Speech Recognition Techniques for a Sign Language Recognition System. In Interspeech, pages 2513-2516, Antwerp, Belgium, August 2007.
ISCA best student paper award Interspeech 2007.
The National Center for sign language and Gesture Resources of the Boston University published a database of ASL sentences. Although this database has not been produced primarily for image processing research, it consists of 201 annotated video streams of ASL sentences.
The signing is captured simultaneously by four standard stationary cameras where three of them are black/white and one is a color camera. Two black/white cameras, placed towards the signer's face, form a stereo pair and another camera is installed on the side of the signer. The color camera is placed between the stereo camera pair and is zoomed to capture only the face of the signer. The movies published on the internet are at 30 frames per second and the size of the frames is 312*242 pixels. We use the published video streams at the same frame rate but we use only the upper center part of size 195*165 pixels because parts of the bottom of the frames show some information about the frame and the left and right border of the frames are unused.
To create the RWTH-BOSTON-104 sign language database for ASL sentence recognition, we separated the video streams to training and test set which the training set consists of 161 sign language sentences and the test set includes 40 remaining sign language sentenses. You can download the sign language database containing the videos of the training and test set, the image frames of the movies, the lexica and language models, the tracked dominant hand information, and their annotation files from our FTP server (685 MB).
- a complete overview for the RWTH-BOSTON-104 sign language database with detailed information for each sequence
- overview for the training data of the RWTH-BOSTON-104 sign language database with detailed information for each sequence
- overview for the test data of the RWTH-BOSTON-104 sign language database with detailed information for each sequence
Philippe Dreuw Last modified: Wed Jul 18 15:36:03 CEST 2007 Disclaimer. Created Wed Dec 22 18:04:32 CET 2004