The I6-BOSTON10 Database

The National Center for sign language and Gesture Resources of the Boston University published a database of ASL sentences. Although this database has not been produced primarily for image processing research, it consists of 201 annotated video streams of ASL sentences.

The signing is captured simultaneously by four standard stationary cameras where three of them are black/white and one is a color camera. Two black/white cameras, placed towards the signer's face, form a stereo pair and another camera is installed on the side of the signer. The color camera is placed between the stereo camera pair and is zoomed to capture only the face of the signer. The movies published on the internet are at 30 frames per second and the size of the frames is 312*242 pixels. We use the published video streams at the same frame rate but we use only the upper center part of size 195*165 pixels because parts of the bottom of the frames show some information about the frame and the left and right border of the frames are unused.

To create I6-BOSTON10 database for ASL word recognition, we extracted 110 utterances of 10 words from this database as listed in the table. These utterances are segmented manually. You can download them here.

Word	Number of utterances
CAN	17
BUY	15
CAR	15
BOOK	13
HOUSE	11
WHAT	10
POSS (Possession)	9
WOMAN	8
IX far (Pointing far)	7
BREAK-DOWN	5
Sum	110

In I6-BOSTON10, there are three signers: one male and two female signers. All of the signers are dressed differently and the brightness of their clothes is different. We use the frames captured by two of the four cameras, one camera of the stereo camera pair in front of the signer and the other lateral. Using both of the stereo cameras and the color camera may be useful in stereo and facial expression recognition, respectively. Both of the used cameras are in fixed positions and capture the videos in a controlled environment simultaneously. The signers and the views of the cameras are shown here:

We hope that other research groups use this database and publish their results. This database is freely available and you can use it as you desire. If you use it, please cite this web page and source database created in the Boston University.

List of Publications on I6-BOSTON10 Database

2005

M. Zahedi, D. Keysers, and H. Ney. Appearance-Based Recognition of Words in American Sign Language. In IbPRIA 2005, 2nd Iberian Conference on Pattern Recognition and Image Analysis, Estoril, Portugal, Volume LNCS 3522 of Lecture Notes in Pattern Recognition and Image Analysis, pages 511-519, June 2005.

2004

M. Zahedi, D. Keysers, and H. Ney. Appearance-Based Recognition of Signs in American Sign Language. Poster presentation at the 5th Sign Language Workshop of the RWTH Aachen University, Aachen, Germany, October 29, 2004.

- Morteza Zahedi, Lehrstuhl für Informatik VI | zahedi@i6.informatik.rwth-aachen.de -
Lehrstuhl für Informatik VI, Computer Science Department, RWTH Aachen University, D-52056 Aachen, Germany
Ahornstr. 55, Building E2, Room 6125a, Tel +49-241-80-21610, Fax +49-241-80-22219 Last modified: Tue Apr 19 10:36:39 CEST 2005
Disclaimer. Hits since Tue Mar 18 2003: [counter]