SignGuide
Automated Museum Guidance using Sign Language

PROJECT ABSTRACT

The right for equal access to educational and cultural content is described in the european chart for human rights. However, there is practically very limited availability of accessible cultural museum content for the deaf.

The goal of the SignGuide project is to develop a prototype interactive museum guide system for deaf visitors using mobile devices that will be able to receive visitors' questions in their native (sign language) with regard to the exhibits, and to provide additional content also in sign language using an avatar or video, utilizing techniques from the field of computer vision and machine learning.

To this end, we will develop a demonstration system for guidance in the Archaeological Museum of Thessaloniki. System integration and commercial exploitation will be done through MLS Information Technology. The development of the tracking system and avatar will be developed by the Foundation for Research and Technology - Hellas, Computer Vision and Robotics Lab and Human Computer Interaction Lab respectively. Users will deaf from the Deaf Studies Unit of the University of Patras. The Signal Processing and Telecommunications Lab of the University of Patras will implement the machine learning algorithms and Cultural Technology Lab of the same university will organize the content and will coordinate the project.

PROJECT ID

CONSORTIUM

1. Πανεπιστήμιο Πατρών - Τμήμα Ιστορίας και Αρχαιολογίας (Εργαστήριο Πολιτισμικής Τεχνολογίας - Συντονιστής), Παιδαγωγικό Τμήμα Δημοτικής Εκπαίδευσης (Μονάδα Αγωγής Κωφών)
2. Ίδρυμα Τεχνολογίας και Έρευνας - Ινστιτούτο Πληροφορικής (Εργαστήριο Υπολογιστικής Όρασης και Ρομποτικής, Εργαστήριο Αλληλλεπίδρασης Ανθρώπου–Υπολογιστή)
3. Αρχαιολογικό Μουσείο Θεσσαλονίκης
4. Bioassist S.A.

Επιστημονικός υπεύθυνος έργου: Κοσμόπουλος Δημήτριος, Αναπληρωτής Καθηγητής, Πανεπιστήμιο Πάτρας