How AI Could Make Phones More Accessible for Deaf Users

For many Deaf people, communicating with hearing people by phone can be difficult. Typing may take time, and written English may not be their first language. Google DeepMind is developing SL2T, an artificial intelligence model that can recognise American Sign Language through a phone camera and translate it into written English.

Everyday uses of sign language translation

This technology could support everyday communication in many situations, including appointments, education, work, travel, shopping, and contact with public services. Patients may also be able to use it independently in their daily lives to communicate with family members, friends, colleagues, customer service workers, and other people who do not know sign language. This could reduce reliance on others and give Deaf users more control over how they communicate.

SL2T in healthcare and therapy

In healthcare and therapy, SL2T may help patients describe simple needs, understand information, ask questions, and communicate more independently with therapists and other professionals who do not know sign language. It could also help Deaf people communicate with the wider community and society, including neighbours, shop workers, teachers, employers, transport staff, and public service providers. This may support greater participation in daily life and help reduce communication barriers.

A communication aid, not an interpreter

However, AI translation should be viewed as a communication aid, not a replacement for a qualified interpreter. Sign languages have their own grammar, and meaning can depend on hand movements, facial expressions, body position, speed, and context. If the system misses one of these elements, the translation may be inaccurate.

Therapists should therefore use this technology cautiously. It may be suitable for short messages, basic questions, appointment information, or informal communication. It should not be used alone for diagnosis, informed consent, mental health risk assessment, safeguarding, or important treatment decisions. In complex or sensitive situations, a professional interpreter remains essential.

Technical limits

The system may also have difficulty with regional signs, rapid signing, fingerspelling, poor lighting, or unusual camera angles. A translation may appear clear but still be wrong. Professionals should check important information with the patient and give them opportunities to correct the result.

Involving Deaf people and protecting privacy

The involvement of Deaf people in developing and testing the technology is an important strength. Their experience can help developers understand real communication needs and avoid treating sign language as simply a technical problem. Further research is still needed across different sign languages, cultures, regions, and healthcare settings.

Privacy is another concern. Signing may communicate personal, medical, or emotional information. Therapists should explain how the tool works, whether recordings are stored, and who can access the data. Patients should always be free to choose whether they want to use it.

AI can improve accessibility, but professional responsibility remains essential. Therapists must verify the information, recognise possible bias, and avoid assuming that the system is always correct. Used carefully, SL2T may give Deaf users greater independence and more communication choices while supporting, not replacing, human understanding.

Lire cet article en français →

Shopping Cart