View
❯
Live Video
❯Education - Accessibility
Large Companies
Computer Vision - Gesture Recognition
General Public
Education - Accessibility
Chromosome segmentation and deep classification
Government
Defense & Military - Intelligence & Surveillance
Dialogue-based social care services for people with mental illness, dementia and the elderly living alone
Instant triaging of wounds
Large Companies
Small Companies
Entertainment and Media - Metadata Tagging
Intelligent Video Traffic Monitoring
Education - Automated Content Generators
Large Companies
Small Companies
Entertainment and Media - Subtitle Creation
Autonomous apron truck
Robotic prehension of objects
AI decryption of magnetograms
Government
Defense & Military - Autonomous Vehicle
Improvement of productivity of semiconductor manufacturing
Automated defect classification on product surfaces
Pre-screening of cavity and oral diseases based on 2D digital images
Intelligent technology to control manual operations via video Norma
Automatic classification tool for full size core
Real-time patient support and medical information service applying spoken dialogue system
AI situation explanation service for people with visual impairments
General Public
Education - Smart Learning Content
Autonomous trains (Unattended train operation (UTO))
AI sign language interpretation system for people with hearing impairment
Precision Farming as a Service
General Public
Computer Vision - Object & Activity recognition
Facilitating language learning of deaf people
Computer-aided diagnosis in medical imaging based on machine learning
Social humanoid technology capable of multi-modal context recognition and expression
Autonomous Robot Improves Surgical Precision Using AI
General Public
Education - Accessibility
For:
Deaf and hard of hearing (DHH), and non-native speaking academic students.Goal:
Improved Customer Experience, Improved OperationProblem addressed
Accessibility in education gives all people the same access to educational experiences, services, and information, whether a person has a disability or not. Unicef estimates that there are approximately 240 million children with disabilities worldwide.
Breaking down communication barriers is critical for creating an inclusive learning environment. One of the challenges of inclusivity in these environments is making learning materials available to the deaf and hard of hearing (DHH).
Scope of use case
Captioning lecturer's speech to improve the learning experience of Deaf and Hard of Hearing students.
Description
Large Neural Networks consisting of billions of parameters and trained on massive data sets have brought about a step change to language technologies. So much so that it is now possible to automatically transcribe speech in realtime. This is commonly known as automatic speech recognition (ASR) or speech to text (STT). Cloud-based, service-orientated deployment of these technologies has democratized access to these technologies across devices via apps.
The Rochester Institute of Technology has roughly 1,500 students who are deaf or hard of hearing3. They have rolled out Microsoft Translator technology to automatically caption a lecturer's speech while they deliver a lecture using Microsoft Powerpoint. As the technology is multilingual and cross-device, students can also choose to receive the information in a language of their choosing.
Lecturers at the learning institute already have American Sign Language (ASL) interpreters. Academic staff see the technology as augmenting ASL rather than replacing it, due to the fact that gestures can convey several words at once making it less taxing to interpret than reading.
Audio
Live Video
AI: Perceive
Audio Signal processing
Deep Learning
AI: Understand
Other
AI: Act