Nov 08 2016: Oxford researchers develop computer program that can read lips with superhuman accuracy

Back in Nov 08 2016: Oxford researchers develop computer program that can read lips with superhuman accuracy

Scientists at the University of Oxford have developed a computer program called "LipNet" that can read lips with 93.4% accuracy, surpassing the abilities of human professionals. The program, trained on thousands of videos, has potential applications in improving hearing aids, enabling conversations in noisy places, or adding speech to silent movies.

However, concerns arise over potential mass surveillance or invasion of privacy. Although the software is still limited to a specific collection of videos, it has the potential to advance with a larger database and more speakers.

Fast forward to Aug 03 2023: Apple Patent Says Siri Could Be Trained to Read Your Lips

Apple has filed a patent for a proprietary lip-reading program, indicating that the company is actively considering developing a system to analyze users' mouth movements to improve voice recognition. The system would use motion sensors such as accelerometers or gyroscopes to record mouth, neck, or head movements and determine if they indicate human speech.

This technology could potentially be integrated into devices such as AirPods or smart glasses. The patent suggests that Apple would need a large amount of data to train the system, including voice profiles and sample data sets for facial movements.

Why would Apple want to develop a lip-reading program using motion-sensing technology for Siri and other devices?