Apple’s new Live Captions adds subtitles in real time to everything, even the person in front of you.
Apple Glasses will revolutionize the future
Like Google’s concept AR Glasses , announced this week , Apple’s Live Captions can record incoming audio and transcribe it on the fly. The difference is that Apple’s version is coming “later this year,” which likely means it’ll be in this fall’s iOS 16 release. But the real news here is that this is Apple’s most obvious attempt at testing future Apple Glasses features in plain sight.
“As someone with two parents who both have hearing difficulties, this could be a big help,” writes Apple-focused journalist Dan Moren on his personal Six Colors blog. “I’m curious to see how well the feature actually works and how it handles a large FaceTime call with many participants; Apple says it will attribute dialogue to specific speakers.”
Live Captions, which we’ll get to shortly, is far from the first AR glasses feature Apple has tried. The most obvious is the addition of LIDAR cameras to iPhones and iPads. These scanners help create an accurate 3D map of the outside world, allowing the iPhone to overlay 3D models onto the real world shown by the camera.