All of the Live Text Updates in iOS 16

by

Last year in iOS 15, Apple added a feature that is designed to let you highlight and select written and typed text from photos, interacting with it as you would text in any other place in the operating system.

Subscribe to the MacRumors YouTube channel for more videos.

With iOS 16, available now, Apple has continued to improve Live Text, and it has some impressive new capabilities, which we've outlined below.

Live Text in Videos

Video support is the biggest new feature added to Live Text. Rather than just being able to select text in photos, you can now pause a video and interact with the text like you would in an image.

Text in any paused video frame can be copied and pasted or translated, plus it works with Look Up. Live Text works across the operating system in Photos, Camera, Safari, and other apps.

To copy text in a video, pause it on the frame that you want and then touch and hold on a word. You can grab the two blue markers to narrow or widen your selection, and then you can press and hold to get to options like translate and copy.

Quick Actions

Text that is in a photo or a video also supports quick actions, something that Apple added in iOS 15. In iOS 16, there are new quick actions that let you track flights, track packages, translate languages, and convert currencies right from a photo or video.

If you have a photo with a sign in a foreign language, for example, you might see the "Translate" quick action available. Or if there's a foreign currency, Apple will offer up the conversion quick action.

Translate Camera

Apple is using Live Text's functionality in the Translate app, adding a Camera button that opens up the device camera so you can get live translations in real time.

New Languages

Live Text now works with Japanese, Korean, and Ukrainian text in addition to English, Chinese, French, German, Spanish, Italian, and Portuguese.

Live Text Spotlight Search

Live Text capabilities that allow for text to be recognized in photos and videos can be used in Spotlight search in iOS 16, so you can do a Spotlight search to find specific text in an image or video.

Live Text Requirements

Using Live Text features requires an iPhone with an A12 Bionic or later. The ‌iPhone‌ XR, ‌iPhone‌ XS, and ‌iPhone‌ XS Max from 2018 are equipped with an A12 Bionic, so if you have one of these devices or newer you can take advantage of Live Text.

Guide Feedback

Have questions about Live Text in iOS 16, know of a feature we left out, or want to offer feedback on this guide? Send us an email here.

Related Forum: iOS 16

Popular Stories

iPhone SE 4 Vertical Camera Feature

iPhone SE 4 Rumored to Use Same Rear Chassis as iPhone 16

Friday July 19, 2024 7:16 am PDT by
Apple will adopt the same rear chassis manufacturing process for the iPhone SE 4 that it is using for the upcoming standard iPhone 16, claims a new rumor coming out of China. According to the Weibo-based leaker "Fixed Focus Digital," the backplate manufacturing process for the iPhone SE 4 is "exactly the same" as the standard model in Apple's upcoming iPhone 16 lineup, which is expected to...
Read Full Article • 136 comments
iPhone 16 Pro Sizes Feature

iPhone 16 Series Is Just Two Months Away: Everything We Know

Monday July 15, 2024 4:44 am PDT by
Apple typically releases its new iPhone series around mid-September, which means we are about two months out from the launch of the iPhone 16. Like the iPhone 15 series, this year's lineup is expected to stick with four models – iPhone 16, iPhone 16 Plus, iPhone 16 Pro, and iPhone 16 Pro Max – although there are plenty of design differences and new features to take into account. To bring ...
Read Full Article • 129 comments
bsod

Crowdstrike Says Global IT Outage Impacting Windows PCs, But Mac and Linux Hosts Not Affected

Friday July 19, 2024 3:12 am PDT by
A widespread system failure is currently affecting numerous Windows devices globally, causing critical boot failures across various industries, including banks, rail networks, airlines, retailers, broadcasters, healthcare, and many more sectors. The issue, manifesting as a Blue Screen of Death (BSOD), is preventing computers from starting up properly and forcing them into continuous recovery...
Read Full Article • 492 comments
iphone 14 lineup

Cellebrite Unable to Unlock iPhones on iOS 17.4 or Later, Leak Reveals

Thursday July 18, 2024 4:18 am PDT by
Israel-based mobile forensics company Cellebrite is unable to unlock iPhones running iOS 17.4 or later, according to leaked documents verified by 404 Media. The documents provide a rare glimpse into the capabilities of the company's mobile forensics tools and highlight the ongoing security improvements in Apple's latest devices. The leaked "Cellebrite iOS Support Matrix" obtained by 404 Media...
Read Full Article • 66 comments
Apple Watch Series 9

2024 Apple Watch Lineup: Key Changes We're Expecting

Tuesday July 16, 2024 7:59 am PDT by
Apple is seemingly planning a rework of the Apple Watch lineup for 2024, according to a range of reports from over the past year. Here's everything we know so far. Apple is expected to continue to offer three different Apple Watch models in five casing sizes, but the various display sizes will allegedly grow by up to 12% and the casings will get taller. Based on all of the latest rumors,...
Read Full Article • 38 comments
tinypod apple watch

TinyPod Turns Your Apple Watch Into an iPod

Wednesday July 17, 2024 3:18 pm PDT by
If you have an old Apple Watch and you're not sure what to do with it, a new product called TinyPod might be the answer. Priced at $79, the TinyPod is a silicone case with a built-in scroll wheel that houses the Apple Watch chassis. When an Apple Watch is placed inside the TinyPod, the click wheel on the case is able to be used to scroll through the Apple Watch interface. The feature works...
Read Full Article • 133 comments

Top Rated Comments

jayducharme Avatar
jayducharme
26 months ago
I've gotten so spoiled with increasingly advanced tech features, it's difficult for me to appreciate how mind-blowing Translate Camera is.
Score: 8 Votes (Like | Disagree)
techfreak23 Avatar
techfreak23
26 months ago
It's a useful feature, but it has added an annoyance when doing certain tasks. A lot of times, if I'm holding down a YouTube thumbnail that has text in it, Live Text will pick it up instead of opening the contextual menu. Hopefully videos aren't going to have the same issue.
Score: 8 Votes (Like | Disagree)
FloatingBones Avatar
FloatingBones
26 months ago
I love MacOS 12's Live Text. It's so cool to just grab text blocks in Preview. The interface is so unpresuming: just select the text to copy, and paste it elsewhere. So much computation happening behind the scenes! I haven't used on iOS/iPadOS, but I'm sure it's just as easy.

Apple experts should show these cool tools to their less technical friends. They will benefit from using these magical tools; they will think fondly of you for showing them the tools.
Score: 6 Votes (Like | Disagree)
BootsWalking Avatar
BootsWalking
26 months ago
My memory has turned into mush ever since I started using the Live Text feature to transcribe names, addresses, phone numbers, etc. Now I have trouble remembering a few digits ;)
Score: 5 Votes (Like | Disagree)
mrgraff Avatar
mrgraff
26 months ago

Definitely have the same experience. More often than not I don’t want the live text enabled. anyway to disable it?
Settings > General > Language & Region. Then turn off the toggle button next to “Live Text“.
Score: 5 Votes (Like | Disagree)
Mr. Awesome Avatar
Mr. Awesome
26 months ago

These are all great. If they can scan the whole video for text seems like they should scan the whole video for faces as well but often seems like it only scans first few seconds.

I know apple has been behind in this area so glad to see them working to catch up.
That’s not exactly what it does. It scans the current frame for text when you pause the video. It doesn’t scan the whole video for text.
Score: 5 Votes (Like | Disagree)
Read All Comments