As expected, Apple revealed numerous details about its upcoming iOS 15 operating systems for iPhones and iPads today. Due later this year, the software updates will introduce major new features to notifications and other parts of the experience.
In the age of Coronavirus, naturally FaceTime is getting a few new features for more natural conversations. A new spatial audio feature will make it sound like “people are in the same room.” Callers’ voices will come from the same direction as their thumbnails. Machine learning powered voice isolation that will block out background sounds, or a “wide spectrum” mode will pick up everything in the room.
Grid view will let you view FaceTime calls just like Zoom. Portrait mode will blur out your background, just like a camera mode. You can also generate a link for a FaceTime call, making it work, again, just like joining Zoom. Facetime is even coming to Android, sort of, via a browser. A new feature called “Shareplay” will let you share media or your device screen over the video call.
iMessage is getting some upgrades too, like a collage view for multiple photos. Any articles shared over Apple News will show tag identifying who shared it, allowing you to quickly jump into a conversation with them over iMessage.
Notification have been revamped, with a new design and bigger pictures. “Notification Summary” can bundle several notifications into a big group, ordered by priority. Message notifications get elevated out of bundles, so you won’t miss them. Do not disturb status will be automatically displayed in iMessage, so people can see you would like to be left along. There is a way for them to break through DND, though, if the message is really important. There are notification settings for individual apps and people now, allowing you to elevate important apps and people above the noise.
A new camera mode called “Live Text” will let you copy and paste text from real life. One of the demos involved taking a picture of a handwritten whiteboard, and just copying and pasting the text through the magic of machine learning. It works on seven languages, and can even do searches based on images, like identifying dog breeds.
On the Apple Wallet front, Apple is adding keys for your car, house, and hotel rooms. Apple is also pushing for in-app government ID cards, where you’ll be able to pull out your phone instead of showing a driver’s license. Weather has been revamped with full-screen graphic displays for air quality and other weather data.
Apple Maps is now projected on a 3D globe, and is getting new details like 3D map elevation, nighttime lighting, and more. New driving map details show crosswalks, bike lanes, and 3D overlapping highways and bridges. Transit lets you pin your favorite route to the top of the UI. A 3D AR camera view will let you quickly orient yourself without relying on the sometimes-wonky compass.
And let’s not forget about iPads and iPad OS. Just like on iOS, you can now mix in widgets with your app icons, instead of siloing them on an individual page. There are also bigger, more content-rich widgets for the iPad.
Multitasking has been revamped in iPadOS, with buttons at the top of the screen to move apps into split-screen. Apps can be swiped down, out of the split-screen view, and replaced with a different app. A new area called “the shelf” gives you easy access to all open windows of an app.
Notes is getting a system-wide upgrade called “Quick Note.” Swiping in from the corner of the screen will make a pop-up note app appear, and you can quickly jot something down. Translate is getting a similar system-wide upgrade, and can now translate apps.
“Swift Playground” is like a portable Xcode for iPad, allowing you to make Swift UI apps on the iPad. Since you’re doing this on iOS, code you write is immediately reflected in the preview.
A new privacy dashboard will give you reports on apps, showing which ones accessed which permissions in the past seven days. Mail will also block tracking pixels and your IP address. Siri voice commands won’t leave the device anymore, thanks to on-device voice recognition. It’s a lot faster too.
Family and friends can be given a recovery key for your account. They won’t be able to log into your account, but they will have a key that lets you log in if you can’t access your account. There are also new “Digital Legacy” contacts that can request access to your account when you die, just like a will.
Apple also announced a premium iCloud+ tier with additional privacy features, which we’ll look at in detail as soon as we have access.
This story is developing. Follow along with our WWDC 2021 liveblog for real-time updates.