Today at Apple’s 2021 WWDC event, the company unveiled the new iOS 15, iPadOS 15 operating systems. This year, Apple presented a large number of new features and improvements across both the main OS components as well as Apple’s core ecosystem apps. While we are just scratching the surface, we picked out a few highlight features that are looking forward to test later in the year once the new versions will be hitting consumers in their final versions.

Offline Siri

A large new upgrade to Siri isn’t exactly a functional one, but rather the way the voice assistant works under the hood. With iOS 15, Siri now becomes fully offline, with all voice queries being captured, and processed and interpreted by the Neural Engine inside of your iDevice SoC. Beyond greatly improving the security aspect of things, given that data never leaves your device for cloud processing queries, a large functional benefit of the new on-device processing is that it vastly reduces round-trip time and accelerates Siri’s response time. This means that Siri will now act or respond more immediately, rather taking a pause to think about every query, greatly improving the experience.

Live Text (OCR)

Another big new feature to iOS 15 is Live Text, which is essentially an OCR mechanism built right into the OS that will be able to seamlessly integrate into apps and extract text from pictures, either on the web – or in photos that you’ve captured on your device.

“Visual Look Up” is an object identification mechanism that works in your photos app to categorize and classify objects and persons – notably allowing you to also search your galleries now.

New Maps (for those lucky)

One of the more impressive showcases at this year’s WWDC was the new more detailed Maps app. The updated app and dataset now features far more datail for major cities, featuring even advanced 3D terrain representation of the scene. This also extends over to navigation as well, which now features advanced 3D modelling of roadways and bridges, as welll as information on a road's various lanes (turn, etc), simplifying complex intersections for example.

The negative part of this new announcement is that it’s limited to only a hand-full of US cities and London – with most of the rest of the world having to wait out for future updates – if they ever happen.

New FaceTime & Screen Sharing

Apple spent a lot of time around the new FaceTime and screen sharing features. Essentially Apple here is attempting to create their own virtual social ecosystem and build a conferencing integration around FaceTime. FaceTime itself received a large number of new features including spatial audio reproduction-based Group FaceTime calls in which callers’ audio is mimicked to be spatially spread out.

FaceTime calls now essentially are able to get Zoom-ified in terms of creation of links into calls – which now can be integrated and easily shared across applications. FaceTime now even works for any other non-Apple device by allowing users which have access to a link to join in via a web browser interface. And, given how many devices this expands Facetime to, it's a bit of a shame that Apple didn't go into more detail on how that will work.

SharePlay is a screen sharing and application experience synchronisation feature. It allows callers to share media with each other, such as playing back the same audio or movie content, and goes quite deep into app integration as Apple introduces as swathe of new APIs that allow sharing and essentially casting of content across devices and applications.

New Notificiation Summary

iOS’s notification system has lagged behind Android’s for quite some years now, and Apple today took a further step in trying to get a grip over the more traditional “linear” notification system that iOS had to deal with until now. “Notification Summary” is essentially a second layer filtering and grouping mechanism of your notifications, allowing you to prioritise notifications which are important to you and set aside more general clutter notifications for later. It’s said that the priority algorithm will learn based on your apps and contacts, and try to keep those notifications at the top for you to see.

New Safari UI

Safari has seen a large new UI shift on the larger form-factor macOS and iPadOS variant, but also the iOS variant has seen important UI changes such as a more full-screen browsing experience with a dynamic address and navigation bar that appears and disappears at the bottom of the screen, which is a nice ergonomics improvement given the size of devices nowadays. Under the hood, the introduction of full fledged browser extensions is sure to vastly augment the iOS Safari experience.

A larger Wallet

A new expanded Wallet can now go well beyond your Apple Pay uses or even transport card uses today. Apple will be partnering up with states and providers to enable integration of things such as hotel room keys, or even your actual government ID. The system will continue to use the secure enclave which enables Apple Pay.

Beta starting July

Apple will be making available the new versions of iOS for developers starting today, while the public beta will start in July with the usual planned final roll-out in the September period.

Related Reading:

• The Apple WWDC 2021 Keynote Live Blog (Starts at 10am PT/17:00 UTC)