Everything You Missed from WWDC 2024: Apple Intelligence, iOS 18, More

Apple on Monday showed off the latest versions of its operating systems, and while they all add some notable new features, the star of the show is Apple’s highly anticipated embrace of artificial intelligence, which the company has dubbed Apple Intelligence.

As its name suggests, the Worldwide Developers’ Conference is a developer-focused event. Apple gives them early access to the next-gen versions of iOS, iPadOS, macOS, and more so they can play around with them and troubleshoot before a final launch in the fall. But it’s also a chance for the average Apple fan to see what’s coming down the line for our favorite devices.

If you didn’t have time to watch the almost two-hour WWDC keynote on Monday, here’s a rundown of what Apple showed off. 

Apple Recap: WWDC 2024 in 20 Minutes

Apple Intelligence

At this point, you may be sick of hearing about AI. It’s hard to escape. But Apple has never been one to jump on a trend, preferring to let rivals work out the kinks until it has what it believes to be the best solution. In this case, that’s Apple Intelligence, which promises productivity-focused upgrades across its OSes, from writing assistance to generative to helping you organize your emails. It arrives in the fall with iOS 18, iPadOS 18, and macOS Sequoia, though it will only run on an iPhone 15 Pro and Pro Max or and iPad or Mac running an M1 chip and above. If that’s you, here’s what you can expect.

On-Device Processing

Apple’s approach to AI has a particular focus on privacy, and it spent a good deal of time explaining how the bulk of the processing for Apple Intelligence will be done on device. Your information won’t be sent off to far-flung servers. Well, until it has to, at least.

Apple acknowledges that its devices sometimes need an assist to “run more complex requests.” In those cases, Apple Intelligence will shift over to Private Cloud Compute, which are “models run on servers powered by Apple silicon, providing a foundation that allows Apple to ensure that data is never retained or exposed.” For a deeper dive on that, check out this blog post from Apple Security Research.

Writing Tools

What most people will care about is what Apple Intelligence can do for them. To start, it’s going to help you polish up your writing. The Rewrite option serves up different version of what you wrote, adjusting for tone and the audience you’re addressing. Proofread is pretty self-explanatory, while Summarize does what AI does best; ingest and spit out summaries.

Mail App Upgrades

The Mail app leaves something to be desired when compared with the Gmail app, but Apple Intelligence aims to change that. If you have an unwieldy inbox, Priority Messages will show you the most urgent emails, like those that mention an event that day or a document like a boarding pass. The app will also be able to give you a TL;DR summary of messages from the inbox; no need to open them up. Speaking of Gmail, the Mail app will finally serve up smart replies, something Google’s version has done for years.

Notifications 

Snowed under by notifications? Like the Mail app, Priority Notifications will surface important notices at the top of the stack, with key details. Plus, Apple is adding a new Focus option, Reduce Interruptions, which only gives you a heads up on the most pressing items, like the fact that I need to be picked up at 2:30 p.m.

Record or Transcribe Audio

Apple Intelligence can record, transcribe, and summarize audio captured in the Notes and Phone apps. People on the other end of the line will be notified when recording starts, and Apple will generate a summary.

Generative AI

We couldn’t have an AI tool without some generative AI. Image Playground, which will be integrated into Apple’s OS and released as a standalone app, can create images from text using three styles: Animation, Illustration, or Sketch. If you have a compatible Apple Pencil, Image Wand in Notes can spruce up an image or even a white space that you highlight with the stylus.

Not happy with your emoji options? A Genmoji will create one based on your request, and can even use photos of friends and family.

Photos

If you have a hefty photo library, Apple Intelligence will allow for more natural language search. A Clean Up tool will also remove background clutter.

Siri

Siri has her moments, but she could use an upgrade, and that's what Apple's promising with Apple Intelligence. "With Apple Intelligence, Siri will be able to take hundreds of new actions in and across Apple and third-party apps," Apple says. She's also getting a new look, responding with a pulsating glow around the edge of the screen versus the swirling orb we know now. We'll have to wait to put her to the test to see if this does the trick.

Recommended by Our Editors

Sour Grapes? Elon Musk Says Apple Intelligence Is 'Creepy Spyware'

Apple's Siri Gets a ChatGPT Integration, Plus a Few Tricks of Her Own

'Apple Intelligence' Won't Send Your Data to Far-Flung Servers (for the Most Part)

ChatGPT Integration

One thing that might help Siri smarten up is a ChatGPT integration. Siri will "tap into ChatGPT's expertise," Apple says, meaning it can route questions to the chatbot for an answer if the user gives it permission to do so. Apple gave the example of uploading a picture of an outdoor patio and asking ChatGPT what plants might look good on it. At least one person hates it: Elon Musk.

iOS 18 and iPadOS 18

Coming this fall, Apple's newest versions of its mobile operating systems brings some long-requested features, some of which are old hat to Android users. Here are some of the more notable additions coming to iOS 18 and iPadOS 18.

• The ability to schedule your text messages.

• More options with Home screen setup. Move the icons to wherever you want; you're no longer restricted to neat, side-by-side rows.

• Create multiple, custom Control Centers. One for smart home devices and another for video-streaming apps, for example.

• More options for text messages reactions (aka Tapbacks). Use any emoji or sticker to show your love or displeasure, not just the drab heart or thumbs down.

• Satellite messaging will work in the Messages app for regular texting in remote areas, not just via the Emergency SOS feature.

• Apple also made brief mention of RCS support, which it first tipped last year.

• Hide certain apps in a private "Hidden" folder that's only accessible via Face ID, Touch ID, or a passcode.

• Tap to Cash will let two people send and receive Apple Cash by holding two iPhones together.

• iPadOS 18 is getting these features too, Apple also teased a floating tab bar, and an official calculator app.

macOS Sequoia

One of the standout functions of Apple's new macOS will be iPhone mirroring for the Continuity feature. This will allow you to view and control your iPhone on a Mac. Just click the iPhone Mirroring icon, and a window will appear showing a real-time view of an iPhone's home screen. We have all the details here.

Rumors about an Apple password manager turned out to be true, though the Passwords app is not restricted to macOS. It's also coming to iOS, iPadOS, and on Windows.

visionOS 2

The Vision Pro interface is getting a small upgrade courtesy of its first visionOS update. The highlight is "a powerful way to transform photos into 3D memories" that feel more immersive than your standard image or video clip. But there are also virtual display updates coming, as well as support for a train mode, so you can get weird looks on the Acela.

watchOS 11

WatchOS 11 will go beyond the stats and figure out how tough or easy your workout was as you train for your next big event, offer new ways to check your vitals, and offer assistance in picking a picture and making your watch face personal. Here are the 11 features we're most excited to try.

Honorable Mention...

• This fall, Apple TV+ movies and shows will get on-screen details about actors, characters, and music, similar to Amazon's Prime Video X-Ray feature.

• Apple is promising improvements to Enhance Dialogue in tvOS 18, so you're not blowing out your eardrums with musical interludes but straining to her what people are saying.

• Don't want people to know you're talking to Siri? Siri Interactions on AirPods Pro will let you respond to Siri with a head nod yes or shake no.

• Voice Isolation is also coming to AirPods Pro so you won't be drowned out by wind or background noise.