Apple releases Audio Intelligence beta for Apple Watch

Audio Intelligence enters beta

Apple released the first developer beta of iOS 27.3 and watchOS 27.3 this week, bringing Live Rewind and Siri Recaps to the Apple Watch Series 12 and Ultra 4. The features were announced in September but held back until after the watches launched, ZDNET reported. Both are opt-in.

Live Rewind continuously buffers audio so the wearer can see a transcript of the previous 15 seconds. A double-press of the Digital Crown brings up the transcript, which stays on screen for 30 seconds; the watch chimes and shows an animation while it is in use. The user can send the snippet to the Siri app to save it or ask about it. If the user does not act, the snippet is deleted. Saved snippets are encrypted through iCloud, and ZDNET reported that Live Rewind is processed on the device and not sent to Apple.

Siri Recaps tries to detect meetings and other encounters, then writes text summaries of key details such as dates, times, prices and action items. Users can save a recap in the Siri app or export it to Notes or Journal. If they do not save it, it is automatically deleted after seven days. The feature can be switched on or off in Control Center, set to run only at certain places, started manually, or left on to pick up meetings on its own. It pauses when the user is on a phone or FaceTime call, plays music, or uses earbuds or other Bluetooth devices.

Audio Intelligence works only in English at first and appears not to handle German yet, heise reported. It is not available in the EU, though it appears active in Switzerland.

Where the processing happens

Apple's privacy case rests on where audio is handled. The company says Live Rewind runs locally by default, deletes the recorded audio stream immediately and protects data in a Secure Exclave. Siri Recaps uses Apple's cloud models through Private Cloud Compute. ZDNET reported that for Siri Recaps, the watch's S11 chip detects whether the wearer is part of a conversation, then encrypted audio goes to the Secure Exclave on the paired iPhone. The iPhone turns that audio into condensed text before it is sent to Private Cloud Compute.

Apple says the summaries do not identify speakers and that the system is designed to exclude or redact sensitive material such as financial data, authentication data and personal identifiers. It also says it does not store raw audio files. Those are company claims. Apple stresses that users must switch the features on themselves.

Privacy and legal questions

The legal picture is unsettled. In some US states, recordings are allowed only if every party consents, raising the question of whether a user could face legal risk by turning Live Rewind or Siri Recaps on. European data protection rules are stricter, and it is not clear that Apple can launch Audio Intelligence there in its current form.

In a hands-on test, Siri Recaps captured a car repair deductible, the repair timeframe and the fuel level in a rental, according to TechCrunch. It then mixed those details with family errands discussed later at home. The discomfort is less about storage than about normalising a device that listens through the day.

What happens next

A public beta of watchOS 27.3 is expected next week. The finished iOS 27.3 is expected to be widely available sometime in December. Apple has not confirmed either date.

The open question is Europe. Audio Intelligence appears active in Switzerland, but Apple has not said whether it will be approved for the bloc. Until then, the developer beta is the way to try the features in markets where they are available.