Apple watch beta tests AI features for conversation review and summarization
Apple is rolling out beta testing for its Audio Intelligence technology on the Apple Watch Series 12, following its September announcement. This suite of four opt-in features allows users to detect important sounds, identify music via Shazam, and interact with conversations through Live Rewind and Siri Recaps.
Live Rewind enables users to review the last 15 seconds of spoken audio as a text snippet by double-pressing the digital crown; these snippets auto-delete after 30 seconds unless saved to the Siri app. Siri Recaps offers a more advanced function, summarizing conversations into key bullet points and short sentences without identifying speakers or saving raw audio. These summaries can be saved to the Notes or Journal apps, and users are prompted to review them daily.
The functionality relies on the S11 chip, the watch's microphone, and Apple Intelligence models running on the paired iPhone, utilizing a secure enclave for on-device processing. The process involves lightweight AI models on the watch transferring audio to the iPhone's secure enclave for text condensation, which is then encrypted and sent to Apple’s Private Cloud Compute (PCC) for recap generation. Apple assures that the features are designed to omit sensitive data and should not affect battery life.