Skip to the content
Know your tech before you buy it. Makers: get listed from $49/mo

Apple Music Understanding

developer.apple.com

  • macOS
  • iPhone and iPad
  • API

What the maker publishes

Analysis dimensions
It analyzes key, rhythm, structure, pace, instrument activity, and loudness. source
Export
Session results can be encoded as JSON. source
File input limit
Asset-based sessions require locally available media or a complete file. source
Incremental delivery
The framework offers a streaming API that delivers loudness values every 100 milliseconds of analyzed audio. source
Instrument activity
Instrument activity results can indicate instrument presence and activity intensity over time. source
Loudness output
Loudness results include integrated, momentary, short-term, and peak measurements. source
On-device and offline
The framework runs on-device and works offline; Apple says analyzed audio stays private. source
Purpose
Music Understanding is an Apple framework for analyzing audio and extracting musical information. source
Rhythm output
Rhythm results include beat and bar timestamps and an optional global tempo in BPM. source
Selective analysis
Apps can request only selected analysis types to avoid unnecessary computations. source
Session input
A session can use an AVAsset or a custom audio provider. source
Streaming input
A custom audio provider yields AVReadOnlyAudioPCMBuffer objects through an AsyncSequence. source
Structure output
Structure analysis returns time ranges for sections, segments, and phrases. source
Use cases
Apple suggests beat-synced visuals, DJ catalog organization, and music-driven game animation as use cases. source

Checked against the maker's pages on 14 Nov 2026.