Apple Music Understanding
developer.apple.com
- macOS
- iPhone and iPad
- API
5.8 Club score Visit developer.apple.com
What the maker publishes
- Analysis dimensions
- It analyzes key, rhythm, structure, pace, instrument activity, and loudness. source
- Export
- Session results can be encoded as JSON. source
- File input limit
- Asset-based sessions require locally available media or a complete file. source
- Incremental delivery
- The framework offers a streaming API that delivers loudness values every 100 milliseconds of analyzed audio. source
- Instrument activity
- Instrument activity results can indicate instrument presence and activity intensity over time. source
- Loudness output
- Loudness results include integrated, momentary, short-term, and peak measurements. source
- On-device and offline
- The framework runs on-device and works offline; Apple says analyzed audio stays private. source
- Purpose
- Music Understanding is an Apple framework for analyzing audio and extracting musical information. source
- Rhythm output
- Rhythm results include beat and bar timestamps and an optional global tempo in BPM. source
- Selective analysis
- Apps can request only selected analysis types to avoid unnecessary computations. source
- Session input
- A session can use an AVAsset or a custom audio provider. source
- Streaming input
- A custom audio provider yields AVReadOnlyAudioPCMBuffer objects through an AsyncSequence. source
- Structure output
- Structure analysis returns time ranges for sections, segments, and phrases. source
- Use cases
- Apple suggests beat-synced visuals, DJ catalog organization, and music-driven game animation as use cases. source
Checked against the maker's pages on 14 Nov 2026.