mirror of https://github.com/CharlesWiltgen/Axiom.git synced 2026-09-20 19:58:20 +08:00

Files

T

Charles Wiltgen 3105b1118b fix(axiom-media): correct what reviewing the fixes found, and sweep the docs pages

An independent review of the audit's own fixes found defects the fixes had
introduced or left behind, and the hand-written docs pages — which restate many
of the same claims and are not generated from the skills — had not followed the
corrections.

Fixes that were wrong or incomplete:

- The paused-player elapsed fix was correct only where it was measured.
  `playerTime(forNodeTime:)` returns nil whenever the player is not playing —
  paused, stopped, or never started — and falling back to the lock screen's
  dictionary republished the *previous item's* elapsed on a track change. It now
  keeps an app-owned value, reset when a new item loads.
- "Other request types, hand-pose among them, still succeed" is false: measured
  across eleven Vision requests, only hand-pose and text recognition run.
  Barcodes, animal, body pose, human rectangles, saliency and feature print all
  fail to build an inference context, and an order-reversed control on a second
  device showed the failure is request-specific, not context exhaustion.
- `teardownCommands()` was left defined and called from nowhere. Two
  `isEnabled = true` writes contradicted the file's own rule that registering a
  target enables a command by default. The Bluetooth option legend that produced
  a recording-recipe straddle still omitted that A2DP is output-only routing.
- Two citations pointed at the wrong guide page, one range omitted the page
  holding its section's last step, and one quoted a sentence the guide does not
  contain.

The docs sweep found fifteen stale claims across the pages mirroring this suite,
including the automatic-passthrough mechanism the audit disproved, a fabricated
`prepare()` timing figure, and a fabricated set of diagnostic percentages.

`photo-library`'s PNG/JPEG/HEIC split is now measured rather than asserted:
`Image.importedContentTypes()` and `exportedContentTypes()` are both
`["public.jpeg", "public.png"]`, with HEIC and HEIF absent.

Cursor, Codex, inlined-auditor and MCP distributions regenerated.

Verified: npm test (static validation clean).

2026-09-17 09:45:56 -07:00

5.0 KiB

Raw Permalink Blame History

name, description

name	description
avfoundation-ref	AVFoundation audio APIs — AVAudioSession categories/modes, iOS 27 async activation and deactivation notifications, AVAudioEngine pipelines and iOS 27 throwing engine APIs, bit-perfect DAC output, iOS 26+ spatial audio capture, ASAF/APAC, Audio Mix

AVFoundation Audio Reference

API reference for AVFoundation audio — AVAudioSession, AVAudioEngine, bit-perfect USB DAC output, iOS 26+ spatial audio, and the iOS 27 async session and throwing engine APIs. It's for developers building playback, recording, or audio-processing features who need exact API names and platform availability.

When to Use This Reference

Use this reference when:

Configuring audio session categories, modes, and options
Handling interruptions and route changes, or moving to the iOS 27 deactivation and resumption notifications
Building AVAudioEngine processing pipelines, taps, and format conversion
Fixing iOS 27 deprecation warnings on connect, play(), or installTap
Implementing USB DAC bit-perfect output
Adding iOS 26+ input selection UI or AirPods high-quality recording
Recording spatial audio or controlling Audio Mix

Example Prompts

Questions you can ask Claude that will draw from this reference:

"Which audio session category should a podcast player use?"
"How do I activate my audio session without blocking the main thread on iOS 27?"
"My interruption handler warns that InterruptionType is deprecated — what replaces it?"
"How do I tell whether the system or my app deactivated the audio session?"
"AVAudioEngine.connect is deprecated in iOS 27 — what do I use instead?"
"How do I read samples from the read-only buffer that installAudioTap delivers?"
"Can I write a realtime-safe AVAudioSourceNode render block in Swift?"
"How do I let users pick a microphone with AVInputPickerInteraction?"
"How do I record spatial audio with First Order Ambisonics?"

What's Covered

AVAudioSession

Categories (.ambient, .soloAmbient, .playback, .record, .playAndRecord, .multiRoute) and modes
Options (.mixWithOthers, .duckOthers, .allowBluetoothHFP, .allowBluetoothA2DP, .bluetoothHighQualityRecording, .defaultToSpeaker)
Interruption and route-change handling

Async activation and deactivation (iOS 27, not macOS)

activate(options:), deactivate(options:), AVAudioSessionDeactivationOptions.notifyOthersOnDeactivation
didBecomeActiveNotification, didBecomeInactiveNotification, resumptionRecommendationNotification
DeactivationContext, InterruptionContext, ResumptionContext
Typed messages — DidBecomeInactiveMessage (DeactivationResult), ResumptionRecommendationMessage
Deprecated InterruptionType / InterruptionOptions
AVAudioSession.Port.mediaDeviceExtension (iOS only)

AVAudioEngine

Node types, connections, and pipelines
Input taps and format conversion (AVAudioConverter)

Throwing engine and node APIs (iOS 27)

connectNode(_:to:format:) and bus/connection-point variants, playAudio(), playAudio(at:)
installAudioTap(onBus:bufferSize:format:tapProvider:), AVReadOnlyAudioPCMBuffer, channelData(_:)
connectMIDI(_:to:format:eventListProvider:), AVMIDIEventListBlock
AVAudioFormat.init(formatDescription:)
Realtime-safe render and receiver blocks (Objective-C and C only)
AVAudioUnitReverbPreset.outdoorGeneral

Bit-perfect output (USB DAC)

Hardware-rate rendering, asking for the source rate with setPreferredSampleRate(_:), USB DAC routing

iOS 26+ features

AVInputPickerInteraction
AirPods high-quality recording
Spatial audio capture (First Order Ambisonics), ASAF, APAC
Audio Mix with the Cinematic framework (CNAssetSpatialAudioInfo)

Documentation Scope

This page documents the avfoundation-ref skill in the axiom-media suite. It is a reference skill — a comprehensive API guide without mandatory workflows. The skill file holds the code examples and anti-patterns Claude uses when answering.

For AVFoundation video writing, export, and rendering, see AVFoundation Video
For camera and microphone capture sessions, see Camera Capture

AVFoundation Video – The video write/export/render counterpart to this audio reference
Camera Capture – AVCaptureSession setup, which also configures the audio session for spatial and AirPods recording
Now Playing – Lock Screen and Control Center metadata for background audio playback
Screen Capture – ScreenCaptureKit recording, which writes the AVFileType and codec types covered here
networking – Network.framework for streaming audio

Resources

WWDC: 2025-251, 2025-403, 2019-510

Docs: /avfoundation, /avfaudio/avaudiosession, /avfaudio/avaudioengine, /avkit, /cinematic

5.0 KiB Raw Permalink Blame History Unescape Escape