LiteRT Core ML delegate

The LiteRT Core ML delegate enables running LiteRT models on Core ML framework, which results in faster model inference on iOS devices.

Supported iOS versions and devices:

  • iOS 12 and later. In the older iOS versions, Core ML delegate will automatically fallback to CPU.
  • By default, Core ML delegate will only be enabled on devices with A12 SoC and later (iPhone Xs and later) to use Neural Engine for faster inference. If you want to use Core ML delegate also on the older devices, please see best practices

Supported models

The Core ML delegate currently supports float (FP32 and FP16) models.

Trying the Core ML delegate on your own model

The Core ML delegate is already included in nightly release of LiteRT CocoaPods. To use Core ML delegate, change your LiteRT pod to include subspec CoreML in your Podfile.