Login to follow
Local LLM Plugin

Local LLM Plugin (ODC)

Stable version 1.0.0 (Compatible with ODC)
Uploaded on 11 May (4 weeks ago) by OutSystems Labs
Local LLM Plugin

Local LLM Plugin (ODC)

Details
Detailed Description

Note: OutSystems Labs Plugin. This is an experimental plugin, it is NOT a supported component.

The Local LLM Plugin gives your application the ability to run AI language model inference directly on the user's device, using Apple Intelligence on iOS and Gemini Nano on Android. Because all processing happens on-device, no data is sent over the network, ensuring user privacy and enabling AI features without an internet connection.

With this plugin you can:

  • Monitor the on-device AI availability in real time
  • Pre-initialize the model to reduce first-response latency
  • Generate text responses from natural-language prompts
  • Maintain multi-turn conversations using session management
  • Generate images from text prompts (iOS only)

This plugin is only compatible with Capacitor.

The plugin requires device-level AI support, which not all mobile devices possess. More information is available in the Limitations section.

Limitations

General

  • Experimental plugin; no support provided.
  • Not all devices support on-device AI. Call SystemAvailability before using other features.

iOS

  • Prompt requires iOS 26+ and an Apple Intelligence device. More info.
  • GenerateImage requires iOS 18.4+.
  • Apple Intelligence must be enabled by the user; the plugin cannot enable it.
  • Context limited to 4096 tokens.
  • Download is unavailable on iOS.

Android

  • Requires a device with AI hardware. More info
  • Output capped at 256 tokens per response.
  • Inference while the app is in background is not supported.
  • Inference quota enforced; exceeding it may return an error.
  • Context does not survive app restarts; the app must persist history if needed.
  • GenerateImage is unavailable on Android.
License

MIT License

Copyright (c) 2026 OutSystems