Supported AI Models on AI for Process

The AI for Process offers flexible orchestration and runtime support for a wide range of AI Models across leading providers. Whether you're building real-time assistants or background workflows, you can choose from Platform-hosted, open-source, externally integrated, or third-party models to meet your needs.

Supported Open-Source Models

AI for Process supports over thirty open-source models and provides them as a service. Platform-hosted models can be optimized prior to deployment, making them ideal for private environments or specialized applications.

The supported models and their variants are given below:

Model Provider	Model Variant
Amazon	amazon/MistralLite
Argilla	argilla/notus-7b-v1 argilla/notux-8x7b-v1
DeepSeek	deepseek-ai/DeepSeek-R1-Distill-Llama-8B deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B deepseek-ai/DeepSeek-R1-Distill-Qwen-14B deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
Eleutherai	EleutherAI/gpt-j-6b EleutherAI/gpt-neo-1.3B EleutherAI/gpt-neo-125m EleutherAI/gpt-neo-2.7B EleutherAI/gpt-neox-20b
Facebook	facebook/opt-1.3b facebook/opt-2.7b facebook/opt-350m facebook/opt-6.7b
Google	google/flan-t5-base google/flan-t5-large google/flan-t5-small google/flan-t5-xl google/flan-t5-xxl google/gemma-2-27b-it google/gemma-2-9b-it google/gemma-2b google/gemma-2b-it google/gemma-3-12b-it google/gemma-7b google/gemma-7b-it
Helsinki-nlp	Helsinki-NLP/opus-mt-es-en
Huggingfaceh4	HuggingFaceH4/zephyr-7b-alpha HuggingFaceH4/zephyr-7b-beta
Meta-llama	meta-llama/Llama-2-13b-hf meta-llama/Llama-2-7b-hf meta-llama/Llama-3.2-1B meta-llama/Llama-3.2-1B-Instruct meta-llama/Llama-3.2-3B meta-llama/Llama-3.2-3B-Instruct meta-llama/Llama-3.2-11B-Vision-Instruct meta-llama/Llama-Guard-4-12B meta-llama/Meta-Llama-3-8B meta-llama/Meta-Llama-3-8B-Instruct meta-llama/Meta-Llama-3.1-8B meta-llama/Meta-Llama-3.1-8B-Instruct
Microsoft	microsoft/phi-1 microsoft/phi-1_5 microsoft/phi-2 microsoft/Phi-3-medium-128k-instruct microsoft/Phi-3-medium-4k-instruct microsoft/Phi-3-mini-128k-instruct microsoft/Phi-3-mini-4k-instruct
Mistralai	mistralai/Mistral-7B-Instruct-v0.1 mistralai/Mistral-7B-Instruct-v0.2 mistralai/Mistral-7B-Instruct-v0.3 mistralai/Mistral-7B-v0.1 mistralai/Mistral-Nemo-Instruct-2407 mistralai/Mixtral-8x7B-Instruct-v0.1 mistralai/Mixtral-8x7B-v0.1
OpenAI	GPT2
OpenAI Community	openai-community/gpt2-large openai-community/gpt2-medium openai-community/gpt2-xl
Stable Diffusion	stabilityai/stable-diffusion-xl-base-1.0 stabilityai/stable-diffusion-2-1 stable-diffusion-v1-5/stable-diffusion-v1-5 (Available only in the text-to-image node, No Prompt Studio support.)
T5	t5-base t5-large t5-small
Tiiuae	tiiuae/falcon-40b tiiuae/falcon-40b-instruct tiiuae/falcon-7b tiiuae/falcon-7b-instruct tiiuae/falcon-rw-1b
Xiaomi	Mimo-7B--VL-RL

Supported Models for Structured Output

Kore-hosted open-source models can produce structured JSON responses, making outputs consistent and easy to parse.

• Structured output support depends on the optimization technique used: No optimization or vLLM.
• Models optimized with CT2, fine-tuned models, Hugging Face imports, and locally imported models are not supported.

The following table lists the models that support structured JSON output:

Model Name	vLLM	No Optimization
amazon/MistralLite	❌	✅
argilla/notus-7b-v1	❌	✅
EleutherAI/gpt-j-6b	❌	✅
facebook/opt-1.3b	✅	✅
facebook/opt-2.7b	✅	✅
facebook/opt-350m	✅	✅
facebook/opt-6.7b	✅	✅
google/gemma-2b	❌	✅
google/gemma-2b-it	❌	✅
google/gemma-7b	❌	✅
google/gemma-7b-it	❌	✅
HuggingFaceH4/zephyr-7b-alpha	❌	✅
HuggingFaceH4/zephyr-7b-beta	❌	✅
meta-llama/Llama-2-7b-chat-hf	❌	❌
meta-llama/Llama-2-7b-hf	❌	✅
meta-llama/Llama-3.2-1B	✅	❌
meta-llama/Llama-3.2-1B-Instruct	✅	❌
meta-llama/Llama-3.2-3B	✅	❌
meta-llama/Llama-3.2-3B-Instruct	✅	❌
meta-llama/Meta-Llama-3-8B	✅	✅
meta-llama/Meta-Llama-3-8B-Instruct	❌	✅
meta-llama/Meta-Llama-3.1-8B	✅	✅
meta-llama/Meta-Llama-3.1-8B-Instruct	❌	✅
microsoft/Phi-3-medium-128k-instruct	❌	✅
microsoft/Phi-3-medium-4k-instruct	❌	✅
microsoft/Phi-3-mini-128k-instruct	✅	✅
microsoft/Phi-3-mini-4k-instruct	❌	✅
microsoft/phi-1	❌	✅
microsoft/phi-1_5	❌	✅
microsoft/phi-2	✅	✅
mistralai/Mistral-7B-Instruct-v0.1	❌	✅
mistralai/Mistral-7B-Instruct-v0.2	❌	✅
mistralai/Mistral-7B-Instruct-v0.3	✅	✅
mistralai/Mistral-7B-v0.1	❌	✅
openai-community/gpt2-large	❌	✅
openai-community/gpt2-medium	❌	✅
openai-community/gpt2-xl	❌	✅
tiiuae/falcon-7b	❌	✅
tiiuae/falcon-7b-instruct	❌	✅
tiiuae/falcon-rw-1b	✅	✅

Supported External Models for Easy Integration

With Easy Integration, you can quickly connect to external model providers, such as OpenAI, Anthropic, Google, Cohere, and Amazon Bedrock. No infrastructure setup is needed—just authenticate and start deploying models.

Here is the list of all the external models supported in AI for Process:

Model Provider	Model Variant
Anthropic	claude-3-5-sonnet-20240620 claude-3-haiku-20240307 claude-3-opus-20240229 claude-3-sonnet-20240229 claude-2.1 claude-2.0 claude-3-7-sonnet-20250219 claude-3-5-sonnet-20241022 claude-3-5-haiku-20241022 claude-sonnet-4-20250514 claude-opus-4-20250514 claude-opus-4-1-20250805 Claude Sonnet Vision (Available only for the Image-to-text node, No Prompt Studio support.)
Azure Open AI	GPT-4 GPT-3.5-Turbo GPT-4o-Mini GPT-4o GPT-4.1 GPT-4.1-mini GPT-4.1-nano GPT-4.5-preview O1-Mini O1 O3-Mini
Cohere	command-light-nightly command-light command command-nightly
Google	gemini-1.5-flash-latest gemini-1.5-pro gemini-1.0-pro gemini-2.5-Pro gemini-2.0-flash gemini-2.0-flash-lite gemini-2.5-flash-preview-05-20 gemini-2.5-flash
Open AI	gpt-4o gpt-4o-mini gpt-3.5-turbo gpt-3.5-turbo-1106 gpt-4-0613 o1-preview o1-mini o3-mini gpt-4-0125-preview gpt-4-turbo-preview gpt-4-1106-preview gpt-5-2025-08-07 gpt-5-nano-2025-08-07 gpt-5-mini-2025-08-07 gpt-5-chat-latest gpt-4 whisper (Available only for the Audio-to-text node, No Prompt Studio support.) whisper-1 gpt-4o-realtime-preview gpt-4o-mini-realtime-preview gpt-4.1-2025-04-14 gpt-4.1-mini-2025-04-14 gpt-4.1-nano-2025-04-14 gpt-4.5-preview-2025-02-27 dall-e-3 dall-e-2 text-embedding-3-small text-embedding-3-large text-embedding-ada-002

Send Feedback