Model Compatibility

AgentNode Runtime tested against 246 models from 40 providers. 222 pass all 4 scenarios (90%).

Last tested: 2026-07-09. Models marked legacy were verified in an earlier batch and not re-tested in the latest run — still listed with their last known result, not removed.

246

Models Tested

222

Perfect Score (S-Tier)

Providers

90%

S-Tier Rate

Tier System

Perfect

4/4 scenarios passed

222

Great

3/4 scenarios passed

Partial

2/4 scenarios passed

Minimal

1/4 scenarios passed

Unsupported

0/4 scenarios passed

Test Scenarios

1Capabilities

Model calls agentnode_capabilities to list installed tools

2Search + Install

Model searches for a package, then installs it

3Run Tool

Model executes a tool with specific arguments

4Multi-step

Model chains multiple tool calls autonomously

All 40 tested providers are counted in the totals above. Providers whose tested models only returned API or execution errors are excluded from the visible table below, so fewer provider groups may appear here than the total number of providers tested.

246 of 246 models

Provider	Model	Tier	S1	S2	S3	S4	Score
~anthropic	claude-haiku-latest	S	✔	✔	✔	✔	4/4
~anthropic	claude-opus-latest	S	✔	✔	✔	✔	4/4
~anthropic	claude-sonnet-latest	S	✔	✔	✔	✔	4/4
~google	gemini-flash-latest	S	✔	✔	✔	✔	4/4
~moonshotai	kimi-latest	S	✔	✔	✔	✔	4/4
~openai	gpt-latest	S	✔	✔	✔	✔	4/4
~x-ai	grok-latest	S	✔	✔	✔	✔	4/4
aion-labs	aion-2.0	S	✔	✔	✔	✔	4/4
aion-labs	aion-3.0	S	✔	✔	✔	✔	4/4
aion-labs	aion-3.0-mini	S	✔	✔	✔	✔	4/4
amazon	nova-2-lite-v1legacy	S	✔	✔	✔	✔	4/4
amazon	nova-lite-v1legacy	S	✔	✔	✔	✔	4/4
amazon	nova-micro-v1legacy	S	✔	✔	✔	✔	4/4
amazon	nova-premier-v1legacy	S	✔	✔	✔	✔	4/4
amazon	nova-pro-v1legacy	S	✔	✔	✔	✔	4/4
anthropic	claude-3-haikulegacy	S	✔	✔	✔	✔	4/4
anthropic	claude-fable-5	S	✔	✔	✔	✔	4/4
anthropic	claude-haiku-4.5legacy	S	✔	✔	✔	✔	4/4
anthropic	claude-opus-4legacy	S	✔	✔	✔	✔	4/4
anthropic	claude-opus-4.1legacy	S	✔	✔	✔	✔	4/4
anthropic	claude-opus-4.5legacy	S	✔	✔	✔	✔	4/4
anthropic	claude-opus-4.6legacy	S	✔	✔	✔	✔	4/4
anthropic	claude-opus-4.7	S	✔	✔	✔	✔	4/4
anthropic	claude-opus-4.8	S	✔	✔	✔	✔	4/4
anthropic	claude-opus-4.8-fast	S	✔	✔	✔	✔	4/4
anthropic	claude-sonnet-4legacy	S	✔	✔	✔	✔	4/4
anthropic	claude-sonnet-4.5legacy	S	✔	✔	✔	✔	4/4
anthropic	claude-sonnet-4.6legacy	S	✔	✔	✔	✔	4/4
bytedance-seed	seed-1.6legacy	S	✔	✔	✔	✔	4/4
bytedance-seed	seed-1.6-flashlegacy	S	✔	✔	✔	✔	4/4
bytedance-seed	seed-2.0-litelegacy	S	✔	✔	✔	✔	4/4
bytedance-seed	seed-2.0-minilegacy	S	✔	✔	✔	✔	4/4
cohere	command-r-08-2024legacy	S	✔	✔	✔	✔	4/4
cohere	command-r-plus-08-2024legacy	S	✔	✔	✔	✔	4/4
cohere	north-mini-code:free	S	✔	✔	✔	✔	4/4
deepseek	deepseek-chatlegacy	S	✔	✔	✔	✔	4/4
deepseek	deepseek-chat-v3-0324legacy	S	✔	✔	✔	✔	4/4
deepseek	deepseek-chat-v3.1legacy	S	✔	✔	✔	✔	4/4
deepseek	deepseek-r1legacy	S	✔	✔	✔	✔	4/4
deepseek	deepseek-v3.1-terminuslegacy	S	✔	✔	✔	✔	4/4
deepseek	deepseek-v3.2legacy	S	✔	✔	✔	✔	4/4
deepseek	deepseek-v3.2-explegacy	S	✔	✔	✔	✔	4/4
deepseek	deepseek-v4-flash	S	✔	✔	✔	✔	4/4
google	gemini-2.5-flashlegacy	S	✔	✔	✔	✔	4/4
google	gemini-2.5-flash-lite	S	✔	✔	✔	✔	4/4
google	gemini-2.5-flash-lite-preview-09-2025	S	✔	✔	✔	✔	4/4
google	gemini-2.5-prolegacy	S	✔	✔	✔	✔	4/4
google	gemini-2.5-pro-preview	S	✔	✔	✔	✔	4/4
google	gemini-2.5-pro-preview-05-06	S	✔	✔	✔	✔	4/4
google	gemini-3-pro-image	S	✔	✔	✔	✔	4/4
google	gemini-3.1-flash-lite	S	✔	✔	✔	✔	4/4
google	gemini-3.1-flash-lite-preview	S	✔	✔	✔	✔	4/4
google	gemini-3.1-pro-preview-customtools	S	✔	✔	✔	✔	4/4
google	gemini-3.5-flash	S	✔	✔	✔	✔	4/4
google	gemma-4-26b-a4b-itlegacy	S	✔	✔	✔	✔	4/4
google	gemma-4-31b-itlegacy	S	✔	✔	✔	✔	4/4
ibm-granite	granite-4.1-8b	S	✔	✔	✔	✔	4/4
inception	mercury-2legacy	S	✔	✔	✔	✔	4/4
inclusionai	ling-2.6-1t	S	✔	✔	✔	✔	4/4
inclusionai	ring-2.6-1t	S	✔	✔	✔	✔	4/4
kwaipilot	kat-coder-pro-v2legacy	S	✔	✔	✔	✔	4/4
meta-llama	llama-3-8b-instructlegacy	S	✔	✔	✔	✔	4/4
meta-llama	llama-3.1-70b-instructlegacy	S	✔	✔	✔	✔	4/4
meta-llama	llama-3.1-8b-instructlegacy	S	✔	✔	✔	✔	4/4
meta-llama	llama-3.3-70b-instructlegacy	S	✔	✔	✔	✔	4/4
meta-llama	llama-4-mavericklegacy	S	✔	✔	✔	✔	4/4
meta-llama	llama-4-scoutlegacy	S	✔	✔	✔	✔	4/4
minimax	minimax-m1legacy	S	✔	✔	✔	✔	4/4
minimax	minimax-m2legacy	S	✔	✔	✔	✔	4/4
minimax	minimax-m2.1legacy	S	✔	✔	✔	✔	4/4
minimax	minimax-m2.5legacy	S	✔	✔	✔	✔	4/4
minimax	minimax-m2.7legacy	S	✔	✔	✔	✔	4/4
minimax	minimax-m3	S	✔	✔	✔	✔	4/4
mistralai	codestral-2508legacy	S	✔	✔	✔	✔	4/4
mistralai	devstral-2512legacy	S	✔	✔	✔	✔	4/4
mistralai	ministral-14b-2512legacy	S	✔	✔	✔	✔	4/4
mistralai	ministral-3b-2512legacy	S	✔	✔	✔	✔	4/4
mistralai	ministral-8b-2512legacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-largelegacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-large-2407legacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-large-2512legacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-medium-3legacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-medium-3-5	S	✔	✔	✔	✔	4/4
mistralai	mistral-medium-3.1legacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-nemolegacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-sabalegacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-small-2603legacy	S	✔	✔	✔	✔	4/4
mistralai	mistral-small-3.2-24b-instructlegacy	S	✔	✔	✔	✔	4/4
mistralai	mixtral-8x22b-instructlegacy	S	✔	✔	✔	✔	4/4
mistralai	voxtral-small-24b-2507legacy	S	✔	✔	✔	✔	4/4
moonshotai	kimi-k2legacy	S	✔	✔	✔	✔	4/4
moonshotai	kimi-k2-0905legacy	S	✔	✔	✔	✔	4/4
moonshotai	kimi-k2-thinking	S	✔	✔	✔	✔	4/4
moonshotai	kimi-k2.5legacy	S	✔	✔	✔	✔	4/4
moonshotai	kimi-k2.6	S	✔	✔	✔	✔	4/4
moonshotai	kimi-k2.7-code	S	✔	✔	✔	✔	4/4
nex-agi	nex-n2-mini	S	✔	✔	✔	✔	4/4
nex-agi	nex-n2-pro	S	✔	✔	✔	✔	4/4
nvidia	llama-3.3-nemotron-super-49b-v1.5legacy	S	✔	✔	✔	✔	4/4
nvidia	nemotron-3-nano-30b-a3blegacy	S	✔	✔	✔	✔	4/4
nvidia	nemotron-3-nano-omni-30b-a3b-reasoning:free	S	✔	✔	✔	✔	4/4
nvidia	nemotron-3-super-120b-a12b	S	✔	✔	✔	✔	4/4
nvidia	nemotron-3-ultra-550b-a55b	S	✔	✔	✔	✔	4/4
nvidia	nemotron-3-ultra-550b-a55b:free	S	✔	✔	✔	✔	4/4
openai	gpt-3.5-turbolegacy	S	✔	✔	✔	✔	4/4
openai	gpt-3.5-turbo-0613legacy	S	✔	✔	✔	✔	4/4
openai	gpt-3.5-turbo-16klegacy	S	✔	✔	✔	✔	4/4
openai	gpt-4legacy	S	✔	✔	✔	✔	4/4
openai	gpt-4-turbolegacy	S	✔	✔	✔	✔	4/4
openai	gpt-4.1legacy	S	✔	✔	✔	✔	4/4
openai	gpt-4.1-minilegacy	S	✔	✔	✔	✔	4/4
openai	gpt-4.1-nanolegacy	S	✔	✔	✔	✔	4/4
openai	gpt-4olegacy	S	✔	✔	✔	✔	4/4
openai	gpt-4o-2024-05-13legacy	S	✔	✔	✔	✔	4/4
openai	gpt-4o-2024-08-06legacy	S	✔	✔	✔	✔	4/4
openai	gpt-4o-2024-11-20legacy	S	✔	✔	✔	✔	4/4
openai	gpt-4o-minilegacy	S	✔	✔	✔	✔	4/4
openai	gpt-4o-mini-2024-07-18legacy	S	✔	✔	✔	✔	4/4
openai	gpt-5legacy	S	✔	✔	✔	✔	4/4
openai	gpt-5-codex	S	✔	✔	✔	✔	4/4
openai	gpt-5-minilegacy	S	✔	✔	✔	✔	4/4
openai	gpt-5-nanolegacy	S	✔	✔	✔	✔	4/4
openai	gpt-5-prolegacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.1legacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.1-chatlegacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.1-codex	S	✔	✔	✔	✔	4/4
openai	gpt-5.1-codex-max	S	✔	✔	✔	✔	4/4
openai	gpt-5.1-codex-mini	S	✔	✔	✔	✔	4/4
openai	gpt-5.2legacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.2-chatlegacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.2-codex	S	✔	✔	✔	✔	4/4
openai	gpt-5.3-chatlegacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.3-codex	S	✔	✔	✔	✔	4/4
openai	gpt-5.4legacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.4-minilegacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.4-nanolegacy	S	✔	✔	✔	✔	4/4
openai	gpt-5.5	S	✔	✔	✔	✔	4/4
openai	gpt-chat-latest	S	✔	✔	✔	✔	4/4
openai	gpt-oss-120blegacy	S	✔	✔	✔	✔	4/4
openai	gpt-oss-20blegacy	S	✔	✔	✔	✔	4/4
openai	gpt-oss-20b:free	S	✔	✔	✔	✔	4/4
openai	o1legacy	S	✔	✔	✔	✔	4/4
openai	o3legacy	S	✔	✔	✔	✔	4/4
openai	o3-minilegacy	S	✔	✔	✔	✔	4/4
openai	o3-mini-highlegacy	S	✔	✔	✔	✔	4/4
openai	o3-prolegacy	S	✔	✔	✔	✔	4/4
openai	o4-minilegacy	S	✔	✔	✔	✔	4/4
openai	o4-mini-highlegacy	S	✔	✔	✔	✔	4/4
openrouter	autolegacy	S	✔	✔	✔	✔	4/4
openrouter	freelegacy	S	✔	✔	✔	✔	4/4
poolside	laguna-m.1	S	✔	✔	✔	✔	4/4
poolside	laguna-xs-2.1	S	✔	✔	✔	✔	4/4
poolside	laguna-xs-2.1:free	S	✔	✔	✔	✔	4/4
poolside	laguna-xs.2	S	✔	✔	✔	✔	4/4
poolside	laguna-xs.2:free	S	✔	✔	✔	✔	4/4
qwen	qwen-2.5-72b-instructlegacy	S	✔	✔	✔	✔	4/4
qwen	qwen-2.5-7b-instructlegacy	S	✔	✔	✔	✔	4/4
qwen	qwen-pluslegacy	S	✔	✔	✔	✔	4/4
qwen	qwen-plus-2025-07-28legacy	S	✔	✔	✔	✔	4/4
qwen	qwen-plus-2025-07-28:thinking	S	✔	✔	✔	✔	4/4
qwen	qwen3-14blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-235b-a22blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-235b-a22b-2507legacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-30b-a3blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-30b-a3b-instruct-2507legacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-30b-a3b-thinking-2507	S	✔	✔	✔	✔	4/4
qwen	qwen3-32blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-8blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-coderlegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-coder-30b-a3b-instructlegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-coder-flashlegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-coder-nextlegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-coder-pluslegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-maxlegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-max-thinking	S	✔	✔	✔	✔	4/4
qwen	qwen3-next-80b-a3b-instructlegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3-next-80b-a3b-thinking	S	✔	✔	✔	✔	4/4
qwen	qwen3-vl-235b-a22b-instruct	S	✔	✔	✔	✔	4/4
qwen	qwen3-vl-235b-a22b-thinking	S	✔	✔	✔	✔	4/4
qwen	qwen3-vl-30b-a3b-instruct	S	✔	✔	✔	✔	4/4
qwen	qwen3-vl-30b-a3b-thinking	S	✔	✔	✔	✔	4/4
qwen	qwen3-vl-32b-instruct	S	✔	✔	✔	✔	4/4
qwen	qwen3-vl-8b-instruct	S	✔	✔	✔	✔	4/4
qwen	qwen3-vl-8b-thinking	S	✔	✔	✔	✔	4/4
qwen	qwen3.5-122b-a10blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3.5-27blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3.5-35b-a3blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3.5-397b-a17blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3.5-9blegacy	S	✔	✔	✔	✔	4/4
qwen	qwen3.5-flash-02-23legacy	S	✔	✔	✔	✔	4/4
qwen	qwen3.5-plus-02-15legacy	S	✔	✔	✔	✔	4/4
qwen	qwen3.5-plus-20260420	S	✔	✔	✔	✔	4/4
qwen	qwen3.6-27b	S	✔	✔	✔	✔	4/4
qwen	qwen3.6-35b-a3b	S	✔	✔	✔	✔	4/4
qwen	qwen3.6-flash	S	✔	✔	✔	✔	4/4
qwen	qwen3.6-max-preview	S	✔	✔	✔	✔	4/4
qwen	qwen3.6-plus	S	✔	✔	✔	✔	4/4
qwen	qwen3.7-max	S	✔	✔	✔	✔	4/4
qwen	qwen3.7-plus	S	✔	✔	✔	✔	4/4
relace	relace-searchlegacy	S	✔	✔	✔	✔	4/4
stepfun	step-3.5-flashlegacy	S	✔	✔	✔	✔	4/4
stepfun	step-3.7-flash	S	✔	✔	✔	✔	4/4
tencent	hy3	S	✔	✔	✔	✔	4/4
tencent	hy3-preview	S	✔	✔	✔	✔	4/4
tencent	hy3:free	S	✔	✔	✔	✔	4/4
upstage	solar-pro-3legacy	S	✔	✔	✔	✔	4/4
x-ai	grok-4.20legacy	S	✔	✔	✔	✔	4/4
x-ai	grok-build-0.1	S	✔	✔	✔	✔	4/4
xiaomi	mimo-v2.5	S	✔	✔	✔	✔	4/4
xiaomi	mimo-v2.5-pro	S	✔	✔	✔	✔	4/4
z-ai	glm-4.5legacy	S	✔	✔	✔	✔	4/4
z-ai	glm-4.5-airlegacy	S	✔	✔	✔	✔	4/4
z-ai	glm-4.5vlegacy	S	✔	✔	✔	✔	4/4
z-ai	glm-4.6legacy	S	✔	✔	✔	✔	4/4
z-ai	glm-4.6vlegacy	S	✔	✔	✔	✔	4/4
z-ai	glm-4.7legacy	S	✔	✔	✔	✔	4/4
z-ai	glm-4.7-flashlegacy	S	✔	✔	✔	✔	4/4
z-ai	glm-5legacy	S	✔	✔	✔	✔	4/4
z-ai	glm-5-turbolegacy	S	✔	✔	✔	✔	4/4
z-ai	glm-5.1	S	✔	✔	✔	✔	4/4
z-ai	glm-5.2	S	✔	✔	✔	✔	4/4
z-ai	glm-5v-turbolegacy	S	✔	✔	✔	✔	4/4
~openai	gpt-mini-latest	A	✔	✔	✔	✖	3/4
anthropic	claude-sonnet-5	A	✔	✖	✔	✔	3/4
arcee-ai	trinity-large-thinking	A	✔	✖	✔	✔	3/4
deepseek	deepseek-r1-0528legacy	A	✔	✖	✔	✔	3/4
deepseek	deepseek-v4-pro	A	✔	✖	✔	✔	3/4
google	gemini-3-flash-preview	A	✔	✖	✔	✔	3/4
google	gemini-3.1-pro-preview	A	✔	✖	✔	✔	3/4
inclusionai	ling-2.6-flash	A	✔	✔	✖	✔	3/4
nvidia	nemotron-3-nano-30b-a3b:free	A	✔	✖	✔	✔	3/4
nvidia	nemotron-3-super-120b-a12b:free	A	✔	✖	✔	✔	3/4
nvidia	nemotron-nano-9b-v2:free	A	✔	✔	✔	✖	3/4
poolside	laguna-m.1:free	A	✔	✖	✔	✔	3/4
rekaai	reka-edgelegacy	A	✔	✖	✔	✔	3/4
openai	gpt-oss-safeguard-20blegacy	B	✔	✖	✔	✖	2/4
ai21	jamba-large-1.7legacy	C	✔	✖	✖	✖	1/4
arcee-ai	trinity-minilegacy	C	✖	✔	✖	✖	1/4
google	gemma-3-27b-it	C	✖	✔	✖	✖	1/4
nvidia	nemotron-nano-12b-v2-vl:free	C	✔	✖	✖	✖	1/4
openai	gpt-oss-120b:free	C	✔	✖	✖	✖	1/4
qwen	qwen3-235b-a22b-thinking-2507	C	✔	✖	✖	✖	1/4
google	gemma-3-12b-it	F	✖	✖	✖	✖	0/4
google	gemma-4-26b-a4b-it:free	F	✖	✖	✖	✖	0/4
openai	gpt-audio	F	✖	✖	✖	✖	0/4
thedrummer	unslopnemo-12b	F	✖	✖	✖	✖	0/4

Methodology

Every model is tested through OpenRouter using the OpenAI-compatible API format. Each model runs 4 real tool-calling scenarios against a live AgentNode Runtime instance with actual registered tools.

A scenario passes when the model calls all expected tools with correct arguments and produces a coherent response. No mocking, no simulated tool calls. The model must generate valid function calls that the runtime can execute.

Models that return API errors (rate limits, unavailable, etc.) are excluded from the matrix and not counted in any tier.

Works with your model

90% of all tested models achieve perfect compatibility. Pick any model from your provider and start building.

Runtime Docs Get Started