Skip to main content
ModelScale

Qwen3.8-27B

Alibaba · Open Weight · rank 39 · bench-align-v5

Self-hosted
Canonical idqwen3-8-27b
Overall score64.65
Context window262K tokens
Release date2026-08-05
Access typeOpen Weight
Blended $/1MUnavailable75% input / 25% output

Capability shape

Seven axes from the ranking source. A missing axis is drawn as a gap.

Capability evidence

Agentic82.4
Coding55.6
Knowledge47
Reasoning77.4
Multimodal & Grounded80
Instruction Following84.7
MathUnavailable

Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim.

Time to first token: latency to the first answer chunk (Artificial Analysis, via BenchLM). Reasoning models include thinking time, so values can run to tens or hundreds of seconds.

Evidence key: Observed

Runtime measurements
MeasurementValueObservedLast goodEvidence
Time to first token48.5 s2026-09-172026-09-17
Throughput45 tok/s2026-09-172026-09-17

Regional or per-endpoint measurements appear only when the API supplies them; none are modelled here.

Endpoint and price matrix

Every published price component, including cache reads and writes.

Price components
ComponentUSDEvidence
Input / 1M tokensUnavailable
Output / 1M tokensUnavailable
Cache read / 1M tokensUnavailable
Cache write / 1M tokensUnavailable
Blended / 1M (75% input / 25% output)Unavailable
Self-hosted listingQwen publishes Qwen3.8-27B under Apache-2.0 for self-hosting and has not published a first-party hosted token rate for the exact model. BenchLM represents the open-weight row as self-host/free-per-token before infrastructure costs. Qwen Cloud says hosted access is coming soon, so the pricing row does not inherit Qwen3.8 Max rates.No hosted token rate was published for this model, so its per-token price is unavailable rather than zero.

Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. This uses the same calculator as the cost simulator, so an unavailable applicable rate makes the example unavailable too.

Modelled monthly costUnavailableThe applicable input rate is unavailable.
Modelled tokensUnavailable
Open the simulatorChange this workload

Benchmark record

52 matched benchmark rows with their published value, unit, and provenance.

Knowledge

Knowledge benchmarks
BenchmarkValueTasksDifficultyProvenance
GPQA
Graduate-Level Google-Proof Q&A
89.2448 questionsGraduate levelGPQA: A Graduate-Level Google-Proof Q&A Benchmark
GPQA-D
GPQA Diamond
89.2Graduate-level science questionsGraduate levelTrinity-Large-Thinking: Scaling an Open Source Frontier Agent
HLE
Humanity's Last Exam
30.8Expert-level questionsFrontier expert levelHumanity's Last Exam
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index
33.9Cross-benchmark intelligence indexDisplay-only external referenceArtificial Analysis
AA-GPQA Diamond
Artificial Analysis GPQA Diamond
90.5Graduate-level science questionsGraduate-level science reasoningArtificial Analysis GPQA Diamond Benchmark Leaderboard
AA-HLE
Artificial Analysis Humanity's Last Exam
33.9Expert-level questionsFrontier expert reasoningArtificial Analysis Humanity's Last Exam Benchmark Leaderboard
AA-Omniscience Index
Artificial Analysis Omniscience Index
-10.0Knowledge questionsBroad factual knowledgeAA-Omniscience: Knowledge and Hallucination Benchmark
AA-Omniscience Accuracy
Artificial Analysis Omniscience Accuracy
15.6Knowledge questionsBroad knowledgeArtificial Analysis model benchmarks
AA-Omniscience Hallucination Rate
Artificial Analysis Omniscience Hallucination Rate
30.3Knowledge questionsFactualityArtificial Analysis model benchmarks
HLE w/o tools
Humanity's Last Exam without tools
30.8Expert-level questionsFrontier expert levelIntroducing GPT-5.4 mini and nano
GPQA Diamond (Vals)
GPQA Diamond, Vals AI run
88.9Graduate-level science questionsExpert reasoningVals AI GPQA Diamond, Vals AI run leaderboard
MMLU-Pro (Vals)
MMLU-Pro, Vals AI run
84.3Academic multiple-choice questionsBroad academic knowledgeVals AI MMLU-Pro, Vals AI run leaderboard

Coding

Coding benchmarks
BenchmarkValueTasksDifficultyProvenance
Terminal-Bench 2.1
Terminal-Bench 2.1 (provider run)
73.0Terminal-based software-agent tasksProfessional software engineeringDeepSeek V4 Flash 0731 update
LiveCodeBench v6
LiveCodeBench v6
90.3Fresh programming problemsCompetitive programming levelLiveCodeBench official repository and release documentation
SWE-bench Pro
SWE-bench Pro
61.71,865 repository problemsLong-horizon professional engineeringSWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
VulcanBench v3
VulcanBench v3
82.623 post-cutoff repository tasks in the v3 reportProfessional multi-file software engineeringVulcanBench
NL2Repo
NL2Repo
42.3Natural language to repository tasksSystem-level software comprehensionMiniMax M2.7: Early Echoes of Self-Evolution
AA Coding Index
Artificial Analysis Coding Index
68.1Cross-benchmark coding indexDisplay-only external referenceArtificial Analysis model leaderboards
AA-SciCode
Artificial Analysis SciCode
46.6Scientific coding subproblemsScientific programmingArtificial Analysis SciCode Benchmark Leaderboard
LiveCodeBench (Vals)
LiveCodeBench, Vals AI run
84.0Competitive programming problems (easy, medium, hard)Frontier codingVals AI LiveCodeBench, Vals AI run leaderboard
SWE-bench (Vals)
SWE-bench, Vals AI run
86.0Real repository issues by human time bucketFrontier coding agentsVals AI SWE-bench, Vals AI run leaderboard
DeepSWE
DeepSWE
42.2113 software engineering tasks across 91 repositories and 5 languagesLong-horizon software engineeringDeepSWE benchmark blog

Reasoning

Reasoning benchmarks
BenchmarkValueTasksDifficultyProvenance
AA-LCR
Artificial Analysis Long Context Reasoning
82.0Long-context reasoning tasksLong-context reasoningArtificial Analysis model benchmarks
MLCR-AA
Medical Long Context Reasoning (MLCR-AA)
21.7Long, fragmented medical-record reasoningLong-context medical reasoningMedical Long Context Reasoning (MLCR-AA)
CritPt
Critical Physics Tasks
5.4Research-level physics questionsResearch-level physics reasoningCritPt Benchmark Leaderboard

Instruction Following

Instruction Following benchmarks
BenchmarkValueTasksDifficultyProvenance
IFBench
Instruction Following Benchmark
79.5BenchLM

Agentic

Agentic benchmarks
BenchmarkValueTasksDifficultyProvenance
AA Briefcase
Artificial Analysis Briefcase
1398Professional knowledge-work tasksProfessional workArtificial Analysis Briefcase Benchmark Leaderboard
AA EnterpriseOps-Gym
Artificial Analysis EnterpriseOps-Gym
44.2Enterprise operations workflowsEnterprise agent operationsArtificial Analysis EnterpriseOps-Gym Benchmark Leaderboard
AA Tau3 Banking
Artificial Analysis Tau3-Banking
48.0Banking tool-use workflowsAgentic banking workflowsArtificial Analysis Tau3-Banking Benchmark Leaderboard
Terminal-Bench 2.1
Terminal-Bench 2.1 (provider run)
73.0Terminal-based software-agent tasksProfessional software engineeringDeepSeek V4 Flash 0731 update
GDPval-AA
GDPval-AA
1463Agentic real-world work tasksProfessional agentic workflowsDeepSeek-V4 Technical Report
GDPval-AA
GDPval-AA normalized
48.2Economically valuable tasksProfessional agentic workflowsArtificial Analysis model benchmarks
AA Agentic Index
Artificial Analysis Agentic Index
46.5Cross-benchmark agentic indexDisplay-only external referenceArtificial Analysis model leaderboards
GDP.pdf
Artificial Analysis GDP.pdf
16.4Professional document-production tasksProfessional knowledge workGDP.pdf Benchmark Leaderboard
OSWorld-Verified
OSWorld-Verified
84.3369 real-world computer tasks (361 when eight Google Drive tasks are excluded)Multi-step desktop and cross-application workflowsOSWorld
JobBench
JobBench
33.4130 tasks across 35 occupationsProfessional multi-source workflowsJobBench: Aligning Agent Work With Human Will
AndroidWorld
AndroidWorld
81.9Android app workflowsComplex mobile task completionGLM-5V-Turbo
Agents' Last Exam
Agents' Last Exam
42.9Agent tasksAdvanced agentic workDeepSeek V4 Flash 0731 update
CoWorkBench
CoWorkBench
70.7Long-horizon professional workflowsCross-domain professional workQwen3.8-Max: A New Bar for Coding and Cowork
WebArena-Verified
WebArena-Verified Browser Agent Benchmark
64.8812 verified tasks; separate 258-task Hard subsetAudited stateful browser workWebArena-Verified: A Fully Audited Benchmark for Web Agents
Terminal-Bench 2.1 (Vals)
Terminal-Bench 2.1, Vals AI run
58.4Difficult terminal tasksFrontier agenticVals AI Terminal-Bench 2.1, Vals AI run leaderboard

Multimodal & Grounded

Multimodal & Grounded benchmarks
BenchmarkValueTasksDifficultyProvenance
AA-MMMU-Pro
Artificial Analysis MMMU-Pro
76.3Multimodal academic reasoningFrontier multimodalArtificial Analysis MMMU-Pro Benchmark Leaderboard
MathVision w/ Python
MathVision with Python
94.6Visual mathematics problems with PythonAdvanced multimodal mathematicsKimi K3: Open Frontier Intelligence
BabyVision w/ Python
BabyVision with Python
85.6Visual perception tasks with PythonFine-grained visual perceptionKimi K3: Open Frontier Intelligence
OmniDocBench 1.5
OmniDocBench 1.5
91.1Document understanding tasksGrounded document reasoningIntroducing GPT-5.4 mini and nano
RealWorldQA
RealWorldQA
85.9Real-world visual question answeringGeneral visual reasoningQwen3.6 launch benchmarks
MathVision
MathVision
90.0Visually grounded math problemsAdvanced multimodal mathematicsQwen3.6 launch benchmarks
ERQA
ERQA
65.5Evidence-based visual QAGrounded multimodal reasoningQwen3.6 launch benchmarks
Vision2Web
Vision2Web
62.9Screenshot-to-web tasksMultimodal web generationGLM-5V-Turbo
CharXiv
CharXiv Reasoning
90.2Scientific chart reasoningScientific visualization reasoningCharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
CharXiv w/o tools
CharXiv Reasoning without tools
83.7Scientific chart reasoning (tool-free)Scientific visualization reasoningCharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
BabyVision
BabyVision
65.7Visual perception tasksFine-grained visual perceptionMuse Spark 1.1 Evaluation Report

Lifecycle and limitations log

Lifecycle events the source associates with this model, plus what this profile does not claim.

No lifecycle event references this model.

That is not evidence the model has no lifecycle plan — only that this source published none.

What this profile does not claimValues are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned — the attempt timestamp is in each badge. Last attempted fetch for this model’s score: 2026-09-17 17:17 UTC.