Loading page…
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
Loading page…
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
Jev 1.13.0 by TypeSafe AI is in the ModelScale catalog, with no published score, price or context window to report.
TypeSafe AI · Proprietary · bench-align-v5
Seven axes from the ranking source. A missing axis is drawn as a gap.
Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim.
Time to first token: latency to the first answer chunk (Artificial Analysis, via BenchLM). Reasoning models include thinking time, so values can run to tens or hundreds of seconds.
Evidence key: Unavailable
| Measurement | Value | Observed | Last good | Evidence |
|---|---|---|---|---|
| Time to first token | Unavailable | Unavailable | Unavailable | |
| Throughput | Unavailable | Unavailable | Unavailable |
Regional or per-endpoint measurements appear only when the API supplies them; none are modelled here.
Every published price component, including cache reads and writes.
10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. This uses the same calculator as the cost simulator, so an unavailable applicable rate makes the example unavailable too.
14 matched benchmark rows with their published value, unit, and provenance.
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| JevBench 1.4 JevBench 1.4 | 63.29 | 534 frozen v1.2 decisions plus 308 sealed v1.4 decisions | Typed decisions with sealed generalization tests | JevBench v1.4 method |
| JevBench 1.5 JevBench 1.5 | 72.13 | 904 open decisions plus 720 sealed decisions per complete run | Choice, Noul, and Score decisions with sealed generalization tests | JevBench v1.5 frozen method and disclosures |
Lifecycle events the source associates with this model, plus what this profile does not claim.
That is not evidence the model has no lifecycle plan — only that this source published none.
| Ambiguous-reference resolution |
| Depends on the sampled tasks and label mapping |
| Perplexity Decider v1 27B model card |
| FinancialPhraseBank (Perplexity panel) FinancialPhraseBank (Perplexity panel) | 76.98 | Financial sentiment classification | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| RAGTruth (Perplexity panel) RAGTruth (Perplexity panel) | 77.27 | Unsupported-claim detection | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| JudgeBench (Perplexity panel) JudgeBench (Perplexity panel) | 78.57 | Response-pair judgment | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| BBH (Perplexity panel) BBH (Perplexity panel) | 94.27 | Challenging reasoning tasks | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| JevBench public hard (Perplexity panel) JevBench public hard (Perplexity panel) | 73.27 | Public-hard decision accuracy | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| TabFact (Perplexity panel) TabFact (Perplexity panel) | 89.80 | Table-based fact verification | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| ContractNLI (Perplexity panel) ContractNLI (Perplexity panel) | 77.45 | Contract hypothesis classification | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| Circa (Perplexity panel) Circa (Perplexity panel) | 84.60 | Indirect yes/no answer interpretation | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| Belebele (Perplexity panel) Belebele (Perplexity panel) | 95.00 | Passage comprehension | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| TruthfulQA binary (Perplexity panel) TruthfulQA binary (Perplexity panel) | 92.00 | Binary truthfulness classification | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |
| Perplexity Decision Panel Perplexity Decision Panel | 84.51 | 11 decision task families | Depends on the sampled tasks and label mapping | Perplexity Decider v1 27B model card |