Categoryexternal
MeasureDecision classification
TasksContract entailment and evidence identification
DifficultyDepends on the evaluated split and label mapping
ContractNLI asks whether a contract entails, contradicts, or does not mention a hypothesis. The original task also requires evidence spans that support the classification.
No model in the catalog has a published ContractNLI score.The benchmark is defined by ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.
About ContractNLI
What the benchmark measures and how its value is published, from the source’s own record.
What is ContractNLI?
ContractNLI is an external benchmark published by ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts. ContractNLI asks whether a contract entails, contradicts, or does not mention a hypothesis. The original task also requires evidence spans that support the classification. Its evaluation set is described by the source as contract entailment and evidence identification. The source rates its difficulty as depends on the evaluated split and label mapping.
How is ContractNLI scored?
Each model's result is published by ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts as decision classification. ModelScale prints that value exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
ModelScale