Endpoint Compliance Claims and Evidence Consistency Evaluation Dataset
- Records
- 7520
- Size
- 0.4GB
- Format
- JSON
- Provider
MOBIUSI INC- Updated
- v1.02026-11-05
This benchmark dataset contains JSON records of endpoint compliance claims alongside related configuration check results, telemetry observations, and audit evidence. It evaluates whether the available evidence supports each claim, including cases with missing or incomplete evidence and conflicts across sources. Designed for evidence-based verification rather than classification of claim fields alone, it supports automated consistency evaluation in endpoint management, digital workplace, and security compliance workflows.
Overview
Dataset Insights
Preview
Sample Examples
Schema
Technical Specifications
| Field | Type | Description |
|---|---|---|
| file_name | string | File name |
| audit_evidence | object | Available audit records relevant to the compliance claim; this source may be absent or incomplete. |
| contradictions | array | Conflicts among the claim, configuration checks, telemetry observations, and audit records. |
| claim_supported | boolean | Whether the available evidence positively supports the compliance claim. |
| compliance_claim | object | The original endpoint compliance conclusion and its identifying context. |
| missing_evidence | array | Evidence items or source details needed for verification that are absent from the input record. |
| assessment_status | string | An evidence-based assessment of whether the available inputs support the claimed compliance status. |
| telemetry_evidence | object | Available endpoint telemetry observations used as evidence; the object or its observations may be absent. |
| assessment_rationale | string | A concise explanation connecting the available evidence, evidence gaps, or contradictions to the assessment status. |
| conclusion_alignment | string | How the available evidence aligns with the stated compliance conclusion. |
| configuration_checks | array | Available configuration check results. This source may be absent or incomplete when evidence is missing. |
| evidence_completeness | string | The assessed completeness of the evidence needed to verify the claim. |
Trust
Compliance Statement
Authorization Type
Proprietary - Commercial AI Training License (No Redistribution)
Commercial Use
Requires exclusive subscription or authorization contract (monthly or per-invocation charging)
Privacy and Anonymization
No PII, no real company names, simulated scenarios follow industry standards
Compliance System
Compliant with China's Data Security Law / EU GDPR / supports enterprise data access logs
FAQ
Frequently Asked Questions
- What does the dataset contain?
- Records include endpoint compliance claims, configuration check results, telemetry evidence, audit records, and assessments of evidence completeness, claim support, contradictions, and rationale. Evidence sources may be missing or incomplete in some records, which is part of the evaluation.
- Which capabilities does the benchmark evaluate?
- It evaluates whether a model can determine if available evidence supports a compliance claim, identify insufficient or missing evidence and conflicts across sources, and provide an assessment grounded in the evidence rather than merely classifying claim text.
- What are the intended use cases?
- The dataset is suited to compliance verification, configuration auditing, security posture assessment, and automated evaluation or quality assurance of compliance-checking models in endpoint management and digital workplace environments.
- How can I access the dataset, and what are the licensing terms?
- Check the current product listing or contact the data provider for availability, access procedures, and licensing terms, including any commercial-use conditions. The records use a JSON structure; access methods and permitted uses are determined by the applicable listing or provider terms.
Can't find the data you need?
Post a request and let data providers reach out to you.
Get this Dataset
High-quality data, ready for your next AI breakthrough.
Cite this Work
@dataset{Mobiusi2026,
title={Endpoint Compliance Claims and Evidence Consistency Evaluation Dataset},
author={MOBIUSI INC},
year={2026},
url={https://www.mobiusi.com/datasets/67bec093ab58354954ba2c083719ea6b?dataset_task_cate_id=1},
urldate={2026-10-22},
keywords={endpoint compliance dataset,compliance claim verification,evidence consistency benchmark,endpoint management data,configuration check data,telemetry evidence analysis,audit evidence verification,automated compliance evaluation},
version={1.0}
}Using this in research? Please cite us.