Threat+Constellation
Live— UTC

Execution · NO — NOT EXECUTED

Independent Evidence Validation

Can Evidence Boundaries Be Reproduced?

Inter-Rater Reliability, Epistemic Disagreement, and the Reproducibility of Institutional Accountability Assessment

Can independent researchers applying the same evidence definitions reach reproducible classifications of institutional knowledge, authority, feasibility, and accountability reviewability?

Protocol vrb-annotation-protocol/0.7. Agreement is not truth. Consensus is not independent verification. Unknown is a valid research outcome. Disagreement is evidence of interpretive variation, not necessarily reviewer failure. Methodological reliability is not execution authority. Local browser blinding is a workflow feature, not an adversarial security boundary. executionStatus remains NOT EXECUTED.

Record population

02 / Evidence Snapshot

Freezing public metadata and bounded claims…

    03 / Independent Annotation

    Enter a pseudonymous alias and start a local blinded session. Other reviewers' classifications remain hidden until finalization.

    04 / Session Export / Import

    File export is the supported recovery path. Local browser storage is a workflow convenience, not multi-user research infrastructure. Snapshot id vrb-public-evidence-pack-0.7.

    05 / Reliability Analysis

    Human reviewers 0
    Synthetic test reviewers 0
    AI-assisted reviewers 0
    Completed review REVIEW_NOT_STARTED

    NO EMPIRICAL RELIABILITY RESULT

    06 / Disagreement Register

    Peer classifications stay hidden until this independent review is finalized.

    07 / Adjudication

    Adjudication is stored separately. It does not rewrite independent annotations, promote claims to VERIFIED, or generate execution authority.

    08 / Research Limitations

    • This is a limited versioned validation dataset drawn from currently available public registry records.
    • It is not a representative sample of vulnerability response, institutions, or historical alternatives.
    • No genuine independent human annotations are included in the shipped dataset.
    • Synthetic fixtures exist only for engine tests and must not be reported as methodological validation.
    • Local browser storage is a workflow convenience, not multi-user research infrastructure.
    • sessionStorage is origin-scoped, not durable across browsers, and not an adversarial security boundary.
    • File export is the supported recovery and comparison path.
    • v0.7 has no authentication system and no remote persistence.