Execution · NO — NOT EXECUTED
- Overview
- Discovery Clock
- Institutional Clock
- Authority Surface
- Reversibility
- Decision Boundary
- Known Risk Dwell
- Friction
- Defender's Window
- Case Studies
- Comparison
- Evidence
- Trace
- Accountability
- Counterfactual
- Validation
- Readiness
- Methodology
- Theory
Independent Evidence Validation
Can Evidence Boundaries Be Reproduced?
Inter-Rater Reliability, Epistemic Disagreement, and the Reproducibility of Institutional Accountability Assessment
Can independent researchers applying the same evidence definitions reach reproducible classifications of institutional knowledge, authority, feasibility, and accountability reviewability?
Protocol vrb-annotation-protocol/0.7. Agreement is not truth. Consensus is not independent verification. Unknown is a valid research outcome. Disagreement is evidence of interpretive variation, not necessarily reviewer failure. Methodological reliability is not execution authority. Local browser blinding is a workflow feature, not an adversarial security boundary. executionStatus remains NOT EXECUTED.
Record population
02 / Evidence Snapshot
Freezing public metadata and bounded claims…
03 / Independent Annotation
Enter a pseudonymous alias and start a local blinded session. Other reviewers' classifications remain hidden until finalization.
04 / Session Export / Import
File export is the supported recovery path. Local browser storage is a workflow convenience, not multi-user research infrastructure. Snapshot id vrb-public-evidence-pack-0.7.
05 / Reliability Analysis
NO EMPIRICAL RELIABILITY RESULT
06 / Disagreement Register
Peer classifications stay hidden until this independent review is finalized.
07 / Adjudication
Adjudication is stored separately. It does not rewrite independent annotations, promote claims to VERIFIED, or generate execution authority.
08 / Research Limitations
- This is a limited versioned validation dataset drawn from currently available public registry records.
- It is not a representative sample of vulnerability response, institutions, or historical alternatives.
- No genuine independent human annotations are included in the shipped dataset.
- Synthetic fixtures exist only for engine tests and must not be reported as methodological validation.
- Local browser storage is a workflow convenience, not multi-user research infrastructure.
- sessionStorage is origin-scoped, not durable across browsers, and not an adversarial security boundary.
- File export is the supported recovery and comparison path.
- v0.7 has no authentication system and no remote persistence.