RESEARCH BRIEF 05 / 30
Systematic evidence synthesis without cherry-picked sources
Research question
What constitutes a defensible synthesis of rapidly changing digital research when convenient search results disagree?
Proposed research protocol
Frame a review question using population/context, intervention or exposure, comparator and outcomes. Preregister inclusion criteria, eligible time window, search syntax and screening workflow. Search multiple bibliographic indexes and inspect backward/forward citations. Apply duplicate-independent screening to a subset or all records where resources permit; record disagreements and adjudication rules.
Analytical framework and study design
Extract study design, denominator, outcome measurement, funding and risk-of-bias factors into a machine-readable table. Synthesize comparable effect measures only after checking heterogeneity and design compatibility; otherwise present a structured narrative map. Use explicit inclusion dates and do not mix an updated preprint with an older peer-reviewed estimate as if identical.
Validation, reporting and acceptance evidence
Report the search date, database names, deduplication counts, screened records, exclusions with reasons and a PRISMA-style flow record. Provide a reproducible search strategy and an uncertainty table that separates consensus, conflicting evidence and evidence gaps.
Limitations and responsible interpretation
PRISMA governs transparent reporting, not guaranteed correctness or formal certification. Do not represent a curated reading list as a systematic review without performing the promised workflow.
Methodological references
RESEARCH BRIEF 06 / 30
FAIR research data and provenance-aware publication
Research question
How should research records be structured so that third parties can re-use them without exposing confidential or personal information?
Proposed research protocol
Specify persistent identifiers, human- and machine-readable metadata, controlled units, instrument calibration, transformations and licensing restrictions at data creation. Record raw inputs and derived outputs separately. Maintain a provenance graph linking dataset revisions to code commits, analytical parameters, authorship approvals and publication versions.
Analytical framework and study design
Assess findability, accessibility under legitimate authorization, interoperability through documented schemas and reuse through explicit provenance. FAIR does not imply unrestricted openness: sensitive data may require controlled access and aggregate release. Introduce schema validation, unit tests for ranges and a documented procedure for de-identification and retention.
Validation, reporting and acceptance evidence
Test reproducibility by having a second reviewer independently regenerate an example figure or analysis from authorized inputs. Measure metadata completeness, broken links, unresolved units and time-to-reproduce. Deliver a data dictionary, provenance manifest and a rights-aware access policy.
Limitations and responsible interpretation
A perfect metadata score does not prove data accuracy; instruments and collection protocols still require independent validation. Rights and consent override convenience of data distribution.
Methodological references