Loading…
Validate replication studies. Read, judge, earn points.
Enter your username and email and we will send you a sign-in link.
A few things have changed since your last visit.
Five worked examples: two are correct, three have errors typical of FLoRA's automated extraction. After each, you'll see whether you were right, and why.
It doesn't count toward the leaderboard, and you need to finish it to continue.
You've judged every available pair in this mode. Try the other mode.
| # | Study | Type | Outcome | Status | Validators | Skips | Agreement | Approved by | Approve | Review |
|---|
No entries match this filter.
FLoRA pipeline
Builds flora.csv from the source records, validates it, and
stores it as the dataset that Download full CSV and the public API serve. It also runs
nightly at 03:00 UTC. The repository copy (output/flora.csv on GitHub) is
updated after the nightly run; to update it sooner, start Publish FLoRA in the
repository's Actions tab.
flora.csv starts with id and id_md5,
then the reference columns in order; new records and columns are added at the end.
Loading run history…
| ID | Type | Original | Replication / Reproduction | Outcome | Status | Reviewed |
|---|
No records match this filter.
output/flora.csv) after the next
nightly run.| # | Validator | Level ? | Joined | Records ? | Avg time ? | Median ? | Min | Max | Flagged ? | Approved ? | Last login | DM ? |
|---|
No data yet.
Loading…
Loading…
Extractor pipeline
Every night at 02:00 UTC the app imports flora-extractor's latest
extracted.csv. You can also run it now.
Fetches the extractor's latest CSV and counts the pairs added and dropped since the last import. Nothing is deleted in this step.
New pairs become records to validate and changed ones are updated. A read-only report counts the records the CSV no longer lists.
Records the extractor lists as withdrawn are
removed if nobody has worked on them, after a copy is saved in
retired_records. Anything a validator touched is only flagged.
Run full sync runs the same three steps. A large import can take half an hour; you can leave this page.
History
Loading run history…
FLoRA dataset
Built from the current source records: outcomes derived, DOIs cleaned, exclusions and duplicate rulings applied. Open a record to correct it; source records stay as imported. A record keeps the ID of the source record it was first built from, even if a duplicate ruling later changes its source. Pipeline runs and their reports are under Source Records.
| Record ID | Source | Type | Original | Replication / Reproduction | Outcome |
|---|
No records match this filter.
Each pair may be one paper under two DOIs, usually a preprint and its published version. Compare the authors, years and DOIs, then choose.
output/flora.csv) after the next nightly run.Loading…
Loading…
Select a conversation to view messages.
Each admin has their own handle and password, and their approvals carry their handle. New admins get a single-use invitation link and set their own password.
Only trusted admins can add or remove admin accounts.
Show an urgent message to every signed-in validator. Clear banner removes it.
Flora Validator isn't built for phones yet. Use a desktop or laptop.
Calibration done. You can start validating.
Take your time, and skip anything that's unclear.
Enter the email address you registered with and we'll send your username to your inbox.
You can request this up to twice a day. Check your spam folder if it doesn't arrive within a few minutes.
Loading…
Loading…
Loading…
Loading…
Each judgement stays on this device until it is saved, its record is released or closed, or you discard it.
↳ Export JSON saves a local copy; it doesn't submit or remove anything.
You've been inactive for a while.
You'll be signed out in 5:00. Your work is saved and resumes when you sign back in.
Loading…
Your account was created with a personal code. Enter it once and choose the email address you'll sign in with. Your points and history stay as they are.
For FLoRA administrators. Validators sign in on the main screen.