— text, options, correct answer, weight, critical flag, media binding.

Templates — preset bundles (Histology, Microbiology, NDT) for a quick start.

Click Preview to see how questions will look to the participant.

Critical question

Marking a question as critical means a wrong answer automatically makes the questionnaire unsatisfactory, regardless of the overall percentage.

Media binding

First add media on the scheme edit page (image / WSI viewer), then pick it in the question's media selector and choose its position (above, below, side, modal).

Don't forget to click Save after edits.

12:T448,

The coordinator runs calculation when all participants have submitted (or after the deadline). The calculation runs independently for each analyte.

Quantitative analytes

Robust statistics via Algorithm A (ISO 13528 §9)
Assigned value (consensus / reference / formulated)
Z-score, En, ζ-score depending on the chosen method
Outlier detection via Grubbs test

Qualitative analytes

Nominal: accuracy + confusion matrix
Binary: sensitivity, specificity, Cohen κ, F1
Ordinal: distance, weighted κ
Questionnaire: % score, problem-question detection

Approval

Calculation → status calculated
Coordinator reviews → Approve → approved
Publish results → participants see their grades → published

You can recalculate while the evaluation is not yet approved. After approval, all changes are logged in audit_log.

S-ILC