From 899a8d0c4b18dc3c8ab92914d8cc9166e14dfadd Mon Sep 17 00:00:00 2001 From: Martin Polanka Date: Tue, 9 Aug 2016 18:06:56 +0200 Subject: [PATCH] judges --- Tasks.md | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/Tasks.md b/Tasks.md index 98d39fa..473379c 100644 --- a/Tasks.md +++ b/Tasks.md @@ -36,7 +36,11 @@ Basic information about tasks is on [Assignments overview](https://github.com/Re ## Judges -Judges are treated as normal external command, so there is no special task for them. All judges are adopted from old Codex with only very small modifications. Judges base directory is in `${JUDGES_DIR}` variable, which can be used in job config file. +Judges are treated as normal external command, so there is no special task for them. They should be used for comparision of outputted files from execution tasks and sample outputs. Results of this comparision should be at least information if files are same or not. Extension for this is percentual results based on similarity of given files. + +All packed judges are adopted from old Codex with only very small modifications. ReCodEx judges base directory is in `${JUDGES_DIR}` variable, which can be used in job config file. + +### Judges interface For future extensibility is **critical** that judges have some shared **interface** of calling and return values. - Parameters: There are two mandatory positional parameters which has to be files for comparision @@ -48,6 +52,10 @@ For future extensibility is **critical** that judges have some shared **interfac - exitcode: 1 - stderr: there should be description of error +### ReCodEx judges + +Below is list of judges which is packed with ReCodEx project and comply above requirements. + **recodex-judge-normal** is base judge used by most of exercises. This judge compares two text files. It compares only text tokens regardless amount of whitespace between them. ``` Usage: recodex-judge-normal [-r | -n | -rn]