From 7fb69a1b8a3e377ff1f51051f3487233458f18aa Mon Sep 17 00:00:00 2001 From: Martin Polanka Date: Sat, 17 Mar 2018 23:08:53 +0100 Subject: [PATCH] exercise vs assignment --- FAQ.md | 23 ++++++++++++----------- 1 file changed, 12 insertions(+), 11 deletions(-) diff --git a/FAQ.md b/FAQ.md index a247d07..8399de8 100644 --- a/FAQ.md +++ b/FAQ.md @@ -8,7 +8,6 @@ Make sure you refresh your browser cache (`Ctrl+F5`) before logging in, especial Sometimes a component on a page does not refresh itself correctly. The application is a complex system of components and is still under development. If you make an action and do not see the results in a reasonable while, refresh the page. - ## How to register into ReCodEx and what method should I use? ReCodEx provides multiple ways for a user to register and log in. Currently there are two options: a **local** ReCodEx account or an account bound to the **CAS** service. The preferred way of registration and authentication is using the CAS service and using a local account only in special circumstances. CAS authentication provides more features, such as automatic binding of users to **SIS** groups. @@ -21,12 +20,6 @@ The system's login mechanism is prepared for this option. The only prerequisite User can create local account in the profile **Settings** page. In here if you are registered using external account and not local one, you should see **Create local account** button. After clicking on it local login _without_ password will be created. Next thing you have to set your password to newly created local login (Current password leave blank). -## As a supervisor I want to see more detailed logs of user submissions - -Before we start let us define **debug** vs. **regular** submissions. The results of a debug submission contain evaluation results, the execution log and the outputs of executed programs. And the results of a regular submission contain only the results needed for proper assignment of points (aka. evaluation results). - -With this being said, all submissions made by students for an assignment are regular and even submissions of reference exercise solutions are regular. As a supervisor you should be able to do something called resubmitting a user solution; this feature should be available on every page of a particular submission. On resubmitting, debug outputs and execution log are turned on by default and can be found in the results archive. Please note that resubmitting all solutions for an assignment is just a regular submission without debug information. - ## C# Reader In **C#** language there are none of the handy functions to operate with textual inputs like _scanf_ in **C**. Therefore for every C# build in ReCodEx there is [Reader.cs](https://github.com/ReCodEx/utils/blob/master/runners/cs/Reader.cs) library included to make life of C# programmers easier. Please note that library is suppose to work only with ASCII files and some difficulties can be observed with modern Unicode (UTF-8) encodings. @@ -35,6 +28,18 @@ In **C#** language there are none of the handy functions to operate with textual For some particular languages ReCodEx provides mappings of exit codes from internal runners to messages. Full tables of codes can be found on [separate page](https://github.com/ReCodEx/wiki/wiki/Exit-Code-Mappings). +## Exercise vs. Assignment + +Exercise and assignment are two terms which are not the same and there are some differences. Exercises are algorithmic problems defined and configured by supervisors. Exercise contains test cases which executes solutions submitted by users and check their outputs against sample results. Configuration of exercise also defines limits which solution should meet and scoring details which are used on evaluation. Exercise itself cannot be solved by students and is displayed only to supervisors. + +If supervisor assigns exercise to the group of students the exercise become assignment. Assignment can define some further details like number of points which can students gain or deadlines which should be met. But mainly assignment is full copy of the exercise, that means if configuration of exercise is changed, assignment will stay the same as when it was assigned. This behavior was chosen to avoid unnecessary broken assignments in case exercise would get broken by its author. + +## As a supervisor I want to see more detailed logs of user submissions + +Before we start let us define **debug** vs. **normal** submissions. The results of a debug submission contain evaluation results, the execution log and the outputs of executed programs. And the results of a normal submission contain only the results needed for proper assignment of points (aka. evaluation results). + +With this being said, all submissions made by students for an assignment are normal and even submissions of reference exercise solutions are normal. As a supervisor you should be able to do something called resubmitting of a user solution; this feature should be available on every page of a particular submission. On resubmitting, debug outputs and execution log are turned on by default and can be found in the results archive. Please note that resubmitting all solutions for an assignment is just a normal submission without debug information. + ## How to write Custom Judges ReCodEx provides a few initial judges programs. They are mostly adopted from @@ -67,7 +72,3 @@ implemented: The additional double value is saved to the results file and can be used for score calculation in the frontend. If just the basic judge is used, the values are 1.0 for exit code 0 and 0.0 for exit code 1. - -If more values are needed for score computation, multiple judges can be used in -sequence and the values used together. However, extended judge interface should -comply most of possible use cases. \ No newline at end of file