Test cases
The VPL 1.4 incorporates a feature to facilitate the evaluation of student's submissions. This feature allows to run the student program and check its output for a given input. To set up the evaluation cases you must populate the file "vpl_evaluate.cases".
The file "vpl_evaluate.cases" has the following format:
- "case = Description of case": Optional. Set an start of test case definition.
- "input = text": can use several lines. Ends with other instruction.
- "output = text": can use several lines. Ends with other instruction. A case can have differents correct output. There are three types of output: numbers, text and exact test:
- number: defined as sequence of numbers (integers and floats). Only numbers in the output are checked, other text are ignored. Floats are checked with tolerance
- text: defined as text without double quote. Only words are checked and the rest of chars are ignored, the comparation is case-insensitive
- exact text: defined as text into double quote. The exact match is used to test the output.
- "grade reduction = [value|percentage%]" : By default an error reduces student's grade (starts with maxgrade) by (grade_range/number of cases) but with this instruction you can change the reduction value or percentage.