Coding Process
Evaluation of coding questions
Test cases: They are predefined inputs with expected outputs uploaded, so as to check the accuracy of the candidate’s program. Test cases can be of two types: Sample Test cases and Hidden Test cases.
  1. Sample Test Cases: The input and the expected output values of these test cases will be visible to the candidates. These Test cases will help the candidates in understanding the input and output format.
  2. Hidden Test Cases:Only the Status (Accepted/ Wrong Answer/ Runtime Error) of these Test cases will be visible to the candidates, after the Save and Submit button is clicked. The input and output values of these Test cases will be visible only to the admin.
The candidates are marked based on the number of Test cases passed for each programming-related question. Most critical inputs involving corner cases should be included in the Hidden Test cases to check the relevant programming skills of the candidate.
It is advised to mark the first few Test cases as Sample Test cases. Marking Sample Test cases anywhere randomly from the Test case list can confuse the test-taking candidates.
The Sample Test cases are visible to the candidates. Hence, you should assign zero marks to the Sample Test cases. Only the Hidden Test cases should carry actual marks.
It is recommended to assign variable marks to different Test cases depending upon their difficulty and criticality. The marking system should be simple yet effective so that it can be easily understood by any other question setter. It is standard practice to have at least 15 Test cases and to mark 3 of them as Sample Test cases. For prebuilt questions the test cases are arranged according to the difficulty level and the marks are provided accordingly, however the recruiter has the flexibility to modify the marks if required.
The coding Sample Marking scheme is mentioned below, and this can be customized on basis of requirements given during the test design.
Easy: 50, Medium: 75, Difficult: 100
You can also mark as many Test cases as you want as a Sample Test Case in the Sample column. You have the liberty to assign any marks to the Sample Test cases.
However, it is advised to assign zero marks to Sample Test cases because of their visibility to the candidates.
For Multiple choice default marking scheme is mentioned below and this can be customized on basis of requirements given during the test design.
Easy: 1 marks, Medium: 2 Marks, Difficult: 3 Marks