ILIAS Support (English)

Reiter

Funktionen

Manual: Test

Manual: Test & question pool for tests
Please use the ILIAS «Test» tool only for exercises or exam preparation. If you want to conduct a digital exam, please use the iliasEXAM or evaexam platform that has been developed for this purpose. You can find more information here: www.link.unibe.ch/exam.

Question pools are therefore not required but offer the option of creating questions outside of a test and then using them simultaneously in different tests and learning modules or randomly adding questions to a test.
.

1. Creating a test

Click on «Add Object».
Select «Test».
Give the test a «Titel».
Click «Add test».
.

2. Create a question pool for tests

Click on «Add Object».
Select «Question Pool Test».
Give the pool a «Titel».
Click «Add Question Pool Test».
.

3. Adjust settings

The setting options of a question pool for tests are minimal and are not detailed here. Instead, we explain the setting options for the test and point out if something also applies to the question pool.
The ILIAS test is quite complex and therefore offers many setting options, which are divided into 3.1 General, 3.2 Grading System, 3.3 Scoring & Results, 3.4 Certificat and 3.5 Personal Default Settings.
By default, the test settings are preconfigured for a simple self-test, so you hardly need to make any changes for this purpose.
.

General

This section includes the most important general settings you need to consider before starting a test. These comprise the «General settings» (e.g., question selection & anonymity), availability, presentation preferences, introductory options, access restrictions, test mechanics, question behavior (e.g.,  randomization, hints, feedback), features for participants and admins, and outro options (e.g., forwarding, notification).
General settings
To access the «General settings» go to the «Settings» tab.
Define the selection of questions:
  • «Fixed Questions»: You can add questions from existing question pools to the test or createnew questions directly in the test.
  • Random Questions»: You can only randomly add questions to the test from existing question pools.
Choose whether you would like to anonymize the results:
  • «Results With Names»: Results include the names of the participants.
  • «Results Without Names / Anonymous Test»: Results don't include the names of the participants.
.
Availability
To take the test or use the question pool, the «Online» option has to be checked.
A test can only be set «Online» when at least one question has been created (see 4.1 Create questions).
You can set the time period in which the test can be accessed. The test is automatically «Offline» outside this period even if the «Online» option is checked. 
.
Presentation
Under «Tile Image» you can upload a tile image for the test (see Manual: Tile design). 
When inserting images, please follow the recommended image sizes (see Notes on image sizes on ILIAS).
.
Informationen before start of test
You can add a text that the test participants can read before starting the test.
You can choose whether the test properties are displayed to participants in the «Info» tab, e.g., order, scoring, or results output. 
.
Administering the test: access
You can specify a time period during which the test can be completed. Outside of this period, the test cannot be accessed.
You can set a password for the test. Participants must enter this password to start the test.
You can allow only selected participants to take the test. You have to enter these participants in the «Participants» tab manually.
You can limit the number of people taking the test simultaneously.
.
Administering the test: test mechanics
You can specify how often participants are allowed to take the test.
You can specify how much time participants have to complete the test.
If activated, all screen elements not part of the test are hidden while participants are taking the test. 
.
Administering the test: behavior of the questions
You can specify whether the question titles and/or achievable points per question are displayed to participants during the test.
You can specify whether and at what intervals responses should be saved automatically.
Please note that the automatic saving of answers is only intended for emergencies, e.g., if the browser window is accidentally closed. These automatically saved answers are not taken into account by ILIAS in the automated scoring and must always be scored manually (see 6.1 Manual scoring).
If activated, the questions are presented in a different order per participant and per attempt.
If activated, participants can request solution hints during the test, which can be specified for each question (see 4.6 Set hints). You can decide whether points are deducted if a solution hint is used.
If activated, participants can request feedback on their answers during the test. You can create overall feedback for correct or incorrect answers and/or specific feedback for each answer option (see 4.5 Set feedback). You can also provide the best possible solution.
Instead of (or in addition to)Instead of (or in addition to) «Instant feedback» during the test, you can also provide feedback after the test has been completed (see 3.3 Scoring & Results).
Specify whether and under what conditions participants can retrospectively change their answers.
If activated, you can specify for each question whether it is mandatory or not in the «Questions» tab. Participants cannot navigate to the next question or complete the test without having answered mandatory questions.
.
Administering the test: functionality available to participants
If activated, participants can view their answers from the previous attempt.
If activated, participants can suspend the test and continue working on it later.
If a time limit is defined for the test (see Administering the test: test mechanics), it will not be interrupted during the suspension.
Specify whether unanswered questions should remain at their position or be moved to the end of the test.
If activated, participants can view the list of questions and their processing status during the test.
If activated, participants have the option to flag questions.
.
Finishing the test
If activated, participants are shown an overview of all questions and their answers after completing the test. 
You can enter a concluding remark that will be displayed to participants after they have completed the test.
You can specify a website to which participants will be forwarded after completing the test.
If activated, the creator of the test receives a notification when a participant completes the test.
.

Grading system

Under «Grading System» you can define how your test is graded.

To get to the «Grading System», go to the «Grading System» sub-tab in the «Settings» tab. 
Click «Create New Grade Category» to add a grade to the grading system.
Enter a «Short Form» (max. 12 characters) for the grade.
The «Short Form» is used for the «Grading» column in the results overview (see View & manage test results). 
Enter an «Official Form» for the grade.
Enter the «Minimum Score Required» to achieve the grade in %.
Indicate which grades are considered «Passed».
Save your settings.
By clicking «Reset to Simple Mark Schema», you can reset the grading system to the default two-level pass/fail scheme.
.

Scoring and Results

Under «Scoring and Results» you can define settings for test scoring and communication of the result.

To get to «Scoring and Results», go to the «Scoring and Results» sub-tab in the «settings» tab.
«Scoring Options»: Define whether partial solutions are allowed, how questions are scored, whether negative points are possible, and what the scoring should look like in the case of multiple test runs.
«Summary Test Results»: Define whether and when the results are made available to participants, whether the status (e.g., pass/fail) is displayed, and, if applicable, the resulting grade.
Wenn Sie mit «Inhalten zur Wiederholung» und/oder «Rückmeldungen» nach Testbeendigung (siehe 4.5 4.5 Rückmeldungen definieren bzw. 4.7 Inhalte zur Wiederholung hinterlegen) arbeiten, muss die Option «Detaillierte Testergebnisse anzeigen» aktiviert werden.
«Further Options»: For the «Show detailed test results» (see point 2), you can define which information specifically should be displayed and whether to include a printable list. For the «Feedback» option, you can define overall feedback for correct or incorrect answers and/or separate feedback for each answer option (see 4.5 Set feedback).
The «Further Options» section refers to the «Show detailed test results» setting. The options listed here are not required if this setting is not activated. Hence the options activated here are only valid if the «Show detailed test results» has also been selected.
«Gamification»: Specify whether participants will be shown their ranking.
Save your settings.
.

Certificate

Under «Certificate», you can design a certificate for your participants and have it issued automatically if they complete your test.

To get to the «Certificate», go to the «Certificate» sub-tab in the «Settings» tab.
 «Availability»: For the certificate to be issued and downloadable for participants, the «Active» option has to be selected.
 «Layout and Text»: Define the layout for your certificate and enter your text.
Various placeholders are available for you to use for your text.
Save your settings.
.

Personal Default Settings

Under «Personal Default Settings» you have the option of saving the test settings as a template so that you can apply the same settings to other tests without additional effort. You can apply your default settings directly when creating a new test or retrospectively for a test that has already been created.

To get to the «Personal Default Settings», go to the «Personal Default Settings» sub-tab in the «Settings» tab.
Give your default settings a name.
Klick «Add».
To apply your default settings retrospectively to a test that has already been created, select the default setting from the list. Then select the «Apply settings to test» option and click «Execute choices».
.

4. Create, insert & edit questions

.

Create questions

You can create questions directly in your test or in a question pool.
Go to the «Questions» tab.
Click «Create Question».
Select a question type from the drop-down menu (see 4.2 Question types).
Starting with the second question, you can select the question's position from the drop-down menu. You can later change the order of the questions if necessary (siehe 4.10 Change the order of the questions).
Select an editor. The following steps in this manual refer to the «Use plain text for questions and answers and ILIAS page editor for feedback and hints» option.
In most cases, we recommend the option «Use plain text for questions and answers and ILIAS page editor for feedback and hints», especially if you want to insert the questions with feedback into a learning module.
Specify whether the new question should be added to a question pool and, if so, to which question pool.
Click «Create».
.

Question types

We recommend using a maximum of three different question types in a test and grouping them as much as possible to avoid confusing participants with constantly changing expected behavior.
.
Multiple Choice Question (Single Answer)
In a single choice question, several answer options are available, whereby only one is correct/most likely and all others are incorrect/less likely (= distractors). The distractors must be plausible, clearly related to the topic, and similar in length and complexity to the correct answer. Distractors do not have to be completely wrong; however, the correct answer must be clearly and positively distinguishable.
Enter the question «Title».
Enter your question, vignette, case description, etc.
If activated, your answer options will be randomized for each test run.
We recommend randomizing answer options especially if multiple test runs are allowed.
If you want to use images for your answer options, the «Single Line Answers» option must be selected for the answer editor. Enter the size of the images that will be displayed.
When specifying the «Thumbnail Size», choose a not too large «Thumbnail Size» so that all images can be seen simultaneously. Use the preview under «Back to the question page» to check sizing. 
Enter your answer options. For single-line answer answers, you can add answer graphics to the answer text or select answer graphics only. To do this, click «Select File», select your image and confirm with «Upload».
Allocate points for each answer option. For each distractor, enter 0 points.
The actions can be used to add and remove answer options.
In practice, five response options (1 correct + 4 distractors) have proven to be the best combination (Krebs, 2019).
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Multiple Choice Question (Multiple Answer)
In a multiple choice question, several answer options are available, whereby one or more of these options can be correct or incorrect (= distractors). The distractors must be plausible, clearly related to the topic, and similar in length and complexity to the correct answer. Distractors do not have to be completely wrong; however, the correct answer must be clearly and positively distinguishable.
Enter the question «Title».
Enter your question, vignette, case description, etc.
If activated, your answer options will be randomized for each test run.
We recommend randomizing answer options especially if multiple test runs are allowed.
You can specify the maximum number of answer options that participants can select.
If you want to use images for your answer options, the «Single Line Answers» option must be selected for the answer editor. Enter the size of the images that will be displayed.
When specifying the «Thumbnail Size», choose a not too large «Thumbnail Size» so that all images can be seen simultaneously. Use the preview under «Back to the question page» to check sizing. 
Enter your answer options. For single-line answer answers, you can add answer graphics to the answer text or select answer graphics only. To do this, click «Select File», select your image and confirm with «Upload».
Allocate points for each answer option.
The actions can be used to add and remove answer options.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Multiple Choice Question (Kprim Answer)
In a Kprim Choice question, exactly four thematically related statements are posed, each of which is correct or incorrect. The statements can be presented as texts or pictures.
Enter the question «Title».
Enter your question, vignette, case description, etc.
If activated, your answer options will be randomized for each test run.
We recommend randomizing answer options especially if multiple test runs are allowed.
If you want to use images for your answer options, the «Single Line Answers» option must be selected for the answer editor. Enter the size of the images that will be displayed.
When specifying the «Thumbnail Size», choose a not too large «Thumbnail Size» so that all images can be seen simultaneously. Use the preview under «Back to the question page» to check sizing. 
Select the labels for the decision options. For «Userdefined Labels», enter the desired decision options in the text fields.
Specify how many points can be awarded in total for the question.
If activated, half of the maximum points are awarded for three correct answers.
Enter your answer options. For single-line answer answers, you can add answer graphics to the answer text or select answer graphics only. To do this, click «Select File», select your image and confirm with «Upload».
In the «Settings» for each answer, select which option label applies to the respective answer.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Error Text
The question type «Error Text» can be used to test whether the participants can identify incorrect words. The test participants have to identify the incorrect words and highlight them by clicking on them with the mouse. This type of question is suitable for spelling, grammar, incorrect information, etc.
Enter the question «Title».
Enter your question, vignette, case description, etc.
Enter your text. Mark incorrect words in the text with a preceding hash sign (#).
Click «Analyze Error Text».
Complete the incorrect text with the correct solution. This is necessary if you want to provide the solution via direct feedback (see 3.1 General).
Allocate points for the listed words.
Allocate points for incorrect selections.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Hot Spot/Image Map Question
Image maps are images with active sections (so-called hot spots), which participants have to identify by clicking on them. Hovering the cursor over an active section turns the arrow into a hand symbol, indicating that there is a hot spot at that location.
Enter the question «Title».
Enter your question, vignette, case description, etc.
Specify whether participants can only select one (single choice) or several sections (multiple choice).
Click «Select File» to upload the image to which you want to add hot spots.
Please note that you cannot adjust the image size after uploading. Therefore, make sure that your image is in a suitable format beforehand. We recommend a width of approx. 600-800px (ideally 72dpi resolution, max. 1.5MB) so that the images are not too large and take too long to load when the question is viewed. Use the “preview” of the question to check user-friendliness. Bear in mind that test participants cannot enlarge the images.
Click «Save».
Create your hot spots:
  • Rectangle: First, mark the top left corner and then the bottom right corner of the trigger.
  • Circle: First, select the center and then the radius of the trigger.
  • Polygon: First, select the startingpoint and then the desired number of corner points of the trigger.
You can enter a note that appears when hovering over the hot spot with the cursor. Click «Save».
As with normal single and multiple choice questions, you should not only define the correct section, but also a few incorrect sections.
Allocate points for the hot spots.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Cloze Question
This question type consists of a text passage with a code for creating gaps, in which the answers must either be entered in text form or selected from a drop-down menu.
Enter the question «Title».
Enter your question, vignette, case description, etc.
Enter the text into which you want to insert gaps.
Move your cursor to the position in the text where you want to insert a text gap and click «Text Gap» or open the actions menu and select an appropriate gap type.
Click in the middle of the code between the square brackets to open a layover for answer options and point allocation.
Enter your answer options for text gaps and selection gaps or the required values for numerical gaps.
Allocate points.
Instead of awarding points for individual gaps, you can also award points for certain combinations of gaps (see point 11). 
The actions can be used to add and remove gaps.
Click  «OK».
For scoring text gaps, we recommend setting up a text matching method (error tolerance). Levenshtein distances allow one or more characters to be incorrect in any form: upper/lower case, wrong, and/or missing/additional character.
An alternative to the Levenshtein distance is adding answer options with various spellings that still seem acceptable. By allocating different points, you can ensure that the orthographically correct answer scores more points than an answer that is correct in terms of content but incorrect in terms of spelling.
You can give all cloze fields a fixed length.
We recommend a fixed length so that the size of the gap does not hint at a specific word.
Activate «Identical Scoring» if several gaps require the same correct answer.
Specify the additional parameters for each gap if necessary:
For text gaps, you can specify individual lengths.
For selection gaps, you can choose whether answer options should be randomized for each run.
For numerical gaps, you can specify individual lengths.
Clicking «Gap Combination» allows you to enter a combined score for several gaps. When using gap combinations, you do not need to score individual gaps.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Numeric Question
Beim Fragentyp «Numerischen Antwort» müssen Teilnehmende selbständig numerische Werte eintragen. Mittels einer Ober- und einer Untergrenze kann ein Bereich korrekter Zahlen festgelegt werden.
Geben Sie den «Titel» der Frage ein.
Geben Sie Ihre Frage, Vignette, Fallbeschreibung etc. ein.
Bestimmen Sie Sie die Grösse des Eingabefeldes.
Geben Sie die Anzahl Punkte für diese Aufgabe an.
Geben Sie die obere und untere Schranke an. Alle Zahlen im Bereich der unteren und oberen Grenze werden als korrekt bewertet und mit der entsprechenden Anzahl Punkte vergütet.
Durch Angabe desselben Wertes für Ober- und Untergrenze kann auch genau eine Lösung als richtig vorgegeben werden.
Klicken Sie auf «Speichern und zurückkehren». Es wird Ihnen eine Vorschau der Frage angezeigt.
Um zur Fragenliste zurückzukehren, klicken Sie auf «Zurück zum Test».
.
Formula Question
The «Formula Question» is a particular question type for creating formula tasks with variables. Specify the variable's value range (minimum, maximum) and the formula, and ILIAS will automatically generate custom problems with this formula for each test run.
Enter the question «Title».
Enter your question, vignette, case description, etc.
  • Define your variables with $v1,$v2,...,$vn.
  • Define your results with $r1,$r2,...,$rn.
Click «Parse Question».
Define the parameters for each variable. You can define a minimum and maximum range to generate different problems.
Enter the formula using the previously defined variables.
Specify the number of required decimal places.
Allocate points for the correct solution.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Text Subset Question
In the «Text Subset Question» question type, participants have to name a specified number of terms, which can be any selection from a (larger) set of correct answer options.
Enter the question «Title».
Enter your question, vignette, case description, etc.
Specify the number of answer fields that the participants are shown.
For scoring text anwers, we recommend setting up a text matching method (error tolerance). Levenshtein distances allow one or more characters to be incorrect in any form: upper/lower case, wrong, and/or missing/additional character.
An alternative to the Levenshtein distance is adding answer options with various spellings that still seem acceptable. By allocating different points, you can ensure that the orthographically correct answer scores more points than an answer that is correct in terms of content but incorrect in terms of spelling.
Enter your answer options.
Allocate points for each answer option.
The actions can be used to add and remove answer options.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Ordering Question: vertical
In an «Ordering Question: vertical», elements that collectively have a logical order are displayed, usually out of order. With the vertical ordering question, the elements are displayed one below the other.
Enter the question «Title».
Enter your question, vignette, case description, etc.
Specify how many points can be awarded in total for the question. This score will only be awarded if all elements have been placed correctly; partial scoring is not possible.
Select whether the response options should be nested («Use indents in answers») or not («No indents, just order»). You can specify the correct nesting in the «Indentation» sub-tab after you have defined the ordering elements.
Enter any number of ordering elements in the correct order. If you want to use pictures as ordering elements, click «Use answer pictures».
The actions can be used to addremove and move answer options.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Ordering Question: horizontal
In an «Ordering Question: horizontal», elements that collectively have a logical order are displayed, usually out of order. With the horizontal ordering question, the elements are displayed next to each other.
Enter the question «Title».
Enter your question, vignette, case description, etc.
Enter your text in the correct order.
You can specify the text size.
Specify how many points can be awarded in total for the question. This score will only be awarded if all elements have been placed correctly; partial scoring is not possible.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Matching Question
In a «Matching Question» elements (e.g., terms, definitions, graphics) are presented and can be matched in different combinations. It is also possible to offer redundant, non-assignable elements for selection.
Enter the question «Title».
Enter your question, vignette, case description, etc.
Specify whether terms and/or definitions should be randomized.
If you want to use images for your definitions and/or terms, enter the size you want the images displayed.
When specifying the «Thumbnail Size», choose a not too large «Thumbnail Size» so that all images can be seen simultaneously. Use the preview under «Back to the question page» to check sizing. 
Under «Matching Mode», define whether exactly one term can be matched to exactly one definition or whether several terms can be matched to several definitions.
Enter the definitions. These will be displayed on the left side of the screen in the test and cannot be moved. You can enter text and/or images. To add images, click «Select file», select your image, and confirm with «Upload».
Enter the terms. These will be displayed on the right side of the screen in the test and can be moved for matching. You can enter text and/or images. To add images, click «Select file», select your image, and confirm with «Upload».
Under «Matching Pairs», you specify which definitions and terms belong together and allocate points for each correct match.
The actions can be used to add and remove definitions, terms, and matching pairs.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Essay Question
In an «Essay Question», participants are asked a question without being provided with answer options, so they have to produce an answer themselves.
Enter the question «Title».
Enter your question, vignette, case description, etc.
You can specify the maximum number of characters allowed. This can help give participants guidelines on how much text is expected.
We recommend using this question type only for questions with short answers (approx. 200 words / 2000 characters with spaces / 5 min working time). For longer answers, we recommend the «File Upload Question» (see File Upload Question).
For scoring text anwers, we recommend setting up a text matching method (error tolerance). Levenshtein distances allow one or more characters to be incorrect in any form: upper/lower case, wrong, and/or missing/additional character. These settings are only relevant if you enable automatic scoring (see point 5).
Specify how many points can be awarded in total for the question. You can also specify words that allow for automatic scoring. Otherwise, you will have to score the question manually (see 6.1 Manual Scoring).
For the options with automatic scoring, the actions can be used to add and remove words.
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
File Upload Question
In a «File Upoad Question», participants are asked a question or given an assignment without being provided with answer options, so they have to produce an answer themselves. The question/task is answered in an external program. The saved file is then uploaded.
Enter the question «Title».
Enter your question, vignette, case description, etc.
You can specify the maximum size of the file to be uploaded.
You can specify which file formats can be uploaded.
Specify how many points can be awarded in total for the question.
If checked, participants will automatically receive the full score for the question as soon as they have submitted a file. Otherwise, the question has to be scored manually (see 6.1 Manual Scoring). Uploaded files can be downloaded collectively via the «Statistics» tab in the «Results by Question» sub-tab (see 6.2 View & manage test results).
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.
Long Menu
In a «Long Menu Question», text fields or selection fields are inserted, e.g., in cloze texts. Depending on the settings, an auto-complete function can be used when entering an answer in a text field, which displays a list of predefined answer options based on the letter combination entered.
Enter the question «Title».
Enter your question, vignette, case description, etc.
Enter the text into which you want to insert gaps.
Move your cursor to the position in the text where you want to insert a gap and click «Insert Gap».
For text gaps, you can set at which point, depending on the number of characters entered, solution suggestions containing the character combination will be displayed to participants. The minimum value for autocompletion is 1. To bypass autocompletion, enter a value higher than the number of characters of the longest answer option, e.g., 50 - the resulting warning when saving can be ignored.
Activate «Identical Scoring» if several gaps require the same correct answer.
Under «Typ», select whether the gap should be displayed as a text field for input or as a drop-down menu for selection.
Click «Add answers».
A layover will appear. You have two options for adding answer options:
File-Upload: Click Select Filen» to upload a .txt file. In the file, all answer options have to be listed one below the other. Make sure that there are no blank spaces after the answers.
Manual Editing: Enter the answer options in the fields provided. Answer options can be added and removed using «+» and «–».
If you choose to bypass autocomplete, make sure to add the answer options in all possible spelling variants (e.g., upper/lower case, abbreviations, etc.).
To avoid involuntary solution hints, all text fields should have the same length, regardless of the longest answer option per text field. To do this, add the longest answer option to all text fields.
After entering all the answer options, click «Save».
Type the first few characters of the correct answer(s) and select the correct option(s) from the suggestions. The defined correct answers are then highlighted.
Allocate points for each gap. 
Click «Save and Return». You will be forwarded to the question page preview.
To return to the question list, click «Back to the test».
.

 Edit existing questions

You can only edit questions in a test if the test does not yet contain data (results). You can edit questions in a question pool at any time. However, the changes will not be applied to tests that already contain the question.
Go to the «Questions» tab.
Open the question's actions menu.
Click «Edit Question».
Edit your question as needed and click «Save and Return».
In a question pool, the options «Save» and «Save and Return» apply changes only to the question in the pool itself. If you change a question in a test after it was inserted from a question pool, you can choose whether the changes should also be applied to the question in the source pool.
.

Integrate media into a question

Go to the «Questions» tab.
Click on the question title.
Click «Edit Page». The page editor opens, which you can use to add media to the question page (see Manual: Page Editor). 
.

Set feedback

You can add feedback to each question. Depending on the settings, participants can view the feedback immediately after answering a question (see 3.1 General) or after completing the test (see 3.3 Scoring and Resultsg).
Go to the «Questions» tab.
Open the question's actions menu.
Click «Feedback». Here, you have two options for providing feedback:
Correct/incorrect answer feedback: Overall feedback on the correct or incorrect answer, regardless of which incorrect answer(s) were selected. You have to define two pieces of feedback.
Feedback for every answer: Individual feedback per answer option. The amount of feedback to be entered depends on the number of answer options. This option is not available for all question types.
For the «Instant Feedback» während der Testdurchführung (see 3.1 General) you can use one or both of these options. The «Feedback» after test completion (see 3.3 Scoring and Results) always shows all entered pieces of feedback from both options.
Click «Edit Content». Click «Edit Page». The page editor opens, which you can use to enter and design your feedback (see Manual: Page Editor). 
This step is not necessary if the option «Use Rich-Text-Editor (TinyMCE) for editing questions and answers, feedbacks and hints» was selected when creating the question (see 4.1 Create questions). In this case, draft and format your feedback directly in the editors provided on the page.
Save your entries.
.

Set hints

Hints can be used to help participants remember the answers by providing assistance on the way to the correct answer. Participants can decide for themselves whether and how many of the available hints they want to see.

Hints are only available to participants if they have been activated in the test settings (see Administering the test: behavior of the questions).
Go to the «Questions» tab.
Open the question's actions menu.
Click «Hints».
Click «Add Hint».
Enter how many points should be deducted when viewing the hint. 
Click «Save Points and Edit Page». The page editor opens, which you can use to draft and design your hints (see Manual: Page Editor). 
This step is not necessary if the option «Use Rich-Text-Editor (TinyMCE) for editing questions and answers, feedbacks and hints» was selected when creating the question (see 4.1 Create questions). In this case, draft and format your hints directly in the editors provided on the page.
.

Set content for recapitulation

You can set «Content for recapitulation» for each question. With the appropriate settings (see 3.3 Scoring and Results) participants can view these in the detailed test results after completing the test (see 5.1 Features for participants).
Gehen Sie zum Register «Fragen».
Open the question's actions menu.
Click «Edit Question».
Go to the «Content for Recapitulation» sub-tab. 
Select a type of content
  • ILIAS learning module: Refer to an existing learning module.
  • Chapter: Refer to a specific chapter of an existing learning module.
  • Page: Refer to a specific page of an existing learning module.
  • Glossary term: Refer to a specific term in an existing glossary.
  • File download: Upload a file.
  • Text: Enter a text.
Click «Select» and follow the instructions on the screen.
.

Add questions from a question pool

If you have created your questions in a question pool, you can add them to your test. To do this, make sure that the question pool is «Online» and that you are an administrator for this question pool.
In your test, go to the «Questions» tab.
Click «Add from Pool»
All questions from all available question pools will be displayed. If necessary, you can use the filter function to find specific questions.
Select the questions you would like to add and click «Insert».
.

Add questions from another test

If you have created your questions in another test, you can add them to a new test.
In your new test, go to the «Questions» tab.
Click «Add from Other Test»
All questions from all available tests will be displayed. If necessary, you can use the filter function to find specific questions.
Select the questions you would like to add and click «Insert».
.

Change the order of the questions

In most cases, it makes sense to randomize the order of the questions per participant and run (see 3.1 General). However, if you would like to present your questions in a fixed sequence, you can adjust the order of the questions as follows:
In your test, go to the «Questions» tab.
Enter your preferred order of questions in the «Sorting» column.
Click «Save Order».
.

Move existing questions to a question pool

You can move questions you have created and saved directly in the test to a question pool anytime. To add a question to a question pool, the question pool has to be «Online».
In your test, go to the «Questions» tab.
In the «Question Pool» column, you can see whether a question is already assigned to a question pool and, if so, to which one. A question can only ever be assigned to one question pool. This assignment cannot be changed at a later date.
Select the question(s) you want to move to a question pool.
Select «Add to question pool» and confirm with «Execute».
All available question pools are listed in the drop-down menu. Select the preferred question pool and click «Submit».
.

5. Conduct a test

To be able to conduct the test, it has to be set to «Online» (see 3.1 General).
.

Features for participants

Participants start the test by going to the «Info» tab of the test and clicking «Start Test».
Depending on the settings (see 3.1 General) the following features are available to participants:
Show/hide list of questions. Participants can use the list of questions to navigate to any question.
View the test attempt overview.
Suspend the test.
Finishing the test.
Navigate to the previous and next question.
Flag questions.
View feedback.
View hints.
Depending on the settings (see 3.1 General), participants can view their results in the «Results» tab after completing the test.
Multiple test runs are listed underneath each other. Depending on the setting (see 3.3 Results and Scoring) the last or the best test run is marked as graded. The graded test run is marked in the «Scored Pass» column.
«Feedback» and «Content for Recapitulation» can be viewed via the «Detailed Results». The «Show detailed test results» option, as well as the additional «Scored Answers of Participant» or «Scored Answers on single pages», need to be activated (see 3.3 Results and Scoring).
You can do a trial run of the test, but you will then have to delete your test data (see «Results»), before you can continue working on questions or change certain settings.
.

Features for admins

Administrators can follow participants' progress in the test and manually end test runs.
Go to the «Participants» tab.
The table shows you who started the test, whether there are any unfinished and/or finished runs, and when the test was last accessed.
There are two ways to end test runs manually:
To simultaneously end the test for all active participants, click «Finish all Test Passes».
To end the test for individual participants who are still active, open the actions menu for the person concerned and select «Finish Test».
Please use this function very carefully, as participants' unsaved entries are lost when test runs are ended manually.
.

6. Processing the exam

.

Manual scoring

If you used the question types «Essay Question» and/or «File Upload» without a method for automatic scoring (see Essay Question and File Upload), you need to score the answers manually for each question. Other question types with text entries can also be scored manually. Otherwise, this step can be skipped.

Manual scoring can be done either by question oder by participant.
.
Scoring by questions
Go to the «Manual Scoring» tab.
Select the question to be scored from the drop-down menu.
Click «Apply Filter».
Click «Show Answer» for the participant to be scored.
After reviewing the answer, enter the  «Points for the Answer» for this participant and check «Scoring completed» if applicable.
Save the entry. Repeat the steps for all participants and all relevant questions.
Students will not be able to see the «Manual Feedback». It can, therefore, be used for, e.g., correction notes or information for other examiners.
.
Scoring by participant
In the «Manual Scorint» tab, go to the «Scoring by Participant» sub-tab.
Click «Edit Scoring» for the participant to be scored. All the test questions to be scored for this participant will be displayed.
Enter the «Points for the Answer» for each question.
Under «Participant» check the «Mark as ‘Scored Participant’» option.
Save the entries. Repeat the steps for all participants and all participants.
.

View & manage results

There are three ways to view and manage the participants' test results: the «Results», the «Statistics» and the «Export».
.

«Results»

Under «Results», you can view and delete participant data. The list shows all participants who have started or completed the test.
Go to the «Results» tab.
The option «Show Marked Pass Overview» in the drop-down menu generates an overview of the maximum and obtained points per question and selected participant.
The option «Show User's Marked Answers» in the drop-down menu generates an overview of the answers given per question and participant.
An overview of the maximum and obtained points, the answers given per question and the pass status can be accessed for individual participants via the «Test Results» in the actions menu An overview of the maximum and obtained points, the answers given per question and the pass status can be accessed for individual participants via the “Test results” in the Actions menu or for multiple selected participants via «Show User's Detailed Results (Marked Pass» in the drop-down menu.
With «Remove Test Data of Selected Users» in the drop-down menu, the results of selected participants can be deleted. Please note that these cannot be restored afterward.
If you have completed the test yourself for trial purposes, you have to delete your test data via «Delete Test Data of all Participants» or «Remove Test Data of Selected Users» before you can edit your questions and settings.
.

«Statistics»

Under «Statistics», you can see detailed results for all test runs of participants who have started the test. In addition to aggregated results, individual data for each participant is available. The results can be exported as an Excel or CSV file.
Go to the «Statistics» tab.
«Evaluation for All Users»: Overview for all participants with the number of points achieved, grade, questions answered, processing time, and, if applicable, requested solution hints.
«Aggregated Test Results»: General overview of statistical data (total number of people who started the test; total number of completed tests; average completion time; etc.) and the average number of points achieved per question.
«Results by Question»: Detailed information on each question answered as a PDF file. PDF exports are helpful, for example, if you use question types that have to be scored manually (essay question, file upload). You can export all answers to a question in a PDF and print them here. In addition, uploaded files of a file upload question can be downloaded collectively using the «Download» function.
.

«Export»

Under «Export» you can create and download data exports. However, we recommend using the «Statistics» export options for further processing of the test (see «Statistics»).
Go to the «Export» tab.
«Create Test Export File»: You can export your test, including questions and settings, as a compressed ZIP file and import it to another ILIAS installation. Please note, however, that this export does not contain the participants' responses.
«Create Test Export File (incl. Participant Results)»: As with the previous option, you can export the entire test, including questions and settings, as well as the participant results.
«Create Test Results Export File»: You can generate two files (.xlsx and .csv) with all test results.
«Create Test Archive File»: You can generate and download an archive file as a ZIP file. 
.

7. Application scenarios

The following pages will give you an idea of how a data collection can be used:

Zuletzt geändert: 30. Aug 2024, 12:22, Thiel, Anja [a.thiel5]