ROPOTs (Exams and PC Tests)

The ROPOTs (Revision, Opinion Poll and Testing) contain questions and allow students to actively answer. The system typically automatically stores and evaluates the answers.

The preparation of the ROPOT consists of two steps - applications:

1. Question Sets – what the ROPOT asks, the questions to be asked
2. ROPOT Descriptions – who is allowed to take the test, when and under what conditions, from which question sets the questions are to be used.

The ROPOT can, for instance, be used for the following purposes:

Exercises

Many questions designed for students to work on outside the classroom (recapitulation, drill, checking understanding of the material, ...). Students can open the practice test at any time and view the correct results after submitting it.

PC-based test

A clicker exam that students take in the computer classroom. The test is typically timed and the results are recorded in a notebook (the ability to generate a grade) without displaying the correct answers to the students.

PC-based test demo

The mode is used to easily create a sample test on which students can experience what a live PC-based test looks like. It is advisable to include it during the semester with sufficient distance from the actual testing. The results are not saved.

Text (accompanied by other materials) or opinion poll

Unscored questions with some accompanying texts – shorter interactive teaching materials (with checking of understanding of the text), surveys, questionnaires. The order of questions and answers is not mixed.

Scannable test (multiple choice)

Creating a printable test and then completing it on paper. The results are entered into a notebook after scanning the submitted paper. The scans are also stored in the student's Retrieval Box for review. Please note: the contents of the short answer sheet are entered in full, including the assignment, when uploading to the student's retrieval box.

Scannable handwritten text and scores

A very specific mode – the printed assignment with a free space is filled in manually by the student and the teacher manually corrects and enters the points. After scanning, the number of points is entered into a notebook and the corrected paper is available in the Retrieval Box.

First, you need to create a question set and then use the ROPOT description to define the behavior of the ROPOT (when the student can answer, whether they can see the correct answers, etc.). Only the ROPOT description will allow students to answer the questions, a question set alone is not enough.

After creating the ROPOT, you can see how students will see the test. Via

enter the Administering ROPOT page and click on "answer questions"under the name of the ROPOT. From the same page, you can also access the students' answers, this time via the "responses provided" link.

If you want to try how students will see the ROPOT, try to practice answering it using

After submitting the test, you can view how you completed it by clicking on the "view" link. Please note that the link will only appear if you have enabled access to the view in the ROPOT description. This also applies to other settings, such as being able to answer the same form repeatedly or setting up new questions. If you have enabled the answer display, you will see the correct and incorrect answers marked in green and red, the correct solution listed in green, and the number of points scored for each question, if applicable.

Student answers can be accessed via Responses application:

The Answers application displays all responses and person answering operations for the selected ROPOT. Students' answers can also be evaluated here (with points or verbal comments).

On the page listing the respondents and their responses you can find all the information about who worked with the ROPOT, when and how. A list of respondents is available, which can be restricted and sorted as required, and batch operations can be performed on the list of respondents and their responses.

The Answers application records all the passes and operations during the answering process of all the persons recorded for a particular ROPOT, and displays the students' answers in the course in priority. The application can be launched via:

For the course teacher, the application allows to filter these ROPOT sessions using the options given at the top of the page, to delete sessions, to renew sessions, to force the submission of a pending sessions and last but not least to view the student's answers after submission or at different stages of filling in the ROPOT.

In addition, the application allows you to manually rate the student's answers with points or verbal comments. Answers can also be exported or checked for plagiarism (see Help Are the answers in the ROPOTs also checked?).

The display of options in the Answers app varies slightly based on, among other things, the mode of the answerer, its settings, or whether the answerer is allowed to have more than one pass. For individual records, sessions or operations, only those options that are relevant at the time, i.e. can be performed, are offered.

In the application

also find the responses of students who wrote the tests on scannable answer sheets. In addition, each student's test sheet number information is included. If you also need to see test sheets that could not be linked to a specific student, select "View: All Records".

If students have handwritten a paper on a scannable answer sheet and after correcting it they want to discuss the marking of their paper with you, for example, you can view their paper using the application

Responses provided by student are automatically removed five years after the session have been launched.

Using the Difficulty level application, you can get a summary of the answers to each question in the ROPOT and see which questions are most difficult for students. You can find the application via

A table will be displayed showing the so-called difficulty coefficient. The difficulty factor is the ratio of correct answers to all answers (including unanswered questions). The lower the number, the more students made mistakes.

You can also sort the questions by how they are placed in the set. The calculation of the coefficient may take into account the scoring of the ROPOT. For example, in the case of tests with negative scores for wrong answers, multiple-choice questions will be more comparable.

You can also view the identity of the respondents and see how the selected students answered each question.

At first glance, you can see the distribution of students' answers to the question. The prevalence of wrong answers may be an impulse to revise the wording of the question, or it may suggest that the material needs to be discussed more with students.

If the wrong option hasn't fooled anyone, perhaps it is unnecessary in the question or another one can be devised. This is a so-called non-functional distractor.

Sometimes it may happen that a student's connection breaks down while answering (e.g. when answering from home). You may also want to change the assignment and ask students to retake the test. In this case, you must first cancel the students' answers via

You can cancel all responses from all persons or only the responses of an individual. You can cancel responses especially if you have set "no" or "Yes, they should, but it is always the same form (same questions) that should be offered to them." in the section dedicated to repetitive work with the ROPOT in the description of the ROPOT form. If it is a practice ROPOT with the setting "Yes, they should and some other questions should be offered to them next time they work with the ROPOT application.", the student simply launches the ROPOT creating a new session and the problem is solved.

Cancelled answers are not definitively lost. You can restore them using

Also remind students to use the "Save and continue" button. In the event of a power outage or disconnection, it is then possible to return to a partially completed test and complete it.

After saving the ROPOT description, use the application fill in the form and submit it for evaluation. This is also how the student works with the ROPOT. Depending on what you have entered in the description, you can answer repeatedly or once, and you can have the same form over and over or new questions each time. A single launching of a blank form (selecting questions and assembling them into a page) is called a ROPOT session. In the application you can see who was working with the ROPOT.

If the ROPOT description is set to "Should students be allowed to access this ROPOT application repeatedly? Yes, they should, but it is always the same form (same questions) that should be offered to them." you can still see the original session when you select "Work with the question form again" (in the ROPOT application).

If the ROPOT description is set to " Should students be allowed to access this ROPOT application repeatedly? Yes, they should and some other questions should be offered to them next time they work with the ROPOT application." you don't have to cancel your answers when trying the behaviour of the ROPOT, you can already create new sessions with the current questions.

The agenda can be used for testing in the computer classroom. Students fill in a form in the IS, which itself corrects the exam. If the test includes free-form answers (which the system cannot correct automatically), the teacher will correct them manually later. The test is not accessible before the start of the exam.

You can limit the time for taking the test, ither by the total number of minutes or by setting the day and hour from-to which the ROPOT can be worked with, or a combination of both (see above).

If you limit the time for working with the ROPOT, the answers will be automatically submitted after the time limit expires. Therefore, the answers of students who did not save the test using the "Submit" button are not lost.

Organization of ROPOTs for multiple examination dates

Make these decisions:
Do I want to use one assignment for multiple examination dates?
Do I want the student to not be able to view the assignment questions in any way after submitting the test?
Depending on the level of "uniqueness" you require, you need to create as many ROPOTs as you need. The usual procedures are:

• Each examination date has a unique assignment stored in a separate question set, the test questions are mixed (each student sees them in a different order)
• For example, there are three different question sets, each set to be used on multiple examination dates.
• There is only one assignment = question set.

How many ROPOTs:
Access to a single ROPOT can be "given and taken" over time. It can be made accesible on Mondays 8.00-9.00, then 14.00-15.00, etc., as the examination dates are organized. A student who has already taken the test cannot change the answers, but can look at the wording of the questions should he/she reopen the ROPOT when the next examination date is in progress. This can be avoided if you restrict access to the ROPOT to a specific part of the computer network (the classroom – LVT department will help), so that it is not freely accessible from the internet. If you cannot use this restriction and do not want students to be able to return to the assignment, create a separate ROPOT description for each examination date.

Security mechanisms

Find out from the technical support of the computer room the range of addresses of the computer network of the classroom (the so-called IP addresses) and enter them in the description of the ROPOT– the section "On which computers should the students be allowed to work with the ROPOT application?". The student can also give you the address of the computer individually, it can be found under

Information system System Remote client IP address

If you don't want or can't find out the IP addresses, you can do the following:

• Use the regular examination dates application to divide students into examination dates, set up "log in" and "log out" dates well before the exam date so that someone can't log in at the last minute and open the test (view the test questions).
• In the description of the ROPOT, under "Rights and time group", specify that only those with a reservation on a specific examination date can open it.
• At the beginning of the exam, check attendance and remove those students who are absent from the examination date reservation (so that they do not open the ROPOT from the internet during the exam).

You can also use other security mechanisms:

• You can specify in the ROPOT description that a wide coloured column should appear on the left side of the screen when the ROPOT is launched.

  

  It allows you to remotely check that everyone is working with the correct ROPOT only. You can choose the colour of the column to distinguish e.g. individual test dates.

• If you have set up the display of the left column (see the previous paragraph), the identity of the respondent, i.e. the name, učo and photo of the person logged in, will also be displayed. This will make it easier to check the identity of the respondent.
• You can contact the faculty CIT to ask if it would be possible to disable access to other sites than is.cevro.cz.

What else is good to know...

The student cannot unknowingly open the ROPOT twice (e.g. by double-clicking). If such a situation occurs, MU IS will ask the student whether he/she really wants to open the ROPOT a second time. The same question will be asked if the student wants to open the unsaved test in two browser windows or panels. Whether he/she will be able to do this depends on the setting of the parameters in the ROPOT description, but the ROPOT cannot be reopened and the answers cannot be continued/changed if the setting is "no (once you open the ROPOT, you cannot reopen the ROPOT sometime later and change the answers)"..

Students have a "Save and continue" button to prevent inconveniences caused by power outages, etc. If you set in the ROPOT description for the test to have multiple pages, “save and continue” is done automatically when a respondent moves between pages. It also occurs when a respondent presses the "Enter" key. However, only the final submission, is the decisive moment for the evaluation of the test and the allocation of points..

The system records all operations that have been performed (time of launching the ROPOT, computer address, answers chosen, time of submission, viewing the answers, etc.). In the event of problems or suspected malpractice, these data can be found.

If a student accidentally submits a session for evaluation, they typically cannot return to the test. A possible solution is to remove his/hers answers with the application

Information system Teacher [course selection] Work with ROPOT Remove answers

and let him/her launch the ROPOT all over again.

Student responses to a particular ROPOT can be exported to different formats and further processed freely. Use the application in the Teacher's Notebook

Select the ROPOT from which you want to export the answers. In the application, you have the possibility to modify the export properties (form of exported questions and options, answers, sessions, etc.), select the exported file format and encoding. The exported answers can be output to the screen or printed, this option is mainly used to check the exported data. For further processing of the answers, use the export to a text file or formats designed for processing in Excel.

You can view the students' answers in XML format, which is suitable for further processing by a programmer. You can retrieve them using Download them to your computer and give them to the programmer.

Student responses in the answer sheet can also be exported to a pdf file and then printed. It can only export ROPOTs where questions of type :a (open answer), :r (select one answer), :c (select multiple correct answers) are used.

It is available under the link

The exported pdf contains a list of students who have completed the ROPOT. Student responses always start on a new page. The pdf can be used to archive the answers, for example, for state final exams or admissions.

The a_texty folder is created if you have ROPOTs with free-form answers. Student answers are stored there in text format. IS CEVRO needs these files to search for plagiarism, but they are not important for a normal user.

Yes, you can. The ROPOT can also be launched in unauthenticated mode, i.e. without logging into the IS CEVRO. Just add the right "anyone on the Internet" in the section "Rights and time group" when editing the description of the ROPOT. Anyone can then launch the ROPOT via the unauthenticated link to the *.qref file.

With unauthenticated access, the identity of the respondent cannot be uniquely determined because individual accesses are identified only by an access number. This number, which is displayed in the list of answers instead of the name and username, is stored in the browser by means of cookies and allows, for example, to retake the test from the same computer and account and to view the results of the previous session. For unauthenticated access it is therefore necessary to have cookies enabled in the browser. Access via an unauthenticated link from another browser/computer means a completely new launch of the ROPOT.

Points from unauthenticated accesses cannot be recorded in the notebook.

ROPOTs with non-authenticated access may be useful for various surveys and polls (e.g. during open days).

The statistics of the scores and the number of completed tests can be found in the usual way by selecting or through the Difficulty level if it is prepared within the course (which is not necessary, it can be placed outside the Study Materials, e.g. in the Document Server).

Yes. In the description of the ROPOT, you can assign the right to work with the ROPOT using Rights and time group setting to applicants for study (i.e. persons who have submitted an application for study) or to sit entrance examination, where you specify a specific date. These persons will be identified by an application number.

The IS CEVRO allows you to easily obtain a list of persons (who have passed the test) with the number of points achieved and the time of completing the test using the "simple export" function. The function can be accessed using Here you can choose whether you just want to print the list to the screen or download it in Excel and Word format. The list contains all the people who have worked with the ROPOT, including the respondents authenticated via application number and records of unauthenticated accesses (instead of the name, the record is indicated by the access number).

Simple export is useful for obtaining scores from unauthenticated accesses to the ROPOT, or when using the ROPOT outside of a specific course.

Use the "Export Questions for Drill" feature if you want to allow students to practice the material using Drill application. The export can be found in the application:

Use the form provided to find the question set you want to export and confirm with the "Use" button.

The export application allows you to export the questions including all options in CSV format, which you then use as a data file for importing into the drill. Exporting for drill is only suitable for :r and :c questions where students do not need to know the exact answer but are able to select it from the options provided.

We recommend that you use the drill export only for questions that contain some factual knowledge. You can learn more about drill application in the Help

and in the question: How do I import data from the answer sheet into the drill?

For the transfer of ROPOTs, as well as other materials in the course, there is an application for copying materials:

Here, select the course and semester from which you want to copy the ROPOTs and any other files and click on "Copy".

In addition to actually copying the materials, this application also sets access rights and access rights in the ROPOTs for the target semester.