Mixing
![Not getting the relieving letter. Need it urgently [duplicate]](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgjbpfN9tAutmK93bJRC3ZoROZzi2TJDms5n8_qJuhgE0a9b52OOHayv3NGT8igAdFL7byXNst-_1DZK5SjrIJ28_6RQPUpBROqMs5s6jo-ZsjX8kjDwfxJufIitH3TaQRXWaGSQKRQib-f/s72-c/1.jpg)
Is it common to have exam questions 'peer reviewed'?
Clash Royale CLAN TAG#URR8PPP
up vote
4
down vote
favorite
How common is it that exam questions, after being designed by the instructor and before being given to the students, are checked by a colleague in one's same institute, to make sure that they are appropriate and unambiguous and that their results are correct? Is this normally enforced by universities across the world?
Motivation: anecdotal. A recent answer mentions "having [exam questions] checked / verified for quality, consistency etc". And I heard from a colleague from a country in the English-speaking world that in their institution something similar goes on: they prepare exam questions one week in advance, and then they are sent to be checked by a colleague. OTOH, this is completely unheard of for me in Italy --- the instructor designs the questions, then they are sent out to the students without any form of review imposed by the university (though the Italian system is somehow peculiar when it comes to exams.)
exams course-design
asked 1 hour ago
Federico Poloni
24.3k1175127
add a comment |Â
up vote
4
down vote
favorite
How common is it that exam questions, after being designed by the instructor and before being given to the students, are checked by a colleague in one's same institute, to make sure that they are appropriate and unambiguous and that their results are correct? Is this normally enforced by universities across the world?
Motivation: anecdotal. A recent answer mentions "having [exam questions] checked / verified for quality, consistency etc". And I heard from a colleague from a country in the English-speaking world that in their institution something similar goes on: they prepare exam questions one week in advance, and then they are sent to be checked by a colleague. OTOH, this is completely unheard of for me in Italy --- the instructor designs the questions, then they are sent out to the students without any form of review imposed by the university (though the Italian system is somehow peculiar when it comes to exams.)
exams course-design
asked 1 hour ago
Federico Poloni
24.3k1175127
add a comment |Â
up vote
4
down vote
favorite
up vote
4
down vote
favorite
How common is it that exam questions, after being designed by the instructor and before being given to the students, are checked by a colleague in one's same institute, to make sure that they are appropriate and unambiguous and that their results are correct? Is this normally enforced by universities across the world?
Motivation: anecdotal. A recent answer mentions "having [exam questions] checked / verified for quality, consistency etc". And I heard from a colleague from a country in the English-speaking world that in their institution something similar goes on: they prepare exam questions one week in advance, and then they are sent to be checked by a colleague. OTOH, this is completely unheard of for me in Italy --- the instructor designs the questions, then they are sent out to the students without any form of review imposed by the university (though the Italian system is somehow peculiar when it comes to exams.)
exams course-design
asked 1 hour ago
Federico Poloni
24.3k1175127
How common is it that exam questions, after being designed by the instructor and before being given to the students, are checked by a colleague in one's same institute, to make sure that they are appropriate and unambiguous and that their results are correct? Is this normally enforced by universities across the world?
Motivation: anecdotal. A recent answer mentions "having [exam questions] checked / verified for quality, consistency etc". And I heard from a colleague from a country in the English-speaking world that in their institution something similar goes on: they prepare exam questions one week in advance, and then they are sent to be checked by a colleague. OTOH, this is completely unheard of for me in Italy --- the instructor designs the questions, then they are sent out to the students without any form of review imposed by the university (though the Italian system is somehow peculiar when it comes to exams.)
exams course-design
exams course-design
asked 1 hour ago
Federico Poloni
24.3k1175127
asked 1 hour ago
Federico Poloni
24.3k1175127
asked 1 hour ago
Federico Poloni
24.3k1175127
asked 1 hour ago
Federico Poloni
24.3k1175127
asked 1 hour ago
Federico Poloni
24.3k1175127
24.3k1175127
add a comment |Â
add a comment |Â
3 Answers
3
active
oldest
votes
up vote
2
down vote
In the United Kingdom, the quality assurance process imposed my the UK Quality Assurance Agency requires both internal and external moderation of assessments. Internal moderators are academics from the same unit or department as the lecturer. External moderators are academics from outside the university (and may be international experts in the field).
Internal and external moderation occurs at two stages. The first is in the construction of exams and coursework assessments prior to release to students. These assessments are subject to review and revision before release. The second is in the assessment of the distribution of marks and in the conduct of the exam. In this step, we discuss issues such as the performance of the cohort against expectation, cases of academic misconduct, etc.
The regime is quite involved and very bureaucratic. However, its value is apparent when there are disputes about the level of the exam or the performance of students.
answered 41 mins ago
St. Inkbug
3,383932
add a comment |Â
up vote
2
down vote
Yes; as mentioned in the UK it is expected that assignments (usually those greater than a certain proportion of the overall mark) is both internally checked and externally checked.
I have acted as an external examiner involved in the checking of the exam papers of another university. It is a valuable role that experienced academics can play in both improving the student experience, and the quality of the learning and teaching of an institution.
Another aspect that is also worth mentioning is post-exam error checking. In my department (some considerable time ago) we did an experiment of random error checking and to our astonishment, that despite the diligence of the most experience marker things got missed. Our checking showed up whole missed script pages, ridiculous arithmetic errors in the final score and whole class transcription errors where spreadsheet cells were "off-by-one". As a result more regular clerical checks were done on everyone's marking and result recording to gain much in quality and student satisfaction.
answered 29 mins ago
Brian Tompsett - 汤莱æ©
8,53232944
add a comment |Â
up vote
1
down vote
Very common in my experience.
And even if it is not proscribed by the university, common sense does seem to get most of my colleagues in the past to ask one to "have a look at x" on an ad hoc basis. We tended to do this for each other, even before "moderation systems" were "forced upon us" or the existing relationship was made more formal...
This, simply, helps to avoid typing errors, or number errors ie a factor of 10 missing that can make a really good question such an issue for students who are under stress...
Part of moderation can be where external moderators from other institutions come in to evaluate a particular course, where they speak to the lecturers, the students and check the exams and answer scripts for consistency.
On a personal note, I did not like being externally moderated at first, but now value the process for a different view point as I have found the people who come in face the same problems with classes / students that I do. So, the discussion tends to be "I'm considering this" and the response is " Well, interesting, worth a try, but look out for this or this". It makes a difference which I now value...
I remember a Professor, where I did my studies, who was told to write an "open book" exam for his course. So he duly did so... Sent it in for external moderation (the so-called experts as mentioned in another answer...) and the moderator could not complete the exam... :) The moderator had to ask for the solutions... My lecturer continued with the original style of exam not going to open book....
answered 50 mins ago
Solar Mike
9,86432142
"And even if it is not proscribed by the university..." Do you mean "prescribed" (they tell you to do it, like a doctor telling you to take pills) rather than "proscribed" (prohibited)?
– David Richerby
14 mins ago
add a comment |Â
3 Answers
3
active
oldest
votes
3 Answers
3
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
2
down vote
In the United Kingdom, the quality assurance process imposed my the UK Quality Assurance Agency requires both internal and external moderation of assessments. Internal moderators are academics from the same unit or department as the lecturer. External moderators are academics from outside the university (and may be international experts in the field).
Internal and external moderation occurs at two stages. The first is in the construction of exams and coursework assessments prior to release to students. These assessments are subject to review and revision before release. The second is in the assessment of the distribution of marks and in the conduct of the exam. In this step, we discuss issues such as the performance of the cohort against expectation, cases of academic misconduct, etc.
The regime is quite involved and very bureaucratic. However, its value is apparent when there are disputes about the level of the exam or the performance of students.
answered 41 mins ago
St. Inkbug
3,383932
add a comment |Â
up vote
2
down vote
In the United Kingdom, the quality assurance process imposed my the UK Quality Assurance Agency requires both internal and external moderation of assessments. Internal moderators are academics from the same unit or department as the lecturer. External moderators are academics from outside the university (and may be international experts in the field).
Internal and external moderation occurs at two stages. The first is in the construction of exams and coursework assessments prior to release to students. These assessments are subject to review and revision before release. The second is in the assessment of the distribution of marks and in the conduct of the exam. In this step, we discuss issues such as the performance of the cohort against expectation, cases of academic misconduct, etc.
The regime is quite involved and very bureaucratic. However, its value is apparent when there are disputes about the level of the exam or the performance of students.
answered 41 mins ago
St. Inkbug
3,383932
add a comment |Â
up vote
2
down vote
up vote
2
down vote
In the United Kingdom, the quality assurance process imposed my the UK Quality Assurance Agency requires both internal and external moderation of assessments. Internal moderators are academics from the same unit or department as the lecturer. External moderators are academics from outside the university (and may be international experts in the field).
Internal and external moderation occurs at two stages. The first is in the construction of exams and coursework assessments prior to release to students. These assessments are subject to review and revision before release. The second is in the assessment of the distribution of marks and in the conduct of the exam. In this step, we discuss issues such as the performance of the cohort against expectation, cases of academic misconduct, etc.
The regime is quite involved and very bureaucratic. However, its value is apparent when there are disputes about the level of the exam or the performance of students.
answered 41 mins ago
St. Inkbug
3,383932
In the United Kingdom, the quality assurance process imposed my the UK Quality Assurance Agency requires both internal and external moderation of assessments. Internal moderators are academics from the same unit or department as the lecturer. External moderators are academics from outside the university (and may be international experts in the field).
Internal and external moderation occurs at two stages. The first is in the construction of exams and coursework assessments prior to release to students. These assessments are subject to review and revision before release. The second is in the assessment of the distribution of marks and in the conduct of the exam. In this step, we discuss issues such as the performance of the cohort against expectation, cases of academic misconduct, etc.
The regime is quite involved and very bureaucratic. However, its value is apparent when there are disputes about the level of the exam or the performance of students.
answered 41 mins ago
St. Inkbug
3,383932
answered 41 mins ago
St. Inkbug
3,383932
answered 41 mins ago
St. Inkbug
3,383932
answered 41 mins ago
St. Inkbug
3,383932
3,383932
add a comment |Â
add a comment |Â
up vote
2
down vote
Yes; as mentioned in the UK it is expected that assignments (usually those greater than a certain proportion of the overall mark) is both internally checked and externally checked.
I have acted as an external examiner involved in the checking of the exam papers of another university. It is a valuable role that experienced academics can play in both improving the student experience, and the quality of the learning and teaching of an institution.
Another aspect that is also worth mentioning is post-exam error checking. In my department (some considerable time ago) we did an experiment of random error checking and to our astonishment, that despite the diligence of the most experience marker things got missed. Our checking showed up whole missed script pages, ridiculous arithmetic errors in the final score and whole class transcription errors where spreadsheet cells were "off-by-one". As a result more regular clerical checks were done on everyone's marking and result recording to gain much in quality and student satisfaction.
answered 29 mins ago
Brian Tompsett - 汤莱æ©
8,53232944
add a comment |Â
up vote
2
down vote
Yes; as mentioned in the UK it is expected that assignments (usually those greater than a certain proportion of the overall mark) is both internally checked and externally checked.
I have acted as an external examiner involved in the checking of the exam papers of another university. It is a valuable role that experienced academics can play in both improving the student experience, and the quality of the learning and teaching of an institution.
Another aspect that is also worth mentioning is post-exam error checking. In my department (some considerable time ago) we did an experiment of random error checking and to our astonishment, that despite the diligence of the most experience marker things got missed. Our checking showed up whole missed script pages, ridiculous arithmetic errors in the final score and whole class transcription errors where spreadsheet cells were "off-by-one". As a result more regular clerical checks were done on everyone's marking and result recording to gain much in quality and student satisfaction.
answered 29 mins ago
Brian Tompsett - 汤莱æ©
8,53232944
add a comment |Â
up vote
2
down vote
up vote
2
down vote
Yes; as mentioned in the UK it is expected that assignments (usually those greater than a certain proportion of the overall mark) is both internally checked and externally checked.
I have acted as an external examiner involved in the checking of the exam papers of another university. It is a valuable role that experienced academics can play in both improving the student experience, and the quality of the learning and teaching of an institution.
Another aspect that is also worth mentioning is post-exam error checking. In my department (some considerable time ago) we did an experiment of random error checking and to our astonishment, that despite the diligence of the most experience marker things got missed. Our checking showed up whole missed script pages, ridiculous arithmetic errors in the final score and whole class transcription errors where spreadsheet cells were "off-by-one". As a result more regular clerical checks were done on everyone's marking and result recording to gain much in quality and student satisfaction.
answered 29 mins ago
Brian Tompsett - 汤莱æ©
8,53232944
Yes; as mentioned in the UK it is expected that assignments (usually those greater than a certain proportion of the overall mark) is both internally checked and externally checked.
I have acted as an external examiner involved in the checking of the exam papers of another university. It is a valuable role that experienced academics can play in both improving the student experience, and the quality of the learning and teaching of an institution.
Another aspect that is also worth mentioning is post-exam error checking. In my department (some considerable time ago) we did an experiment of random error checking and to our astonishment, that despite the diligence of the most experience marker things got missed. Our checking showed up whole missed script pages, ridiculous arithmetic errors in the final score and whole class transcription errors where spreadsheet cells were "off-by-one". As a result more regular clerical checks were done on everyone's marking and result recording to gain much in quality and student satisfaction.
answered 29 mins ago
Brian Tompsett - 汤莱æ©
8,53232944
answered 29 mins ago
Brian Tompsett - 汤莱æ©
8,53232944
answered 29 mins ago
Brian Tompsett - 汤莱æ©
8,53232944
answered 29 mins ago
Brian Tompsett - 汤莱æ©
8,53232944
8,53232944
add a comment |Â
add a comment |Â
up vote
1
down vote
Very common in my experience.
And even if it is not proscribed by the university, common sense does seem to get most of my colleagues in the past to ask one to "have a look at x" on an ad hoc basis. We tended to do this for each other, even before "moderation systems" were "forced upon us" or the existing relationship was made more formal...
This, simply, helps to avoid typing errors, or number errors ie a factor of 10 missing that can make a really good question such an issue for students who are under stress...
Part of moderation can be where external moderators from other institutions come in to evaluate a particular course, where they speak to the lecturers, the students and check the exams and answer scripts for consistency.
On a personal note, I did not like being externally moderated at first, but now value the process for a different view point as I have found the people who come in face the same problems with classes / students that I do. So, the discussion tends to be "I'm considering this" and the response is " Well, interesting, worth a try, but look out for this or this". It makes a difference which I now value...
I remember a Professor, where I did my studies, who was told to write an "open book" exam for his course. So he duly did so... Sent it in for external moderation (the so-called experts as mentioned in another answer...) and the moderator could not complete the exam... :) The moderator had to ask for the solutions... My lecturer continued with the original style of exam not going to open book....
answered 50 mins ago
Solar Mike
9,86432142
"And even if it is not proscribed by the university..." Do you mean "prescribed" (they tell you to do it, like a doctor telling you to take pills) rather than "proscribed" (prohibited)?
– David Richerby
14 mins ago
add a comment |Â
up vote
1
down vote
Very common in my experience.
And even if it is not proscribed by the university, common sense does seem to get most of my colleagues in the past to ask one to "have a look at x" on an ad hoc basis. We tended to do this for each other, even before "moderation systems" were "forced upon us" or the existing relationship was made more formal...
This, simply, helps to avoid typing errors, or number errors ie a factor of 10 missing that can make a really good question such an issue for students who are under stress...
Part of moderation can be where external moderators from other institutions come in to evaluate a particular course, where they speak to the lecturers, the students and check the exams and answer scripts for consistency.
On a personal note, I did not like being externally moderated at first, but now value the process for a different view point as I have found the people who come in face the same problems with classes / students that I do. So, the discussion tends to be "I'm considering this" and the response is " Well, interesting, worth a try, but look out for this or this". It makes a difference which I now value...
I remember a Professor, where I did my studies, who was told to write an "open book" exam for his course. So he duly did so... Sent it in for external moderation (the so-called experts as mentioned in another answer...) and the moderator could not complete the exam... :) The moderator had to ask for the solutions... My lecturer continued with the original style of exam not going to open book....
answered 50 mins ago
Solar Mike
9,86432142
"And even if it is not proscribed by the university..." Do you mean "prescribed" (they tell you to do it, like a doctor telling you to take pills) rather than "proscribed" (prohibited)?
– David Richerby
14 mins ago
add a comment |Â
up vote
1
down vote
up vote
1
down vote
Very common in my experience.
And even if it is not proscribed by the university, common sense does seem to get most of my colleagues in the past to ask one to "have a look at x" on an ad hoc basis. We tended to do this for each other, even before "moderation systems" were "forced upon us" or the existing relationship was made more formal...
This, simply, helps to avoid typing errors, or number errors ie a factor of 10 missing that can make a really good question such an issue for students who are under stress...
Part of moderation can be where external moderators from other institutions come in to evaluate a particular course, where they speak to the lecturers, the students and check the exams and answer scripts for consistency.
On a personal note, I did not like being externally moderated at first, but now value the process for a different view point as I have found the people who come in face the same problems with classes / students that I do. So, the discussion tends to be "I'm considering this" and the response is " Well, interesting, worth a try, but look out for this or this". It makes a difference which I now value...
I remember a Professor, where I did my studies, who was told to write an "open book" exam for his course. So he duly did so... Sent it in for external moderation (the so-called experts as mentioned in another answer...) and the moderator could not complete the exam... :) The moderator had to ask for the solutions... My lecturer continued with the original style of exam not going to open book....
answered 50 mins ago
Solar Mike
9,86432142
Very common in my experience.
And even if it is not proscribed by the university, common sense does seem to get most of my colleagues in the past to ask one to "have a look at x" on an ad hoc basis. We tended to do this for each other, even before "moderation systems" were "forced upon us" or the existing relationship was made more formal...
This, simply, helps to avoid typing errors, or number errors ie a factor of 10 missing that can make a really good question such an issue for students who are under stress...
Part of moderation can be where external moderators from other institutions come in to evaluate a particular course, where they speak to the lecturers, the students and check the exams and answer scripts for consistency.
On a personal note, I did not like being externally moderated at first, but now value the process for a different view point as I have found the people who come in face the same problems with classes / students that I do. So, the discussion tends to be "I'm considering this" and the response is " Well, interesting, worth a try, but look out for this or this". It makes a difference which I now value...
I remember a Professor, where I did my studies, who was told to write an "open book" exam for his course. So he duly did so... Sent it in for external moderation (the so-called experts as mentioned in another answer...) and the moderator could not complete the exam... :) The moderator had to ask for the solutions... My lecturer continued with the original style of exam not going to open book....
answered 50 mins ago
Solar Mike
9,86432142
edited 29 mins ago
answered 50 mins ago
Solar Mike
9,86432142
answered 50 mins ago
Solar Mike
9,86432142
answered 50 mins ago
Solar Mike
9,86432142
9,86432142
"And even if it is not proscribed by the university..." Do you mean "prescribed" (they tell you to do it, like a doctor telling you to take pills) rather than "proscribed" (prohibited)?
– David Richerby
14 mins ago
add a comment |Â
"And even if it is not proscribed by the university..." Do you mean "prescribed" (they tell you to do it, like a doctor telling you to take pills) rather than "proscribed" (prohibited)?
– David Richerby
14 mins ago
"And even if it is not proscribed by the university..." Do you mean "prescribed" (they tell you to do it, like a doctor telling you to take pills) rather than "proscribed" (prohibited)?
– David Richerby
14 mins ago
"And even if it is not proscribed by the university..." Do you mean "prescribed" (they tell you to do it, like a doctor telling you to take pills) rather than "proscribed" (prohibited)?
– David Richerby
14 mins ago
add a comment |Â
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f119177%2fis-it-common-to-have-exam-questions-peer-reviewed%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
