Mixing
![How long do companies wait for a candidate to decide if they accept an offer? [closed]](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgjbpfN9tAutmK93bJRC3ZoROZzi2TJDms5n8_qJuhgE0a9b52OOHayv3NGT8igAdFL7byXNst-_1DZK5SjrIJ28_6RQPUpBROqMs5s6jo-ZsjX8kjDwfxJufIitH3TaQRXWaGSQKRQib-f/s72-c/1.jpg)
Do the authors have to cite or make comparisons against works on domains such as arXiv?
Clash Royale CLAN TAG#URR8PPP
up vote
13
down vote
favorite
I'm reviewing a conference manuscript (computer science) and i found 2 other recent methods related to the same problem which were published on arXiv.
So, i think it is highly recommended to compare their method to those ones. The arXiv papers also claimed to beat the state-of-the-art, but on different datasets, so one cannot compare them based on the reported numerical results.
So, should/could i say that it is a weak point that the authors have not included/used those recent relevant works in their introduction or evaluation basis?
Or they do not have such an obligation as those papers have not been yet published in any proceedings?
publications citations peer-review computer-science arxiv
edited Aug 24 at 21:50
Tripartio
2,883521
asked Aug 24 at 10:12
Bob
1,0391621
add a comment |Â
up vote
13
down vote
favorite
I'm reviewing a conference manuscript (computer science) and i found 2 other recent methods related to the same problem which were published on arXiv.
So, i think it is highly recommended to compare their method to those ones. The arXiv papers also claimed to beat the state-of-the-art, but on different datasets, so one cannot compare them based on the reported numerical results.
So, should/could i say that it is a weak point that the authors have not included/used those recent relevant works in their introduction or evaluation basis?
Or they do not have such an obligation as those papers have not been yet published in any proceedings?
publications citations peer-review computer-science arxiv
edited Aug 24 at 21:50
Tripartio
2,883521
asked Aug 24 at 10:12
Bob
1,0391621
5
You don't need to cite things you don't know about of course. The question really is whether you should know about them. This varies by field as noted by the answer here: academia.stackexchange.com/a/115771/75368
– Buffy
Aug 24 at 11:15
Since notification tools (e.g., Google Scholar) can alert researchers to new results, they should know
– user2768
Aug 24 at 14:28
3
As a stylistic note, it’s actually arXiv
– Stella Biderman
Aug 24 at 20:53
2
@Buffy, "You don't need to cite things you don't know about of course." In general, I politely disagree. Publishing authors are responsible to become aware of what is currently published in their field. Looking at it another way, I would not consider, "I didn't know that article was published" to be an acceptable excuse for not citing relevant work. That said, my point doesn't necessarily apply to grey literature like arXiv: so, I certainly agree with you that whether or not someone is expected to know what is current on arXiv depends very much on their field.
– Tripartio
Aug 24 at 21:55
@mikea, it would depend on the contents of the articles. If something newly appears on arXiv that convincingly contradicts the authors' findings, as a peer-reviewer I would at least clearly express my reservations to the authors and to the editor. Peer-review should respect scholarly accuracy more than a sense of that authors have a right to publish something just because they said it before anyone had time to contradict it. Or perhaps I misunderstand your implication?
– Tripartio
Aug 25 at 6:16
add a comment |Â
up vote
13
down vote
favorite
up vote
13
down vote
favorite
I'm reviewing a conference manuscript (computer science) and i found 2 other recent methods related to the same problem which were published on arXiv.
So, i think it is highly recommended to compare their method to those ones. The arXiv papers also claimed to beat the state-of-the-art, but on different datasets, so one cannot compare them based on the reported numerical results.
So, should/could i say that it is a weak point that the authors have not included/used those recent relevant works in their introduction or evaluation basis?
Or they do not have such an obligation as those papers have not been yet published in any proceedings?
publications citations peer-review computer-science arxiv
edited Aug 24 at 21:50
Tripartio
2,883521
asked Aug 24 at 10:12
Bob
1,0391621
I'm reviewing a conference manuscript (computer science) and i found 2 other recent methods related to the same problem which were published on arXiv.
So, i think it is highly recommended to compare their method to those ones. The arXiv papers also claimed to beat the state-of-the-art, but on different datasets, so one cannot compare them based on the reported numerical results.
So, should/could i say that it is a weak point that the authors have not included/used those recent relevant works in their introduction or evaluation basis?
Or they do not have such an obligation as those papers have not been yet published in any proceedings?
publications citations peer-review computer-science arxiv
edited Aug 24 at 21:50
Tripartio
2,883521
asked Aug 24 at 10:12
Bob
1,0391621
edited Aug 24 at 21:50
Tripartio
2,883521
edited Aug 24 at 21:50
Tripartio
2,883521
edited Aug 24 at 21:50
Tripartio
2,883521
2,883521
asked Aug 24 at 10:12
Bob
1,0391621
asked Aug 24 at 10:12
Bob
1,0391621
asked Aug 24 at 10:12
Bob
1,0391621
1,0391621
5
You don't need to cite things you don't know about of course. The question really is whether you should know about them. This varies by field as noted by the answer here: academia.stackexchange.com/a/115771/75368
– Buffy
Aug 24 at 11:15
Since notification tools (e.g., Google Scholar) can alert researchers to new results, they should know
– user2768
Aug 24 at 14:28
3
As a stylistic note, it’s actually arXiv
– Stella Biderman
Aug 24 at 20:53
2
@Buffy, "You don't need to cite things you don't know about of course." In general, I politely disagree. Publishing authors are responsible to become aware of what is currently published in their field. Looking at it another way, I would not consider, "I didn't know that article was published" to be an acceptable excuse for not citing relevant work. That said, my point doesn't necessarily apply to grey literature like arXiv: so, I certainly agree with you that whether or not someone is expected to know what is current on arXiv depends very much on their field.
– Tripartio
Aug 24 at 21:55
@mikea, it would depend on the contents of the articles. If something newly appears on arXiv that convincingly contradicts the authors' findings, as a peer-reviewer I would at least clearly express my reservations to the authors and to the editor. Peer-review should respect scholarly accuracy more than a sense of that authors have a right to publish something just because they said it before anyone had time to contradict it. Or perhaps I misunderstand your implication?
– Tripartio
Aug 25 at 6:16
add a comment |Â
5
You don't need to cite things you don't know about of course. The question really is whether you should know about them. This varies by field as noted by the answer here: academia.stackexchange.com/a/115771/75368
– Buffy
Aug 24 at 11:15
Since notification tools (e.g., Google Scholar) can alert researchers to new results, they should know
– user2768
Aug 24 at 14:28
3
As a stylistic note, it’s actually arXiv
– Stella Biderman
Aug 24 at 20:53
2
@Buffy, "You don't need to cite things you don't know about of course." In general, I politely disagree. Publishing authors are responsible to become aware of what is currently published in their field. Looking at it another way, I would not consider, "I didn't know that article was published" to be an acceptable excuse for not citing relevant work. That said, my point doesn't necessarily apply to grey literature like arXiv: so, I certainly agree with you that whether or not someone is expected to know what is current on arXiv depends very much on their field.
– Tripartio
Aug 24 at 21:55
@mikea, it would depend on the contents of the articles. If something newly appears on arXiv that convincingly contradicts the authors' findings, as a peer-reviewer I would at least clearly express my reservations to the authors and to the editor. Peer-review should respect scholarly accuracy more than a sense of that authors have a right to publish something just because they said it before anyone had time to contradict it. Or perhaps I misunderstand your implication?
– Tripartio
Aug 25 at 6:16
5
5
You don't need to cite things you don't know about of course. The question really is whether you should know about them. This varies by field as noted by the answer here: academia.stackexchange.com/a/115771/75368
– Buffy
Aug 24 at 11:15
You don't need to cite things you don't know about of course. The question really is whether you should know about them. This varies by field as noted by the answer here: academia.stackexchange.com/a/115771/75368
– Buffy
Aug 24 at 11:15
Since notification tools (e.g., Google Scholar) can alert researchers to new results, they should know
– user2768
Aug 24 at 14:28
Since notification tools (e.g., Google Scholar) can alert researchers to new results, they should know
– user2768
Aug 24 at 14:28
3
3
As a stylistic note, it’s actually arXiv
– Stella Biderman
Aug 24 at 20:53
As a stylistic note, it’s actually arXiv
– Stella Biderman
Aug 24 at 20:53
2
2
@Buffy, "You don't need to cite things you don't know about of course." In general, I politely disagree. Publishing authors are responsible to become aware of what is currently published in their field. Looking at it another way, I would not consider, "I didn't know that article was published" to be an acceptable excuse for not citing relevant work. That said, my point doesn't necessarily apply to grey literature like arXiv: so, I certainly agree with you that whether or not someone is expected to know what is current on arXiv depends very much on their field.
– Tripartio
Aug 24 at 21:55
@Buffy, "You don't need to cite things you don't know about of course." In general, I politely disagree. Publishing authors are responsible to become aware of what is currently published in their field. Looking at it another way, I would not consider, "I didn't know that article was published" to be an acceptable excuse for not citing relevant work. That said, my point doesn't necessarily apply to grey literature like arXiv: so, I certainly agree with you that whether or not someone is expected to know what is current on arXiv depends very much on their field.
– Tripartio
Aug 24 at 21:55
@mikea, it would depend on the contents of the articles. If something newly appears on arXiv that convincingly contradicts the authors' findings, as a peer-reviewer I would at least clearly express my reservations to the authors and to the editor. Peer-review should respect scholarly accuracy more than a sense of that authors have a right to publish something just because they said it before anyone had time to contradict it. Or perhaps I misunderstand your implication?
– Tripartio
Aug 25 at 6:16
@mikea, it would depend on the contents of the articles. If something newly appears on arXiv that convincingly contradicts the authors' findings, as a peer-reviewer I would at least clearly express my reservations to the authors and to the editor. Peer-review should respect scholarly accuracy more than a sense of that authors have a right to publish something just because they said it before anyone had time to contradict it. Or perhaps I misunderstand your implication?
– Tripartio
Aug 25 at 6:16
add a comment |Â
4 Answers
4
active
oldest
votes
up vote
16
down vote
I think this question is ultimately about standards within particular fields and societies. In math, where arxiv has been central for decades, it would be odd to overlook highly related examples, and using your language it's reasonable to assume authors would be obligated to check. In psychology, where I work, preprint repositories are still fairly unusual, and authors are not expected to review these sources.
answered Aug 24 at 10:17
Cameron Brick
3575
3
in math, where arxiv has been central for decades — ...or in theoretical computer science, where everyone uses Google to find references already. (See also: ECCC, technical reports, manuscripts on personal web pages)
– JeffE
Aug 25 at 4:18
add a comment |Â
up vote
9
down vote
If you know about these results, then you should definitely mention them in your review. Since you are the sub-reviewer you can simply notify the PC members about this, and they will (or should) know how to treat ArXiV publications.
Usually, I think they will not consider it a detraction of the result. Also, they will need to assess whether the results have been obtained independently of the ArXiV papers or not.
answered Aug 24 at 17:01
Dilworth
3,6351219
1
Usually, I think they will not consider it a detraction of the result. — That really depends on the age and content of the arXiv paper. If a paper solving the same problem as the submission has been posted on arXiv for more than a few weeks before the submission deadline, the submission is likely to be (and should be) rejected..
– JeffE
Aug 25 at 4:21
I think few weeks is not that much. If it was like half a year maybe. I know of cases were this didn't detract the acceptance of papers; though this was for very prestigious journals, and it was claimed that the results were independently obtained, and so this case is slightly different.
– Dilworth
Aug 25 at 12:59
add a comment |Â
up vote
8
down vote
Ultimately, scientific papers are supposed to further the "state of the art" in a field. For that, they need to compare with the state of the art, which includes any publication a paper's authors or readers can find -- whether it's in a peer reviewed journal or on a preprint server such as arXiv does not immediately matter.
So yes: you should definitely mention this!
answered Aug 24 at 21:19
Wolfgang Bangerth
31.5k461113
add a comment |Â
up vote
1
down vote
On one hand, I do consider it the job of reviewers to verify that authors are aware of relevant literature and to help them become aware of relevant work that they might have missed. So, I think you should definitely mention the arXiv articles that you found.
On the other hand, I think the authors should be given the right to decide whether they want to consider non-peer-reviewed work in their study, even if they are made aware of it. After all, they have submitted their work for your peer-review because they value the peer-review system; they should not be required to consider work as relevant that has not been formally evaluated by independent, qualified scholars.
So, in short, I think you should bring these works to their attention, but leave it to their discretion whether or not to incorporate their findings.
answered Aug 24 at 21:49
Tripartio
2,883521
...because they value the peer-review system — [citation needed] It's at least as likely that they have submitted their work to the peer-review system because, to first order, only peer-reviewed publications count toward hiring and promotion decisions.
– JeffE
Aug 25 at 4:23
@jeffe, yes: in your example, they value the peer-review system for its role in validating their publications for the sake of their career advancement--I very much have such scenarios in mind when I talk about "value". I did not necessarily mean that they value the system intrinsically.
– Tripartio
Aug 25 at 6:08
@Tripartio : Quite many don't value the peer-review system particularly highly. It's more they need the peer-reviewed articles as it boosts their chances to be hired to spots they want in the future. Like a necessary evil.
– mathreadler
Aug 25 at 11:15
Many researchers could be much more productive if they did not have to spend such large amounts of time and energy banging their head against the peer-review wall.
– mathreadler
Aug 25 at 11:22
add a comment |Â
4 Answers
4
active
oldest
votes
4 Answers
4
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
16
down vote
I think this question is ultimately about standards within particular fields and societies. In math, where arxiv has been central for decades, it would be odd to overlook highly related examples, and using your language it's reasonable to assume authors would be obligated to check. In psychology, where I work, preprint repositories are still fairly unusual, and authors are not expected to review these sources.
answered Aug 24 at 10:17
Cameron Brick
3575
3
in math, where arxiv has been central for decades — ...or in theoretical computer science, where everyone uses Google to find references already. (See also: ECCC, technical reports, manuscripts on personal web pages)
– JeffE
Aug 25 at 4:18
add a comment |Â
up vote
16
down vote
I think this question is ultimately about standards within particular fields and societies. In math, where arxiv has been central for decades, it would be odd to overlook highly related examples, and using your language it's reasonable to assume authors would be obligated to check. In psychology, where I work, preprint repositories are still fairly unusual, and authors are not expected to review these sources.
answered Aug 24 at 10:17
Cameron Brick
3575
3
in math, where arxiv has been central for decades — ...or in theoretical computer science, where everyone uses Google to find references already. (See also: ECCC, technical reports, manuscripts on personal web pages)
– JeffE
Aug 25 at 4:18
add a comment |Â
up vote
16
down vote
up vote
16
down vote
I think this question is ultimately about standards within particular fields and societies. In math, where arxiv has been central for decades, it would be odd to overlook highly related examples, and using your language it's reasonable to assume authors would be obligated to check. In psychology, where I work, preprint repositories are still fairly unusual, and authors are not expected to review these sources.
answered Aug 24 at 10:17
Cameron Brick
3575
I think this question is ultimately about standards within particular fields and societies. In math, where arxiv has been central for decades, it would be odd to overlook highly related examples, and using your language it's reasonable to assume authors would be obligated to check. In psychology, where I work, preprint repositories are still fairly unusual, and authors are not expected to review these sources.
answered Aug 24 at 10:17
Cameron Brick
3575
answered Aug 24 at 10:17
Cameron Brick
3575
answered Aug 24 at 10:17
Cameron Brick
3575
answered Aug 24 at 10:17
Cameron Brick
3575
3575
3
in math, where arxiv has been central for decades — ...or in theoretical computer science, where everyone uses Google to find references already. (See also: ECCC, technical reports, manuscripts on personal web pages)
– JeffE
Aug 25 at 4:18
add a comment |Â
3
in math, where arxiv has been central for decades — ...or in theoretical computer science, where everyone uses Google to find references already. (See also: ECCC, technical reports, manuscripts on personal web pages)
– JeffE
Aug 25 at 4:18
3
3
in math, where arxiv has been central for decades — ...or in theoretical computer science, where everyone uses Google to find references already. (See also: ECCC, technical reports, manuscripts on personal web pages)
– JeffE
Aug 25 at 4:18
in math, where arxiv has been central for decades — ...or in theoretical computer science, where everyone uses Google to find references already. (See also: ECCC, technical reports, manuscripts on personal web pages)
– JeffE
Aug 25 at 4:18
add a comment |Â
up vote
9
down vote
If you know about these results, then you should definitely mention them in your review. Since you are the sub-reviewer you can simply notify the PC members about this, and they will (or should) know how to treat ArXiV publications.
Usually, I think they will not consider it a detraction of the result. Also, they will need to assess whether the results have been obtained independently of the ArXiV papers or not.
answered Aug 24 at 17:01
Dilworth
3,6351219
1
Usually, I think they will not consider it a detraction of the result. — That really depends on the age and content of the arXiv paper. If a paper solving the same problem as the submission has been posted on arXiv for more than a few weeks before the submission deadline, the submission is likely to be (and should be) rejected..
– JeffE
Aug 25 at 4:21
I think few weeks is not that much. If it was like half a year maybe. I know of cases were this didn't detract the acceptance of papers; though this was for very prestigious journals, and it was claimed that the results were independently obtained, and so this case is slightly different.
– Dilworth
Aug 25 at 12:59
add a comment |Â
up vote
9
down vote
If you know about these results, then you should definitely mention them in your review. Since you are the sub-reviewer you can simply notify the PC members about this, and they will (or should) know how to treat ArXiV publications.
Usually, I think they will not consider it a detraction of the result. Also, they will need to assess whether the results have been obtained independently of the ArXiV papers or not.
answered Aug 24 at 17:01
Dilworth
3,6351219
1
Usually, I think they will not consider it a detraction of the result. — That really depends on the age and content of the arXiv paper. If a paper solving the same problem as the submission has been posted on arXiv for more than a few weeks before the submission deadline, the submission is likely to be (and should be) rejected..
– JeffE
Aug 25 at 4:21
I think few weeks is not that much. If it was like half a year maybe. I know of cases were this didn't detract the acceptance of papers; though this was for very prestigious journals, and it was claimed that the results were independently obtained, and so this case is slightly different.
– Dilworth
Aug 25 at 12:59
add a comment |Â
up vote
9
down vote
up vote
9
down vote
If you know about these results, then you should definitely mention them in your review. Since you are the sub-reviewer you can simply notify the PC members about this, and they will (or should) know how to treat ArXiV publications.
Usually, I think they will not consider it a detraction of the result. Also, they will need to assess whether the results have been obtained independently of the ArXiV papers or not.
answered Aug 24 at 17:01
Dilworth
3,6351219
If you know about these results, then you should definitely mention them in your review. Since you are the sub-reviewer you can simply notify the PC members about this, and they will (or should) know how to treat ArXiV publications.
Usually, I think they will not consider it a detraction of the result. Also, they will need to assess whether the results have been obtained independently of the ArXiV papers or not.
answered Aug 24 at 17:01
Dilworth
3,6351219
edited Aug 24 at 20:14
answered Aug 24 at 17:01
Dilworth
3,6351219
answered Aug 24 at 17:01
Dilworth
3,6351219
answered Aug 24 at 17:01
Dilworth
3,6351219
3,6351219
1
Usually, I think they will not consider it a detraction of the result. — That really depends on the age and content of the arXiv paper. If a paper solving the same problem as the submission has been posted on arXiv for more than a few weeks before the submission deadline, the submission is likely to be (and should be) rejected..
– JeffE
Aug 25 at 4:21
I think few weeks is not that much. If it was like half a year maybe. I know of cases were this didn't detract the acceptance of papers; though this was for very prestigious journals, and it was claimed that the results were independently obtained, and so this case is slightly different.
– Dilworth
Aug 25 at 12:59
add a comment |Â
1
Usually, I think they will not consider it a detraction of the result. — That really depends on the age and content of the arXiv paper. If a paper solving the same problem as the submission has been posted on arXiv for more than a few weeks before the submission deadline, the submission is likely to be (and should be) rejected..
– JeffE
Aug 25 at 4:21
I think few weeks is not that much. If it was like half a year maybe. I know of cases were this didn't detract the acceptance of papers; though this was for very prestigious journals, and it was claimed that the results were independently obtained, and so this case is slightly different.
– Dilworth
Aug 25 at 12:59
1
1
Usually, I think they will not consider it a detraction of the result. — That really depends on the age and content of the arXiv paper. If a paper solving the same problem as the submission has been posted on arXiv for more than a few weeks before the submission deadline, the submission is likely to be (and should be) rejected..
– JeffE
Aug 25 at 4:21
Usually, I think they will not consider it a detraction of the result. — That really depends on the age and content of the arXiv paper. If a paper solving the same problem as the submission has been posted on arXiv for more than a few weeks before the submission deadline, the submission is likely to be (and should be) rejected..
– JeffE
Aug 25 at 4:21
I think few weeks is not that much. If it was like half a year maybe. I know of cases were this didn't detract the acceptance of papers; though this was for very prestigious journals, and it was claimed that the results were independently obtained, and so this case is slightly different.
– Dilworth
Aug 25 at 12:59
I think few weeks is not that much. If it was like half a year maybe. I know of cases were this didn't detract the acceptance of papers; though this was for very prestigious journals, and it was claimed that the results were independently obtained, and so this case is slightly different.
– Dilworth
Aug 25 at 12:59
add a comment |Â
up vote
8
down vote
Ultimately, scientific papers are supposed to further the "state of the art" in a field. For that, they need to compare with the state of the art, which includes any publication a paper's authors or readers can find -- whether it's in a peer reviewed journal or on a preprint server such as arXiv does not immediately matter.
So yes: you should definitely mention this!
answered Aug 24 at 21:19
Wolfgang Bangerth
31.5k461113
add a comment |Â
up vote
8
down vote
Ultimately, scientific papers are supposed to further the "state of the art" in a field. For that, they need to compare with the state of the art, which includes any publication a paper's authors or readers can find -- whether it's in a peer reviewed journal or on a preprint server such as arXiv does not immediately matter.
So yes: you should definitely mention this!
answered Aug 24 at 21:19
Wolfgang Bangerth
31.5k461113
add a comment |Â
up vote
8
down vote
up vote
8
down vote
Ultimately, scientific papers are supposed to further the "state of the art" in a field. For that, they need to compare with the state of the art, which includes any publication a paper's authors or readers can find -- whether it's in a peer reviewed journal or on a preprint server such as arXiv does not immediately matter.
So yes: you should definitely mention this!
answered Aug 24 at 21:19
Wolfgang Bangerth
31.5k461113
Ultimately, scientific papers are supposed to further the "state of the art" in a field. For that, they need to compare with the state of the art, which includes any publication a paper's authors or readers can find -- whether it's in a peer reviewed journal or on a preprint server such as arXiv does not immediately matter.
So yes: you should definitely mention this!
answered Aug 24 at 21:19
Wolfgang Bangerth
31.5k461113
answered Aug 24 at 21:19
Wolfgang Bangerth
31.5k461113
answered Aug 24 at 21:19
Wolfgang Bangerth
31.5k461113
answered Aug 24 at 21:19
Wolfgang Bangerth
31.5k461113
31.5k461113
add a comment |Â
add a comment |Â
up vote
1
down vote
On one hand, I do consider it the job of reviewers to verify that authors are aware of relevant literature and to help them become aware of relevant work that they might have missed. So, I think you should definitely mention the arXiv articles that you found.
On the other hand, I think the authors should be given the right to decide whether they want to consider non-peer-reviewed work in their study, even if they are made aware of it. After all, they have submitted their work for your peer-review because they value the peer-review system; they should not be required to consider work as relevant that has not been formally evaluated by independent, qualified scholars.
So, in short, I think you should bring these works to their attention, but leave it to their discretion whether or not to incorporate their findings.
answered Aug 24 at 21:49
Tripartio
2,883521
...because they value the peer-review system — [citation needed] It's at least as likely that they have submitted their work to the peer-review system because, to first order, only peer-reviewed publications count toward hiring and promotion decisions.
– JeffE
Aug 25 at 4:23
@jeffe, yes: in your example, they value the peer-review system for its role in validating their publications for the sake of their career advancement--I very much have such scenarios in mind when I talk about "value". I did not necessarily mean that they value the system intrinsically.
– Tripartio
Aug 25 at 6:08
@Tripartio : Quite many don't value the peer-review system particularly highly. It's more they need the peer-reviewed articles as it boosts their chances to be hired to spots they want in the future. Like a necessary evil.
– mathreadler
Aug 25 at 11:15
Many researchers could be much more productive if they did not have to spend such large amounts of time and energy banging their head against the peer-review wall.
– mathreadler
Aug 25 at 11:22
add a comment |Â
up vote
1
down vote
On one hand, I do consider it the job of reviewers to verify that authors are aware of relevant literature and to help them become aware of relevant work that they might have missed. So, I think you should definitely mention the arXiv articles that you found.
On the other hand, I think the authors should be given the right to decide whether they want to consider non-peer-reviewed work in their study, even if they are made aware of it. After all, they have submitted their work for your peer-review because they value the peer-review system; they should not be required to consider work as relevant that has not been formally evaluated by independent, qualified scholars.
So, in short, I think you should bring these works to their attention, but leave it to their discretion whether or not to incorporate their findings.
answered Aug 24 at 21:49
Tripartio
2,883521
...because they value the peer-review system — [citation needed] It's at least as likely that they have submitted their work to the peer-review system because, to first order, only peer-reviewed publications count toward hiring and promotion decisions.
– JeffE
Aug 25 at 4:23
@jeffe, yes: in your example, they value the peer-review system for its role in validating their publications for the sake of their career advancement--I very much have such scenarios in mind when I talk about "value". I did not necessarily mean that they value the system intrinsically.
– Tripartio
Aug 25 at 6:08
@Tripartio : Quite many don't value the peer-review system particularly highly. It's more they need the peer-reviewed articles as it boosts their chances to be hired to spots they want in the future. Like a necessary evil.
– mathreadler
Aug 25 at 11:15
Many researchers could be much more productive if they did not have to spend such large amounts of time and energy banging their head against the peer-review wall.
– mathreadler
Aug 25 at 11:22
add a comment |Â
up vote
1
down vote
up vote
1
down vote
On one hand, I do consider it the job of reviewers to verify that authors are aware of relevant literature and to help them become aware of relevant work that they might have missed. So, I think you should definitely mention the arXiv articles that you found.
On the other hand, I think the authors should be given the right to decide whether they want to consider non-peer-reviewed work in their study, even if they are made aware of it. After all, they have submitted their work for your peer-review because they value the peer-review system; they should not be required to consider work as relevant that has not been formally evaluated by independent, qualified scholars.
So, in short, I think you should bring these works to their attention, but leave it to their discretion whether or not to incorporate their findings.
answered Aug 24 at 21:49
Tripartio
2,883521
On one hand, I do consider it the job of reviewers to verify that authors are aware of relevant literature and to help them become aware of relevant work that they might have missed. So, I think you should definitely mention the arXiv articles that you found.
On the other hand, I think the authors should be given the right to decide whether they want to consider non-peer-reviewed work in their study, even if they are made aware of it. After all, they have submitted their work for your peer-review because they value the peer-review system; they should not be required to consider work as relevant that has not been formally evaluated by independent, qualified scholars.
So, in short, I think you should bring these works to their attention, but leave it to their discretion whether or not to incorporate their findings.
answered Aug 24 at 21:49
Tripartio
2,883521
answered Aug 24 at 21:49
Tripartio
2,883521
answered Aug 24 at 21:49
Tripartio
2,883521
answered Aug 24 at 21:49
Tripartio
2,883521
2,883521
...because they value the peer-review system — [citation needed] It's at least as likely that they have submitted their work to the peer-review system because, to first order, only peer-reviewed publications count toward hiring and promotion decisions.
– JeffE
Aug 25 at 4:23
@jeffe, yes: in your example, they value the peer-review system for its role in validating their publications for the sake of their career advancement--I very much have such scenarios in mind when I talk about "value". I did not necessarily mean that they value the system intrinsically.
– Tripartio
Aug 25 at 6:08
@Tripartio : Quite many don't value the peer-review system particularly highly. It's more they need the peer-reviewed articles as it boosts their chances to be hired to spots they want in the future. Like a necessary evil.
– mathreadler
Aug 25 at 11:15
Many researchers could be much more productive if they did not have to spend such large amounts of time and energy banging their head against the peer-review wall.
– mathreadler
Aug 25 at 11:22
add a comment |Â
...because they value the peer-review system — [citation needed] It's at least as likely that they have submitted their work to the peer-review system because, to first order, only peer-reviewed publications count toward hiring and promotion decisions.
– JeffE
Aug 25 at 4:23
@jeffe, yes: in your example, they value the peer-review system for its role in validating their publications for the sake of their career advancement--I very much have such scenarios in mind when I talk about "value". I did not necessarily mean that they value the system intrinsically.
– Tripartio
Aug 25 at 6:08
@Tripartio : Quite many don't value the peer-review system particularly highly. It's more they need the peer-reviewed articles as it boosts their chances to be hired to spots they want in the future. Like a necessary evil.
– mathreadler
Aug 25 at 11:15
Many researchers could be much more productive if they did not have to spend such large amounts of time and energy banging their head against the peer-review wall.
– mathreadler
Aug 25 at 11:22
...because they value the peer-review system — [citation needed] It's at least as likely that they have submitted their work to the peer-review system because, to first order, only peer-reviewed publications count toward hiring and promotion decisions.
– JeffE
Aug 25 at 4:23
...because they value the peer-review system — [citation needed] It's at least as likely that they have submitted their work to the peer-review system because, to first order, only peer-reviewed publications count toward hiring and promotion decisions.
– JeffE
Aug 25 at 4:23
@jeffe, yes: in your example, they value the peer-review system for its role in validating their publications for the sake of their career advancement--I very much have such scenarios in mind when I talk about "value". I did not necessarily mean that they value the system intrinsically.
– Tripartio
Aug 25 at 6:08
@jeffe, yes: in your example, they value the peer-review system for its role in validating their publications for the sake of their career advancement--I very much have such scenarios in mind when I talk about "value". I did not necessarily mean that they value the system intrinsically.
– Tripartio
Aug 25 at 6:08
@Tripartio : Quite many don't value the peer-review system particularly highly. It's more they need the peer-reviewed articles as it boosts their chances to be hired to spots they want in the future. Like a necessary evil.
– mathreadler
Aug 25 at 11:15
@Tripartio : Quite many don't value the peer-review system particularly highly. It's more they need the peer-reviewed articles as it boosts their chances to be hired to spots they want in the future. Like a necessary evil.
– mathreadler
Aug 25 at 11:15
Many researchers could be much more productive if they did not have to spend such large amounts of time and energy banging their head against the peer-review wall.
– mathreadler
Aug 25 at 11:22
Many researchers could be much more productive if they did not have to spend such large amounts of time and energy banging their head against the peer-review wall.
– mathreadler
Aug 25 at 11:22
add a comment |Â
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f115770%2fdo-the-authors-have-to-cite-or-make-comparisons-against-works-on-domains-such-as%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
5
You don't need to cite things you don't know about of course. The question really is whether you should know about them. This varies by field as noted by the answer here: academia.stackexchange.com/a/115771/75368
– Buffy
Aug 24 at 11:15
Since notification tools (e.g., Google Scholar) can alert researchers to new results, they should know
– user2768
Aug 24 at 14:28
3
As a stylistic note, it’s actually arXiv
– Stella Biderman
Aug 24 at 20:53
2
@Buffy, "You don't need to cite things you don't know about of course." In general, I politely disagree. Publishing authors are responsible to become aware of what is currently published in their field. Looking at it another way, I would not consider, "I didn't know that article was published" to be an acceptable excuse for not citing relevant work. That said, my point doesn't necessarily apply to grey literature like arXiv: so, I certainly agree with you that whether or not someone is expected to know what is current on arXiv depends very much on their field.
– Tripartio
Aug 24 at 21:55
@mikea, it would depend on the contents of the articles. If something newly appears on arXiv that convincingly contradicts the authors' findings, as a peer-reviewer I would at least clearly express my reservations to the authors and to the editor. Peer-review should respect scholarly accuracy more than a sense of that authors have a right to publish something just because they said it before anyone had time to contradict it. Or perhaps I misunderstand your implication?
– Tripartio
Aug 25 at 6:16