Re: OT: interesting global warming quote found elsewhwere

Kris Krieger wrote:
James Arthur <bogusabdsqy@xxxxxxxxxxx> wrote in
8x0nk.402$ZV1.380@trnddc07:">news:8x0nk.402$ZV1.380@trnddc07:

bill.sloman@xxxxxxxx wrote:
On Aug 7, 3:53 am, Joerg <notthisjoerg...@xxxxxxxxxxxxxxxxxxxxx>
wrote:
James Arthur wrote:
bill.slo...@xxxxxxxx wrote:
[...]



I haven't noticed Steve McIntyre, or
anybody else with concerns about the quality of refereeing in
scientific journals, ever coming up with scheme for paying
referees for the time they put in on reading and trying to
understand other people's papers. At the moment the people who put
in the time get very little back for their work, and this time
could more productively be invested in work that will get them
publications, grant money and promotion.
"... that will get them publications, grant money and promotion".
That is a nearly perfect description for a publish-or-parish gravy
train mentality. And that's part of this whole problem. or in plain
English: Selfishness.
We happen to live in a selfish society.
Publishers like Elsevier who charge big bucks for the academic
journals they publish, while paying nothing to the referees who do
the quality control that makes the journals worth those big bucks,
presumably also rate as selfish.

That's the most damning description of peer-review I've heard.
If the reviewers aren't interested and don't have the time, maybe
they shouldn't do it.
Exactamente.
Nevertheless, enough people do it, and do it well enough, that we do
seem to have a growing body of useful scientific knowledge.

If you don't like the system, you are welcome to devise a scheme that
might work better, and spend the time, effort and money required to
get it working in competition with the existing structure.
No Bill, what you describe is a corruption, a sham, not peer-review.

Peer review is no guarantee of quality or accuracy--as it's intended
to be and as you've touted it--if the reviewers aren't actually
examining the data, methods, and checking calculations for errors.

By your description peer review is worthless; a Good Housekeeping
Seal of Approval would be better; at least those products are
checked for quality before being endorsed.

Cheers,
James Arthur


I know someone who's published a number of scientific papers, and it's my understanding that the people who review papers on a given topic are knowledgeable enough so that they don't *have* to redo everything - they can spot methodological problems, wrroneous calculations, disjuncts of logic, and other erros without literally sitting down and redoing it all.

Part of being an expert is having a certain dataset pretty much committed to memory.

That's not the case here. The reviewers didn't have the data and
authors weren't giving it out. T'was secret. That's my gripe.

Nor were the methods disclosed. So there's no way reviewers could
have actually checked the articles they supposedly checked.

And, it turns out, there *were* a whole bunch of mistakes, which
wasn't discovered until 8 years later when some non-climatologists
managed to get, then add up the numbers. And they didn't add up.

Best,
James Arthur
.

Relevant Pages

  • Re: OT: interesting global warming quote found elsewhwere
    ... ever coming up with scheme for paying referees ... journals they publish, while paying nothing to the referees who do the ... If the reviewers aren't interested and don't have the time, ...
    (sci.electronics.design)
  • Re: OT: interesting global warming quote found elsewhwere
    ... journals they publish, while paying nothing to the referees who do ... If the reviewers aren't interested and don't have the time, ... I know someone who's published a number of scientific papers, ...
    (sci.electronics.design)
  • Re: OT: interesting global warming quote found elsewhwere
    ... understand other people's papers. ... journals they publish, while paying nothing to the referees who do ... If the reviewers aren't interested and don't have the time, ... McIntyre claimed that this meant that random data treated in this way ...
    (sci.electronics.design)
  • Re: stop railing against other people, ART Sowers.
    ... When one factors in that only a few journals are heavily read, then the goal should be to get one's paper into those journals. ... This is, however, basically unfeasible because the rejection rate at those journals is far higher than average and the secondary purpose of publishing (namely to satisfy promotion requirements and minimum publication rate standards to retain a job) becomes the primary purpose and if one spends too much time re-submitting a rejected paper, then one is taking too much time to get work published. ... hostage to the whims, prefernces, biases, and significance-detecting abilities of a few editors at the top journals who decide if a particular report is "exciting" enough that the paper will actually be reviewed to see if it is "exciting" to the sellected reviewers as well as those editors who think first about whether the results are "exciting" and think second about whether the study was carried out scientifically and competantly. ...
    (sci.research.careers)
  • Re: stop railing against other people, ART Sowers.
    ... The same is quite often the case in grant proposal reviews: primary reviewers may be coming from related but not the same field, but I've seen many from fields unrelated to the topic of the proposal. ... When one factors in that only a few journals are heavily read, then the goal should be to get one's paper into those journals. ... This is, however, basically unfeasible because the rejection rate at those journals is far higher than average and the secondary purpose of publishing (namely to satisfy promotion requirements and minimum publication rate standards to retain a job) becomes the primary purpose and if one spends too much time re-submitting a rejected paper, then one is taking too much time to get work published. ... Most scientists have a more difficult time if they pursue avenues of research that are more creative, original, or new because all of those avenues are more risky and involve more unknowns. ...
    (sci.research.careers)