In physics and math, a lot of the the intellectual/ academic "action" (a combination of the sharing of results + acclamation by peers (for tenure and promotion)) has moved to preprint servers, specifically http://arxiv.org. Instead of the closed peer review process, what happens is that your scientific peers either start citing you publically or they rip you to shreds publically -- just as good for judging a result as three anonymous (and usually old and set in their ways) reviewers.
This move really pisses off the big publishing houses/ copyright owners like Wiley, but whenever they blather about anonymous peer review what they are really saying is "we make a lot of money off this process -- don't take it away".
The problem with systems like arxiv -- and the reason why all academics don't go there in droves -- is that acedemia promotes people and the govt gives grants based on a formula: sum(journal_prestige .* number_articles). Take away the current system and there is no way to evaluate anybody.
What about via their intellectual merit, you ask? You can prove things in the experimental sciences and math, but in the humanities and the social "sciences" (ack!), there is no objective criteria for evaluating whether a potential hire is either "good" or "not so good" except the above formula. What makes it worse, is that in the social sciences, nobody ever reads papers unless their advisor or one of their advisor's friends wrote it, so if you are on a hiring committee outside your field, you don't know shit about most potential hires (except sum(prestige .* count))
As for the cost -- the internet makes it basically free -- all you have to do is host a bunch of pdf's and have a search function. Fairly trivial for a linux enabled programmer in a university. It is the sociology of it all that prevents the move to open articles.
One of the contradictions, though, to the evaluation argument above is that academics increase in value with each citation, so it hurts an academic to put barriers in front of her papers. Academics almost NEVER make royalties, btw.
(The linked article makes many of the same points.)
A lot of hot academics just put pdf's of their articles on their personal website anyway.
Suggesting that the cost of organizing, judging, critiquing, and hosting those papers is basically free is not supported. http://arstechnica.com/science/news/2010/11/the-economic-cas...
This nice article by ars does quick job of pulling together those costs. Also, just slapping a search engine on a whole bunch of articles exists in Google Scholar, but that hasn't revolutionized anything. It is nice that one can see where all the copies of an article exist, but it is still missing je ne sais quoi.
I guess I was assuming that the product wouldn't be the same as old school publishing, just free; rather I was assuming more like the articles published on arxiv. In this latter case, the layout editing etc is absorbed with the producer and their administrative staff at the university, with the hopes that their article will have a big impact.
The problem is that arxiv-style publishing cannot replace peer-reviewed work in academia. Peer review isn't just something the big publishers are pushing- it's an integral part of academia. Without reputation, a journal doesn't get read- and reputation in academia necessitates peer review.
OTOH, layout is pretty replaceable. Publishers guard their layout guides pretty seriously (lol!), but I'm not sure typesetting services are so important now that most universities- even liberal arts unis- have at least one resident LaTeX guru.
I actually think traditional peer review (2-4 anonymous editors, generally old-boys in their field) is really, really broken. Arxiv and the like functions just fine without it because you get peer reviewed in the open by everyone; if you matter, people subscribe to your papers and try to poke holes in them or start citing them. Also, if you have a new theory that challenges the old guard it won't make it into the journals; with open discussion, if you can back up your crackpot theories with data and theorems they get accepted. (Remember that the "ether" was an obvious truth in the late 1800's in physics; this is a worse problem in the non-hard "sciences" like sociology.)
I think the "peer review" offered by traditional academic publishing process sucks, and the sooner we get away from it the better. The old style peer review USED to work in that it kept complete garbage out of the printed journals that got sent around.
I heard a story the other day about a paper trying to make it into CHI, a big conference in human-computer interaction. In CS and its subfields, conferences like CHI tend to be more important than journals (or so I've heard). Anyway, the paper was rejected by reviewers, and the rebuttal wasn't enough to make it into the conference.
The paper was stellar, and the author knew it, so he persisted, reasoning that the paper was just too far-reaching for his reviewers. He applied to a portion of the conference called alt.chi, where highly externally reviewed papers can be accepted into the conference, despite being turned down by the review proper. He was able to garner 38 positive named reviews - a shoo-in - and was entered into the conference.
On one hand, this is a great story about how the academic community can build processes that correct for conservative or short-sighted peer review. OTO, though, it's interesting to note that if he hadn't had 38 positive named reviews (or some n less than 38, but considered very strong), he wouldn't have been accepted. This is because, historically, named review is messed up- no one would negatively review his paper and attach his or her name. I can't talk too much about the details of arXiv, but I do know that in a named review system, it's easy to both
a) discourage negative commentary, and
b) discourage younger or less experienced reviewers, who are especially afraid of hurting their reputation against more experienced colleagues.
Don't get me wrong- I do think that more open systems can replace the current peer review- but I also believe that double-blind reviews and sometimes the intervention of an editor are important for a coercion-free process. They also make it easier to cut the information clutter- instead of following individual researchers, I can follow a few peer-reviewed outlets I trust.
EDIT: I guess a big part of my point is that while it doesn't need to be traditional peer review, some of the aspects of traditional peer review process need to be maintained in the community.
You make an important point, but public named negative reviews are common in the field of writing fiction. Then apparently, the social setup that writers live in is different from the academic setup where public negative reviews may have "political" consequences for your career.
Any comments on that? Is there something that the academic world can borrow from the writers' world to remove the discouraging influences you mention? I haven't thought through this since I don't know much about a writer's world.
I agree that peer review greatly improves academic publishing, because criticism always accelerates intellectual development. But it doesn't have to take the form practiced by contemporary journals. This recent NASA publication[1] is a good example of how the old system can break down, and how peer review can occur outside that system anyway.[2] It's actually already possible for people to publish that way today. PLoSOne is one facility for this. Unfortunately, there is so much momentum behind the old system that outlets like PLoSOne are seen as dumping grounds for papers which weren't accepted by conventional journals.
>just slapping a search engine on a whole bunch of articles exists in Google Scholar, but that hasn't revolutionized anything
That could be because it was around a long time before Google [Scholar].
When I used to do patent searches we used terminal based services including searches of journals (either abstract or fulltext). I'm guessing these were pre-WWW dial-in services.
> ... acedemia promotes people and the govt gives grants based on a formula: sum(journal_prestige .* number_articles). Take away the current system and there is no way to evaluate anybody.
Neal Stephenson made a similar argument with respect to the arts in his answer to the second question in this interview with slashdot:
Removing barriers to increase citation count, h-index, etc is the primary argument for open access from an author's perspective. I went to a talk at Georgia Tech on open access recently, put on by the library, and they harped really hard on this. Removing barriers can even increase the reputation of a research institution with more highly cited faculty.
This move really pisses off the big publishing houses/ copyright owners like Wiley, but whenever they blather about anonymous peer review what they are really saying is "we make a lot of money off this process -- don't take it away".
The problem with systems like arxiv -- and the reason why all academics don't go there in droves -- is that acedemia promotes people and the govt gives grants based on a formula: sum(journal_prestige .* number_articles). Take away the current system and there is no way to evaluate anybody.
What about via their intellectual merit, you ask? You can prove things in the experimental sciences and math, but in the humanities and the social "sciences" (ack!), there is no objective criteria for evaluating whether a potential hire is either "good" or "not so good" except the above formula. What makes it worse, is that in the social sciences, nobody ever reads papers unless their advisor or one of their advisor's friends wrote it, so if you are on a hiring committee outside your field, you don't know shit about most potential hires (except sum(prestige .* count))
As for the cost -- the internet makes it basically free -- all you have to do is host a bunch of pdf's and have a search function. Fairly trivial for a linux enabled programmer in a university. It is the sociology of it all that prevents the move to open articles.
One of the contradictions, though, to the evaluation argument above is that academics increase in value with each citation, so it hurts an academic to put barriers in front of her papers. Academics almost NEVER make royalties, btw.
(The linked article makes many of the same points.)
A lot of hot academics just put pdf's of their articles on their personal website anyway.