Friday, July 31, 2009

Workshops: Official or Unofficial Proceedings?

In the process of organizing DBRank 2010, we had to answer the following question: Should the proceedings for the workshop be "official" or "unofficial"?


Official workshop proceedings are undergoing the same process as the conference papers: Specific camera-ready format, submission by a given date to the proceedings chair, and then are officially hosted at the digital library of the publisher, with all the metadata, digital identifiers (DOI), and so on. (For DBRank 2010, that would be IEEE Xplore.) For buraucratic purposes, these papers are considered "publications."

Unofficial proceedings are, well, unofficial. Typically the workshop chair posts the papers up to the website, and potentially brings printed copies for distribution at the workshop. There is no official publisher, there is no DOI assigned to the papers, and in principle this is not more of a publication than a paper posted to a website.

So, should workshops have official or unofficial proceedings?

There are some arguments aganst official proceedings:
  • Increasingly, there is a significant conflict between workshop and conference publications. With some workshops allowing 8- or even 10-page workshop papers, it becomes hard for the authors of these papers to publish the same work in a conference, as there is typically significant overlap. Most database conferences will consider any past paper that is 3 pages or longer, to be a prior publication, and the conference version should have significant new content in order to be considered a "new" paper.
  • As conference become increasingly competitive many authors submit to workshops papers that could not "make it" to a conference. A workshop is typically easier to get into, and at the end "you get a paper" out of it. Needless to say, this pretty much violates the spirit of workshops that are supposed to be places for new, relatively immature research, not an archival publication.
On the other hand, there are advantages in having official proceedings:
  • It makes the workshop more attractive in the eyes of many authors. Authors get an official timestamp for their work and can point to a paper that has at least been lightly refereed, instead of pointing to a technical report or working paper.
  • It makes it easier for someone to locate the papers that were presented in the workshop. The websites for the workshops are not always hosted in "stable" websites and they disappear for various reasons. (For example, the websites for WebDB'99, WebDB 2000, WebDB 2001, and WebDB 2003 are not available any more, because the organizers have moved to different institutions.)
So, what to do? Official or unofficial?

3 comments:

Amélie said...

Unfortunately, some reviewers consider even unofficial workshop publications as published. It happened to me with two different papers that were rejected because they had too much overlap with an unofficial workshop publication, and since the workshop proceedings were available on a web site, the reviewers considered it prior published work. In this case, we might as well make all workshop proceedings official.

FWIW, I'd rather have them unofficial and have workshops as forums for new and immature research ideas, but I don't think it is what is happening in practice.

Maya said...

One of my recent submissions to WebDB which had pretty well-fleshed out ideas on ranking structured data was rejected for not having a detailed related work section (we did not satisfactorily differentiate ourselves) and not having efficiency experiments (we had only a user study). That indicates to me that, what I basically need is a conference level paper or at least a paper which touches upon all the things that a conference paper would, but a shorter version of it. And if I do that much of work, then it better be an official publication.

And I personally would prefer to have my workshop publication as a recognized publication. Sure, the idea may be immature, but I should still be able take "official credit" for it!

Mor said...

I had the same experience as Amelie, with journal paper rejected because not enough content was new over an unofficial workshop submission.

But my answer is: why choose? I think there is room for both types of workshop. The "real" workshop, with work-in-progress submission, discussion-style meeting (not frontal presentations, or at least not most of the time) and informal. More established workshops that take real papers should have official, archival proceedings and the authors should take that into account. Yes, that will encourage re-submission of rejected conference papers, but that's the job of the PC to handle!

Post a Comment