Task1


Tim Holzheim, Wolfgang Fahl

Task

Task
id  1
title  Extraction and Assessment of Workshop Proceedings Information
objective  Common questions related to the quality of a scientific workshop or conference include whether a researcher should submit a paper to it or accept an invitation

to its program committee, whether a publisher should publish its proceedings, or whether a company should sponsor it [2]. Moreover, knowing the quality of an event helps to assess the quality of the papers accepted there. In the 2014 Challenge, we had designed Task 1 to extract from selected CEUR-WS.org work- shop proceedings volumes RDF that would enable the computation of certain indicators for the workshops’ quality [10]. The second objective of this effort was to bootstrap the publication of all CEUR-WS.org workshops – more than 1,400 at the time of this writing – as linked data. As discussed above in Section 2, we reused the 2014 queries, with two exceptions. As only one of the three 2014 submissions had addressed the two Task 1 queries that required metadata ex- traction from the PDF full text of the papers (cf. [7]), and as Task 2 focused on full-text extraction anyway, we replaced these queries (Q1.19 and Q1.20) by similar queries that only relied on information available from HTML sources.

since  2015-08-25


Task[edit]

Task
id  1
title  Extraction and Assessment of Workshop Proceedings Information
objective  Common questions related to the quality of a scientific workshop or conference include whether a researcher should submit a paper to it or accept an invitation

to its program committee, whether a publisher should publish its proceedings, or whether a company should sponsor it [2]. Moreover, knowing the quality of an event helps to assess the quality of the papers accepted there. In the 2014 Challenge, we had designed Task 1 to extract from selected CEUR-WS.org work- shop proceedings volumes RDF that would enable the computation of certain indicators for the workshops’ quality [10]. The second objective of this effort was to bootstrap the publication of all CEUR-WS.org workshops – more than 1,400 at the time of this writing – as linked data. As discussed above in Section 2, we reused the 2014 queries, with two exceptions. As only one of the three 2014 submissions had addressed the two Task 1 queries that required metadata ex- traction from the PDF full text of the papers (cf. [7]), and as Task 2 focused on full-text extraction anyway, we replaced these queries (Q1.19 and Q1.20) by similar queries that only relied on information available from HTML sources.

since  2015-08-25


Queries[edit]

 TitleDescriptionTry it!WDQS UrlRelevance
Q1.1All Editors of Workshop(Volume W)List the full names of all editors of the proceedings of workshop W .JGBD4b6UAa3
Q1.2Number of Papers in Workshop(Volume W)Count the number of papers in workshop W .9e3zUz6UAd3
Q1.3All Authors of WorkshopList the full names of all authors who have (co-)authored a paper in workshop W .6JIyAd6UAf2
Q1.4Average #of pages in workshopCompute the average length of a paper (in pages) in workshop WNGlB2l6UAX3
Q1.5Publication turnaroundFind out whether the proceedings of work- shop W were published on CEUR-WS.org before the workshop took place. This query lists all proceedings that were published before the event took place.PAvC7D6UAk3
Q1.6previous editions of a workshop(previous editions of a workshop) Identify all editions that the work- shop series titled T has published with CEUR-WS.org.kUPI5O6UAo1
Q1.7chairs over the history of a workshopIdentify the full names of those chairs of the workshop series titled T that have so far been a chair in every edition of the workshop published with CEUR-WS.org.ngbkiD6UAu4
Q1.8Workshops of Conference in YearIdentify all CEUR-WS.org proceedings volumes in which workshops of conference C in year Y were published.j57HVl6UAw2
Q1.9Chair of Workshop as CoauthorIdentify those papers of workshop W that were (co-)authored by at least one chair of the workshop.qKaWxd6UA$3
Q1.10Authors of invited papersList the full names of all authors of invited papers in workshop W4
Q1.11Number of Editions of workshop seriesDetermine the number of editions that the workshop series titled T has had, regardless of whether published with CEUR-WS.org.uVEk8R6UB42
Q1.12Change of Workshop title(change of workshop title) Determine the title (without year) that workshop W had in its first edition.a1sm2q6UB53
Q1.13workshops that have diedOf the workshops of conference C in year Y , identify those that did not publish with CEUR-WS.org in the following year (and that therefore probably no longer took place).3
Q1.14Jointly published papers(papers of a workshop published jointly with others) Identify the papers of the workshop titled T (which was published in a joint volume V with other workshops).vgcLz46UBA2
Q1.15Editors of jointly published papers(editors of one workshop published jointly with others)List the full names of all editors of the proceedings of the workshop titled T (which was published in a joint volume V with other workshops)TBhxb56UBB3
Q1.16Workshop with biggest percent of growth of number of papersOf the workshops that had editions at conference C both in year Y and Y +1, identify the workshop(s) with the biggest percentage of growth in their number of papers.5
Q1.17change of conference affiliation(Event,Year)Return the acronyms of those work- shops of conference C in year Y whose previous edition was co-located with a different conference series.3
Q1.18change of workshop dateOf the workshop series titled T, identify those editions that took place more than two months later/earlier than the previous edition published with CEUR-WS.org.3
Q1.19institutional diversity and internationality of chairsIdentify the affiliations and countries of all editors of the proceedings of workshop W .3
Q1.20continuity of authorsIdentify the full names of those authors of papers in the workshop series titled T that have so far (co-)authored a paper in every edition of the workshop published with CEUR-WS.org4

Queries[edit]

 TitleDescriptionTry it!WDQS UrlRelevance
Q1.1All Editors of Workshop(Volume W)List the full names of all editors of the proceedings of workshop W .JGBD4b6UAa3
Q1.2Number of Papers in Workshop(Volume W)Count the number of papers in workshop W .9e3zUz6UAd3
Q1.3All Authors of WorkshopList the full names of all authors who have (co-)authored a paper in workshop W .6JIyAd6UAf2
Q1.4Average #of pages in workshopCompute the average length of a paper (in pages) in workshop WNGlB2l6UAX3
Q1.5Publication turnaroundFind out whether the proceedings of work- shop W were published on CEUR-WS.org before the workshop took place. This query lists all proceedings that were published before the event took place.PAvC7D6UAk3
Q1.6previous editions of a workshop(previous editions of a workshop) Identify all editions that the work- shop series titled T has published with CEUR-WS.org.kUPI5O6UAo1
Q1.7chairs over the history of a workshopIdentify the full names of those chairs of the workshop series titled T that have so far been a chair in every edition of the workshop published with CEUR-WS.org.ngbkiD6UAu4
Q1.8Workshops of Conference in YearIdentify all CEUR-WS.org proceedings volumes in which workshops of conference C in year Y were published.j57HVl6UAw2
Q1.9Chair of Workshop as CoauthorIdentify those papers of workshop W that were (co-)authored by at least one chair of the workshop.qKaWxd6UA$3
Q1.10Authors of invited papersList the full names of all authors of invited papers in workshop W4
Q1.11Number of Editions of workshop seriesDetermine the number of editions that the workshop series titled T has had, regardless of whether published with CEUR-WS.org.uVEk8R6UB42
Q1.12Change of Workshop title(change of workshop title) Determine the title (without year) that workshop W had in its first edition.a1sm2q6UB53
Q1.13workshops that have diedOf the workshops of conference C in year Y , identify those that did not publish with CEUR-WS.org in the following year (and that therefore probably no longer took place).3
Q1.14Jointly published papers(papers of a workshop published jointly with others) Identify the papers of the workshop titled T (which was published in a joint volume V with other workshops).vgcLz46UBA2
Q1.15Editors of jointly published papers(editors of one workshop published jointly with others)List the full names of all editors of the proceedings of the workshop titled T (which was published in a joint volume V with other workshops)TBhxb56UBB3
Q1.16Workshop with biggest percent of growth of number of papersOf the workshops that had editions at conference C both in year Y and Y +1, identify the workshop(s) with the biggest percentage of growth in their number of papers.5
Q1.17change of conference affiliation(Event,Year)Return the acronyms of those work- shops of conference C in year Y whose previous edition was co-located with a different conference series.3
Q1.18change of workshop dateOf the workshop series titled T, identify those editions that took place more than two months later/earlier than the previous edition published with CEUR-WS.org.3
Q1.19institutional diversity and internationality of chairsIdentify the affiliations and countries of all editors of the proceedings of workshop W .3
Q1.20continuity of authorsIdentify the full names of those authors of papers in the workshop series titled T that have so far (co-)authored a paper in every edition of the workshop published with CEUR-WS.org4
🖨 🚪