Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education

Christine Bauer; Ben Carterette; Nicola Ferro; Norbert Fuhr; Joeran Beel; Timo Breuer; Charles l. a. Clarke; Anita Crescenzi; Gianluca Demartini; Giorgio Maria Di Nunzio; Laura Dietz; Guglielmo Faggioli; Bruce Ferwerda; Maik Fröbe; Matthias Hagen; Allan Hanbury; Claudia Hauff; Dietmar Jannach; Noriko Kando; Evangelos Kanoulas; Bart P. Knijnenburg; Udo Kruschwitz; Meijie Li; Maria Maistro; Lien Michiels; Andrea Papenmeier; Martin Potthast; Paolo Rosso; Alan Said; Philipp Schaer; Christin Seifert; Damiano Spina; Benno Stein; Nava Tintarev; Julián Urbano; Henning Wachsmuth; Martijn c. Willemsen; Justin Zobel

doi:10.1145/3636341.3636351

Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education

Christine Bauer^*, Ben Carterette, Nicola Ferro, Norbert Fuhr, Joeran Beel, Timo Breuer, Charles l. a. Clarke, Anita Crescenzi, Gianluca Demartini, Giorgio Maria Di Nunzio, Laura Dietz, Guglielmo Faggioli, Bruce Ferwerda, Maik Fröbe, Matthias Hagen, Allan Hanbury, Claudia Hauff, Dietmar Jannach, Noriko Kando, Evangelos KanoulasBart P. Knijnenburg, Udo Kruschwitz, Meijie Li, Maria Maistro, Lien Michiels, Andrea Papenmeier, Martin Potthast, Paolo Rosso, Alan Said, Philipp Schaer, Christin Seifert, Damiano Spina, Benno Stein, Nava Tintarev, Julián Urbano, Henning Wachsmuth, Martijn c. Willemsen, Justin Zobel

^*Korrespondierende/r Autor/-in für diese Arbeit

Artificial Intelligence and Human Interfaces

Publikation: Beitrag in Fachzeitschrift › Artikel

Abstract

This report documents the program and the outcomes of Dagstuhl Seminar 23031 “Frontiers of Information Access Experimentation for Research and Education”, which brought together 38 participants from 12 countries. The seminar addressed technology-enhanced information access (information retrieval, recommender systems, natural language processing) and specifically focused on developing more responsible experimental practices leading to more valid results, both for research as well as for scientific education.
The seminar featured a series of long and short talks delivered by participants, who helped in setting a common ground and in letting emerge topics of interest to be explored as the main output of the seminar. This led to the definition of five groups which investigated challenges, opportunities, and next steps in the following areas: reality check, i.e. conducting real-world studies, human–machine-collaborative relevance judgment frameworks, overcoming method- ological challenges in information retrieval and recommender systems through awareness and education, results-blind reviewing, and guidance for authors.

Originalsprache	Englisch
Seiten (von - bis)	1-28
Seitenumfang	28
Fachzeitschrift	SIGIR Forum (ACM Special Interest Group on Information Retrieval)
Jahrgang	57
Ausgabenummer	1
DOIs	https://doi.org/10.1145/3636341.3636351
Publikationsstatus	Veröffentlicht - 1 Juni 2023

Systematik der Wissenschaftszweige 2012

102 Informatik
509 Andere Sozialwissenschaften

Zugriff auf Dokument

10.1145/3636341.3636351Lizenz: CC BY-NC-ND

1 Laufend

EXDIGIT: Excellence in Digital Sciences and Interdisciplinary Technologies
Horejs-Höck, J. (Projektleitung), Hüsing, N. (Projektleitung), Tscheligi, M. (Projektmitarbeiter/in), Bauer, C. (Projektmitarbeiter/in), Demir, C. (Projektmitarbeiter/in), Dong, Y. (Projektmitarbeiter/in), Faria Costa, J. (Projektmitarbeiter/in), Graf, F. (Projektmitarbeiter/in), Grilnberger, M. (Projektmitarbeiter/in), Hannibal, G. (Projektmitarbeiter/in), Katzlberger, D. (Projektmitarbeiter/in), Leschke, N. C. (Projektmitarbeiter/in), Linortner, M. (Projektmitarbeiter/in), Maislinger, L. (Projektmitarbeiter/in), Mocnik, F.-B. (Projektmitarbeiter/in), Pallas, F. (Projektmitarbeiter/in), Unterberger, E. (Projektmitarbeiter/in), Williams, M. C. (Projektmitarbeiter/in), Zimmermann, G. (Projektmitarbeiter/in), Carrozzo, A. E. (Projektmitarbeiter/in), Mehran, N. (Projektmitarbeiter/in) & Dabiri, Z. (Projektmitarbeiter/in)
1/04/22 → 31/03/28
Projekt: Forschung

1 Forschungsbericht

Frontiers of Information Access Experimentation for Research and Education: Report from Dagstuhl Seminar 23031
Bauer, C. (Herausgeber/in), Carterette, B. (Herausgeber/in), Fuhr, N. (Herausgeber/in), Ferro, N. (Herausgeber/in), Faggioli, G. (Herausgeber/in), Soboroff, I., Zobel, J., Knijnenburg, B. P., Clarke, C. L. A., Demartini, G., Willemsen, M. C., Schaer, P., Dietz, L., Breuer, T., Maistro, M., Kruschwitz, U., Rosso, P., Said, A., Ferwerda, B. & Hanbury, A. &10 mehr, Larsen, B., Michiels, L., Papenmeier, A., Hagn, M., Hauff, C., Kando, N., Kanoulas, E., Potthast, M., Stein, B. & Wachsmuth, H., 18 Sept. 2023, 1 Aufl. Leibniz: Schloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing. 87 S. (Dagstuhl Reports; Band 13, Nr. 1)
Publikation: Buch/Bericht/Gesetzeskommentar › Forschungsbericht

Open Access

1 Organisation einer Veranstaltung

Dagstuhl Seminar 23031 Frontiers of Information Access Experimentation for Research and Education
Bauer, C. (Organisator/in), Carterette, B. (Organisator/in), Ferro, N. (Organisator/in) & Fuhr, N. (Organisator/in)
15 Jan. 2023 → 20 Jan. 2023
Aktivität: Mitwirkung an und Organisation einer Veranstaltung › Organisation einer Veranstaltung

Dieses zitieren

Bauer, C., Carterette, B., Ferro, N., Fuhr, N., Beel, J., Breuer, T., Clarke, C. L. A., Crescenzi, A., Demartini, G., Di Nunzio, G. M., Dietz, L., Faggioli, G., Ferwerda, B., Fröbe, M., Hagen, M., Hanbury, A., Hauff, C., Jannach, D., Kando, N., ... Zobel, J. (2023). Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education. SIGIR Forum (ACM Special Interest Group on Information Retrieval), 57(1), 1-28. https://doi.org/10.1145/3636341.3636351

@article{ecd538f7052846b2b689e905c2c160b3,

title = "Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education",

abstract = "This report documents the program and the outcomes of Dagstuhl Seminar 23031 “Frontiers of Information Access Experimentation for Research and Education”, which brought together 38 participants from 12 countries. The seminar addressed technology-enhanced information access (information retrieval, recommender systems, natural language processing) and specifically focused on developing more responsible experimental practices leading to more valid results, both for research as well as for scientific education.The seminar featured a series of long and short talks delivered by participants, who helped in setting a common ground and in letting emerge topics of interest to be explored as the main output of the seminar. This led to the definition of five groups which investigated challenges, opportunities, and next steps in the following areas: reality check, i.e. conducting real-world studies, human–machine-collaborative relevance judgment frameworks, overcoming method- ological challenges in information retrieval and recommender systems through awareness and education, results-blind reviewing, and guidance for authors.",

keywords = "recommender systems, information retrieval, information access systems, evaluation, Dagstuhl",

author = "Christine Bauer and Ben Carterette and Nicola Ferro and Norbert Fuhr and Joeran Beel and Timo Breuer and Clarke, {Charles l. a.} and Anita Crescenzi and Gianluca Demartini and {Di Nunzio}, {Giorgio Maria} and Laura Dietz and Guglielmo Faggioli and Bruce Ferwerda and Maik Fr{\"o}be and Matthias Hagen and Allan Hanbury and Claudia Hauff and Dietmar Jannach and Noriko Kando and Evangelos Kanoulas and Knijnenburg, {Bart P.} and Udo Kruschwitz and Meijie Li and Maria Maistro and Lien Michiels and Andrea Papenmeier and Martin Potthast and Paolo Rosso and Alan Said and Philipp Schaer and Christin Seifert and Damiano Spina and Benno Stein and Nava Tintarev and Juli{\'a}n Urbano and Henning Wachsmuth and Willemsen, {Martijn c.} and Justin Zobel",

year = "2023",

month = jun,

day = "1",

doi = "10.1145/3636341.3636351",

language = "English",

volume = "57",

pages = "1--28",

journal = "SIGIR Forum (ACM Special Interest Group on Information Retrieval)",

issn = "0163-5840",

publisher = "Association for Computing Machinery (ACM)",

number = "1",

}

Bauer, C, Carterette, B, Ferro, N, Fuhr, N, Beel, J, Breuer, T, Clarke, CLA, Crescenzi, A, Demartini, G, Di Nunzio, GM, Dietz, L, Faggioli, G, Ferwerda, B, Fröbe, M, Hagen, M, Hanbury, A, Hauff, C, Jannach, D, Kando, N, Kanoulas, E, Knijnenburg, BP, Kruschwitz, U, Li, M, Maistro, M, Michiels, L, Papenmeier, A, Potthast, M, Rosso, P, Said, A, Schaer, P, Seifert, C, Spina, D, Stein, B, Tintarev, N, Urbano, J, Wachsmuth, H, Willemsen, MC & Zobel, J 2023, 'Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education', SIGIR Forum (ACM Special Interest Group on Information Retrieval), Jg. 57, Nr. 1, S. 1-28. https://doi.org/10.1145/3636341.3636351

TY - JOUR

T1 - Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education

AU - Bauer, Christine

AU - Carterette, Ben

AU - Ferro, Nicola

AU - Fuhr, Norbert

AU - Beel, Joeran

AU - Breuer, Timo

AU - Clarke, Charles l. a.

AU - Crescenzi, Anita

AU - Demartini, Gianluca

AU - Di Nunzio, Giorgio Maria

AU - Dietz, Laura

AU - Faggioli, Guglielmo

AU - Ferwerda, Bruce

AU - Fröbe, Maik

AU - Hagen, Matthias

AU - Hanbury, Allan

AU - Hauff, Claudia

AU - Jannach, Dietmar

AU - Kando, Noriko

AU - Kanoulas, Evangelos

AU - Knijnenburg, Bart P.

AU - Kruschwitz, Udo

AU - Li, Meijie

AU - Maistro, Maria

AU - Michiels, Lien

AU - Papenmeier, Andrea

AU - Potthast, Martin

AU - Rosso, Paolo

AU - Said, Alan

AU - Schaer, Philipp

AU - Seifert, Christin

AU - Spina, Damiano

AU - Stein, Benno

AU - Tintarev, Nava

AU - Urbano, Julián

AU - Wachsmuth, Henning

AU - Willemsen, Martijn c.

AU - Zobel, Justin

PY - 2023/6/1

Y1 - 2023/6/1

N2 - This report documents the program and the outcomes of Dagstuhl Seminar 23031 “Frontiers of Information Access Experimentation for Research and Education”, which brought together 38 participants from 12 countries. The seminar addressed technology-enhanced information access (information retrieval, recommender systems, natural language processing) and specifically focused on developing more responsible experimental practices leading to more valid results, both for research as well as for scientific education.The seminar featured a series of long and short talks delivered by participants, who helped in setting a common ground and in letting emerge topics of interest to be explored as the main output of the seminar. This led to the definition of five groups which investigated challenges, opportunities, and next steps in the following areas: reality check, i.e. conducting real-world studies, human–machine-collaborative relevance judgment frameworks, overcoming method- ological challenges in information retrieval and recommender systems through awareness and education, results-blind reviewing, and guidance for authors.

AB - This report documents the program and the outcomes of Dagstuhl Seminar 23031 “Frontiers of Information Access Experimentation for Research and Education”, which brought together 38 participants from 12 countries. The seminar addressed technology-enhanced information access (information retrieval, recommender systems, natural language processing) and specifically focused on developing more responsible experimental practices leading to more valid results, both for research as well as for scientific education.The seminar featured a series of long and short talks delivered by participants, who helped in setting a common ground and in letting emerge topics of interest to be explored as the main output of the seminar. This led to the definition of five groups which investigated challenges, opportunities, and next steps in the following areas: reality check, i.e. conducting real-world studies, human–machine-collaborative relevance judgment frameworks, overcoming method- ological challenges in information retrieval and recommender systems through awareness and education, results-blind reviewing, and guidance for authors.

KW - recommender systems

KW - information retrieval

KW - information access systems

KW - evaluation

KW - Dagstuhl

U2 - 10.1145/3636341.3636351

DO - 10.1145/3636341.3636351

M3 - Article

SN - 0163-5840

VL - 57

SP - 1

EP - 28

JO - SIGIR Forum (ACM Special Interest Group on Information Retrieval)

JF - SIGIR Forum (ACM Special Interest Group on Information Retrieval)

IS - 1

ER -

Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education

Abstract

Systematik der Wissenschaftszweige 2012

Zugriff auf Dokument

Projekte

EXDIGIT: Excellence in Digital Sciences and Interdisciplinary Technologies

Publikationen

Frontiers of Information Access Experimentation for Research and Education: Report from Dagstuhl Seminar 23031

Aktivitäten

Dagstuhl Seminar 23031 Frontiers of Information Access Experimentation for Research and Education

Dieses zitieren