EBeM 2022: Evaluation Beyond Metrics 2022 IJCAI-ECAI 2022 Vienna, Austria, July 23-25, 2022 |
Conference website | https://sites.google.com/view/ebem2022 |
Submission link | https://easychair.org/conferences/?conf=ebem2022 |
Submission deadline | May 13, 2022 |
[CFP] EBeM@IJCAI: Evaluation Beyond Metrics Workshop
The goal of this workshop is to challenge the widespread yet limited approach of evaluating the performance of intelligent systems with aggregated metrics over a benchmark or distribution of tasks. We consider papers on all areas of AI evaluation for all kinds of systems (RL agents, machine vision, language models, planning, etc.). We especially welcome alternative approaches that draw on ideas and recent progress in cognitive and developmental psychology, psychometrics, software testing, and other areas.
We will consider technical and position papers. The submission deadline is May 13th. The workshop will be part of the International Joint Conference on Artificial Intelligence (IJCAI-2022) in Vienna (Austria), with workshops being held between 23-25 July [concrete date TBA]. All information about topics, format and submission instructions available on the website: https://sites.google.com/view/ebem2022.
Organisers
- José Hernández-Orallo - Universitat Politècnica de València (http://josephorallo.webs.upv.es/)
- Lucy Cheke - Cambridge University (http://lcfi.ac.uk/about/team/lucy-cheke)
- Josh Tenenbaum - Massachusetts Institute of Technology (http://web.mit.edu/cocosci/josh.html)
- Tomer D. Ullman - University of Harvard (https://www.tomerullman.org/)
- Fernando Martínez-Plumed - European Commission (https://nandomp.github.io/)
- Danaja Rutar - University of Cambridge (http://lcfi.ac.uk/about/team/danaja-rutar/)
- John Burden - University of Cambridge (www.johnburden.co.uk)
- Ryan Burnell - University of Cambridge (https://ryanburnell.com)
- Wout Schellaert - Universitat Politècnica de València (https://schellaert.org)
Main contact: ebemworkshop@gmail.com
Regards,
The EbEM Organizing Team