BHCC 2019: 1st Symposium on Biases in Human Computation and Crowdsourcing Diamond building Sheffield, UK, October 21-22, 2019 |
Conference website | https://sites.google.com/sheffield.ac.uk/bhcc2019 |
Submission link | https://easychair.org/conferences/?conf=bhcc2019 |
Abstract registration deadline | September 15, 2019 |
Submission deadline | September 15, 2019 |
Human Computation and Crowdsourcing have become ubiquitous in the world of algorithm augmentation and data management. However, humans have various cognitive biases that influence the way they make decisions, remember information, and interact with machines. It is thus important to identify human biases and analyse their effect on complex hybrid systems. On the other hand, the potential interaction with a large pool of human contributor gives the opportunity to detect and handle biases in existing data and systems.
The goal of this symposium is to analyse both existing human biases in hybrid systems, and methods to manage bias via crowdsourcing and human computation. We will discuss different types of biases, measures and methods to track bias, as well as methodologies to prevent and solve bias.
An interdisciplinary approach is often required to capture the broad effects that these processes have on systems and people, and at the same time improve model interpretability and systems’ fairness.
We will provide a framework for discussion among scholars, practitioners and other interested parties, including industry, crowd workers, requesters and crowdsourcing platform managers. We expect contributions combining ideas from different disciplines, including computer science, psychology, economics and social sciences.
For more information, please visit the event website: https://sites.google.com/sheffield.ac.uk/bhcc2019.
Submission Guidelines
We welcome ~250-word abstracts describing methodologies, studies or systems relevant to the topics of the workshop. Submissions are not anonymous. Non published work, vision statements, and work in progress are welcome.
We are looking for contributions with interesting insights, which could lead to productive discussion during the symposium. The main criteria of evaluation of the Programme Committee are scientific relevance, innovation level and research potential.
Abstract should be submitted at https://easychair.org/conferences/?conf=bhcc2019.
List of Topics
Biases in Human Computation and Crowdsourcing
- Human sampling bias
- Effect of cultural, gender and ethnic biases
- Effect of human in the loop training and past experiences
- Effect of human expertise vs interest
- Bias in experts vs bias in crowdsourcing
- Bias in outsourcing vs bias in crowdsourcing
- Bias in task selection
- Task assignment/recommendation for reducing bias
- Effect of human engagement on bias
- Responsibility and ethics in human computation and bias management
- Preventing bias in crowdsourcing and human computation
- Creating awareness of cognitive biases among human agents
- Measuring and addressing ambiguities and biases in human annotation
- Human factors in AI
Using Human Computation and Crowdsourcing for Bias Understanding and Management
- Biases in Human-in-the-loop systems
- Identifying new types of cognitive bias in data or content
- Measuring bias in data or content
- Removing bias in data or content
- Dealing with algorithmic bias
- Fake news detection
- Diversification of sources by means
- Provenance and traceability
- Long-term crowd engagement
- Generating benchmarks for bias management
Committees
Program Committee
- Alessandro Bozzon, University of Delft (Netherlands)
- Alessandro Checco, University of Sheffield (UK)
- Amrapali Zaveri, Institute of Data Science, Maastricht University (Netherlands)
- Eddy Maddalena, University of Southampton (UK)
- Jahna Otterbacher, Open University of Cyprus (Cyprus)
- Jo Bates, University of Sheffield (UK)
- Mengdie Zhuang, University of London (UK)
- Pierpaolo Loreti, University of Rome "Tor Vergata" (Italy)
- Ujwal Gadiraju, L3S Research Center, Hannover (Germany)
Organizing committee
- Alessandro Checco, University of Sheffield (UK)
- Eddy Maddalena, University of Southampton (UK)
Venue and Registration
Please visit the event website: https://sites.google.com/sheffield.ac.uk/bhcc2019.
Contact
All questions about submissions should be emailed to a.checco@sheffield.ac.uk.
All questions about logistics and registration should be email to Kathryn MacKellar k.mackellar@sheffield.ac.uk.
Sponsors
- FashionBrain https://fashionbrain-project.eu
- Qrowd http://qrowd-project.eu
Please contact us if you want to be a sponsor: you will be able to advertise your company/project with a booth during the two-day symposium, distribute flyers and appear on this website.