Evaluation In The Crowd Crowdsourcing And Human Centered Experiments
Download Evaluation In The Crowd Crowdsourcing And Human Centered Experiments PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Evaluation In The Crowd Crowdsourcing And Human Centered Experiments book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages.
Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments
As the outcome of the Dagstuhl Seminar 15481 on Crowdsourcing and Human-Centered Experiments, this book is a primer for computer science researchers who intend to use crowdsourcing technology for human centered experiments. The focus of this Dagstuhl seminar, held in Dagstuhl Castle in November 2015, was to discuss experiences and methodological considerations when using crowdsourcing platforms to run human-centered experiments to test the effectiveness of visual representations. The inspiring Dagstuhl atmosphere fostered discussions and brought together researchers from different research directions. The papers provide information on crowdsourcing technology and experimental methodologies, comparisons between crowdsourcing and lab experiments, the use of crowdsourcing for visualisation, psychology, QoE and HCI empirical studies, and finally the nature of crowdworkers and their work, their motivation and demographic background, as well as the relationships among people forming the crowdsourcing community.
Eye Tracking and Visual Analytics
Visualization and visual analytics are powerful concepts for exploring data from various application domains. The endless number of possible parameters and the many ways to combine visual variables as well as algorithms and interaction techniques create lots of possibilities for building such techniques and tools. The major goal of those tools is to include the human users with their tasks at hand, their hypotheses, and research questions to provide ways to find solutions to their problems or at least to hint them in a certain direction to come closer to a problem solution. However, due to the sheer number of design variations, it is unclear which technique is suitable for those tasks at hand, requiring some kind of user evaluation to figure out how the human users perform while solving their tasks. The technology of eye tracking has existed for a long time; however, it has only recently been applied to visualization and visual analytics as a means to provide insights to the users’ visual attention behavior. This generates another kind of dataset that has a spatio-temporal nature and hence demands for advanced data science and visual analytics concepts to find insights into the recorded eye movement data, either as a post process or even in real-time. This book describes aspects from the interdisciplinary field of visual analytics, but also discusses more general approaches from the field of visualization as well as algorithms and data handling. A major part of the book covers research on those aspects under the light and perspective of eye tracking, building synergy effects between both fields – eye tracking and visual analytics – in both directions, i.e. eye tracking applied to visual analytics and visual analytics applied to eye tracking data. Technical topics discussed in the book include: • Visualization; • Visual Analytics; • User Evaluation; • Eye Tracking; • Eye Tracking Data Analytics; Eye Tracking and Visual Analytics includes more than 500 references from the fields of visualization, visual analytics, user evaluation, eye tracking, and data science, all fields which have their roots in computer science. Eye Tracking and Visual Analytics is written for researchers in both academia and industry, particularly newcomers starting their PhD, but also for PostDocs and professionals with a longer research history in one or more of the covered research fields. Moreover, it can be used to get an overview about one or more of the involved fields and to understand the interface and synergy effects between all of those fields. The book might even be used for teaching lectures in the fields of information visualization, visual analytics, and/or eye tracking.
Motivation of Workers on Microtask Crowdsourcing Platforms
This book studies the motivation of crowdworkers to find out how to attract more people and reach a higher quality of outcomes. The book first proposes a taxonomy for studying the motivation of crowdworkers including the potential influencing factors, different types of motivation, and possible consequences and outcomes related to the motivation. Next, the CWMS questionnaire, an instrument for measuring the underlying motivation of crowdworkers is developed. It considers different dimensions of motivation suggested by the Self-Determination Theory of motivation which is a well-established and empirically validated psychological theory used in various domains. This instrument can be used to study the effect of platform and user characteristics on the general motivation of crowdworkers. Later, the task-specific motivation of crowdworkers is studied in detail: Influencing factors are investigated, subjective methods for measuring them are evaluated, a model for predicting worker’s decision on taking a task is proposed, the relative importance of different factors for two populations of crowdworkers is studied, and finally, a model for predicting the expected workload (as one of the major influencing factors) given the task design is proposed.