English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

Pilot studies are an essential cornerstone of the design of crowdsourcingcampaigns, yet they are often only mentioned in passing in the scholarlyliterature. A lack of details surrounding pilot studies in crowdsourcingresearch hinders the replication of studies and the reproduction of findings,stalling potential scientific advances. We conducted a systematic literaturereview on the current state of pilot study reporting at the intersection ofcrowdsourcing and HCI research. Our review of ten years of literature included171 articles published in the proceedings of the Conference on HumanComputation and Crowdsourcing (AAAI HCOMP) and the ACM Digital Library. Wefound that pilot studies in crowdsourcing research (i.e., crowd pilot studies)are often under-reported in the literature. Important details, such as thenumber of workers and rewards to workers, are often not reported. On the basisof our findings, we reflect on the current state of practice and formulate aset of best practice guidelines for reporting crowd pilot studies incrowdsourcing research. We also provide implications for the design ofcrowdsourcing platforms and make practical suggestions for supporting crowdpilot study reporting.

The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and Guidelines