English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

Recruiting professional programmers in sufficient numbers for researchstudies can be challenging because they often cannot spare the time, or due totheir geographical distribution and potentially the cost involved. Onlineplatforms such as Clickworker or Qualtrics do provide options to recruitparticipants with programming skill; however, misunderstandings and fraud canbe an issue. This can result in participants without programming skill takingpart in studies and surveys. If these participants are not detected, they cancause detrimental noise in the survey data. In this paper, we develop screenerquestions that are easy and quick to answer for people with programming skillbut difficult to answer correctly for those without. In order to evaluate ourquestionnaire for efficacy and efficiency, we recruited several batches ofparticipants with and without programming skill and tested the questions. Inour batch 42% of Clickworkers stating that they have programming skill did notmeet our criteria and we would recommend filtering these from studies. We alsoevaluated the questions in an adversarial setting. We conclude with a set ofrecommended questions which researchers can use to recruit participants withprogramming skill from online platforms.

Do you really code? Designing and Evaluating Screening Questions for Online Surveys with Programmers