Awesome crowdsourcing, human computation, & online behavioral experiments

A curated list of awesome resources on crowdsourcing, human computation, and online behavioral experiments.

• Crowds
• Prediction Markets
• Competitions
• Crowdfunding
• Software
• Citizen-science experiments & experiential learning
• Conferences
• Tutorials & Advice
• Contributing

Crowds

Where to find people.

• Amazon Mechanical Turk
• CrowdFlower
• Prime Panels
• Prolific Academic
• UpWork
• TaskRabbit
• clickworker
• OneSpace

Prediction markets

Market-based aggregation.

• Augur
• Pivit
• PredictIt

Competitions

Inducement prize contests.

• Kaggle
• Netflix Prize
• 99 Designs

Crowdfunding

Funding by many, small contributions.

• gofundme
• Indiegogo
• Kickstarter
• Kiva
• Patreon

Software

Microtasks.

• Clockwork Raven
• cloudfactory
• CrowdForge
• Hive
• OneSpace
• Orchestra
• pybossa
• Testable
• turksurveyor
• Vulyk

Programming with people

• Automan
• TurKit
• VoxPL

Domain-specific tools.

• Kort — Improving OpenStreetMap through gamification.
• Mark-a-Spot — Tracking public civic issues.
• Rekrei — Digital recreation of lost heritage.

Behavioral & social science experiments.

• Bonn Experiment System
• Breadboard
• CogTest
• ConG
• Daemo
• Dallinger
• economic-games
• Econport
• GameWeb
• GXP
• IBSEN
• Inquisit
• jsPsych
• LIONESS Lab
• Metadata Games
• MobLab
• MWert
• Nodegame
• Nodeshot
• OpenSesame
• oTree
• psiTurk
• PsyToolkit
• Seaweed
• SoPHIE
• Stato.de
• tatool
• The Experiment Factory
• TurkServer
• vcweb
• VeconLab
• Wextor
• XTribe

Citizen-science experiments & experiential learning

Volunteer science.

• Face Research
• Games with words
• iPsychExpts
• Lab in the wild
• Project Implicit
• TestMyBrain
• Volunteer Science

Teaching tools, experiential learning, and demos

• Cambrige Brain Sciences
• GoCognitive
• Online Psychology Laboratory
• TELLab

Brain training

• brainHQ
• Lumosity
• NeuroNation

Conferences

Academic and industry conferences.

• HCOMP — AAAI Conference on Human Computation and Crowdsourcing.
• CrowdML — Workshop on crowdsourcing and machine learning.
• COBE — Workshop on crowdsourcing and online behavioral experiments.
• Crowdsourcing Week
• World Wide Web Conference Crowdsourcing Track

Tutorials & Advice

• Repeated online panel experiments — Instructions for repeated online panel experiments

Contributing

How to contribute to this list.

See Contributing