Use cases
What are the types of web experiment things we are doing as a lab generally? I guess we might want to see if there's a solution that covers some or most of what people wanted. Let’s take a look at some recent papers and proposed projects…
| Paper | JsPsych? | Qualtrics? | psiTurk | Unity | Notes |
|---|---|---|---|---|---|
| Angela’s attention RL task | 👍 | nivturk | perfect 4 jspsych | ||
| Emily’s question asking | 👍 | complex mouse-guided interactions with a battleship grid | |||
| Guy’s VR | 👍 | needed unity (also used React) | |||
| Pam’s multi-player helping task | 👍? | phaser3 | |||
| Ill’s canadian traveler | 👍 | 👍 | unity due to modeling MCTS in c# | ||
| Anna’s causal learning | 👍 | ungodly, but d3js | |||
| Alex rich learning traps | 👍 | clean d3js code + psiturk | |||
| Pam’s categorization | (👍) | 👍 | could have been jspych | ||
| David’s long term memory | 👍 | 👍+returk | jspsych for the task returk to email people days later to follow up second part | ||
| Pat physics experiments | (👍?) | fancy video stuff | |||
| Ethan physics stuff | (👍) | 👍 | ☹️ trials not randomized! | ||
| WaiKeen ARC task | 👍 | complex code from online |
(👍) means in theory could have used it
👍? means unsure
👍? means unsure
Future designs
What are the kinds of things we might want to do in the future?
| Paper | Notes |
|---|---|
| 🤩 Undergrad research projects | Need something easy to teach with |
| Emily build a game to teach | complex, dynamic interactions, maybe phaser |
| Question asking | complex, dynamic interactions, generalization to new task |
| Baba is not RL | sprite based game would be helped by phaser, or just generally dynamic task |
| Future helping exps | build on the phaser multiplayer thing |
| Intuitive physics (video) | video manipulations and ratings of videos |
| Intuitive physics (sims/interact) | some type of in-browser game engine with physics |
| Human-machine interaction | open ended |
| Complex 3d interactions (ala Guy) | Unity and stuff |
| Reinforcement learning and language | basic stuff, jspsych or the like |
| Future "psychology" exps (memory, decision making) | basic stuff, jspsych or the like |