Skip to content

Creating an experiment: experiment stages

Crystal Qian edited this page Oct 8, 2024 · 1 revision

Here’s a description of the supported stages in experiment creation:

  • Terms of Service: Displays the Terms of Service. Participants must accept the terms to proceed.

  • Profile: Participants can set their name, pronouns, and avatar.

    • Option to generate anonymous animal-themed profiles. If enabled, participants will be randomly assigned a profile (e.g., Dog, Cat).
    • This image shows the participant's view of a "Set profile" stage. image
  • Info: Use this stage to provide information to participants.

  • Survey: Add survey questions like free-text, checkboxes (yes/no), multiple choice, or scale questions.

  • Ranking/Election: Allows participants to rank items (or other participants). If "Conduct an election" is selected, a winner will be computed from the rankings.

    • This image shows the participant's view of a "Ranking" stage among participants. image
  • Reveal: Combine Survey or Ranking/Election stages here. You can choose to reveal answers to the cohort. Make sure to inform participants if their answers will be visible to others.

  • This image shows the participant's view of a "Reveal" stage. The results of a ranking (with election) are shown, as well as the results of a survey (with the responses of all participants). image

  • Payout: Displays the participant’s payout for the stage.

    • Participants can receive a fixed amount or a payout based on an Election outcome.
  • Group Chat: Opens a chat for the cohort. Add LLM agents with the "Add mediator" button. Agents will have conversation context.

    • String Parsing: Use "If you want to say something, contribute as X. Otherwise, respond with an empty string."
    • JSON Parsing: Allows querying additional explanations from the model.
      INSTRUCTIONS:
      Fill out the following JSON response:
        1. Do you want to add a message to the chat? ("true" or false)
        2. If yes, what would you like to say?
        3. Why do you want to say that?
      
      EXAMPLE OUTPUT:
      {
        "shouldRespond": true,
        "response": "This is my response",
        "reasoning": "This is why I chose this response."
      }
  • Transfer: A waiting stage where participants are transferred to a different cohort. We recommend creating a "Lobby" cohort for an experiment, and then transferring participants into breakout cohorts as needed.

    • This image shows the experimenter's view of an experiment. Participant Bear has reached the transfer stage, and have been waiting on that stage for less than a minute. By using the Transfer dropdown on the right, the experimenter can transfer the participant to other cohorts within the experiment.

    image