Frequently asked questions

Answers reflect the current demo scope. Production features may expand or change.

Validity & data security

Can AI effectively simulate human psychology and behaviour? Is there supporting evidence?

Yes. Independent teams at universities such as Harvard and Stanford have replicated social-science findings with language models. Their studies consistently show that AI agents can approximate human responses in controlled experiments.

  • Higher fidelity: our replication accuracy improves the 50%-75% range reported in prior work to 93.2%.
  • Stricter tests: we purposefully reproduce studies published after January 2023 to avoid overlap with the model's pre-training data.
  • Operationalisation: the AITurk platform wraps the workflow into a service for researchers and practitioners.

Will my study ideas or data be exposed when I upload them to AITurk?

No. All research materials are encrypted at rest and accessible only to the users and teams you authorise. Platform staff cannot inspect your projects without permission.

Intellectual property and authorship remain yours. We contractually commit not to reuse study assets outside the scope you approve.

Sample configuration

Can I specify richer demographic variables such as income or industry?

Yes. Enable the "Custom" option in the demographic panel to define bespoke attributes for income, occupation, health status, overseas experience, and more.

I targeted CEOs but received 18- to 19-year-old participants. How can I avoid implausible combinations?

Ensure that the traits you request are internally consistent (for example pairing the CEO role with an age bracket above 30). Consider cross-checking age, education and occupation together.

Why do the aggregated demographics sometimes deviate slightly from my settings?

A small share of AI agents can fail to return valid responses, and the augmentation logic introduces minor noise when rebalancing the sample. The discrepancies are usually modest and do not affect headline conclusions.

Does the field "Location" map to the participants' country or region?

Yes. \"Location\" refers to the country or region assigned to the simulated participant.

Do you offer built-in power analysis when selecting sample sizes?

No. Empirically, 30 samples per cell already match the accuracy of larger crowdsourced studies (93.2% in our trials). We therefore recommend 30-per-group as the default setting.

Research design

What is the difference between scenario-based and recall/writing experiments?

Scenario experiments manipulate variables via vignettes that participants read before responding. Recall/writing designs ask participants to reflect on past experiences or compose text (for instance, answering prompts or describing imagined scenes).

Can I embed images in the study materials?

Yes. Image upload is supported in instruction fields such as "Guidance" and "Condition description".

Is AITurk suitable for every type of social-science study?

Not all of them. The platform focuses on tasks that could reasonably be executed on crowdsourcing sites like MTurk or Prolific, where structured instructions and textual responses are sufficient.

Measurement settings

What counts as a large, medium or small expected effect size?

The sliders are subjective. Choose "Medium" for most studies. If you expect a strong relationship (for example job satisfaction vs. life satisfaction) pick "Large"; if you are purely exploring weak associations, pick "Small".

Do I need to insert attention checks like I would on MTurk?

No. The AI respondents always follow instructions, so attention checks can introduce artefacts instead of improving quality.

Does showing the full Likert scale versus only the endpoints change the results?

No. It only affects authoring convenience. If you need to mirror a previous study, choose the presentation that matches the original.

Other topics

Can I control fonts, colours, bold or underline formatting?

Not necessary. The models interpret the text directly, so styling does not influence their responses.

Is pagination available?

No. Pagination is not needed because the models process the full prompt context at once.

Do you support languages other than English?

Yes. You can provide materials in any language supported by the underlying model (English, Chinese, Spanish, Portuguese, Korean, and more). Be mindful of potential cultural differences when mixing languages.

Why is the within-group variance relatively small?

We calibrate sampling temperature to keep variance low, enabling reliable pilot studies with small cell sizes (around 30 samples per group).

Do I need to pay again if I retrain a study after editing the materials?

Edits are free before running training. Once the system generates data, retraining requires a new run because it triggers fresh model calls.

Can I import another user's shared AITurk study into my account?

Yes. Use "Import study" on the workspace page and paste the shared link to copy it into your project list.