Picking the wrong statistical test is one of the quickest ways to weaken a quantitative dissertation. The good news is that the choice follows a few simple questions. This guide shows you how to match your research question and data to the right test, with a decision table, the non-parametric alternatives and the mistakes to avoid.
๐ Table of Contents
3 Questions to Ask First
1. What does my research question ask?
Are you comparing groups, looking for a relationship between variables, or predicting an outcome? This narrows the choice immediately.
2. What type of variables do I have?
Categorical (such as gender or course) or numerical (such as test score or hours worked)? Your outcome variable matters most.
3. Who is in each group?
Are the groups made of different people (independent), or are the same people measured more than once, for example before and after an intervention (related)?
๐ Not sure which test fits your data? Get a data analysis quote โ โ we run the analysis and write the results chapter.
Know Your Variable Types
- Categorical (nominal): labels with no order, such as department or yes/no.
- Ordinal: ordered categories, such as satisfaction ranked from low to high.
- Numerical (scale): measured numbers, such as age, income or exam score.
Likert-scale data sits between ordinal and numerical. Researchers handle it differently, so check what is accepted in your field and explain your choice in your methodology.
Decision Table
Find the row that matches your question. The last column gives the usual alternative if your data do not meet the assumptions of the first test.
| Your question | Typical test | Non-parametric alternative |
|---|---|---|
| Compare two independent groups (numerical outcome) | Independent-samples t-test | Mann-Whitney U |
| Compare the same people twice (before and after) | Paired-samples t-test | Wilcoxon signed-rank |
| Compare three or more independent groups | One-way ANOVA | Kruskal-Wallis |
| Compare the same people three or more times | Repeated-measures ANOVA | Friedman test |
| Relationship between two numerical variables | Pearson correlation | Spearman correlation |
| Association between two categorical variables | Chi-square test of independence | Fisher's exact test (small counts) |
| Predict a numerical outcome | Linear regression (simple or multiple). See how to interpret the output | Depends on the problem; ask your supervisor |
| Predict a yes/no outcome | Logistic regression | โ |
| Check a questionnaire scale is consistent | Cronbach's alpha (reliability) | โ |
๐ก Tip: use the test that matches your research question, and name it in your methodology before you collect data. Choosing a test after seeing the results to get a significant p-value is poor practice.
Check Your Assumptions
Every test rests on assumptions. Common ones include:
- Normality: the outcome is roughly normally distributed (important for t-tests and ANOVA, especially in small samples)
- Equal variances: the groups have similar spread
- Independence: each observation does not influence another
- Linearity: for correlation and regression, the relationship is roughly a straight line
- Sufficient expected counts: for chi-square, no very small expected frequencies
Report briefly which assumptions you tested and what you did if one failed, such as switching to the non-parametric alternative. Our guide to writing a dissertation results chapter shows how to report the results once you have them, and the discussion chapter guide explains how to interpret them.
Worked Example
Research question (fictional): do students who attend weekly tutorials score higher in the final exam than students who do not?
- Outcome: final exam score (numerical)
- Groups: attended tutorials vs did not attend (two independent groups)
- Test: independent-samples t-test
- If the scores are strongly skewed with a small sample: Mann-Whitney U
- Report: group means and standard deviations, the test statistic with degrees of freedom, the exact p-value and an effect size
Now suppose you also ask whether study hours predict the exam score. That is a relationship between two numerical variables, so you would use correlation, or regression if you want to predict the score.
Common Mistakes
โ ๏ธ Running many tests until something is significant. The more tests you run, the greater the chance of a false positive. Decide your tests in advance, and ask your supervisor about corrections if you run several.
- Using several t-tests instead of ANOVA when comparing three or more groups
- Ignoring assumptions or not mentioning them at all
- Reporting only p-values without descriptive statistics or an effect size
- Treating correlation as causation
- Using a test that does not match the variable types, such as a t-test on a categorical outcome
- Not explaining the choice of test in the methodology
Checklist
- โ Each research question is linked to a specific test
- โ Variable types are identified
- โ Independent or related groups are identified
- โ Assumptions are checked and reported
- โ A non-parametric backup is named where needed
- โ Effect sizes are reported along with p-values
- โ The choice of test is justified in the methodology
Frequently Asked Questions
Need Help Choosing and Running the Right Test?
Our postgraduate writers run the analysis in SPSS, R and more, and write it up as a clear results chapter linked to your research questions.
Get a Data Analysis Quote โ