Stats Without Walls is a free statistical tool for all levels. It runs entirely in your browser: nothing you load is uploaded anywhere, there is no account, and it never costs anything. This guide explains every menu, what each option does, and how to read what comes back.
1. Start here
Three ways to run it
- Web. Open learnwithoutwalls.com/stats in any modern browser (Chrome, Edge, Safari, Firefox). This version always has the newest features.
- Install from the browser. In Chrome or Edge, click the install icon in the address bar (or Chrome menu, then "Install Stats Without Walls"). It opens in its own window and works offline after the first visit.
- Installable app. Coming soon, once every part has been checked in real classes; see the app page. Until then the browser version is the app: open it once and it keeps working offline, and on a phone or tablet "Add to Home Screen" gives it an icon.
Privacy
The full policy, for the app stores and for anyone who asks, is on its own page: privacy.html.
Your data stays on your computer. The app has no server. It opens with an empty table unless your browser remembers data of your own. Your browser (local storage) remembers, on the same device:
- Your own data, with its filter and the types you set by hand: a file you opened; data you pasted, typed or simulated; a table you made with Stack columns or Random sample of rows; and a sample dataset once you change it (a computed, recoded, z-score or binned column, an edited cell, a renamed or deleted column, or a type set by hand; a filter or a sort alone does not count). The bar above the table then says "remembered from your last visit".
- Two settings: the decimal places you chose and the panel width you dragged.
Not remembered: a sample dataset you only opened or sorted (open it again from Data, Sample datasets), results, and the distrACTION inputs. Clearing your browser data removes what is stored. To keep a permanent copy, use Results, Save session or Data, Download data as CSV.
Helping someone else use it
Instructors, tutors and anyone who will sit next to a student: Helping someone with Stats Without Walls is a two-page sheet, a one-hour tour of the app in the order to learn it and the ten questions students ask most with where each answer is. Print it.
A two-minute first run
- Data, Sample datasets, pick "Our class data (40 students)", click Open.
- Exploration, Descriptives, select GPA, click Run. A card appears in the Analyses tab.
- Graph, Histogram, choose Hours_Sleep, click Run. The graph appears in the Graphs tab.
- T-Tests, Independent Samples T-Test, dependent variable Hours_Sleep, grouping variable Pet_Owner (Yes or No), click Run. Read the blue interpretation box near the bottom of the card.
2. The screen
| Part | What it is |
|---|---|
| Header | Title, a link to this User guide, a link to install or download the app, a link back to learnwithoutwalls.com. |
| Menu bar | Data, Exploration, Graph, T-Tests, ANOVA, Regression, Frequencies, distrACTION, Nonparametric, Learn, Advanced, Results. Click a menu, then an item, and a dialog opens. distrACTION and the Learn demonstrations open on their own page instead (see below). On a phone the menu bar wraps onto three rows, so every menu shows. With a keyboard, Enter or Arrow Down opens a menu, the arrow keys move through it and Escape closes it; the first Tab on any page shows a Skip to content link that jumps past the menus. |
| Empty table | When nothing is loaded the table area says "No data yet" with four buttons: Sample datasets, Open CSV or Excel file, Paste data and New data table. They do the same as the Data menu items with those names. Under them, two more buttons open distrACTION and Learn, which need no data. |
| Data table | Your dataset. The name, row count and column count are above it. The header row stays in view as you scroll. Under each column name is its type; click it to change the type. Click a column name to sort; click again to reverse; a third click puts the rows back in their first order. Click any cell to edit it. Rows greyed out are excluded by the current filter. On a wide screen the table is on the left: drag the bar between the table and the results to resize them, and double-click it to reset. Widen table (next to the filter box) folds the results away so every column shows; the next result, or Show results, brings them back. On a phone or an iPad in portrait the table is on top, the results are below it, and there is no bar. |
| Filter box | Shown once data are loaded. Type a condition such as Year == "Freshman" and press Enter. Join conditions with and or or (AND, OR, &&, ||, & and | all work). Every analysis then uses only the kept rows. Blank removes it. A condition that cannot be read says so under the box and leaves all rows in use until it is fixed. |
| Results (right, or below the table on a phone or an iPad in portrait) | Two tabs. Analyses holds numeric results; Graphs holds every graph made from the Graph menu (the StatCrunch habit); a plot ticked inside an analysis (a Descriptives box plot, a residual plot) stays with its card under Analyses, and the empty Graphs tab says so. The number on each tab is how many cards it holds. After a reload, a bar above the tabs offers to bring back the last visit's results (see Saving and sharing work). On a phone or an iPad in portrait, a new result scrolls into view, and a graph title too long for the screen wraps onto a second line. |
| Dialog | Every analysis opens the same kind of box: pick variables, tick options, click Run. Run and Cancel stay at the bottom of the box. Cancel, the Escape key or a tap outside the box closes it. Where a list allows several variables, hold Cmd (Mac) or Ctrl (Windows) while clicking; on a phone or an iPad, tap each one you want. Two boxes that offer the same columns (dependent variable and covariate, rows and columns) open on different columns. Where a test can run from a column or from summary statistics, only the boxes for the way chosen in the Data box are shown. |
| distrACTION page | Every item in the distrACTION menu opens a page of its own, with no data table: the inputs on the left (on top on a phone or a narrow iPad), the result on the right. The address ends in #distraction, so it can be bookmarked or linked. Back to data (top left) returns to your table, which is still loaded; the browser's Back button works too. Once a calculator is open, Change distribution at the top of the inputs card switches to another one. Clear this page removes the distrACTION results, and Undo clear brings them back until you do something new. |
| Learn page | The nine demonstrations that need no data (coin flips, the Central Limit Theorem, confidence intervals, p-values, mean versus median, outliers and influence, guess the correlation, the sampling distribution simulator and Bayesian) open on their own page, address ending in #learn, with the same Back to data button and Clear this page. Once a result shows, Choose another demonstration switches to another one. Bootstrap and permutation need a data file, so they stay with the table. |
Variable types
The app guesses a type for each column when data loads. The type decides which menus can use the column.
| Type | Shown as | Meaning | Used by |
|---|---|---|---|
| Continuous | ruler, continuous | Numbers you can average: age, GPA, minutes. | Descriptives, histograms, t-tests, ANOVA, regression, and so on. |
| Ordinal | ordinal | Ordered categories: Freshman to Senior, agreement scales, small numeric codes. | Frequency tables, bar plots, chi-square, grouping variables. Bar plots keep the natural order. |
| Nominal | nominal | Names with no order: major, ZIP code, yes or no. | Frequency tables, bar and pie charts, chi-square, grouping variables. |
| ID | ID | A label for each row (student number). Never analysed. | Point labels on scatter plots. |
If a guess is wrong (a numeric code that is really a category, or a numeric column that was read as text because one cell contains a word), click the type under the column name and pick Continuous, Ordinal, Nominal or ID, the same job as a data setup panel in other tools. A type you set by hand stays set, even after you edit cells. Data, Set variable type does the same thing from the menu.
3. Getting data in
Open CSV or Excel file
An Excel workbook (.xlsx) is read in the browser with no upload: text (shared, inline and rich), numbers, cached formula values, TRUE/FALSE, and dates by the cell's number format (converted to YYYY-MM-DD); when several sheets have data a picker asks which one. The old .xls format is not read: save it as .xlsx or CSV first. Data, Open CSV or Excel file. Any comma-separated file with one row of column names at the top. Exports from Excel, Google Sheets, Canvas, Qualtrics and survey tools all work. Quoted text with commas inside is handled. Dates stay as text.
Paste data
Data, Paste data. Copy a block from a spreadsheet (including the header row), paste it in, give it a name. Tabs and commas both work.
Sample datasets
Data, Sample datasets. Real and course datasets that ship with the app, listed in section 13. They also work offline in the installed app. A sample dataset is not remembered for your next visit until you change it (see Privacy).
New data table
Data, New data table. Type column names separated by commas and how many rows you want. Then click cells to type values. Good for a small in-class exercise.
Editing cells
Click any cell, type, then click away or press Tab. Enter moves down a row, the arrow keys move between cells, and Escape puts back the value the cell had. Types are re-guessed after each edit. Column names can be changed with Data, Rename or delete column.
Download data as CSV
Saves the current table (including computed, recoded and z-score columns) as a CSV file you can open in Excel or load again later.
4. Preparing data
Filters
Data, Filters, or the filter box above the table. Write a condition using column names exactly as written. Rows that fail the condition are greyed out and left out of every analysis and graph until the filter is cleared. Join conditions with and and or in any spelling (AND, &&, &, OR, ||, |), the habits of Python, R and spreadsheets; a single = is read as ==. A condition that cannot be read is explained under the box (in the dialog, under its field), and all rows stay in use until it is fixed.
Year == "Freshman" Commute_Minutes < 30 Year == "Senior" and GPA >= 3.5 Major == "Biology" or Major == "Nursing" Year == "Freshman" && GPA > 3 Employed != "Full-time"
Operators: == equal, != not equal, < <= > >=, AND, OR. Text values go in quotes. A single = is accepted as equal.
Compute a new variable
Data, Compute. Name the new column and write a formula using existing columns.
Hours_Study * 7 weekly hours Commute_Minutes / 60 minutes to hours (GPA - mean(GPA)) / sd(GPA) z-score by hand log(Income) natural log round(Age / 10) * 10 decade Hours_Sleep >= 7 gives true or false
Functions: log (natural), log10, sqrt, abs, exp, round, floor, ceil, pow(x, k). Whole-column summaries: mean(X), sd(X), median(X), min(X), max(X), sum(X), n(X). A row with a missing value in any column used gets a blank.
Transform (recode)
Data, Transform. Turn values into new values, one rule per line, as old = new. Numeric ranges are written 0 to 29 = short. "Everything else becomes" catches what the rules miss; leave it blank to keep the original value.
Full-time = Employed Part-time = Employed Not employed = Not employed
0 to 29 = short 30 to 59 = medium 60 to 300 = long
Add z-score column
Data, Add z-score column. Adds z_Variable with (x minus mean) divided by the sample SD, the same as the by-hand formula.
Bin into classes
Data, Bin into classes. Turns a numeric variable into classes of a width you choose ("60 to under 70"), starting where you say. Each class includes its left end. The new column is categorical, kept in numeric order, ready for a frequency table or bar plot.
Stack columns
Data, Stack columns. When each group sits in its own column, stacking makes one column of values and one column naming where each value came from, the layout two-sample tests, ANOVA and side-by-side graphs need. It makes a new data table (your own, so it is remembered), so download the old one first if you need it.
Reshape: wide to long
Data, Reshape: wide to long. The general form of Stack columns (tidyr's pivot_longer): pick the columns to gather (week1, week4, week8) and the columns to keep on every row (an ID, a group). Every value gets its own row, with a column naming the measurement it came from. Blank values are left out unless you keep them. The card shows the matching R line. It makes a new data table in place of the old one.
Reshape: long to wide
Data, Reshape: long to wide. The reverse (pivot_wider): pick the columns that identify a case, the column whose values become the new column names and the column that fills the cells. When several rows fall into one cell the app stops and names an example, as R does, unless you choose to keep the first, average or count them. Cells with no measurement are left blank.
Merge with another table (join)
Data, Merge with another table (join). Adds the columns of a second table (pasted, or a sample dataset) to the rows of this one wherever a key matches: a left join keeps every row here, an inner join only the matches, a full join everything. The key columns may have different names in the two tables (Student_ID here, StudentID there). The card counts matched and unmatched rows and repeated keys; a column name that already exists is kept apart with _2. Try the class data with STATC1000_Class_Data_Exam1.csv.
Group by and summarize
Data, Group by and summarize. One row per group (by one or two columns) with n, mean, SD, median, min, max, sum and the number of blanks for the numeric columns you pick, in the layout dplyr's group_by and summarise produce (GPA_mean, GPA_sd). Uses the rows a filter keeps. Tick the box to make the summary the new data table, for example to graph group means.
Clean rows (blanks, duplicates)
Data, Clean rows (blanks, duplicates). Turns missing-value codes (NA, N/A, NaN, null, ., -, ?) into blanks, trims spaces around values, removes exact duplicate rows, rows with a blank in the columns you name, and empty rows, and reports every count. Analyses already skip blanks on their own; this matters when a file uses NA or . for missing and the column was read as text.
Simulate random data
Data, Simulate random data. Random values from a normal, uniform, discrete uniform, binomial, Poisson, exponential or yes or no distribution, any number of rows and columns (one column per sample). If the row count matches the open table the columns are added to it; otherwise a new table is made. A seed repeats the same numbers, so a whole class can work with identical data.
Random sample of rows
Data, Random sample of rows. A simple random sample from the open table, with or without replacement, with an optional seed. Uses only the rows kept by a filter. The sample becomes a new data table (your own, so it is remembered) in place of the old one.
Sorting
Click a column name: smallest first (or A to Z), again for the reverse, and a third time for the order the rows had before any sorting. Sorting changes the row order for Time Series and for the display; analyses do not depend on it.
Essentials first: "more options"
A dialog shows the choices most runs need. Sections that most runs never touch (More appearance, Model terms, Checks, Model comparison, Percentages, Cells and a few others) are folded under a dashed heading marked more options; click it to open. A section you open stays open on this computer, and the edit button opens any section where you had changed something. Nothing is hidden for good: every option is one click away.
Accessibility panel
The round button at the bottom left opens the same accessibility panel as the course pages: dark mode (graphs drawn afterwards follow it), larger text, the Lexend font (fetched only when you turn it on), a reading ruler that follows the pointer, and read aloud for the selected text or the whole page. Choices are remembered on this computer.
New versions
The app updates itself in the background. When a new version has arrived, a green bar at the top says so with a Reload now button; your data table stays, and the results on the page are offered back by the restore bar after the reload. Ask's first line names the build you are on.
Check my work
Every result card has a check my work button. It lists the card's numbers (the statistic, df, p-value, interval ends, means and SDs, up to 18 of them); type the ones you worked out by hand and leave the rest blank. Each one is marked as a match within the rounding you typed, or a miss with the most likely reason: a flipped sign, one tail instead of two, the SD divided by n instead of n − 1, a standard error without the square root of n, percent against proportion, a squared or square-rooted value, or rounding too early. The verdict table stays on the card (checking again replaces it) and is not part of the saved analyses.
Files as spreadsheets export them
Open CSV or Excel file and Paste data read the file the way it was written: the delimiter is detected (comma, semicolon as Excel writes it in a Spanish, French or German locale, tab as a spreadsheet pastes, or pipe), a byte-order mark and Windows line ends are fine, quoted commas and line breaks inside a cell are kept. Then, so that numbers count as numbers, four things are tidied on the way in and named on an "Opened" card: decimal commas become decimal points (3,5 is 3.5); a currency sign, thousands separators and a percent sign are removed (45% is kept as 45; a bracketed amount is negative); a column name that appears twice gets _2; and NA, N/A, NaN, null, None, a dot, a dash, a question mark and Excel's #N/A no longer make a number column nominal (they stay in the cells; Data › Clean rows blanks them). A column with a code such as 0x10 stays text. Nothing is tidied in a sample dataset or in a table the app built.
Any confidence level
Every dialog with a confidence interval has a Confidence level (percent) box. Type the level the exercise uses, 95, 98, 90, 80 or anything from 50 to 99.99; a proportion such as 0.95 works too. The card, the APA line, the worked numbers and the R script all use the level typed (conf.level = 0.98). A course profile sets the level offered first, as a percent. The t* calculator in distrACTION takes the same box.
Hypothesis test, or the confidence interval on its own
Every test dialog that gives an interval (one sample t and z, independent and paired t, two sample z, one and two proportions, one and two variances) starts with a Perform choice, as StatCrunch does: Hypothesis test (the card reports the test and the interval, as before) or Confidence interval only. With the interval only, the test value, the hypothesis and alpha disappear and nothing has to be typed against: the card gives n, the estimate, the standard error, t* or z*, the margin of error and the interval at the level typed, the formula, the worked numbers, the APA line and a sentence that reads the interval (and says whether 0, or 1 for a ratio of variances, is inside). The R script for that card has no mu = or p =. Sample size is written n throughout (a population size, as in the hypergeometric calculator, stays N). On a one-sample interval (a mean with t or z, a proportion) the worked box follows the course's four steps: Step 1 the parameter in words, the statistic and the level; Step 2 the conditions checked one by one and the SE; Step 3 the critical value (z* with no df, or t* with its df) and the margin of error; Step 4 the interval and the sentence. For a proportion the sentence is given as a percent ("between 17.2% and 27.8% of all cases") and the card says whether the whole interval lies above 0.5 (more than half), below it, or includes it.
Examples from your field, and Ask in your words
With a field chosen under Student (or Researcher), the main test dialogs (independent and paired t, one and two proportions, contingency tables, one-way ANOVA, logistic regression, survival) show one example sentence from that field under their first box: in health and nursing, "did patients on the new protocol have a shorter length of stay than those on usual care", "vital signs or pain scores for the same patients before and after an intervention", "did the infection rate differ between the two units". The general field shows none. Ask understands the same phrasing: "did the infection rate drop" (two proportions), "how long until patients are readmitted" (survival), "before and after the intervention" (paired t), "the risk of the outcome in the exposed group" (relative risk and odds ratio from a 2 by 2 table), "intervention group versus usual care" (independent t), and "relative risk or odds ratio?" gets the plain-words answer.
A graph on every inferential card
Every test card now carries the picture of its test: the sampling distribution (t, z, chi-square or F) with the statistic as a dashed line and the p-value as the shaded tail (for a two-sided chi-square or F test the tail that holds the statistic is shaded and the title says it is half the p-value), next to the data graph that fits the test: box plots by group for ANOVA, Kruskal-Wallis and Mann-Whitney, row-percentage bars for a contingency table (independence means the same profile in every row), the discordant pairs for McNemar, observed against expected for goodness of fit, and the slope's t curve on the regression card. An interval-only card draws the interval itself: a bar from the lower to the upper end, the estimate as a dot, and the reference value (0 for a difference, 1 for a ratio of variances) as a dashed line, so "does the interval include 0" is read off the picture.
When a condition is not met: the simulation route
When a card's condition check comes out pink (n under 30 for a mean, a count under 10 for a proportion, an expected count under 5 in a table, a group under 30 in a one-way ANOVA or a regression), the card does not stop at the warning. Under the pink box it runs the simulation route from the same data and choices: a bootstrap percentile interval for the estimate (resample the data with replacement 2,000 times, take the middle 95 percent) and a permutation p-value for the test (shuffle the labels, or flip the signs, 2,000 times and count how often the shuffled result is at least as extreme), or for one proportion a binomial simulation at p0. A small table puts the formula answer and the simulation answer side by side, the sentence under it says whether they agree (then the formula answer stands) or differ (then report the simulation answer and say why), and the histogram shows the simulated values with the observed one in red. The simulation is seeded, so the same data give the same numbers. It needs the raw data, so a card built from summary statistics shows the warning only. The same methods, with their own settings, are under Advanced (Bootstrap confidence interval, Permutation test), and under Learn with the picture of how they work.
Copy for Word
Under every table, copy for Word puts a real table on the clipboard in APA style (a rule above and below, one under the header, numbers right aligned, no vertical lines, the title in italics above): paste it into Word, Google Docs or Pages and it arrives as a table you can edit, not as lines of text. The same button in a card's tools copies the whole card: the title, every table, the formula, the APA line, the conclusion, the worked numbers under Method, and a graph as a picture. A plain-text copy rides along for places that take no formatting. (Copy as CSV is for a spreadsheet, copy as Markdown for a report written in Markdown or a slide.)
When the data cannot answer
A variable with no variation (every value the same), a group with a single value, a grouping variable with one level, two columns that differ by the same amount in every pair, or ranks that are all tied: each of these makes a test undefined, and the dialog now says so in a sentence that names the column, the group and the value, instead of running and printing a card of blanks. A number that still cannot be computed, as in a perfect fit where every residual is zero, prints as n/a (an infinite statistic as ∞) and the card carries one line saying why that happens. Check the descriptives first, then the filter.
Large files
A file with tens of thousands of rows opens in well under a second. Up to 4,000 rows the table shows every row, as always; above that it shows the first 300 and brings in more as you scroll (or with the button under the table, or when the arrow keys walk past the last row); every analysis, graph and filter uses all the rows whatever the table shows, and the note under the table says so. Graphs of fifty thousand points take a few seconds to draw.
If something goes wrong
A fault in the app shows as a red bar above the results with the build number and the message, instead of a silent nothing. Dismiss it and carry on; if it comes back, reload with Ctrl+Shift+R (Cmd+Shift+R on a Mac). Your data table stays, and the results can be restored. If you can, email the message and what you clicked to the address on the privacy page.
Spanish interface / Interfaz en español
Results › Language / Idioma, or the Español button in the header, switches the menus, dialogs, buttons and the page itself to Spanish. The result cards, formulas, the APA line and the R script stay in English: they are the record you and your instructor compare, and a saved session, a share link or a course profile opens the same way in either language. Ask reads a question in Spanish (comparar dos grupos, antes y después, ¿qué es un valor p?) and shows how it read it; its answers are in English for now. A browser set to Spanish opens the app in Spanish the first time; the choice is remembered on the device. Ask also answers in Spanish: every route ("comparar dos grupos", "antes y después", "tasa de infección", "riesgo relativo") and every glossary entry ("¿qué es el valor p?", "desviación estándar", "razón de momios") has its Spanish title and answer, the buttons say Abrir, and the result cards they open stay in English. / Preguntar también responde en español: cada ruta y cada entrada del glosario tienen su título y su respuesta en español; las tarjetas de resultados siguen en inglés.
El botón Español en la cabecera, o Resultados › Idioma, cambia los menús, los diálogos y los botones al español. Las tarjetas de resultados, las fórmulas y el guion de R siguen en inglés, el registro que tú y tu profesor comparan. Puedes escribir tus preguntas en Ask en español.
5. Reading a result card
Every analysis produces a card with the same layout, top to bottom:
- Title and a grey line naming the dataset, the variables and n. Three buttons: edit (reopens the same dialog with your choices filled in; change anything and Run, and the new result replaces this card in place, the StatCrunch habit), copy text (copies the card's words and tables as plain text for a report, without its buttons and graphs; the button then says Copied) and remove. Under every table, copy as CSV (for a spreadsheet) and copy as Markdown (for a report or a slide); under every graph, download PNG, so a result goes into a document without a screenshot.
- StatCrunch-style block on every one-sample, two-sample, paired and proportion card: the parameter named in words (mu : Mean of population), the hypotheses for a test (H0 and HA), then one results table in StatCrunch's column order: Sample Mean, Std. Err., DF, Critical t, L. Limit and U. Limit for an interval, or T-Stat (Z-Stat) and P-value for a test. The sample mean is the first number a student reads, never the test statistic. The test value starts blank: a hypothesis test needs the mean the problem claims (H0) typed in, and the dialog says so under the box if it is missing; a test against 0 is never run by accident. If 0 is typed on purpose, the note explains why the statistic is the mean over its standard error. For the interval alone, Perform: Confidence interval only needs no test value. The Chapter 9 to 11 cards open the same way: goodness of fit (n, DF, Chi-Square Stat, P-value), the contingency table (Statistic, DF, Value, P-value), one-way ANOVA (the ANOVA table with Source, DF, SS, MS, F-Stat, P-value) and simple linear regression (the equation, the sample size, R, R-sq, the error SD, then Parameter estimates with Intercept and Slope rows).
- Tables, named the way the course instructions name them (Descriptives, Independent Samples T-Test, Model Fit Measures, Contingency Tables, and so on), so the instructions transfer as written.
- Formula box (grey, monospace): the formula that produced the statistic, with the symbols the course uses: mu and x bar for means, sigma and s for standard deviations, p and p hat for proportions. Under it, Show the numbers in the formula opens the same formula with the actual values in it, worked through to the statistic, the interval and the effect size (t-tests, z-tests, ANOVA, regression, chi-square): the step between the formula and the answer. Then Report it as (APA style), one line such as t(37.98) = −0.15, p = .878, d = −0.05, to paste into a write-up.
- Blue box: the decision and a written conclusion in plain English, including the p-value compared with alpha.
- Green or pink box: a condition check. Green means the condition for the method is met (for example n at least 30, or at least 10 successes and 10 failures). Pink means it is not, and says what to do instead.
- Graphs attached to the analysis (descriptives plots, residual plots), below the text.
Decimals. Numbers are shown to the number of decimals set under Results, Decimal places shown (4 by default). Internally everything is full precision.
6. Which analysis do I need
The Methods Guide covers this in full: every method by research question, with the steps in the app, what to read, how to report it, and what to do when the assumptions fail. It has a student edition and a professional edition. The short version follows.
Which test? (the button next to the filter box, or the first item of the T-Tests menu) asks three questions: what you measured (a number, a yes or no, or a category), what the question is (one group against a value, two groups, three or more, or a relationship), and for two groups whether they are the same people measured twice. It names the test as you answer and opens its dialog. With no data loaded it leaves a note naming the test instead. The table below is the same decision written out.
| Question | Data you have | Use |
|---|---|---|
| Describe one numeric variable | one continuous column | Exploration, Descriptives; Graph, Histogram or Boxplot or Dotplot |
| Describe one categorical variable | one nominal or ordinal column | Exploration, Descriptives with Frequency tables; Graph, Bar Plot |
| Is the mean different from a claimed value? | one continuous column and a number | T-Tests, One Sample T-Test |
| Do two groups have different means? | continuous column plus a two-level group column | T-Tests, Independent Samples T-Test (Welch) |
| Before and after, same people | two continuous columns, one per time | T-Tests, Paired Samples T-Test |
| Do three or more groups have different means? | continuous column plus a group column | ANOVA, One-Way ANOVA (with Tukey) |
| Is a proportion different from a claim? | one categorical column and a number | Frequencies, One proportion: z test (conditions checked); 2 Outcomes: Binomial test for the exact answer |
| Do two groups have different proportions? | categorical outcome plus two-level group | Frequencies, Two proportions z test |
| Do the category counts match expected shares? | one categorical column | Frequencies, N Outcomes: chi-square goodness of fit |
| Are two categorical variables related? | two categorical columns | Frequencies, Contingency Tables |
| Are two numeric variables related? Predict one from the other | two continuous columns | Regression, Correlation Matrix; Regression, Linear Regression; Graph, Scatter Plot |
| Predict from several variables | continuous outcome plus several predictors | Advanced, Multiple Linear Regression |
| Rows nested in clusters (students in classes, repeated measures of the same people) plus predictors | continuous outcome, predictors, a grouping factor | Advanced, Mixed-Effects Model |
| Predict a yes or no outcome | two-level outcome plus predictors | Advanced, Logistic Regression |
| Data are skewed or ranks, small samples | as above but not normal | Nonparametric menu (Mann-Whitney, Wilcoxon, Kruskal-Wallis) |
| A probability from a distribution | parameters only | distrACTION menu |
| Is the mean different from a claim, and sigma is given? | a numeric column, or the mean and n, plus sigma | T-Tests, One Sample Z-Test |
| Is a standard deviation different from a claim? Do two groups differ in spread? | a numeric column, or SDs and n | Advanced, Variance tests |
| Predict y for a new x, with an interval | two numeric columns | Regression, Linear Regression, Predict at x |
| Mean and SD of a discrete random variable | x values and their P(x), typed or as two columns | distrACTION, Custom (discrete x and P(x)) |
| How many people do I need? | a margin of error or an effect size | distrACTION, Sample size for a margin of error; distrACTION, Power and sample size for a test (also Advanced, Power and Sample Size) |
| Understand what a p-value or a confidence interval is | nothing, no data needed | Learn, What a p-value is; Learn, What a confidence interval means |
| Show why a coin does not even out, or why "two of the next ten" is wrong | nothing, no data needed | Learn, Coin flips and the law of large numbers |
| Show the Central Limit Theorem, or where sigma / sqrt(n) comes from | nothing, or a column as the population | Learn, The Central Limit Theorem; Learn, Sampling distribution simulator |
7. Menu by menu
Exploration
Descriptives
Pick one or more variables; optionally split by a group. Tick the statistics you want: N, missing, mean, median, mode (all modes are listed when there is a tie), sum, standard deviation (sample, n minus 1), variance, population SD, range, minimum, maximum, standard error, IQR, quartiles, fences for outliers, skewness, kurtosis, coefficient of variation, and any other percentiles you list (such as 10, 90). Tick plots: histogram, density, boxplot, dotplot, QQ plot, bar plot for categorical variables. Frequency tables appear for nominal and ordinal variables, with counts, relative frequency, percent, cumulative frequency, cumulative relative frequency and cumulative percent. Classes named by numbers ("60 to under 70") are listed in numeric order.
Quartile method. "Textbook halves" (default) finds Q1 and Q3 as the medians of the lower and upper halves with the overall median excluded, which is what the course teaches by hand. "Type 7" is what R and Excel use by default; the two can differ for small n. Boxplots use the same rule as the descriptives.
Scatterplot
Quick scatterplot with an optional group colour and regression line; the Graph menu version has more options.
Graph
All graphs land in the Graphs tab. Every graph follows the honest-graph rules, and says so under the picture. Every graph dialog has an Appearance section with the title, axis labels and color, and a folded More appearance section (click to open) with a palette for groups (Okabe-Ito, which colorblind readers can tell apart; viridis; grayscale for print; pastel), small multiples (one panel per level of a categorical column on shared axes, ggplot2's facet_wrap; a histogram's classes are worked out within each panel), legend position, a minimal or classic theme, font size, axis ranges, log scales, and reference lines typed as y = 3.0 or x = 70 (a label in brackets after the value is used as the line's label). Every graph downloads as PNG (twice the screen resolution) or SVG (vector, for a paper). The edit button on the card reopens the dialog with your choices filled in. A group (Group by, or Color by on the scatter plot) is a categorical column. A numeric column with 10 or fewer different values works too: each value is a group, in numeric order. With more values, or with an ID column, a message under the box asks for a categorical grouping variable instead; Data, Bin into classes turns a numeric column into classes you can group by. The same holds for Split by in Descriptives.
| Item | Pick | Options | Read it as |
|---|---|---|---|
| Bar Plot | a categorical variable, optional group | counts or percent; order (automatic keeps ordered scales in order, otherwise tallest first); counts above bars; frequency table; horizontal | Which categories are common. With a group, percent within group compares groups of different sizes fairly. |
| Pie Chart | a categorical variable | show percent and count | Parts of one whole only. A bar plot is usually clearer. |
| Histogram | a numeric variable, optional group | frequency, relative frequency or density; bin width and starting point; frequency above each bin; frequency table (with cumulative frequency and cumulative relative frequency); mean and median lines; normal curve overlay with the mean and SD of the data | Shape (symmetric, skewed left or right, one peak or more), centre, spread, gaps and outliers. Change the bin width twice before trusting a feature. |
| Dotplot | a numeric variable, optional group | mean and median lines | One dot per observation, nothing hidden. |
| Boxplot | one or more numeric variables, optional group | show all points; horizontal | Box from Q1 to Q3, line at the median, whiskers to the last values inside the fences, dots beyond. Skew shows as a long whisker or an off-centre median. |
| Stem and Leaf | a numeric variable | leaf unit | A histogram that keeps every value. |
| Scatter Plot | x and y numeric, optional colour, optional label column | least-squares line | Direction, form, strength, outliers, in that order. |
| QQ Plot | a numeric variable, optional group | Points near the line mean roughly normal. Curving means skew; tails peeling off mean outliers. Use it to justify t when n is under 30. |
T-Tests
The One Sample and Independent Samples t-test dialogs (and both Z-Tests) have a Data switch: from the data table, or "from summary statistics" (type the mean, SD and N from a textbook problem). With no data loaded they open in summary mode. If a summary box is empty, a message says what to type, and no card is made. The Paired Samples T-Test works from two columns of data. Options: mean difference with confidence interval, effect size (Cohen's d), descriptives, descriptives plots.
One Sample T-Test
Tests whether the population mean equals a test value. Reports t, df, p, mean difference, the confidence interval, and the condition check (n at least 30, or a normal-looking QQ plot when n is smaller). The formula box shows t = (x bar minus mu0) / (s / sqrt(n)).
Independent Samples T-Test
Compares two group means. Welch's version (no equal-variance assumption) is the default; untick it for Student's. Hypothesis can be two-sided, group 1 greater, or group 1 less. If the grouping variable has more than two levels, name the two you want, for example Full-time, Not employed; left blank, the first two levels are compared and the card says so. Summary-statistics mode takes mean, SD and N for each group (each SD above 0, each N at least 2).
One Sample Z-Test and Two Sample Z-Test
Only for problems that give the population standard deviation sigma. You type sigma (one, or one per group); the card gives z, the p-value, and the interval x bar plus or minus z* sigma / sqrt(n). If only the sample SD s is known, use the t-test: the card says so.
Paired Samples T-Test
Two columns measured on the same subjects (before and after). The test is a one-sample t on the differences; tick "Histogram of differences" to see them.
ANOVA
One-Way ANOVA
Three or more group means. Fisher's (equal variances) and Welch's F are both available; the homogeneity check compares the largest SD with the smallest (ratio under 2 passes), and Levene's test (deviations from the median, the Brown-Forsythe version) is available as a formal check. Tukey post-hoc tests tell which pairs differ, with adjusted p-values. Descriptives table and plot (means with confidence intervals) are optional.
Two-Way ANOVA
Two factors, with or without their interaction (Type II sums of squares, as R's car::Anova). Main effects, interaction, cell means table and interaction plot: non-parallel lines in the plot are the interaction. Estimated marginal means for each factor (emmeans' equal-weights definition, SEs from the model) with Tukey-adjusted pairwise comparisons follow the cell table; when the interaction is significant the card says to compare cell means instead.
ANCOVA
One factor plus one or more numeric covariates. The ANCOVA table (Type II) tests the factor after the covariates and each covariate after the factor, with partial eta squared; the adjusted means are each group's predicted value at the covariate mean, with standard errors, so the groups are compared as if they had the same covariate value; Holm-adjusted pairwise comparisons of the adjusted means; the homogeneity-of-slopes check (the group by covariate interaction) says whether one adjustment serves every group; and a scatterplot with the parallel fitted lines.
Repeated Measures and Mixed ANOVA
Wide data, one column per condition, with an optional between-subjects factor. Mauchly's sphericity test, Greenhouse-Geisser and Huynh-Feldt corrections, Holm-adjusted pairwise paired t-tests, the ICC and a profile plot.
MANOVA
One factor, two or more outcomes tested at once. Pillai's trace, Wilks' lambda, the Hotelling-Lawley trace and Roy's largest root, each with its F approximation (as R's summary.manova), the group means, a follow-up one-way ANOVA on each outcome with a Bonferroni line, and a profile plot of the standardized group means. Pillai's trace is the one to read when the groups are unequal in size or spread. Checked against R on the iris data.
Kruskal-Wallis and Friedman
The rank-based versions of one-way and repeated measures ANOVA, for ordinal, skewed or small data. Kruskal-Wallis compares three or more independent groups (H on chi-square). Friedman ranks each row across the conditions: the chi-square with the tie correction, Kendall's W as the agreement between rows, median and mean rank per condition, and Holm-adjusted pairwise Wilcoxon signed-rank tests. Both are also under Nonparametric.
Regression
Correlation Matrix
Two or more numeric variables. Pearson (linear) and Spearman (rank) correlations, with p-values if requested, and a grid of scatter plots. r near 0 means no linear relationship, not no relationship.
Linear Regression
One dependent variable and one explanatory variable (covariate). Reports the coefficients table (intercept, slope, SE, t, p, confidence interval), r (with the sign of the slope) and r squared, the residual plot and QQ plot of residuals, and predictions at one or several x values (comma separated). Each prediction comes with a confidence interval for the mean response and a prediction interval for one new value, and a warning when x is outside the data. Tick "Show confidence and prediction bands" to draw both bands around the line. The slope interpretation sentence is written for you.
Sensitivity to a lurking variable (Cinelli-Hazlett benchmark)
Mediation (indirect effect through a mediator)
Does X work through M? Paths a (X to M), b (M to Y holding X), the direct effect c′ and the total effect c by OLS with any covariates; the indirect effect a × b with Sobel's test and a percentile bootstrap interval (seeded; 2000 resamples by default), the share of the total effect mediated, and a histogram of the bootstrap distribution. The card states the causal assumptions (order in time; no unmeasured variable driving both M and Y). R: mediation::mediate with boot = TRUE.
After "correlation is not causation", the honest next step. Pick an outcome, a treatment (the cause being studied, a number or a 0/1 column), the covariates you adjust for, and a benchmark covariate. The card fits the regression and reports the robustness value: the share of the remaining variation of both the treatment and the outcome that an unobserved confounder (a lurking variable) would have to explain to bring the estimate to zero, and the smaller share that would make it not significant at alpha. The partial R2 of the treatment is the floor: a lurking variable explaining less than that of the outcome cannot explain the estimate away whatever its link to the treatment. Benchmarking asks what a lurking variable 1, 2 or 3 times as strong as the chosen covariate would do: its R2 with the treatment and the outcome, the adjusted estimate, SE and t. The contour plot shows the adjusted estimate for every strength, with the dashed red line where it reaches zero and the benchmark points marked. Formula, worked numbers and an APA-style sentence follow, as on every card. Cinelli and Hazlett (2020), Journal of the Royal Statistical Society B; the sample dataset Darfur survey is the paper's example (peacefactor on directlyharmed, benchmark female), and the card reproduces its Table 2.
Frequencies
One proportion: z test
The z test for one proportion, the way the course does it by hand: SE0 = sqrt(p0(1 minus p0)/n), z = (p hat minus p0)/SE0, with the worked numbers. The card checks the conditions (n p0 and n(1 minus p0) both at least 10) and says so either way; when they fail it points to the exact binomial p-value, which is shown underneath as a check on every run. Same data options and interval methods as the binomial test below.
2 Outcomes: Binomial test
One proportion against a test value. The exact binomial p-value is always given; its two-sided p adds every outcome as unlikely as the one observed, the same rule as R and jamovi. Tick "Also show the z test" for the course's by-hand method with the success and failure check (n p0 and n (1 minus p0) both at least 10). Summary mode: successes and n. Interval method: standard (Wald, the by-hand formula, default), plus four, Agresti-Coull, Wilson score, or exact Clopper-Pearson. When there are fewer than 10 successes or failures, the card points you to one of the small-sample methods instead of the standard interval.
N Outcomes: chi-square Goodness of fit
Do observed counts across categories match expected proportions? Choose Equally likely (every level gets 1 / k, the default) or type your own proportions or counts in the level order shown. The card states which null was used, shows the expected counts and the check that all are at least 5.
Contingency Tables: Independent Samples
Two categorical variables, or a typed table of counts. Chi-square test of independence with expected counts, row, column and total percentages; for a 2 by 2 table also Fisher's exact test, the odds ratio and the relative risk with confidence intervals. Fisher's Hₐ, shown when Fisher's exact test is ticked, picks the alternative: two-sided, greater (row 1 has a larger share of the first column, right tailed) or less (left tailed), where row 1 and the first column are the first ones in the Contingency Tables result (a typed table keeps the order you typed); for Ana with 8 makes and 2 misses and Ben with 3 makes and 7 misses, greater gives "Hₐ: Ana has a larger share of make than Ben (right tailed)" with exact p-value 0.0349. Each cell shows whatever you tick under Cells and Percentages, separated by vertical bars. If you untick all of them the table falls back to the observed counts and says so, rather than printing empty cells.
Two proportions: z test
Compares a success proportion between two groups using the pooled z test taught in the course, with the confidence interval for the difference and the success-failure check in each group. Type the success level exactly as in the data (Yes, not yes); if it is not one of the levels, the message under the box lists them. Summary mode takes successes and n per group.
distrACTION
Calculators, no data needed (Custom can also read two columns of the open dataset). Each one opens on the distrACTION page and works out its answer from the starting values at once, so a card is there before you type anything. The probability calculators draw the distribution and shade the probability.
How the page works
- The inputs card holds the parameters (for example Mean and SD) and a Find box: the Compute list, then x1, and x2 when the event is a "between" one. x2 is hidden for every other choice. Uniform (continuous) and Exponential open with x1 empty, and Custom opens with empty boxes: type a value and the answer appears.
- The result updates as you change anything: the parameters, the Compute list, x1 or x2. You never need to press Run to see it. If an input is empty, a grey note under the inputs says what to type; if it is impossible (an SD that is not positive, x2 below x1, a p outside 0 to 1 for a quantile), the note is red. Until the inputs make sense again the card fades and says "Out of date: see the message under the inputs".
- Run (or Enter) keeps the current result: the card shows Kept for a moment, and your next change starts a new card above it, so you can stack results and compare them. Pressing Run again with nothing changed makes no copy. edit on any card puts its values back in the inputs card and marks the card "Editing this result"; changes then update that card in place.
- When you open another calculator, a card the last one made by itself (one you never changed or kept) goes away, so browsing does not pile up cards.
- Every card starts with the answer in large type. For an event it is the event in symbols, words and percent, for example "P(X ≤ 67) = 0.8849, about 88.5%. The probability that X is at most 67." For t*, a p-value, a critical value, a sample size or power it is that number, for example "t* = 2.086 for 95% confidence". With "none, just the mean and SD" (Poisson, Geometric, Hypergeometric, Discrete Uniform and Custom) it is the mean and the SD, for example "mean = 3, SD = 1.7321". The tables and formula follow. On the probability cards the graph is shaded and its title states what is shaded, for example "Shaded: P(X ≤ 67) = 0.8849"; with "none" nothing is shaded and the title gives the mean and SD.
- A probability too small to show at the decimals chosen prints as "< 0.0001", never a bare 0, and the words give it the way a calculator writes it (for example 3.17E-5). One too close to 1 prints as "> 0.9999".
- On a phone or an iPad in portrait, the inputs card also repeats the current answer under the Find box, with a See the full result button.
Events you can find
| Compute list wording | Event | Discrete (binomial and the others) | Continuous (normal, uniform, exponential, t, chi-square, F) |
|---|---|---|---|
| P(X at most x1) | X ≤ x1 | includes x1 | area to the left of x1 |
| P(X less than x1) | X < x1 | excludes x1 | same as at most |
| P(X at least x1) | X ≥ x1 | includes x1 | area to the right of x1 |
| P(X more than x1) | X > x1 | excludes x1 | same as at least |
| P(X = x1) | X equals x1 | the bar at x1 | always 0 |
| P(x1 at most X at most x2) | x1 ≤ X ≤ x2 | includes both ends | area between |
| P(x1 less than X less than x2) | x1 < X < x2 | excludes both ends | same area between |
| quantile: x for cumulative probability p | the x for a cumulative probability p (type p in x1) | the smallest x with P(X ≤ x) at least p | the x with P(X ≤ x) = p |
Every calculator lists these events in this order (T-Distribution and Chi-square and F list their t*, p-value and critical value choices first). Binomial opens on P(X = x1); the continuous calculators open on "probability: P(X at most x1)". On the continuous calculators the same choices start with "probability:" (for example "probability: P(X at most x1)"), and the card adds the note "For a continuous variable, < and <= give the same area; P(X = a) = 0." For a discrete variable the strict and inclusive choices differ, and the app computes each one exactly. Example, Binomial with n = 4 and p = 1/6: P(X < 1) = 0.4823, P(X ≤ 1) = 0.8681, P(X = 1) = 0.3858, P(X > 3) = 0.0008, P(X ≥ 3) = 0.0162.
The calculators
- Binomial: number of trials and probability of success, then any event above, plus the mean, variance and SD of the distribution and a full table. Up to 100 trials the graph and the full table show every value. For more trials they show the values where the probability is, with a note giving the total probability of the values left out; the answer itself is always exact, for any number of trials.
- Poisson, Geometric, Hypergeometric, Discrete Uniform: the same layout as Binomial, with "none, just the mean and SD" as an extra choice, a full table and a shaded bar graph. Geometric lets you choose whether X counts the trials up to the first success (1, 2, 3, ...) or the failures before it (0, 1, 2, ...), since textbooks use both.
- Custom (discrete x and P(x)): any discrete probability distribution. Either put x in one column and P(x) in another (columns named x and p(x) are picked automatically), or type both lists separated by commas. The two boxes open empty, with grey examples; while you type, a grey note keeps count of the values so far. Gives the mean (expected value), variance and SD, a work table with x P(x) and (x minus mean)^2 P(x) to match the hand method, and any event above. The bar graph shades that probability and marks the mean. It stops with a red message if the two lists have different lengths, if a probability is not between 0 and 1, or if the probabilities do not add to 1. When they add to between 0.99 and 1.01 it says that is usually rounding and uses the values as typed.
- Normal: any event above, or the value for a given percentile (quantile). Type z scores by using mean 0 and SD 1. A between event shows both z scores, "z for x1" and "z for x2".
- Uniform (continuous) and Exponential: any event above and percentiles, with mean and SD and the shaded area. Exponential takes the mean; if you are given a rate lambda, the mean is 1/lambda.
- T-Distribution: the critical t* for a confidence level and df (type the level as a decimal, such as 0.95), the p-value for a t statistic (two-sided, upper or lower tail), or any event above for a t variable with that df. It opens on t* for 95 percent confidence with df = 20, and the graph shades the middle 95 percent.
- Chi-square and F: the right-tail p-value for a statistic (the Statistic box), the critical value for alpha (the alpha box, 0.05 to start), or any event above for that distribution.
- Sample size for a margin of error: for a proportion (with a guess for p, 0.5 if unknown) or a mean (with a guess for s). Only the guess that applies shows.
- Power and sample size for a test: the Advanced power calculator, on the distrACTION page, titled Power and Sample Size. Only the boxes the chosen test uses show.
Nonparametric
Rank-based alternatives for skewed data, ordinal scores or small samples.
- Mann-Whitney U: two independent groups (alternative to the independent t-test). Reports U, the p-value and the group medians.
- Wilcoxon signed-rank and sign test: paired data, or one column against a constant. Both tests are shown; the sign test uses only the direction of each difference.
- Kruskal-Wallis: three or more groups (alternative to one-way ANOVA). Follow a significant result with Mann-Whitney tests on the pairs that matter.
- Friedman: the same people measured under three or more conditions (alternative to Repeated Measures ANOVA). Ranks within each row, Kendall\'s W, Holm-adjusted pairwise Wilcoxon tests. Also under ANOVA.
Learn
Teaching tools that show where the theory comes from. Nine of them need no data and open on the Learn page, so they work on a projector in a room where no one has a file open: everything except bootstrap and permutation. The Central Limit Theorem, the sampling distribution simulator and Bayesian can still use a column of the open dataset. Bootstrap and permutation work from your data and stay with the table.
- Coin flips and the law of large numbers: one coin, two coins, three coins, a die, two dice, or any probability you choose. It shows the first fifty outcomes, a table of the proportion after 10, 25, 50, 100, 250 and more trials, and the running proportion settling toward p. A second plot shows the count drifting further from the expected count even while the proportion settles, which is the answer to "19 percent, so 2 of the next 10 will be priority 1" and to "tails is due."
- The Central Limit Theorem: pick a population shape (right-skewed, normal, uniform, two humps, yes or no, or a column of your data) and several sample sizes at once. The sampling distributions are drawn on the same axes, with a table comparing the simulated SD against sigma / sqrt(n) and the skewness falling as n grows. The point students miss: the center never moves, the spread shrinks by sqrt(n), and only the shape is the theorem.
- What a confidence interval means: draws many samples from a population only you can see, builds an interval from each, and plots them with the true value as a fixed vertical line. It reports the actual capture rate against the stated level. The truth never moves; the interval does. Uses t with n - 1 degrees of freedom for a mean, and warns when n p or n (1 - p) falls under 10 for a proportion.
- What a p-value is: forces H0 to be true, draws thousands of fresh samples from that world, and counts how many land at least as far out as your result. For a proportion it prints the simulated p, the exact binomial p and the z formula p side by side, and explains the gap when the normal approximation is off.
- Mean versus median: click the number line to add values, click a dot to remove one. Or type a value from 0 to 100 and press Add; Remove the last value takes one off. A long tail or one far value drags the mean and barely moves the median.
- Regression: outliers and influence: click to add points to a scatterplot, or type x and y (each 0 to 12) and press Add point, and watch the least-squares line, r and the slope refit against the starting line. Remove the last point takes one off. A point far out in x and off the pattern is influential; an outlier in the middle of the x range is not.
- Guess the correlation: a fresh scatterplot each time; type your guess for r, press Enter or check it, and keep a running average of how far off you are.
- Sampling distribution simulator: pick a population (a column of your data; a normal population, mean 50 and SD 10; a right-skewed one, exponential with mean 8; a uniform one from 0 to 100; or a yes or no population with a chosen p), a statistic, a sample size and a number of samples. For a sample proportion from a column, type the success level (that box shows only for a proportion); a column with no numbers for a mean, or a level that is not in the data, gets a message under its box and nothing is drawn. It draws the population, then the distribution of the sample statistic, and compares its SD with the formula (sigma / sqrt(n) or sqrt(p(1 minus p)/n)). Watch it turn normal as n grows.
- Bootstrap: a confidence interval with no formula. Resample with replacement, recompute the statistic thousands of times, take the middle 95 percent.
- Permutation: what a p-value is. Shuffle the group labels, recompute the difference, count how often the shuffled world beats the real one.
- Bayesian: prior, data, posterior on one picture, for a proportion or a mean, from a column of your data or from numbers you type. The same tool is under Advanced, Bayesian Inference.
Advanced
For second courses, research methods and upper-division work. Each card still ends with a plain-English reading.
| Item | What it does | Key options and reading |
|---|---|---|
| Mixed-Effects Model (nested or repeated data) | One numeric outcome, fixed-effect predictors (numeric and categorical), and a grouping factor whose clusters the rows belong to (subjects, classes, schools, patients). Optional random slope for one numeric predictor. | lme4's linear mixed model: REML (default) or ML, fixed effects with Satterthwaite df and p (lmerTest), random-effect variances, SDs and the intercept-slope correlation, ICC from the empty model, marginal and conditional R² (Nakagawa), AIC and BIC, a boundary-corrected likelihood-ratio test against the model without random effects, cluster effects (BLUPs) with a caterpillar plot, residual plot. Checked against lme4 and lmerTest on the sleepstudy data to four decimals. |
| Multiple Linear Regression | One numeric outcome, several numeric and categorical predictors (categories are dummy coded; the most frequent level is the reference unless you set one under Model terms). | Squared terms, interactions typed as a * b (numeric or categorical, any number of them), reference levels, residual and QQ plots, VIF for collinearity (above 5 is a concern), influence diagnostics (leverage, standardized residuals, Cook's distance), nested F test against a reduced model, backward elimination demo. Read each slope as the change in the outcome per unit of that predictor, holding the others fixed. |
| Logistic Regression | A two-level outcome. You name the level modelled as 1. | Model terms (interactions, squared terms, reference levels) as in multiple regression. Coefficients, odds ratios with confidence intervals, model chi-square, the pseudo R squared family (McFadden, Cox-Snell, Nagelkerke, Tjur), and under Diagnostics the ROC curve with AUC and its interval, a classification table at your cutoff and at Youden's best cut (sensitivity, specificity, precision), the Hosmer-Lemeshow calibration test with a decile plot, an optional deviance-residuals plot, an events-per-predictor check and a separation warning. An odds ratio of 1.5 means the odds are 50 percent higher per unit. |
| Survey estimates with weights (design-based) | Numeric and categorical variables, a weight column, optional strata and cluster columns. | Weighted means and proportions with Taylor-linearized design SEs and intervals (survey::svymean, with-replacement approximation), the unweighted values beside them, design effects, effective n, Kish's weights-only design effect, a warning for single-cluster strata. |
| Mixed-Effects Model for yes/no or counts (glmer) | A yes/no outcome (one row per case, or successes out of trials) or a count, with rows nested in clusters (herds, schools, patients). | Random intercept per cluster by the Laplace approximation (lme4's glmer): odds or rate ratios with intervals, between-cluster variance and SD, ICC on the latent scale, likelihood-ratio test for the random intercept, cluster effects with a caterpillar plot. Checked against glmer on the cbpp sample. |
| Count Regression | Poisson and negative binomial for counts (0, 1, 2, ...), with an optional exposure (time at risk, population) that enters as an offset so the model is for a rate. | Rate ratios with confidence intervals and a dispersion check; when the dispersion is well above 1, the negative binomial is recommended. Model terms (interactions, squared terms, reference levels) as in multiple regression. Checked against R's glm with offset(log(service)) on the ships sample. |
| Multinomial Logistic Regression | Three or more unordered outcome levels against a baseline. | One set of coefficients per non-baseline level, relative risk ratios. |
| Ordinal Logistic Regression | An ordered outcome (proportional odds). You type the levels from lowest to highest. | One set of odds ratios that apply across every cut point. |
| Variance tests | One SD against a claimed value (chi-square), or two SDs compared (F). Data or summary statistics. | Test and confidence intervals for sigma and sigma squared, or for the ratio of variances. Both tests need normal populations at any sample size; to check equal spread before ANOVA, Levene's test is safer. |
| McNemar test | Paired yes or no (before and after on the same people). | Uses only the discordant pairs; summary mode takes the two discordant counts. |
| Cochran-Armitage trend test | Does a proportion rise or fall across ordered groups? | Trend chi-square and a plot of the proportions. |
| Power and Sample Size | t-tests, proportions, ANOVA, correlation, chi-square. | Find power for a given n, or the n for a target power; power curve and effect-size sensitivity plot. Effect sizes should come from prior studies, not the data you are about to collect. |
| Bootstrap confidence interval | Mean, median, SD, proportion, difference in means or medians, correlation, slope. | Resamples, seed (same seed, same answer), percentile interval; a basic interval is added when bias is noticeable. |
| Permutation test | Two groups, paired, or correlation. | Exact logic of a p-value with no normality assumption. |
| Time Series | A numeric series in row order. | Time plot with moving average, ACF and PACF, additive or multiplicative decomposition, lag-1 plot, linear trend with Durbin-Watson, Holt forecast with the seasonal pattern added back. |
| Principal Component Analysis | Three or more numeric variables. | Eigenvalues, scree plot, loadings (varimax optional), score plot coloured by a group. |
| Exploratory Factor Analysis | Items of a questionnaire. | Principal axis factoring with varimax; loadings below a cutoff hidden; communalities. |
| Reliability (Cronbach's alpha) | Items of one scale. | Alpha, alpha if item dropped, item-rest correlations; reverse-keyed items flipped for you. Alpha at least 0.7 is the usual bar. |
| k-means Clustering | Two or more numeric variables. | Standardized by default, k-means++ starts, elbow plot, cluster plot on the first two principal components, optional cluster column added to the data. |
| Survival Analysis | Time to event with censoring. | Kaplan-Meier curves with confidence bands and censoring ticks, median survival, risk table, log-rank test between groups, Cox proportional hazards model with hazard ratios and a forest plot. |
| Bayesian Inference | A proportion (beta prior) or a mean (normal prior), from a column or typed numbers. | Prior, likelihood and posterior on one plot; posterior mean, SD and credible interval; probability the parameter is above a value you choose. |
Results
- Decimal places shown: 2, 3, 4 (default) or 6. It applies to new results, and your browser remembers the choice.
- Ask (the button in the data bar). Type what you measured and what you want to know, in plain words ("compare two groups", "before and after", "my counts are small", "how many people do I need"). It names the method, says why, and offers a button that opens the dialog, with a link to the steps in the Methods Guide. It also answers questions: ask what a term means ("what is a p-value", "SE or SD", "what is an odds ratio", "when do I use t instead of z", "what is the ICC") and it explains in plain words, opens the Learn demo where there is one, and links the glossary; ask "explain my result" or "what does this mean" and it reads the newest card back (APA line, conclusion, warnings) with a note on what the p-value does and does not say. After a result it reads the card's warnings and suggests the next step, for example Fisher's exact test when an expected count is under 5; the Ask button shows how many tips are waiting. It is rule based and works offline; nothing you type leaves the browser.
- Who is using the app: student or researcher. Student (the default) keeps the formula, the worked numbers and the plain-English conclusion on every card. Researcher keeps the same cards but leads with the result, the APA line and the conclusion, folds the formula and worked numbers under Method, and shows 3 decimals unless you set your own. A field (health and nursing, business and finance, social science and education, biology, engineering and quality, public safety) puts its sample datasets first and lists its usual analyses on the start screen. No menu is ever hidden. The same choices sit on the start screen and on the Student / Researcher button in the data bar.
- Notation: symbols or words. Formulas, hypotheses, APA lines and table headers use the textbook's symbols by default (x̄, σ, μ, α, χ², H₀, Hₐ, ±, ≠, √). Choose words (x bar, sigma, chi-square, H0) if you use Read Aloud or a screen reader. Menu names and card titles never change, so the companion guides still match.
- Share link (data + analyses): one address that carries the setup: the dataset (a sample dataset by name, or a table of your own inside the link when it is small enough), the filter, the choices behind every card on the Analyses and Graphs tabs, and the course profile if one is set. Press Copy link and paste it into Canvas, an email or a message. Whoever opens it sees "Open the shared setup?" with what it holds and an Open button; nothing runs until it is pressed, the same data come back, and the same analyses run again on them. Nothing is sent anywhere: the whole setup is in the address after
#s=. An instructor can hand a class a link that opens the app already set up for the day's activity; a student can send exactly what they ran. - Course profile: a small set of defaults an instructor shares: the two-sample t-test offered first (Welch's or pooled), the quartile rule in Descriptives, decimal places, the alpha and confidence level offered first, and which menus show (Data and Results always do, so Advanced can be hidden from a first course). Apply uses it on this computer; the profile name shows above the table. The same dialog downloads it as a
.sww-profile.jsonfile or copies a link that sets it; Open a profile file reads the file. A link made with Share link carries the profile too. Remove the profile from the same dialog. - Print or save as PDF: prints only the results of the page you are on (data table, menus and the distrACTION inputs are hidden). Use your browser's Save as PDF.
- Export results as HTML: one file with every card and graph, including the distrACTION and Learn pages, opens in any browser, good for submitting.
- Script: every step, with the R code: a card listing every analysis and graph on the page, oldest first, with the choices made in each dialog, and the R call that does the same for each (t.test, aov, lm, glm, lmerTest::lmer, chisq.test, prop.test, ggplot2, pivot_longer, left_join and so on; packages named in full). Two downloads: the steps as text, and a ready-to-run .R file that starts by reading the data (a sample by its address, your own file by name). Nothing on the page is hidden from a reader, and a student who moves to R sees the code for what they clicked.
- Script: every step, with the R code: a card listing every analysis and graph on the page, oldest first, with the choices made in each dialog, and the R call that does the same for each (t.test, aov, lm, glm, lmerTest::lmer, chisq.test, prop.test, ggplot2, pivot_longer, left_join and so on; packages named in full). Two downloads: the steps as text, and a ready-to-run .R file that starts by reading the data (a sample by its address, your own file by name). Nothing on the page is hidden from a reader, and a student who moves to R sees the code for what they clicked.
- Save session: a
.sww.jsonfile with the data, the filter, the column types you set, and the cards on the Analyses and Graphs tabs and the distrACTION and Learn pages. Open a saved session brings them back, on any computer. Graphs are not stored in the file, and a card brought back this way can be copied or removed but not edited: to redraw a graph or change a choice, run the analysis again from its menu. Opening a session file never runs anything in it, even one from someone else: its cards come in as plain content, and a saved filter is applied only when it is made of column names, numbers, text in quotes and operators. - Clear analyses and Clear graphs: on the data page, Clear analyses empties the Analyses tab and Clear graphs empties the Graphs tab. On the distrACTION or Learn page both clear that page only, the same as Clear this page, and Undo clear brings the cards back. Individual cards have their own remove button.
8. Honest graphs
Statistics software will happily draw a misleading picture. Stats Without Walls refuses to, and prints the rules it followed under each graph so students learn them.
- The count axis starts at zero and cannot be zoomed on bar plots and histograms. A difference of two students can never be stretched to look like a cliff.
- Equal bins with nice edges. Histogram bins are all the same width, chosen from 1, 2, 2.5, 5, 10 times a power of ten, with tick marks on the edges. Each class includes its left edge; the last class also includes the maximum, so every value is counted once. When you group by a variable, all groups share the same bins so their shapes can be compared.
- Ordered scales stay in order. Freshman to Senior, Never to Always, Strongly disagree to Strongly agree, 1 to 5 and similar scales are drawn in their natural order. Sorting them tallest first hides the shape of the distribution.
- Same width for every bar; only height carries information. No 3D, no pictograms.
- Pies are flat and carry their percent and count, so nobody judges angles by eye.
- Numbers are on the picture. The count or percent is printed above each bar and bin by default, and a frequency table can sit under the graph.
9. Writing up a result
Use the "copy text" button, then write one paragraph with these parts: what was compared, the statistic with its degrees of freedom, the p-value, the decision at alpha, and what it means in context. The blue box gives you most of this sentence. The three examples below come from "Our class data (40 students)", so you can run them and compare.
Run it with T-Tests, Independent Samples T-Test: Coffee_Cups_Daily by Employed, with Full-time, Not employed typed as the two levels to compare.
Run it with Frequencies, Contingency Tables: Independent Samples: rows Employed, columns Pet_Owner.
Run it with Regression, Linear Regression: dependent variable GPA, covariate Hours_Study.
Always report the condition check. If it failed, say so and report the nonparametric or exact result instead.
10. Saving and sharing work
- Your browser remembers your own data (with its filter and the types you set), the decimal setting and the panel width between visits on the same device. A sample dataset counts as your own once you change it. A sample dataset you have not changed and the distrACTION inputs are not remembered. Results are not kept through a reload either, but the choices behind the cards on the Analyses and Graphs tabs are: after a reload, a bar above the tabs says Restore your last session? with the count, the dataset and the time. Restore opens the same data (a sample dataset included) and runs the same analyses again, graphs and edit buttons included; No thanks forgets them. This is a convenience, not a backup.
- For homework, Results, Export results as HTML or Print or save as PDF and upload the file.
- To hand someone exactly what you have open, Results, Share link: the address carries the data (a sample by name, or your own small table), the filter and the analyses, and opens with an Open button.
- To continue later or on another computer, Results, Save session and keep the
.sww.jsonfile. - For the methods section, or to move the work to R, Results › Script: every step, with the R code: every analysis on the page with its choices, and the R call that does the same, downloadable as a .R file.
- To share a dataset with a classmate, Data, Download data as CSV.
11. How it differs from other tools
Menus, option names and table names match the course instructions, so they work as written. Where common statistics software and the course textbook disagree, Stats Without Walls follows the textbook:
| Topic | Other tools | Stats Without Walls |
|---|---|---|
| Quartiles | Type 7 interpolation | Textbook halves by default (median excluded); Type 7 available |
| Mode with ties | Shows one value | Lists every mode, or "no mode" when all values are unique |
| Standard deviation | Sample (n minus 1) only | Sample by default, population SD available and labelled |
| One proportion | Exact binomial only | Exact binomial plus the z test with the success-failure check |
| Two proportions | Often missing from the base menus | Pooled z test with confidence interval |
| Means | t, or z with a known sigma | t by default; the Z-Test needs sigma typed in and its card says to use t when only s is known |
| One proportion interval | One method | Standard (Wald) by default; plus four, Agresti-Coull, Wilson and exact on request |
| Histogram bins | Automatic, may differ by group | Equal nice bins shared across groups, editable width and start |
| Summary statistics input | Often not available | The one-sample and two-sample t and z tests, the proportion tests and chi-square accept typed summaries |
| Graphs | Mixed with output | Own Graphs tab |
| Price | Free to paid subscriptions | Free, always |
12. Troubleshooting
| Symptom | Cause and fix |
|---|---|
| A numeric column is not offered in a t-test or histogram | One cell contains text (such as "NA" or "n/a"), so the column was typed as nominal. Clear the cell, or use Data, Set variable type, Continuous. |
| "Column not found" | A filter or formula uses a name that does not match exactly (case and underscores matter). Copy the header text. Text must be in quotes: Year == Freshman looks for a column called Freshman; write Year == "Freshman". |
| Only one variable gets selected in a multi-select list | Hold Cmd (Mac) or Ctrl (Windows) while clicking. On a phone or an iPad, tap each one you want. |
| Every row is grey and analyses say "no rows" | The filter excludes everything. Clear the filter box and press Enter. |
| "Levels of X: ..." under a box | You typed a level (a success level, a level to test, a yes level) that is not in the data. The message under the box lists the levels and, when only the capitals differ, names the right spelling; type one exactly. Run makes no result until it matches. |
| Pink "small group" warning | A group has fewer than 5 rows. The result is fragile; say so in the write-up or combine groups. |
| Results look stale after an update | The browser cached an old version. Reload with Shift held (or Cmd Shift R). The browser-installed version updates itself on the next launch with internet; the desktop app does not, so download the new version from the download page when one is announced. |
| Mac says the app "cannot be opened" or "is damaged" | The app is not Apple-signed, so macOS quarantines it. Right-click the app in Applications and choose Open, once. If there is no Open Anyway button (newer macOS), open Terminal and run xattr -d com.apple.quarantine "/Applications/Stats Without Walls.app", then open the app normally. Also check you downloaded the right build: Apple Silicon for M1 to M4, Intel for older Macs. |
| Windows SmartScreen warning | Click More info, then Run anyway. The installer is unsigned but the same file as on the download page. |
| The data table has disappeared | You are on the distrACTION or Learn page. Click Back to data at the top left (or the browser's Back button). The data are still loaded. |
| The app opens with a sample dataset I did not ask for | Before build 57 a filter counted as a change, so a filtered sample (a share link or a restore often applies one) was remembered as your own. It no longer counts, and a remembered copy that is exactly the sample is forgotten on the next open. If a copy you did change is in the way, use Data, New data table or open another file; the browser then remembers that instead. |
| The sample dataset I used last time is gone | A sample dataset you did not change is not remembered, so the app opens with an empty table. Open it again from Data, Sample datasets. Once you change a sample (a new column, an edited cell), it is remembered as your own, like your own files and pasted data; a filter alone does not count. |
| A distrACTION card looks faded | An input is empty or impossible: the card says "Out of date: see the message under the inputs", and the message says which. Fix it and the card updates. |
| I cleared a page by mistake | On the distrACTION or Learn page, press Undo clear (where Clear this page was) right away: it goes as soon as you do something new or leave the page. |
| My numbers show fewer decimals than the key | Results, Decimal places shown, 4 (the default). The setting applies to new results, so run the analysis again. |
| Nothing prints | The print window was blocked or closed, or the page is open inside another app (Instagram, the Canvas app) that cannot print. Open the page in Safari or Chrome, wait until the graphs have finished drawing, then use Results, Print or save as PDF, or the browser's own Print: both print only the results. On an iPad or iPhone, use Share, then Print, then pinch out on the preview to save a PDF. |
13. Sample datasets
| Dataset | What it is | Good for |
|---|---|---|
| Our class data (40 students) | Survey of a statistics class: major, year, age, commute, study and sleep hours, coffee, exercise, employment, satisfaction, GPA. | Everything in a first course. |
| Class data, exam 1 version | The same class with exam scores added. | Paired and regression questions. |
| Sleep follow-up | Sleep before and after an intervention. | Paired t-test. |
| Finch beaks | Beak depth in Galapagos finches before and after a drought. | Two-sample t, histograms. |
| Global health | Countries: life expectancy, income, health spending, region. | Correlation, regression, ANOVA by region. |
| Police calls for service, academy fitness, community survey | Law-enforcement course datasets. | Proportions, chi-square, one-way ANOVA, time patterns. |
| CDC teen survey 2023 (1500 students) | Youth Risk Behavior Survey extract: marijuana use, sleep, grades, mood. | Contingency tables, two proportions, logistic regression. |
| General Social Survey 2018 and 2022 | Astrology and science beliefs, politics, wellbeing of US adults. | Chi-square, ordinal outcomes, bar plots of ordered scales. |
| Big Five personality (1200) and Big Five 50 items (500) | Personality scores and raw questionnaire items. | Correlation, PCA, factor analysis, reliability. |
| Cadet mile times | Times at weeks 1, 4, 8, 12 for two training groups. | Repeated measures and mixed ANOVA. |
| Mauna Loa CO2 monthly | NOAA monthly CO2 since 2000. | Time series. |
| Lung cancer survival (227 patients) | Survival time, death or censoring, age, sex, performance score. | Survival analysis. |
A codebook for the real-world datasets is in the app's data folder (README_real_world_datasets).
14. How the numbers were checked
Every procedure was run on the same data in R (and the jmv package where it exists) and compared to four decimals: t-tests, proportion tests, ANOVA and Tukey, chi-square, regression coefficients and intervals, nonparametric tests, multiple and logistic regression with diagnostics, two-way and repeated measures ANOVA, count, multinomial and ordinal models, power calculations, time-series decomposition and autocorrelation, PCA, factor analysis and varimax rotation, Cronbach's alpha, k-means, Kaplan-Meier, log-rank, Cox regression and the Bayesian conjugate updates. Distributions come from jStat; graphs are drawn with Plotly.
The distribution calculators (binomial, custom discrete, Poisson, geometric, hypergeometric, discrete uniform, uniform, exponential) were checked against R's d, p and q functions, and on 2026-10-14 the strict, inclusive, equal-to, between and quantile events again (binomial, normal, uniform, Poisson, geometric, hypergeometric, t, chi-square and F against pbinom, dbinom, qbinom, pnorm, qnorm, punif, ppois, qpois, pgeom, phyper, pt, pchisq and pf); the z tests, the exact binomial test p-value (against binom.test, on 2026-10-15, for n from 5 to 100,000), the five proportion intervals (against prop.test and binom.test), the variance tests (against var.test), Levene's test (against car::leveneTest), kurtosis, percentiles and the regression confidence and prediction intervals (against predict) the same way. Simulated data were checked by their mean and SD against the distribution they came from. On 2026-10-14 every distrACTION calculator and event (967 cases) was checked again against scipy. Binomial probabilities use the same method as R (Loader's saddle point), so they stay right for any number of trials; this was checked for n up to 10,000.
The Learn demonstrations are checked the same way. The simulated sampling distributions are compared against sigma / sqrt(n); the confidence interval demo is checked by its capture rate against the stated level, which also falls below that level on purpose when the success-failure condition fails; and the p-value demo is checked against the exact binomial, computed independently. Where the z formula and the exact answer disagree, the app prints both and says why rather than hiding the gap.
Stats Without Walls was built by Safaa Dabagh for students at Santa Monica College, West Los Angeles College and Loyola Marymount University, and is free for anyone to use.