The BIC model comparison calculator compares two regression models with the Bayesian information criterion, and gives the AIC, the difference, the evidence strength and the approximate probability of each model.
How the calculation works
- Enter the number of observations.
- Enter the residual sum of squares and the number of parameters of each model.
- The calculator gives the BIC and AIC of both models, the difference, and the probability of model A.
Example
With 100 observations, model A has RSS 250 and 3 parameters, and model B has RSS 230 and 6 parameters. The BIC is 105.44 for A and 110.92 for B, a difference of 5.48, so the BIC prefers A with a probability of about 93.9 %. The AIC is 97.63 against 95.29, and prefers B: the criteria disagree because the BIC penalizes complexity more.
Why it matters
The calculator helps students, researchers and analysts who choose between nested or competing regressions and want a quick comparison from the output of their software.
Good to know
The formulas assume models fitted by least squares with normally distributed errors and compared on the same data. The number of parameters should include the intercept, and some software also counts the error variance, which changes both models by the same amount, so the difference is unaffected. The BIC is an approximation to the log of a Bayes factor, valid for large samples, and the probabilities are rough. Do not compare models fitted on different responses or with a different number of observations. The criteria are not tests: a low BIC says a model is best among those tried, not that it is correct. Check the residuals and the use case too.
Related tools
The linear regression calculator fits a line, the R-squared calculator measures fit, the Bayes factor calculator compares hypotheses and the statistical power calculator plans sample sizes.