Bf test r example

The BF function can be used for hypothesis testing and model selection using the Bayes factor. By default exploratory hypothesis tests are performed of whether each model parameter equals zero, is negative, or is positive. Confirmatory hypothesis tests can be executed by specifying hypotheses with equality and/or order constraints on the parameters of interest. Depending on the class of the fitted model different Bayes factors are used as described in the output.

Usage

## Default S3 method: BF( x, hypothesis = NULL, prior.hyp.explo = NULL, prior.hyp.conf = NULL, prior.hyp = NULL, complement = TRUE, log = FALSE, Sigma, n, . ) ## S3 method for class 'lm' BF( x, hypothesis = NULL, prior.hyp.explo = NULL, prior.hyp.conf = NULL, prior.hyp = NULL, complement = TRUE, log = FALSE, BF.type = 2, iter = 10000, . ) ## S3 method for class 't_test' BF( x, hypothesis = NULL, prior.hyp.explo = NULL, prior.hyp.conf = NULL, prior.hyp = NULL, complement = TRUE, log = FALSE, BF.type = 2, iter = 1e+06, . ) 

Arguments

An R object containing the outcome of a statistical analysis. An R object containing the outcome of a statistical analysis. Currently, the following objects can be processed: t_test(), bartlett_test(), lm(), aov(), manova(), cor_test(), lmer() (only for testing random intercep variances), glm(), coxph(), survreg(), polr(), zeroinfl(), rma(), ergm(), bergm(), or named vector objects. In the case x is a named vector, the arguments Sigma and n are also needed. See vignettes for elaborations.

A character string containing the constrained (informative) hypotheses to evaluate in a confirmatory test. The default is NULL, which will result in standard exploratory testing under the model x .

The prior probabilities of the hypotheses in the exploratory tests. Except for objects of class aov (for (M)ANOVA, etc.), this argument should be a vector with three elements reflecting the prior probability of a zero effect, a negative effect, and a positive effect, respectively. For objects of class aov , the argument should be a list where the first element should be a vector of length 3 specifying the prior probabilities of each parameter being zero, negative, or positive, the second element should be a vector of length 2 specifying the prior probabilities of a model where is no main effect for a factor and the full model, and the third element should be a vector of length 2 specifying the prior probabilities of a model where is no interaction effect (if present) for two factors and the full model. The default ( NULL ) specifies equal prior probabilities for each hypothesis per exploratory test.

The prior probabilities of the constrained hypotheses in the confirmatory test.

Deprecated. Please use the argument prior.hyp.conf .

a logical specifying whether the complement should be added to the tested hypothesis under hypothesis .

a logical specifying whether the Bayes factors should be computed on a log scale. Default is FALSE .

An approximate posterior covariance matrix (e.g,. error covariance matrix) of the parameters of interest. This argument is only required when x is a named vector.

The (effective) sample size that was used to acquire the estimates in the named vector x and the error covariance matrix Sigma . This argument is only required when x is a named vector.

Parameters passed to and from other functions.

An integer that specified the type of Bayes factor (or prior) that is used for the test. Currently, this argument is only used for models of class 'lm' and 't_test', where BF.type=2 implies an adjusted fractional Bayes factor with a 'fractional prior mean' at the null value (Mulder, 2014), and BF.type=1 implies a regular fractional Bayes factor (based on O'Hagan (1995)) with a 'fractional prior mean' at the MLE.

Number of iterations that are used to compute the Monte Carlo estimates (only used for certain hypotheses under multivariate models and when testing group variances).

Details

The function requires a fitted modeling object. Current analyses that are supported: t_test , bartlett_test , aov , manova , lm , mlm , glm , hetcor , lmer , coxph , survreg , ergm , bergm , zeroinfl , rma and polr .

For testing parameters from the results of t_test(), lm(), aov(), manova(), and bartlett_test(), hypothesis testing is done using adjusted fractional Bayes factors are computed (using minimal fractions). For testing measures of association (e.g., correlations) via cor_test() , Bayes factors are computed using joint uniform priors under the correlation matrices. For testing intraclass correlations (random intercept variances) via lmer() , Bayes factors are computed using uniform priors for the intraclass correlations. For all other tests, approximate adjusted fractional Bayes factors (with minimal fractions) are computed using Gaussian approximations, similar as a classical Wald test.

Value

The output is an object of class BF . The object has elements:

• BFtu_exploratory : The Bayes factors of the constrained hypotheses against the unconstrained hypothesis in the exploratory test.
• BFtu_main (only for aov objects with predictors of class factor ): The Bayes factors of a constrained model where all levels of a factor are assumed to have the same effect on the outcome variable versus an unconstrained (full) model with no constraints.
• BFtu_interaction (only for aov objects with interaction effects with predictors of class factor ): The Bayes factors of a constrained model where the effect of the dummy variables corresponding to an interaction effects are assumed to be zero versus an unconstrained (full) model with no constraints.
• PHP_exploratory: The posterior probabilities of the constrained hypotheses in the exploratory test.
• PHP_main (only for aov objects with predictors of class factor ): The posterior probabilities a constrained model where all levels of a factor are assumed to have the same effect on the outcome variable versus an unconstrained (full) model with no constraints.
• PHP_interaction (only for aov objects with interaction effects with predictors of class factor ): The posterior probabilities of a constrained model where the effect of the dummy variables corresponding to an interaction effects are assumed to be zero versus an unconstrained (full) model with no constraints.
• BFtu_confirmatory : The Bayes factors of the constrained hypotheses against the unconstrained hypothesis in the confirmatory test using the hypothesis argument.
• PHP_confirmatory : The posterior probabilities of the constrained hypotheses in the confirmatory test using the hypothesis argument.
• BFmatrix_confirmatory : The evidence matrix which contains the Bayes factors between all possible pairs of hypotheses in the confirmatory test.
• BFtable_confirmatory : The Specification table (output when printing the summary of a BF for a confirmatory test) which contains the different elements of the extended Savage Dickey density ratio where
  • The first column ' complex= ' quantifies the relative complexity of the equality constraints of a hypothesis (the prior density at the equality constraints in the extended Savage Dickey density ratio).
  • The second column ' complex> ' quantifies the relative complexity of the order constraints of a hypothesis (the prior probability of the order constraints in the extended Savage Dickey density ratio).
  • The third column ' fit= ' quantifies the relative fit of the equality constraints of a hypothesis (the posterior density at the equality constraints in the extended Savage Dickey density ratio).
  • The fourth column ' fit> ' quantifies the relative fit of the order constraints of a hypothesis (the posterior probability of the order constraints in the extended Savage Dickey density ratio)
  • The fifth column ' BF= ' contains the Bayes factor of the equality constraints against the unconstrained hypothesis.
  • The sixth column ' BF> ' contains the Bayes factor of the order constraints against the unconstrained hypothesis.
  • The seventh column ' BF ' contains the Bayes factor of the constrained hypothesis against the unconstrained hypothesis.
  • The eighth column ' PHP ' contains the posterior probabilities of the hypotheses.

  Methods (by class)

  • BF(default) : S3 method for a named vector 'x'
  • BF(lm) : S3 method for an object of class 'lm'
  • BF(t_test) : BF S3 method for an object of class 't_test'

  References

  Mulder, J., D.R. Williams, Gu, X., A. Tomarken, F. Böing-Messing, J.A.O.C. Olsson-Collentine, Marlyne Meyerink, J. Menke, J.-P. Fox, Y. Rosseel, E.J. Wagenmakers, H. Hoijtink., and van Lissa, C. (2021). BFpack: Flexible Bayes Factor Testing of Scientific Theories in R. Journal of Statistical Software.

  Examples

   # EXAMPLE 1. One-sample t test ttest1 zfWHR > 0; ztrust > 0 & zfWHR = 0") summary(BF1) # EXAMPLE 5. Correlation analysis set.seed(123) cor1 Rat_with_Del > 0; Rat_with_Im = Rat_with_Del = 0") summary(BF2) # correlations can also be computed between continuous/ordinal variables memory_test tensionM > tensionH; woolB = tensionM = tensionH") summary(BF1)