Skip to contents

Run model selection on an aba model.

Source: R/aba_selection.R
aba_selection.Rd

This function allows you to run model selection on a fitted aba model. The function supports both forward and backward selection algorithms, both AIC and p-value as selection criteria, and arbitrary thresholds.

Usage

aba_selection(
  model,
  method = c("forward", "backward"),
  criteria = c("aic", "pval"),
  threshold = NULL,
  verbose = FALSE
)

Arguments

model

abaModel. The fitted aba model to run selection on.

method

string. The selection algorithm to use (forward or backward).

criteria

string. Which metric to use when selecting the next model (aic or pval).

threshold

numeric. Which threshold to use for the selected metric (defaults to -2 for aic; defaults to 0.1 for pval).

verbose

logical. Whether to print out results of each selection round.

Value

an abaSelection object which contains model summary information such as coefficients and metrics for each selection round across the different groups/outcomes/stats.

Details

Forward selection starts from covariates-only and tests the addition of all predictor sets individually, then adds the predictor set which improves the model criteria the most. Backward selection starts from the inclusion of all covariates + predictor sets and tests the removal of all predictor sets individually, then removes the predictor set which improves the model criteria the most. If there are no predictor sets whose addition/removal results in an improvement in the selected criteria by a value at least as good as the selected threshold, then the selection stops and the current model is frozen. Also, note that the model selection procedure is run separately for each group - outcome - stat combination.

Examples


df <- aba::adnimerge %>% dplyr::filter(VISCODE == 'bl')

# standard model selection
model <- df %>% aba_model() %>%
  set_outcomes(ConvertedToAlzheimers) %>%
  set_predictors(
    CDRSB_bl, ADAS13_bl, MMSE_bl,
    CSF_ABETA_bl, CSF_PTAU_bl, CSF_TAU_bl,
    PLASMA_ABETA_bl, PLASMA_PTAU181_bl, PLASMA_NFL_bl,
    MRI_HIPP_bl,
    PET_ABETA_bl
  ) %>%
  set_covariates(AGE, GENDER, EDUCATION) %>%
  set_stats('glm') %>%
  aba_fit()
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"

model_summary <- model %>% aba_summary()

# default selection - forward selection by AIC with threshold = -2
# \donttest{
model_selection <- model %>% aba_selection(verbose=TRUE)
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> Round:  1 
#> Improvement:  ADAS13_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + PET_ABETA_bl"
#> Round:  2 
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + PET_ABETA_bl"
#> Round:  3 
#> Improvement:  CDRSB_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PET_ABETA_bl"
#> Round:  4 
#> Improvement:  PLASMA_NFL_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PET_ABETA_bl"
#> Round:  5 
#> No improvement - stopping
# }
# selection with p-value and threshold = 0.1
# \donttest{
model_selection <- model %>%
  aba_selection(criteria = 'pval', threshold=0.1, verbose=TRUE)
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> Round:  1 
#> Improvement:  ADAS13_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + PET_ABETA_bl"
#> Round:  2 
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + PET_ABETA_bl"
#> Round:  3 
#> Improvement:  CDRSB_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PET_ABETA_bl"
#> Round:  4 
#> Improvement:  PLASMA_NFL_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PET_ABETA_bl"
#> Round:  5 
#> Improvement:  PLASMA_PTAU181_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl + CSF_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl + CSF_PTAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl + PLASMA_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + ADAS13_bl + MRI_HIPP_bl + CDRSB_bl + PLASMA_NFL_bl + PLASMA_PTAU181_bl + PET_ABETA_bl"
#> Round:  6 
#> No improvement - stopping
# }
# selection by group
model2 <- model %>%
  set_predictors(
    c(CDRSB_bl,ADAS13_bl,MMSE_bl),
    c(CSF_ABETA_bl,CSF_PTAU_bl,CSF_TAU_bl),
    c(PLASMA_ABETA_bl, PLASMA_PTAU181_bl, PLASMA_NFL_bl),
    c(MRI_HIPP_bl),
    c(PET_ABETA_bl)
  ) %>%
  aba_fit()
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"

model_summary2 <- model2 %>% aba_summary()

# \donttest{
model_selection2 <- model2 %>%
  aba_selection(criteria='pval', threshold=0.1, verbose=TRUE)
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> Round:  1 
#> Improvement:  CDRSB_bl ADAS13_bl MMSE_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + PET_ABETA_bl"
#> Round:  2 
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PET_ABETA_bl"
#> Round:  3 
#> Improvement:  PLASMA_ABETA_bl PLASMA_PTAU181_bl PLASMA_NFL_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + PET_ABETA_bl"
#> Round:  4 
#> No improvement - stopping
# }

# add more outcomes
model3 <- model2 %>%
  set_outcomes(ConvertedToAlzheimers, ConvertedToDementia) %>%
  aba_fit()
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"

# \donttest{
model_selection3 <- model3 %>%
  aba_selection(criteria='pval', threshold=0.1, verbose=TRUE)
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> Round:  1 
#> Improvement:  CDRSB_bl ADAS13_bl MMSE_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + PET_ABETA_bl"
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + PET_ABETA_bl"
#> Round:  2 
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PET_ABETA_bl"
#> Improvement:  CDRSB_bl ADAS13_bl MMSE_bl 
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PET_ABETA_bl"
#> Round:  3 
#> Improvement:  PLASMA_ABETA_bl PLASMA_PTAU181_bl PLASMA_NFL_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + PET_ABETA_bl"
#> Improvement:  PLASMA_ABETA_bl PLASMA_PTAU181_bl PLASMA_NFL_bl 
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + PET_ABETA_bl"
#> Round:  4 
#> No improvement - stopping
#> No improvement - stopping
# }

# add more groups
model4 <- model3 %>%
  set_groups(everyone(), DX_bl %in% c('MCI','AD')) %>%
  aba_fit()
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"

# \donttest{
model_selection4 <- model4 %>%
  aba_selection(criteria='pval', threshold=0.1, verbose=TRUE)
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + PET_ABETA_bl"
#> Round:  1 
#> Improvement:  CDRSB_bl ADAS13_bl MMSE_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + PET_ABETA_bl"
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + PET_ABETA_bl"
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + PET_ABETA_bl"
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + PET_ABETA_bl"
#> Round:  2 
#> Improvement:  MRI_HIPP_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PET_ABETA_bl"
#> Improvement:  CDRSB_bl ADAS13_bl MMSE_bl 
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PET_ABETA_bl"
#> Improvement:  CSF_ABETA_bl CSF_PTAU_bl CSF_TAU_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + PET_ABETA_bl"
#> Improvement:  CSF_ABETA_bl CSF_PTAU_bl CSF_TAU_bl 
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + PET_ABETA_bl"
#> Round:  3 
#> Improvement:  PLASMA_ABETA_bl PLASMA_PTAU181_bl PLASMA_NFL_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + CDRSB_bl + ADAS13_bl + MMSE_bl + MRI_HIPP_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + PET_ABETA_bl"
#> Improvement:  PLASMA_ABETA_bl PLASMA_PTAU181_bl PLASMA_NFL_bl 
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl"
#> [1] "ConvertedToDementia ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CDRSB_bl + ADAS13_bl + MMSE_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + PET_ABETA_bl"
#> Improvement:  PLASMA_ABETA_bl PLASMA_PTAU181_bl PLASMA_NFL_bl 
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + CDRSB_bl + ADAS13_bl + MMSE_bl"
#> [1] "ConvertedToAlzheimers ~ AGE + GENDER + EDUCATION + MRI_HIPP_bl + CSF_ABETA_bl + CSF_PTAU_bl + CSF_TAU_bl + PLASMA_ABETA_bl + PLASMA_PTAU181_bl + PLASMA_NFL_bl + PET_ABETA_bl"
#> No improvement - stopping
#> Round:  4 
#> No improvement - stopping
#> No improvement - stopping
#> No improvement - stopping
#> Found NA - skipping
# }