I need your help!
I want your feedback to make the book better for you and other readers. If you find typos, errors, or places where the text may be improved, please let me know. The best ways to provide feedback are by GitHub or hypothes.is annotations.
Opening an issue or submitting a pull request on GitHub: https://github.com/isaactpetersen/Principles-Psychological-Assessment
Adding an annotation using hypothes.is.
To add an annotation, select some text and then click the
symbol on the pop-up menu.
To see the annotations of others, click the
symbol in the upper right-hand corner of the page.
Chapter 26 Reproducibility
It is important for work to be reproducible by others. Reproducibility and replicability are key goals of the open science movement (Gandrud, 2020; Open Science Collaboration, 2015; Tackett, Brandes, King, et al., 2019; Tackett, Brandes, & Reardon, 2019). To that aim, I provide information below on my setup that was used to generate the results found in this book. If you run (all of) my code in the same order with the exact same setup, you should get the same results—but let me know if not!
26.1 Session Info
R version 4.4.0 (2024-04-24)
Platform: x86_64-pc-linux-gnu
Running under: Ubuntu 22.04.4 LTS
Matrix products: default
BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3
LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so; LAPACK version 3.10.0
locale:
[1] LC_CTYPE=C.UTF-8 LC_NUMERIC=C LC_TIME=C.UTF-8
[4] LC_COLLATE=C.UTF-8 LC_MONETARY=C.UTF-8 LC_MESSAGES=C.UTF-8
[7] LC_PAPER=C.UTF-8 LC_NAME=C LC_ADDRESS=C
[10] LC_TELEPHONE=C LC_MEASUREMENT=C.UTF-8 LC_IDENTIFICATION=C
time zone: UTC
tzcode source: system (glibc)
attached base packages:
[1] grid stats4 splines stats graphics grDevices utils
[8] datasets methods base
other attached packages:
[1] mirtCAT_1.13 shiny_1.8.1.1 strucchange_1.5-3
[4] sandwich_3.1-0 zoo_1.8-12 dmacs_0.1.0.9002
[7] dagitty_0.3-4 nFactors_2.4.1.1 corrplot_0.92
[10] glmnet_4.1-8 LiblineaR_2.10-23 elasticnet_1.3
[13] lars_1.3 ordinalForest_2.4-3 ranger_0.16.0
[16] e1071_1.7-14 randomForest_4.7-1.1 caret_6.0-94
[19] ggrepel_0.9.5 car_3.1-2 carData_3.0-5
[22] msir_1.3.3 ggpubr_0.6.0 gridExtra_2.3
[25] uroc_0.1.0 PredictABEL_1.2-4 ResourceSelection_0.3-6
[28] rms_6.8-0 Hmisc_5.1-2 ROCR_1.0-11
[31] pROC_1.18.5 magrittr_2.0.3 mirt_1.41
[34] lattice_0.22-6 drc_3.0-1 semTools_0.5-6
[37] nonnest2_0.5-7 quantreg_5.97 SparseM_1.81
[40] mice_3.16.0 snow_0.4-4 simsem_0.5-16
[43] DT_0.33 simstandard_0.6.3 MASS_7.3-60.2
[46] kableExtra_1.4.0 rockchalk_1.8.157 semPlot_1.1.6
[49] here_1.0.1 MOTE_1.0.2 performance_0.11.0
[52] gtheory_0.1.2 lme4_1.1-35.3 Matrix_1.7-0
[55] irrNA_0.2.3 irrICC_1.0 irrCAC_1.0
[58] psychmeta_2.6.5 lavaan_0.6-17 MBESS_4.9.3
[61] blandr_0.5.1 psych_2.4.3 viridis_0.6.5
[64] viridisLite_0.4.2 bookdown_0.39 rmarkdown_2.26
[67] knitr_1.46 tinytex_0.51 lubridate_1.9.3
[70] forcats_1.0.0 stringr_1.5.1 purrr_1.0.2
[73] readr_2.1.5 tidyr_1.3.1 tibble_3.2.1
[76] ggplot2_3.5.1 tidyverse_2.0.0 dplyr_1.1.4
[79] petersenlab_1.0.0
loaded via a namespace (and not attached):
[1] RColorBrewer_1.1-3 insight_0.19.10 numDeriv_2016.8-1.1
[4] tools_4.4.0 backports_1.4.1 utf8_1.2.4
[7] R6_2.5.1 vegan_2.6-4 mgcv_1.9-1
[10] jomo_2.7-6 permute_0.9-7 withr_3.0.0
[13] prettyunits_1.2.0 fdrtool_1.2.17 qgraph_1.9.8
[16] cli_3.6.2 mix_1.0-11 labeling_0.4.3
[19] sass_0.4.9 mvtnorm_1.2-4 polspline_1.1.24
[22] proxy_0.4-27 pbapply_1.7-2 pbivnorm_0.6.0
[25] systemfonts_1.0.6 foreign_0.8-86 svglite_2.1.3
[28] parallelly_1.37.1 lisrelToR_0.3 plotrix_3.8-4
[31] rstudioapi_0.16.0 generics_0.1.3 shape_1.4.6.1
[34] combinat_0.0-8 gtools_3.9.5 vroom_1.6.5
[37] zip_2.3.1 OpenMx_2.21.11 interp_1.1-6
[40] fansi_1.0.6 abind_1.4-5 lifecycle_1.0.4
[43] multcomp_1.4-25 yaml_2.3.8 CompQuadForm_1.4.3
[46] recipes_1.0.10 promises_1.3.0 crayon_1.5.2
[49] mitml_0.4-5 pillar_1.9.0 tcltk_4.4.0
[52] boot_1.3-30 corpcor_1.6.10 lpSolve_5.6.20
[55] future.apply_1.11.2 codetools_0.2-20 pan_1.9
[58] glue_1.7.0 V8_4.4.2 data.table_1.15.4
[61] vctrs_0.6.5 png_0.1-8 gtable_0.3.5
[64] cachem_1.0.8 gower_1.0.1 xfun_0.43
[67] openxlsx_4.2.5.2 mime_0.12 prodlim_2023.08.28
[70] coda_0.19-4.1 survival_3.5-8 timeDate_4032.109
[73] iterators_1.0.14 hardhat_1.3.1 lava_1.8.0
[76] TH.data_1.1-2 ipred_0.9-14 nlme_3.1-164
[79] bit64_4.0.5 progress_1.2.3 rprojroot_2.0.4
[82] mi_1.1 bslib_0.7.0 Deriv_4.1.3
[85] rpart_4.1.23 colorspace_2.1-0 DBI_1.2.2
[88] nnet_7.3-19 mnormt_2.1.1 tidyselect_1.2.1
[91] bit_4.0.5 compiler_4.4.0 curl_5.2.1
[94] htmlTable_2.4.2 animation_2.7 xml2_1.3.6
[97] checkmate_2.3.1 scales_1.3.0 quadprog_1.5-8
[100] sem_3.1-15 digest_0.6.35 minqa_1.2.6
[103] htmltools_0.5.8.1 pkgconfig_2.0.3 jpeg_0.1-10
[106] base64enc_0.1-3 highr_0.10 fastmap_1.1.1
[109] rlang_1.1.3 htmlwidgets_1.6.4 jmvcore_2.4.7
[112] farver_2.1.1 jquerylib_0.1.4 jsonlite_1.8.8
[115] mclust_6.1.1 dcurver_0.9.2 ModelMetrics_1.2.2.2
[118] polynom_1.4-1 Formula_1.2-5 munsell_0.5.1
[121] Rcpp_1.0.12 stringi_1.8.4 plyr_1.8.9
[124] listenv_0.9.1 parallel_4.4.0 deldir_2.0-4
[127] kutils_1.73 hms_1.1.3 PBSmodelling_2.69.3
[130] igraph_2.0.3 ggsignif_0.6.4 reshape2_1.4.4
[133] GPArotation_2024.3-1 XML_3.99-0.16.1 evaluate_0.23
[136] latticeExtra_0.6-30 mitools_2.4 RcppParallel_5.1.7
[139] httpuv_1.6.15 nloptr_2.0.3 tzdb_0.4.0
[142] foreach_1.5.2 MatrixModels_0.5-3 future_1.33.2
[145] reshape_0.8.9 broom_1.0.5 xtable_1.8-4
[148] later_1.3.2 rstatix_0.7.2 class_7.3-22
[151] glasso_1.11 ez_4.4-0 arm_1.14-4
[154] cluster_2.1.6 globals_0.16.3 timechange_0.3.0 References
Gandrud, C. (2020). Reproducible research with R and R studio (3rd ed.). CRC Press. https://www.routledge.com/Reproducible-Research-with-R-and-RStudio/Gandrud/p/book/9780367143985
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251). https://doi.org/10.1126/science.aac4716
Tackett, J. L., Brandes, C. M., King, K. M., & Markon, K. E. (2019). Psychology’s replication crisis and clinical psychological science. Annual Review of Clinical Psychology, 15(1), 579–604. https://doi.org/10.1146/annurev-clinpsy-050718-095710
Tackett, J. L., Brandes, C. M., & Reardon, K. W. (2019). Leveraging the open science framework in clinical psychological assessment research. Psychological Assessment, 31(12), 1386–1394. https://doi.org/10.1037/pas0000583