2 years ago
#47003
tessa
Comparing two models with different majority classes
I calculated the accuracy for a model with listwise deletion (0.75) and for a multiple imputation model (0.67).
It seems like the standard model performs better. However, the naive baseline of the standard model is 70% (the majority class is 70% of the observations) while the naive baseline of the imputed dataset is 60%.
Should I compare 0.677 (accuracy of the multiply imputed model) with 0.75 and conclude that it performs worse, or should I conclude that 0.677 compared to 0.6 (naive baseline imputed dataset) is better than 0.749 compared to 0.7 (naive baseline complete cases dataset)?
I hope you can help me!
missing-data
confusion-matrix
imputation
method-missing
0 Answers
Your Answer