2025-09-17: Classic Machine Learning Models and XAI Methods
Figure 1 in Dwivedi et al. Traditional AI models are often viewed as “black boxes” whose decision-making processes are not revealed to humans, leading to a lack of trust and reliability. Explainable artificial intelligence (XAI) is a set of methods humans can use to understand the reasoning behind the decisions or predictions of models, which typically include SHAP, LIME, and PI. We will start from a basic model and then talk about those XAI methods. Logistic regression Logistic regression (LR) is a classification model, particularly for problems with a binary outcome. It maps the output of linear regression to the interval [0, 1] through the sigmoid function , indicating the probability for a particular class. The logistic regression model is simple and highly interpretable. The coefficient of each feature intuitively reflects the impact of the feature, which is easy to understand and explai...