Exploring Local Interpretability in Dimensionality Reduction: Analysis and Use Cases

N. Mylonas, I. Mollas, N. Bassiliades, G. Tsoumakas, “Exploring Local Interpretability in Dimensionality Reduction: Analysis and Use Cases”, Expert Systems with Applications, Volume 252, Part A, 124074, 2024.

Dimensionality reduction is a crucial area in artificial intelligence that enables the visualization and analysis of high-dimensional data. The main use of dimensionality reduction is to lower the dimensional complexity of data, improving the performance of machine learning models. Non-linear dimensionality reduction approaches, which provide higher quality representations than linear ones, lack interpretability, prohibiting their application in tasks requiring interpretability. This paper presents LXDR (Local eXplanation of Dimensionality Reduction), a local, model-agnostic technique that can be applied to any DR technique. LXDR trains linear models around a neighborhood of a specific instance and provides local interpretations using a variety of neighborhood generation techniques. Variations of the proposed technique are also introduced. The effectiveness of LXDR’s interpretations is evaluated by quantitative and qualitative experiments, as well as demonstrations of its practical implementation in diverse use cases. The experiments emphasize the importance of interpretability in dimensionality reduction and how LXDR reinforces it.