Questions tagged [lime]

Questions related to the Locally Interpretable Model-Agnostic Explanations (LIME) method of explaining black-box machine learning models.

Filter by
Sorted by
Tagged with
1 vote
0 answers
25 views

Appropriateness of using SHAP values to evaluate a model

I am a deep learning researcher that would like to use SHAP values to assess the relative importance of input features on the model's final score. Colleagues of mine have taken issue with the method ...
user avatar
  • 21
1 vote
0 answers
32 views

interpret lime results

What is the meaning of the values of the "blue" features in the lime output? I understand that they influence the lime black-box model to classify an observation as 0 label, but what is the ...
user avatar
  • 67
0 votes
0 answers
25 views

Does lime score matter for continuous variable discretization?

I am using a random forest classifier for binary classification with 977 records and class proportion of 77:23. I am using Lime explainer to explain the predictions made by the model. However, I see ...
user avatar
  • 1,780
1 vote
0 answers
52 views

How to handle inconsistency in ML explanations?

I found out that we have different solutions like below to explain the ML predictions a) LIME b) SHAP Despite using all these approaches, I see that all of them work for certain data points and not ...
user avatar
  • 1,780
1 vote
0 answers
58 views

Lime predictions - Interpretation

I am working on a binary classification using random forest and explanation using LIME. I already referred the posts here, here and here. I have the feature contribution info from LIME like as shown ...
user avatar
  • 1,780
1 vote
1 answer
36 views

Understanding the output of LIME - How is the contribution of features related to the predicted output?

How is the contribution of features extract from explaining a regression model with LIME locally related to the predicted output of the surrogate model? I thought that LIME is additive (some blog post ...
user avatar
  • 533
5 votes
1 answer
447 views

Is there any reason to use LIME now that shap is available?

The context: explaining a binary classifier XGBoost model. If we say that we are limited to the LIME and Shapley Additive Explanation aka "shap" package, is there any reason to use LIME? My ...
user avatar
  • 453
0 votes
0 answers
79 views

How do you interpret LIME output?

I have an LSTM model doing multivariate time series regression. I have two predictions, one vastly higher than the other. I used the Python LIME package's RecurrentTabularExplainer to get this output. ...
user avatar
0 votes
0 answers
157 views

Using LIME without intercept term?

I'm playing with LIME to explain the prediction of a machine learning model. LIME trains a (locally weighted) linear surrogate model around a point of interest. The weights of that surrogate model are ...
user avatar
  • 941
1 vote
2 answers
118 views

Choosing Interpretable Models model vs choosing black box model and explain it with shap/lime

I analyse a dateset of article. The articles are labeled as popular or not popular and off course each article has features like: article section, article writer and etc. I don't want to predict if a ...
user avatar
  • 67
1 vote
0 answers
170 views

Using SHAP or LIME to explain new predictions?

I've previously used SHAP and LIME to explain predictions from a training set, i.e. I have the actual target value. Is it possible to do the same to explain new predictions, i.e. I don't have the ...
user avatar
1 vote
0 answers
30 views

Why LIME does not show the attribution for each features

For the second(central) numbers, why all the features do not attribute to the prediction probabilities? The data is credit default data, here "0" means no default credit, "1" means ...
user avatar
  • 11
2 votes
1 answer
128 views

LIME Shows Very High Probability Score, But Breakdown Has All Negative Factors

I'm using LIME to break down the observation for each row and am taking a look at the positive and negative factors that contribute to the probability outputted. I filtered my dataset down to only ...
user avatar
  • 73
5 votes
2 answers
185 views

LIME Analysis Linear Model

I am looking at explaining a single prediction for a linear model: Y = F(X) = x0 + a1x1 + a2x2 + ... anxn i.e. F: X -> Y i.e. given a single instance z in X, ...
user avatar
3 votes
1 answer
1k views

Using Lime on a binary classification neural network

I would like to use Lime to interpret a neural network model. For the sake of this question, I made a simple Dense model using this dataset: https://raw.githubusercontent.com/jbrownlee/Datasets/...
user avatar
  • 53
5 votes
2 answers
713 views

Reasons that LIME and SHAP might not agree with intuition

I'm leveraging the Python packages lime and shap to explain single (test-set) predictions that a basic, trained model is making on new, tabular data. WLOG, the explanations generated by both methods ...
user avatar
1 vote
0 answers
172 views

Curious on using black box model interpreters (LIME, SHAP, etc) for production models

So, I'm wondering how many of you have been in a similar situation: We have a XGBoost classifier in production that is performing really well. As an enhancement, I want to add an explainer to provide ...
user avatar
  • 277
1 vote
0 answers
197 views

interpretation of plot_features output in LIME- supports vs contradicts output doesn't match the sign of feature_value * feature_weight [closed]

I've created a GBM model explanation using LIME and have used plot_features to plot the results. I'm confused by the mismatch between the output of the plot, in terms of Supporting and Contradicting ...
user avatar
0 votes
0 answers
59 views

Scaled and Unscaled features are giving different feature importances when using LIME

Now, based on my understanding, feature scaling should have no impact on my model results due to the fact that XGBoost isn't sensitive to monotonic transformations. Ref My concern is the model ...
user avatar
  • 277
2 votes
0 answers
21 views

Interpreting/Quantifying what is causing changes in ML model predictions week over week Ask

We are currently predicting an online students likelihood of completing a class each week. We use a lot of demographic information (which is constant throughout the class), as well as a small number ...
user avatar
  • 1,119
2 votes
0 answers
1k views

What are the differences between LIME and SHAP as model interpretation techniques?

Model interpretation has been an important area of study nowadays and because of that some different techniques have risen to help on this task. Maybe the two most famous ones are LIME and SHAP. How ...
user avatar
33 votes
1 answer
12k views

Comparison between SHAP (Shapley Additive Explanation) and LIME (Local Interpretable Model-Agnostic Explanations)

I am reading up about two popular post hoc model interpretability techniques: LIME and SHAP I am having trouble understanding the key difference in these two techniques. To quote Scott Lundberg, ...
user avatar
2 votes
1 answer
413 views

Understanding functioning of LIME(Local Interpretable Model-agnostic Explanations)

Following are the steps that occur in LIME's algorithm https://cran.r-project.org/web/packages/lime/vignettes/Understanding_lime.html I have been trying to read and understand why this process is ...
user avatar
  • 275
1 vote
1 answer
2k views

Why LIME does not show prediction probability for the other class?

On the picture above you can see prediction probabilities. In this case it shows 100% poisonous. However, on next two figures it shows that there is actually small probability of other class (with ...
user avatar
  • 15
0 votes
0 answers
61 views

How does LIME compares with Mutual Information?

So, I was wondering how LIME's linear model approach compares with other explanation metrics, in special, with Mutual Information? For those unfamiliar with how LIME works: Choose the instance you ...
user avatar
2 votes
1 answer
1k views

H2o interpretability - LIME

I have trained a model to predict heart attacks using random forest algorithm using H2O. I have good performance in cross validation. Now, I want to give more interpretation to the predictions in a ...
user avatar
  • 21
4 votes
1 answer
1k views

How to interpret probabilities together with output from R lime package?

My question is related to this one: LIME explanation confusion. But since it does not have a reproducible example or an answer, I am asking here with an example. I have a dataset with unbalanced ...
user avatar
  • 225
1 vote
1 answer
1k views

LIME explanation confusion [closed]

I am working in R creating a GBM model using H2O and trying to use LIME to look at some local explanations to get a feel for what the model is doing. It's a binary classifier and I'm specifying 8 for ...
user avatar
  • 1,478