A sparse matrix is a matrix where many of the elements are zeros.

learn more… | top users | synonyms

1
vote
1answer
37 views

Calculating means and confidence intervals when most data points are 0

I am looking at data set that has four groups. In each group, the data is mostly, 99+% of time, composed of zeros, but, when it is not zero it can be any float number (e.g., 0.01 to 921.2, with most ...
1
vote
2answers
71 views

How to build a predictive model with a billion of sparse features?

I am making a model to learn a dataset which has a big feature number and sparse samples (I am planning to use logistic regression). The feature number can be as big as 1,000,000,000. It is sparse ...
0
votes
2answers
23 views

Kernel SVM on sparse data

I have a sparse dataset where a lot of the columns (features) contain mostly zero values. Class labels are multiple discrete categories (10 classes to be precise). I'm wondering if this should trouble ...
1
vote
0answers
34 views

logistic regression with sparse predictor variables

I am currently modeling some data using a binary logistic regression. The dependent variable has a good number of positive cases and negative cases - it is not sparse. I also have a large training set ...
0
votes
0answers
16 views

Small sample size : dealing with bootstraping for linear or nonlinear multiple regression

I am wondering to heal my ignorance from your experiences or your modeling knowledge. I have many matrices of quantitative variables, let me start with three matrices of proportions.To express ...
0
votes
0answers
18 views

Sparse PLS: algorithm for variable selection and model fitting

In the spls package in R (based on the manuscript by Chun and KeleĊŸ [1]), there is a separate specification for the variable selection and fitting in the main function, ...
0
votes
0answers
16 views

What guidelines should be followed for using Neural Networks with sparse inputs

I have extremely sparse inputs, e.g. locations of certain features in an input image. Further each feature can have multiple detections (not sure if this will have a bearing on the design of the ...
3
votes
1answer
79 views

Cross correlation for very sparse binary data

I have a very large (5271159x60) sparse (~2.5%) binary matrix, and I'd like to calculate the cross correlation between each of the columns (sensors) for a series of lags from -10:10, which would give ...
0
votes
0answers
15 views

cross-validate hierarchical model for binomial data that is often sparse

I have binomial data (e.g, 130 successes in 4000 trials). In many, if not most, cells of interest, there were few trials and thereby few successes (e.g., 0 successes in 35 trials, 1 successes in 18 ...
3
votes
1answer
63 views

Euclidean distance with sparse and high dimension data

I have texts for a bunch of objects. From each text, I removed the stop words, and took each word as an attribute of the object. I then gave each word a rating based on sentiment analysis, so that the ...
0
votes
0answers
19 views

Reduction of sparse features for machine learning

I'm trying to use a 1D histogram as a feature for machine learning. A histogram instance can be very sparse and the range of its bins is theoretically unbounded. Moreover it is expected that non-zero ...
0
votes
1answer
29 views

Tanh activation function and sparsity constraint

According to Lecun's paper "effient backprop" [1] the tanh activation function should be preferred over the logistic activation function for the hidden units in neural networks. For the tanh units ...
1
vote
0answers
26 views

The name data sparsity in different applications

I am recently surveying the techniques or algorithms which handle the data sparsity problems in various fields. And I find quite similar name "data sparsity" or "sparse data" is used including the ...
0
votes
0answers
9 views

How to do if the most training data is sparse

Consider a problem like this You have a customer profiling application(say classic telecoms data) You have customer transactions(lots of them) you want to find rules There is a data element which is ...
1
vote
0answers
20 views

Using an odds ratio when data is sparse

Suppose I have around 20 exposures that potentially affect an outcome and I want to see which exposures have bigger impacts on the outcome. So I want to calculate each exposures' odds ratios by ...
0
votes
1answer
20 views

Utilizing A Correlation Matrix Derived from a Sparse Matrix

I have large correlation matrix in Excel that I'd like to use to inform my choice of explanatory variables in a multiple linear regression model. One problem is that the initial data was very sparse, ...
0
votes
1answer
94 views

LibFM sparse data format

Does the order of columns in the the sparse format matters in case of libfm ? Can I list the non zero components of X in libfm in any order in a row.
0
votes
0answers
52 views

Sparse ELM vs SVM

What's the difference between SVM and Sparse Extreme Learning Machine with Gaussian kernel proposed in the following paper:http://www.ntu.edu.sg/home/egbhuang/pdf/Sparse-ELM-IEEE-T-Cybernetics.pdf As ...
0
votes
1answer
34 views

Literature for Cross Validation on Sparse Data?

I've read a lot about Cross Validation to estimate prediction error, specifically for selecting the number of components in a PCA model (I'm not doing SVD/PCA, but it's very similar), but I can't find ...
1
vote
1answer
187 views

Clustering algorithms for extremely sparse data

I am trying to cluster an extremely sparse text corpus, and I know the number of clusters (my data is the title and author list of scientific publications, for which I already know the number of ...
1
vote
0answers
87 views

regression algorithms which work with sparse categorical predictors

I am working with a very sparse problem with a large number of categories per feature and I am currently looking for existing machine learning regression algorithm implementations which can either ...
1
vote
2answers
148 views

Sparse principal component analysis

Does anyone know where I can find an algorithm (as well as an R implementation of it) to carry out sparse principal component analysis?
0
votes
0answers
23 views

Heavy tailed distribution results in sparse random variable?

I often come across that, in Bayesian inference, to encourage sparseness, we should choose a heavy-tailed probability distribution as prior. AFAIK, in heavy-tailed distribution, it's more likely for ...
1
vote
1answer
42 views

Statistical Practices Using Sparse Data: Methods for Approximating Standard Deviation

Suppose I know that for a discrete, non-negative r.v. $X$ that $X | X \geq 1$ has $\mu = 3.3$ while when $X \geq 0$ has $\mu = 2.1$. That is, the subset of the population that already has a value ...
4
votes
0answers
159 views

Compute Shannon entropy between every row of a large, sparse matrix

I have a sparse, binary matrix of user (rows) and items (columns). Each element of this matrix is either 0 or 1: ...
3
votes
1answer
189 views

Machine learning techniques for spam detection, and in general for text classification

I am going to configure a system for spam detection. What I have is a dataset of labeled (spam/not-spam) strings containing, mostly, sentences. I have a background in machine learning techniques, but ...
6
votes
1answer
116 views

Selection of sparse principal components

Does anyone have experience with approaches for selecting the number of sparse principal components to include in a regression model?
1
vote
0answers
70 views

Clustering time-shifted sales time-series

I need to perform clustering and classification of time series of weekly sales of different products. My data are weekly sales of different products in differest areas (stores). The challenges on this ...
0
votes
0answers
51 views

Active set methods for group lasso?

When the solution is extremely sparse, probably the fastest method for solving LASSO regression is least angle regression, which starts from an all-zero solution and adds nonzero elements to the ...
1
vote
0answers
37 views

Random classification forests for extremely sparse response variables

I have a response variable that can be $A,B,C$. It is very sparse, meaning 99% of the sample is $B$ and the rest is approximately evenly divided between $A$ and $C$. How do I predict this variable in ...
0
votes
1answer
117 views

Sparse PCA/Dictionary learning when the features are extremely sparse?

I am trying to do sparse PCA/dictionary learning, that is decompose a matrix $X\approx UV$ where the loading matrix $V$ is sparse, usually enforced with an $\ell_1$ penalty (the difference between ...
0
votes
0answers
39 views

Optimal to sub-optimal sampling patterns

In the compressed sensing (CS) framework an incoherence property $\mu$ is used to quantify the correlation between a sensing matrix $\Phi$ and a representation matrix $\Psi$. This incoherence ...
3
votes
1answer
1k views

Clustering algorithms that operate on sparse data matricies [closed]

I'm trying to compile a list of clustering algorithms that are: Implemented in R Operate on sparse data matrices (not (dis)similarity matrices), such as those created by the sparseMatrix function. ...
4
votes
2answers
180 views

How exactly is sparse PCA better than PCA?

I learnt about PCA a few lectures ago in class and by digging more about this fascinating concept, I got to know about sparse PCA. I wanted to ask, if I'm not wrong this is what sparse PCA is: In ...
0
votes
2answers
161 views

R or python implementation of sparse PCA for p>n

According to this paper, there are 2 algorithms to perform sparse PCA. One is better if $p>n$. I need to run SPCA on a $2000\times12000$ matrix so I am looking for an implementation of this ...
2
votes
1answer
67 views

Interpretation of lasso recovery results

When people say that lasso regression can under certain assumptions recover "the support", i.e. non-zero regression weights, what does this mean? This cannot mean causal recovery, because Pearl has ...
0
votes
1answer
142 views

How Can I use some variables selected by LASSO?

I am very new about statistics. So, please understand if my question is somewhat awkward, and please give me related any advice. I have some data set. X = 500 x 100 (500 observations x 100 ...
2
votes
1answer
129 views

Limitations of Cohen's kappa for sparse data?

Are there any limitations for using Cohen's kappa with sparse data? I need inter-rater agreement between 2 raters for ~15 items, and the data in the contingency table is quite sparse (0 in some cells, ...
1
vote
1answer
43 views

Apply double non-negative constrain on Sparse PCA

In Non-negative Sparse PCA, we apply a non-negative constrain in the coordinate matrix. Here I'm up to apply non-negative constrains on both the basis matrix and the coordinate matrix. I'm wondering ...
4
votes
2answers
621 views

Why such a poor result from sparse PCA R package?

I'm preparing to use R to perform sparse analysis on my data. I tried to get started with an ad hoc example, but the reconstruction result turned out really poor. I'm wondering if I was making any ...
0
votes
2answers
201 views

What's the tractable data size for Sparse PCA or LASSO?

I'm up to perform certain kinds of sparse decomposition methods on my dataset. However, I'm not sure: what's the tractable data size for the Sparse Decomposition methods? The dataset is a ...
4
votes
1answer
796 views

Validate cluster analysis in R

I am trying to validate hierarchical cluster analysis result following a paper by Guy Brock, et al. clValid: An R Package for Cluster Validation (pdf). Do I have to use all these methods? What are the ...
3
votes
0answers
47 views

Sparsity regularization for eigenvectors

One way to think about finding the eigenvectors of a matrix $A$ is that they are the critical points of the functional $\vec x^\top A \vec x$ subject to $\|\vec x\|_2=1$. To regularize this problem, ...
1
vote
0answers
82 views

Methodology of modelling sparse events

Let us say that we have a process that generates sequences of the following form: ...
1
vote
3answers
628 views

Cosine similarity on sparse matrix

I'm trying to implement item based filtering, with a large feature space representing consumers who bought (1) or did not buy (0) a particular product. I have a long tail distribution, so the matrix ...
1
vote
0answers
73 views

Issues with solving large sparse linear equations

I have some issues solving sparse linear equations $Ax = b$ My matrix $A$ is sparse with dimension of 5 million by 5 million. Actually, it is a combination of two matrices. One is tridiagonal and the ...
1
vote
0answers
91 views

Sparse PCA adjusted variance explained

In the original Sparse PCA paper Sparse Principal Component Analysis ZOU, HASTIE, TIBSHIRANI they describe a way to compute the adjusted variance explained by computing QR decomposition of the Z ...
4
votes
2answers
402 views

Getting rid of a huge categorical factor in multiple regression

I have a large regression problem with a lot of cases, but relatively few independent variables. One of them is a categorical factor with thousands of levels. Robust regression runs forever. In some ...
-1
votes
1answer
67 views

What's the convergence rate when solving L1 regularized optimization via coordinate descent with tiny step? [closed]

Wondering if there is an established result for the convergence rate when solving L1 regularized optimization via coordinate descent with tiny step? By "tiny step" I mean the step is always set to a ...
0
votes
0answers
65 views

Why do Bayesian methods achieve sparsity via normal likelihood and Gamma hyperprior?

In the view of $\ell_1$ regularization, a natural way to incorporate sparsity into a Bayesian model is to add a Laplacian prior in my opinion. But instead of this, a usual fashion to handle sparsity ...