An algorithm is a a set of one or more computations that will produce a calculated result. All statistics methods are algorithms. Algorithms can be simple, such as calculating a percentage, or can be very complex and require a computer for fast and accurate results.

learn more… | top users | synonyms (1)

1
vote
1answer
28 views

Online linear regression. Possible or not? [duplicate]

I don't have a strong background in statistics, but I'm a programmer and needed to implement some statistical aggregate functions in the DSL I'm writing. This DSL processes events in an online ...
1
vote
1answer
56 views

Finding pattern from sparse matrix

I have a large sparse matrix which represents whether the action is happened or not. Each columns represent each action. Each row represents time. The data is collected for every 15min. Zero in the ...
0
votes
0answers
7 views

codes of programm in the packages in R [closed]

Is there a way to access to program codes and algorithms in the packages in R,for any function?
0
votes
1answer
25 views

What are the differences between delta rule and generalized delta rule?

I know that the delta rule is a gradient decent learning rule. But, what are the differences between these two delta rules? Thanks in advance.
3
votes
4answers
64 views

How to plot algorithm runtime for huge input set?

Fo my bachelor thesis, I want to compare the runtime of two algorithms. The runtime is measured by letting these algorithms run for every value in a huge input set. This input set can be partitioned ...
0
votes
1answer
33 views

Data analysis and prediction algorithm recommendation

I need some help. I'm a programmer but I'm not familiar with data science or analysis. I've been given a project which I have to do a research with a list of CSV data files. I converted some of those ...
2
votes
0answers
26 views

Measurements: Calculate start of gradient

let's assume you have 1000 measurements (temperature in this case), all having a similar shape. It's a temperature profile inside a production line measured by a reference block mounted with ...
2
votes
2answers
34 views

Quickly finding nearest time observation

I'm looking to speed up some of the analysis I need to do on a regular basis. Basically, I have many datasets comprised of millions or more records, and for each record I need to calculate the nearest ...
0
votes
0answers
20 views

Dissecting the code of statistical algorithms for education

I was curious if anyone has made or seen any videos that dissect the code of statistical algorithms as a means of learning statistics and coding. Ideally the videos would explain step by step both the ...
0
votes
1answer
38 views

Gini Algorithm for beginners

"Gini Algorithm" when is it used ? I mean what is it used for ? is it used for classification or building the tree ? or something else ? what are the alternative algorithms for the "Gini algorithm" ...
0
votes
1answer
30 views

Does a theoretical “perfect (accuracy) score” exists we could target for a given dataset?

My question is the following : You have a dataset, and you want to determine theoretically what accuracy score (or other way to measure performance such as AUC, etc.) a "perfect" model could get on ...
6
votes
4answers
1k views

Is automated machine learning a dream?

As I discover machine learning I see different interesting techniques such as: automatically tune algorithms with techniques such as grid search, get more ...
0
votes
0answers
13 views

Metrics for evaluating ranking algorithms

I'm interested in looking at several different metrics for ranking algorithms - there are a few listed on the Learning to Rank wikipedia page, including: • Mean average precision (MAP); • DCG and ...
2
votes
2answers
58 views

What fast algorithms exist for computing truncated SVD?

Possibly off topic here, but there exist several (one, two) related questions already. Poking around in the literature (or a google search for Truncated SVD Algorithms) turns up a lot of papers that ...
2
votes
0answers
16 views

Randomly Generating Combinations From Variable Weights

The Question I have a list A of n unique objects. Each object Ai has a variable percentage Pi. I want to create an algorithm that generates a new list B of k objects (k < n/2 and in most cases ...
2
votes
0answers
41 views

How would I determine statistical significance for ad impressions?

I'm programatically adding keywords to bid on. Some keywords will trigger ads and impressions, and some impressions will trigger clicks. Clicks / impressions = CTR (click-through-rate). Clicks cost. ...
2
votes
2answers
39 views

Finding cluster number based on distance & max element count

Given two constraints: The maximum distance d an element can lie from a cluster centroid (or medoid) The maximum number of elements n in one cluster Is it possible to find the minimum number of ...
1
vote
1answer
34 views

How does one map a graph into a feature space?

Assuming there is an undirected weighted graph. How can one convey it's geometrical structure into a feature space? Are there any common practices?
0
votes
1answer
22 views

Algorithm to rank some items

Say I have some items with values 3.3 3.4 6.2 8.8 4.1 and I want to rank them as follow ...
0
votes
2answers
62 views

Weird Results in Newton Raphson

I am running a simple Newton-Raphson problem in R as given below. However I am getting very weird results. Can anyone tell me where I am going wrong? ...
1
vote
1answer
21 views

How do you differentiate a function in the em-algorithm?

I am conducting the EM algorithm. I understand the algorithm and my question is more related to the differentiation procedure within the algorithm more than the algorithm itself. Through using the ...
2
votes
2answers
44 views

Extreme outlier detection algorithm for erroneous latitudes/longitudes

I have a dataset with latitude/longitude of hotels of a "destination". A destination is a city neighbourhood, whole city, or small region, usually having between 3 and 50 hotels. About 1% of the ...
0
votes
0answers
22 views

Algorithms for Suggesting Users

There are often a large number of bug tickets that get generated for the projects at my company. I was thinking of an intelligent way for automatically suggesting users to assign to the tickets based ...
2
votes
1answer
34 views

Evening out a set of buckets

(I am not strong in statistics so please forgive me if I don't use the correct terms here) Let's say I have a book with many (1000+) sections, and each section varies significantly in the number of ...
2
votes
1answer
63 views

Meaning of the Boosting algorithm for Regression Trees

I have a problem with understanding the concept of the Boosting Algorithm. ...
0
votes
1answer
50 views

Algorithm to find common sequence

Assume that "1,2,3" are the ids of users, active means that person visited the stackoverflow in last one month (0=passive, 1=active), and there are positive and negative votes. ...
1
vote
0answers
27 views

An Algorithm for Maximal Correlation

Given a pair of random variables $(X,Y)$ over a product space $\mathcal{X}\times \mathcal{Y}$, the maximal correlation coefficient is defined as ...
0
votes
0answers
32 views

Comparing two algorithms by time series analysis

I have two algorithms. There is one vector of accuracy measurements for each algorithm. Each accuracy result in a vector corresponds to a moving average over a sliding time window and the vectors are ...
1
vote
0answers
36 views

Find meaningful next comparison for total ranking on the fly

I want to obtain a total ranking from pairwise binary comparisons. For this, I can use algorithms like Balanced Rank Estimation or Bradley-Terry Model. However, I wonder if you need fewer comparisons, ...
0
votes
0answers
12 views

How to fix co variance matrix going singular in Gaussian mixture model implementation?

I am implementing GMM in Matlab without using any machine learning library. I am able to initialize the parameters, perform expectation and maximization for one iteration; but when I put expectation ...
5
votes
1answer
70 views

data mining methods/algorithms for fraud case

I recently got into a topic regarding fraudulent transactions. I am relatively new to data mining and just looking for some input for my case here. I started with a cluster analysis / anomaly ...
2
votes
0answers
45 views

EM algorithm: With prior vs. not prior

I have a working EM algorithm without prior. I am asking for some advice on how to add prior on latent variables. Define: $t_i \in \{ +1, -1 \} $: variables of interest to be predicted $p_j \in ...
0
votes
2answers
66 views

Normalized gradients in Steepest descent algorithm

In general setting of steepest descent algorithm we have, \begin{equation} x_{n+1}=x_n-\alpha G_n, \end{equation} where $\alpha$ is the step size and $G_n$ is the gradient evaluated at the point ...
0
votes
0answers
36 views

Testing of the Grassberger-Procaccia algorithm

I've wrote the implementation of Grassberger-Procaccia algorithm in python. It is a method of reconstruction of properties of dynamical system by analysis of single realization. I would like to test ...
5
votes
2answers
70 views

Choosing an algorithm for classification

What determines what classification algorithm you should use for a certain classification problem? e.g. If there is >5 features or you only have 1000 training examples, or there is multiple class's or ...
1
vote
0answers
36 views

What machine learning algorithm should I choose to fill in blanks from context?

I have a project where I need to be able to fill in a missing word given a few words of context. In other words, suppose I have a sentence: I went ____ the store. I want to be able to deduce ...
1
vote
0answers
37 views

Recommendation system and baseline predictors

I'm participating in programming contest, where I have a data, and where the first number is a user, second number is a movie, and the third is a number in then-points rating. ...
1
vote
0answers
31 views

Algorithm to identify a correct input for only one number [closed]

Hello I'm hoping that you good folks here at CrossValidated can help me with this. I'm looking for an algorithm that takes an integer as an input and returns two types of values. One type of value ...
0
votes
0answers
21 views

What is the same or similar alogrithm in Weka for scikit-learn GradientBoostingRegressor?

I'm trying to move a GradientBoostingRegressor model to Weka. I have tried AdditiveRegression with different BaseLearners but the performance is very poor ( in terms of model quality and speed). I ...
1
vote
1answer
123 views

Computational complexity for linear discriminant analysis

The linear discriminant analysis algorithm is as follows: I want to conduct a computational complexity for it. For each step, the complexity is as follows: For each $c$, there are $N_cd$ ...
0
votes
1answer
105 views

Comparing classification algorithms using cross validation and caret's train

I am having issues understanding some concepts of algorithm comparison/parameter optimization/cross-validation in R Let's say I want to compare two classification algorithms, such as Random Forests ...
0
votes
0answers
15 views

Explanations about the parallel tempering

I am reading this paper on parallel tempering but there are a few things I do not really understand. If I'm not mistaken, parallel tempering is a MCMC method which is quite convenient to sample from ...
1
vote
0answers
36 views

Operations research problem to solve for out of stocks [closed]

I have a mathematical problem that I'm trying to solve and am wondering what kind of algorithm I should be looking at. I thought the revised simplex method would work but then I get stuck on knowing ...
0
votes
0answers
9 views

How to compute non-neighboring correlations using belief propagation?

Belief propagation is an algorithm to approximate the marginals of an arbitrary probability distribution. In principle, it allows you to compute the joint marginals at each factor node, which would ...
4
votes
2answers
237 views

Can humans cluster data sets manually? [closed]

Can human cluster data sets manually? For example, consider the Iris data set, depicted below: Instead of using clustering algorithms like connectivity-based clustering (hierarchical clustering), ...
2
votes
1answer
24 views

How to compute the $\chi^2$-table values?

How one can compute the values of $\chi^2$-tables? I saw two tables where was given for example that if degree of freedom is $1$ and $p=0.001$ then table value is in one table $10.827$ but in the ...
0
votes
1answer
112 views

Optimizing parameter estimates by minimizing chi^2 in iterative procedure

I need to minimize my Chi^2 (bottom-left in figure 1) by adjusting parameter-values in a MLE-procedure (or something alike). The chi^2 (red) is a goodness-of-fit measure. It expresses how well the ...
0
votes
0answers
63 views

Are there differences between Delta TF-IDF and TF-IDF?

Are there differences between both algorithm or not ? i mean if i implement for ex Delta TF-IDF in a project instead of ...
0
votes
0answers
97 views

Sentiment Analysis - How should I handle negatively biased word list length?

I'm implementing a simple sentiment analysis algorithm where the authors of the paper have a word list for positive and negative words and simply count the number of occurrences of each in the ...
0
votes
1answer
29 views

Best Clustering Algorithm for Protein data

I have 400 virus genomes. In each virus, there are 100 genes (these are rough estimates). The genes in these viruses are transferred between each other very frequently. So Gene5 of Virus1 could be ...