An algorithm is a a set of one or more computations that will produce a calculated result. All statistics methods are algorithms. Algorithms can be simple, such as calculating a percentage, or can be very complex and require a computer for fast and accurate results.

learn more… | top users | synonyms (1)

0
votes
1answer
35 views

Finding outliers in multiple dimensions

I'm working on dataset which isn't normally distributed. It contains three dimensions: cost, discount and profit. I'm trying to find outliers in all these dimensions. I used $\text{z-score}$ to find ...
0
votes
1answer
22 views

Specifying starting values/modes for K-modes Clustering

I have a very large data set with 9000 observations and 25 categorical variables, which I've transformed into binary data and preformed hierarchical clustering and K-modes clustering in R. ...
4
votes
2answers
34 views

Interpolating binned data such that bin average is preserved

Say I have this binned data as input. The average value $\bar{y}_i$ is given for each successive $\Delta x_i$ interval. For simplicity, let's assume sampling density is uniform within each bin. Now I ...
0
votes
0answers
13 views

Finding a number that considers %worse outcomes and %better outcomes

I have a baseline algorithm and lots of test algorithms. The baseline algorithm's performance is compared to every other algorithm. What I'm left with is a table like so: ...
0
votes
1answer
19 views

How do I calculate the tipping point of over/under odds in Football?

I am trying to understand how game odds work. One scenario I came across was the over/under scores for football (soccer) games in the form of a table like this: ...
0
votes
0answers
13 views

Genetic algorithm for solving the un-certain dimension problem

Introduction Last week, I have learned basic genetic programming using Python to solve a simple problem. I introduce it here: There is a city need for air quality monitoring network. The ...
0
votes
0answers
17 views

online learning- winnow algorithm and mistake bound

I came across an interesting question and I must say I am struggling to figure out how it suppose to work. So we consider the winnow algorithm that learns non-monotone disjunctions. Could someone ...
0
votes
1answer
33 views

How to undersample with algorithms in R to solve class imbalance?

My data set is imbalanced - 5% of the target class represents fraudulent transactions, 95% of the target class represents legitimate transactions. I must use the whole data set, as the 95% of ...
1
vote
1answer
29 views

Parameters setting in genetic programming to avoid locally optimum

I'm fresh on genetic algorithm. Now, I wrote an python program based on genetic algorithm. The programming contain: Set the population and individuals(For my case, each individual is a list ...
0
votes
0answers
9 views

Algorithms For ARMA Estimation From Time Series Data

What are some algorithms that can be used to model time series data as an ARMA model? I do not have access to the input process, only the resulting output process as a time series. I don't want to ...
0
votes
0answers
12 views

Inexact line search in Gradient descent

In general setting of gradient descent algorithm we have, \begin{equation} x_{n+1}=x_n−\alpha d_n, \end{equation} where $\alpha$ is the step size and $d_n$ is the gradient evaluated at the point ...
0
votes
0answers
10 views

Full Factorial Help

I have a data set like the following: How can I create a set of scenarios where I reduce column B by the values in Column D and E, in every increment in column F? I also want to make sure that ...
0
votes
0answers
12 views

DoE and Parallel Coordinate Plot

First off, I'm not too technical; however, I know what I need to do more or less, but don't know how to put the pieces together. I need to create a Design of Experiments, perhaps with R Studio. With ...
3
votes
0answers
24 views

Calculating error of MCMC algorithms?

If for example the Transitional MCMC algorithm is used (or does it matter which one?), what are the common approaches for calculating an error (some sort of distance from the actual PDF), or ...
1
vote
1answer
40 views

Efficient routines for a regression with orthogonal regressors?

I have a standard OLS regression setup, where (sets of) the regresors are orthogonal to each other. I am looking for a fast low-level way (using qr() instead of ...
1
vote
0answers
40 views

Katz Backoff help calculating alpha

$Pkatz(z|x,y) =$ $P'(z|x,y), if C(x,y,z) > 0$ $α(x,y)Pkatz(z|y), else if C(x,y) > 0$ $P'(z), otherwise.$ $Pkatz(z|y) =$ $P'(z|y),ifC(y,z)>0$ $α(y)P' (z), otherwise.$ ...
1
vote
0answers
35 views

Application of Givens rotation to two matrices

I am reading this paper on Multiresolution Matrix Fatorization, http://arxiv.org/pdf/1507.04396v1.pdf, and have come across something that seems like an error to me. In Algorithm 2, the authors take ...
1
vote
1answer
182 views

What type of machine-learning algorithm to use for classifying? [closed]

What machine-learning algorithm do you use if you have an attribute matrix that was rows = samples and cols = attributes and a target vector that matched the attributes to a specific classifier? ...
0
votes
0answers
4 views

Which efficient algorithms for calculating marginal counts over a complete dataset

Having a complete dataset over a set of discrete variables, I need to compute the marginal distribution over different subsets of variables (For instance all subsets comprising 3 or less variables). ...
0
votes
0answers
5 views

Sorting algorithm for comparative judgement

I am doing research using Adaptive Comparative Judgement where I present the user two things and let them choose which one is more difficult for them to understand. For now I am thinking of testing ...
1
vote
1answer
36 views

Creating a machine learning algorithm [closed]

I've heard of various different types of machine learning algorithms such as logistic regression, neural networks, naive bayes etc, and I was wondering what goes into creating a machine learning ...
3
votes
1answer
32 views

Data Transformation or algorithm for prediction of data between 0 and 1

I am trying to predict a time series where every data point is a percentage value between 0 and 1. Most data points are either 1 and few below 0.5. In such a case what could be suitable data ...
0
votes
0answers
6 views

TF-IDF for matching 2 titles?

My question can look irrelevant. But I guess, it's better to ask here, rather than on StackOverflow. Let's consume, we have 2 long titles, like: ...
0
votes
0answers
22 views

Special case of clustering in one dimension

Given an array of positions in an X-axis and each position is associated with a Group. An Example is given below: ...
1
vote
0answers
42 views

Weighted arithmetic mean's alternative for ranking items

I have a Blog post ranking algorithm which has 5 factors which are considered for calculating final score. I have predefined input range according to which i decide score of a factor. e.g. Factor : ...
0
votes
0answers
14 views

Database and Data Waehouse design and processing in Big Data

With the growing popularity of Big Data and related tools, I am looking for books that specifically deal with implementing a warehouse in one of Big Data technologies, database and data-warehouse ...
0
votes
0answers
14 views

Figuring the algorithm / common calculation on a set

I have a column that is size in MM and another that reflects the change in price for said size. I'm trying to figure out the algorithm/common calculation behind these generated numbers so that I would ...
0
votes
0answers
7 views

Soundness and history of a significance index comparing different computational realizations

When comparing filtering algorithms, for instance, one sometimes tests deterministic clean data, adds realizations of noise, and measures the residual noise, since the clean data is known. A standard ...
0
votes
0answers
25 views

Fitting a glm in practice

This question will be a little wordy - I'll try to summarize at the end. I'm currently working on a machine learning library and I'm implementing GLMs. To fit my models I've been implementing an ...
0
votes
0answers
22 views

Stopping Criteria for ADMM algorithm

In Page 19 of this paper admm_distri_stats, the authors provide one reasonable stopping criteria for ADMM algorithm in (3.12). Can anyone tell me if there is any principle to find the reasonable ...
0
votes
0answers
11 views

Budget scoring algorithm

I'm working on a free budgeting app that needs to calculate a few summary scores on the data entered. This is for personal budgeting so no need for enterprise size complexity. I have not done any ...
0
votes
0answers
15 views

MART and GIS within maximum entropy

What is the difference between Multiplicative Algebraic Reconstruction Technique (MART) and Generalized Iterative Scaling (GIS) for solving maximum entropy problems? They both seem quite similar. Is ...
0
votes
1answer
29 views

Algorithm to determine a point in time series data, after which probability of increase in value is very low

I am working with dataset which contains number of movie tickets sold per day. This is basically a count of total number of tickets sold, for a particular movie, for each day after its release date. I ...
0
votes
0answers
42 views

For a U-shaped distribution, how many results must I verify

--edit-- in plain English. I have a distribution with over a million points between 0 and 1 that is shaped like a U with many values falling near 0 and 1. Each point is SUPPOSED to represent a score ...
1
vote
0answers
40 views

How do I get initial transition matrix probabilities?

I have to develop a system to detect and prevent bank transactions fraud - just credit card transactions, for simplicity - I'm thinking about using markov chain. How would I get the initial ...
0
votes
0answers
35 views

Sensor fault detection algorithm explanation

I am attempting to implement a sensor fault detection algorithm from a white paper I found here: http://www.hindawi.com/journals/mpe/2013/712028/ref/ You should not have to read the article to ...
1
vote
0answers
19 views

Estimating the effect of wrong input parameters in a model estimation

I've got a physical system that detect counts in an array of detectors. In each detector $y_i$ I expect to measure $\bar y_i = f_i(\bar \lambda)+\bar b_i$ counts. $b$ represent the vector of of counts ...
0
votes
2answers
84 views

Customization of a standard Bell Curve

Hopefully this isn't a duplicate, I've tried to search for similar things, but to no luck. I'm curious on how you would computationally compute a random distribution of numbers that follows a bell ...
0
votes
0answers
12 views

Optimizing Graph to show areas of improvement

I have a data set that looks like below Bucket: 60-65%, 65-70%, 70-75%...... Days: 22 55 21 Bucket is a % performance and days is the number of days ...
0
votes
1answer
83 views

Optimization with both L1 and L2 regularization

After doing some research I suppose the hard part is that, L2 regularized problem is often solved by gradient descent, while L1 regularized problem is often solved by coordinate descent. But which ...
0
votes
0answers
42 views

General Levenberg-Marquardt Algorithm for training LeNet-5 (CNN)?

During studying Levenberg-Marquardt Algorithm for training Neural Networks I have found that for training MLP networks a General Levenberg-Marquardt Algorithm is used, but if we need to train a ...
1
vote
0answers
36 views

What algorithm could be used to recommend wine given past ratings

Description: given a user's history of 'likes', I would like to predict what product should I recommend to the user, based on past likes (content based). The idea is very similar to Pandora, except ...
1
vote
0answers
31 views

How to develop probability formula?

I am trying to come up with an approximate formula for the failure probability of an event which can be caused by four independent things. I have a lot of measured data (100's of rows) of failure ...
0
votes
0answers
34 views

How to understand the result of label propagation algorithm

The graph is an undirected graph, “Protein 4","Protein 5", "Protein 6",... represents the vertex of graph. The value of two vertices with connected is 1 and that without connected is 0 in the ...
0
votes
1answer
48 views

Understanding The Algorithms Behind Quantile() in R

So I was trying to compute the quantiles from a dataset in R: c(3,5,7,8,12,13,14,18,21) using the quantile() function, and I realised that it was returning ...
0
votes
2answers
68 views

What algorithm should I try to predict number of tweets

Background I have been collecting data of each tweet being sent out for each article. The data is like this. created_at, user_id, article_id xxx, x, x y, y, y ...
0
votes
1answer
38 views

Can I run several independent samples test to compare two stochastic algorithms?

I want to compare performance of two stochastic optimization algorithms: A1 and A2. Performance is defined as the output of a run. The lower the output is, the better is the solution the algorithm ...
0
votes
1answer
31 views

how to find the nearest neighbor of a sparse vector

I have about 500 vectors,each vector is a 1500-dimension vector, and almost every vector is very sparse-- I mean only about 30-70 dimension of the vector is not 0。 Now, the problom is that here is a ...
0
votes
0answers
13 views

How do I find percentage average events acceleration?

We fire an event every time a user clicks something on a page and I would like to find the acceleration or event average acceleration so we could send an alert when the threshold is met. This is the ...
8
votes
0answers
38 views

Algorithm: Binary search when values are uncertain

I need an algorithm to do a binary search when the test at each step may give the wrong result. Background: I need to place students on the most appropriate of 12 difficulty levels. The current ...