Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Join us in building a kind, collaborative learning community via our updated Code of Conduct.

Statistical classification is the problem of identifying the sub-population to which new observations belong, where the identity of the sub-population is unknown, on the basis of a training set of data containing observations whose sub-population is known. Therefore these classifications will show a ...

0
votes
0answers
11 views

Algorithms for everyone

Something I've allways wanted to see is a concise run-through of different machine learning algorithms, all on one page: With their pros and cons, what situations they work in best and when they don'...
0
votes
0answers
8 views

How do I make use of a Weka classifier on data extracted via the pcap library in java?

So Far: Firstly I've been able to extract a large amount of data from packets either being read from a pcap file or live packets (via the pcap library) as they are transferred to or from my local ...
0
votes
1answer
11 views

Longitudinal panel data classification

My problem context specifically lies in churn modeling, where accounts have account-specific attributes (like industry, number of employees, etc), but also have longitudinal yearly data (product usage ...
0
votes
0answers
15 views

extensions of logistic regression in the context of machine learning

I was wondering whether there exists an overview about all extensions of logisitic regression in the context of a machine learning approach. E.g. instance-based logistic rgression (Cheng and ...
0
votes
0answers
10 views

How can I identify the categorical variables that best discriminate between a pair of classes?

I have a set of observations that are characterised by five variables: let's call the variables A, B, C, D and E. All the variables are categorical variables; C and D are ordinal-valued and E is ...
0
votes
0answers
7 views

Bias in a model trained with mutually exclusive datasets

I have two set of customers, Dataset-A: Customers who has taken a training class Dataset-B: Customers who may or may not know about Training classes and has not taken any training class. Will there ...
0
votes
0answers
12 views

is there any diffrence to use nonlinear or liner activation function in single hidden layer network

I am working in a classification problem in which I use RBF with a single hidden layer. I want to use SoftMax activation function for the hidden layer. I already read some documents about the ...
0
votes
1answer
17 views

multiclass SVM classification (using R)

I'm new to supervised classification. Here's my case: I want to classify subjects in 3 classes: healthy, sick and intermediate. I've been asked to use SVM to do the classification. I know how it ...
0
votes
1answer
50 views

When was the first time that logistic regression was used to forecast an unknown outcome?

Logistic regression is originally used to predict probabilities of a binary response or further used to forecast the binary response for unknown responses based on a test data set. I was wondering ...
-3
votes
0answers
19 views

Separate images into training, validation and testing in Keras other than do it manually? [on hold]

I want to use deep learning to train a dataset that has more than 100 classes. I want to sperate the dataset into three sets(train, test, validate), but it is exhausted to sperate them manually in ...
-1
votes
0answers
7 views

is the number of classes in LDA (linear discriminant analysis) known a priori?

Is the number of classes in LDA (linear discriminant analysis) known a priori? Is LDA a supervised or unsupervised learning algorithm?
0
votes
1answer
19 views

Cross Entropy calculation question: calculated is different from Keras' output

I wrote a simple code to test Keras cross entropy, but got different results from this post. I checked everything, but still do not know why keras gives me ...
0
votes
0answers
16 views

Multiclass classification training data & validation

I am building a CNN based model for multiclass classification. There are close to 200 data points in my training data and there are a total of 30 classes for these 200 data points. I am a bit stuck ...
0
votes
0answers
7 views

Discontinuity metric for class prediction

I have a classifier that classifies input variable $\vec x$ into a few classes $0, 1, 2, \dots, n$, predicting the probability of each class. I used approaches typical in multi-class problems, now I ...
1
vote
2answers
20 views

Making machine learning predictions for individual users [on hold]

Currently a student, I am fairly new to machine learning. I am developing a classification model in python which has ratings history of a 100 users for a specific movie, I have a total of 20,000 rows. ...
0
votes
0answers
18 views

Question about classification problem (in particular curse of dimensionality) [closed]

**A scientist must analyze a large microarray, in which a set of unit must be classified into two classes on the basis of a very high number of genes (Variables). Because the membership of each unit ...
0
votes
0answers
7 views

When do we have equal accuracy and f1-score in binary classification?

I am working on a link prediction method and when I run the code, the output of accuracy and f1-score are equal in all iterations. I can't interpret the results. The number of positive and negative ...
0
votes
0answers
12 views

what should be the default of the numbers in labels in multi label classification

I know my question is naive but I could not find a reason for the output I got. I am doing multi-label classification and I have 7 labels. I applied two different classifier. logisticRegression SVM ...
0
votes
0answers
7 views

Feature selection using PArticle swarm optimization

I want to perform classification using weka tool but I am keen to do feature selection using PSO. I am using cocomo dataset for ...
1
vote
1answer
42 views

how to limit one label while doing multi-label classification

I have a data set with 7 labels. I would like to apply multi-label classification on that. by that, each instance may have more than one label associated. now let's explain what I want. Rules in my ...
1
vote
1answer
23 views

Proof for the efficiency of Softmax in multi-classification

I already search for this question but I can't find any convincing explanation so I want to ask it here. my problem is with softmax activation function and cross-entropy.why they can produce a better ...
1
vote
1answer
52 views

Active Learning with Human-in-the-Loop

I did a lot of research and can't find a satisfactory answer. I have just a quick question about Active Learning and would be pleased if you could answer it. I'm still wondering if active learning ...
1
vote
0answers
19 views

Overconfidence of Bayesian classifiers on out-of-distribution samples

I am trying to find a principled way around the following problem: consider a Bayesian classifier $p(x|c)$ where $x$ is the input and $c$ is the class label. According to Bayes rule the class ...
1
vote
0answers
12 views

Introducing “Unclassified” class into a multiclass classifier

I'm trying to multi-class classification problem with a small addition that I can't find a decent way to handle: according to domain knowledge, no classification is better than a wrong classification. ...
0
votes
0answers
10 views

Optimise allocation of sample of mixed features to specific objects [closed]

Say I have a database of objects $P_1, ..., P_n$ which can have 0 or many of each of a set of features $G_1, ..., G_m$ such as they can be coded (where in this case n=2 and m=5) P1 = 0, 1, 0, 1, 1 ...
2
votes
0answers
26 views

comparing CNN vs other classification methods

I working on a classification problem. I have created Python code that takes certain labelled input data. This is then converted into two 2 dimensional arrays. The first array is an input array of ...
1
vote
0answers
34 views

How people use Stacking method in the real-world problems? [closed]

I know that stacking is a very strong method when you using it in machine learning competition(Like Kaggle). But in real life situations do people use this for modeling very often? I heard that ...
1
vote
1answer
12 views

Sample size for designing a study which creates a classifier

I have to plan a study in which I will have to create a classifier. The output variable is a binary with an estimated proportion of value 1 in the overall population of interest to be 0.10 (and ...
0
votes
0answers
21 views

how to measure the correlation between some events and an outcome?

I have a question related to how to measure the correlation between some events and an outcome. For example, consider the above table, which contains several sequence of events, where each event is ...
1
vote
0answers
20 views

Which model to use for problem having 1000+ classes? [duplicate]

I am trying to classify text description to particular category. There are 1000 categories. How should I approach this problem? I was told to use one vs all for 1000 classes which requires 1000 ...
1
vote
0answers
22 views

Machine Learning in human behavior studies [closed]

Let's say we are trying to figure out whether a president of a country will take a step backward or forward related to a topic. We want to classify this by training a learning algorithm on Twitter ...
0
votes
1answer
11 views

Stubbing features in text classifications

I'd like to classify short texts of chats to sentence types (i.e. an informational question, a request, a statement etc). In some of the texts there is extra information, like mentioning of another ...
0
votes
0answers
8 views

R GLMER with fixed and random effects including time

Suppose I have good reason to believe that values of a common lab test may allow identification of subjects with a particular genetic mutation. I want to create a model that classifies a patient into ...
1
vote
0answers
27 views

Specific Predictions (Binary) in R

I want to make two new predictions (based on two new data frames). What I did: First of all (obvious) splitting the data: train / test Secondly: train my model (and evaluate it on my test set) ...
1
vote
0answers
15 views

Different pattern, but similar semantic in Image Classification problem

I have a problem with Image Classification. Concretely, I am building an image classifier that could classify 50 classes. In which, there are some classes those are large intra-pattern variance. For ...
1
vote
0answers
27 views

Filter methods for feature selection are often univariate. What multivariate filter methods exist, and what are their dis/advantages?

Feature selection approaches are often grouped into three categories: "filter", "wrapper" and "embedded" approaches. Filter methods tend to assess the inclusion of an attribute based on some scoring ...
1
vote
1answer
16 views

General rule uniform distributed classes

Given a classifier working with double values e.g. between 0 and 1. There are two classes with different ranges. Their distributions are uniform, however, one class is more likely. Is picking always ...
1
vote
0answers
7 views

Non-Negative and Sparse LDA?

I am wondering if the concept of Non-Negative and Sparse Linear Discriminant Analysis exists? I recently found an algorithm for Non-Negative and Sparse Principal Component Analysis (on which the PC ...
1
vote
3answers
60 views

Statistically prove classification accuracy is acceptable

I made a neural network to do binary classification with medical images. Since I evaluate test accuracy (x% accurate), is there any statistical method which can be ...
1
vote
0answers
14 views

What is the definition of margin for multi-class classification?

I heard the definition was as follows: Let $y_{best} = arg \max_{c \in Classes} f(x)_c$ be the best class and let the prediction function be an output vector $f(x) \in R^{|Classes|}$. Then define: $$...
1
vote
2answers
41 views

Statistically prove minimum number of classifiers to classify 12 datasets

I'm currently developing neural networks to classify medical images. One dataset contains 2 classes of images (Images which can be used and cannot used). So my model will check whether given image can ...
0
votes
0answers
19 views

Can we fit a model using the same dataset applied during cross validation process? [duplicate]

I have the following method that performs Cross Validation on a dataset followed by a final model fit: ...
0
votes
1answer
22 views

Should I use the results of a previous model in my second model?

So I've been trying to predict a minority class, and thus far I've built an svm/boosted tree/random forest/logistic regression/knn combo. After making them all and tuning them and doing feature ...
1
vote
1answer
34 views

xgboost prediction threshold [duplicate]

I am trying to classify the data set "Insurance Company Benchmark (COIL 2000) Data Set" which can be found in Dataset. I am using XGBoost in R (I am new to XGBoost algorithm) for the classification ...
0
votes
0answers
22 views

Which features to extract from circular shape like blobs for classification of objects

I have circular like objects in raw images (first image attached) and there are three object size of these similar shapes. I want to classify them as small-size, medium-size and large-size using ...
0
votes
0answers
9 views

Sklearn Model predict_proba and Mathews Corelation Coefficient

I have a question regarding practical application of the probabilities output by predict_proba. I have a binary classification set, which I've trained a ExtraTreesClassifier on. For the problem I get ...
0
votes
1answer
41 views

Data reduction with nominal variable data

I have a bunch of factor variables. I believe the data comes from only a few clusters. I'd like to analyze the data and perform data reduction. I want to know the ...
1
vote
0answers
11 views

multi class passive aggressive

I'm having a hard time getting the difference between the implementation of multi-class and binary-class classification with passive-aggressive PA online learning. I understand how binary ...
1
vote
0answers
15 views

Poor P-R curve for binary classifier trained on balanced data, with imbalanced test data

I have a very imbalanced dataset (9:1), for which I have performed under-sampling and achieved a balanced training set (~130k samples total post balancing). I am performing classification using ...
1
vote
0answers
28 views

which loss function is better for multi-classification

I training the multilabel classifier using the RBF network. I want to choose between different loss functions. I looked at a bunch of documentation about the different loss functions but can't get an ...