Questions tagged [feature-engineering]

Feature engineering is the process of using domain knowledge of the data to create features for machine learning models. This tag is meant for both theoretical and practical questions regarding feature engineering, excluding questions asking for code, that would be off-topic on CrossValidated.

Filter by
Sorted by
Tagged with
0
votes
0answers
3 views

Vector and curve in random forest feature

I am studying movement in images, and I need to classify them. In order to do so, I've created sequences, that have different lengths, with x y position of centroids. To classify them (supervised ...
1
vote
0answers
17 views

What types of transformation besides logarithm can I use for a linear regression?

I'm used to use log transformation in linear regression, most of times so I can get a normally distributed variable (even though I know this is not a requirement). I was wondering, what other ...
0
votes
0answers
11 views

Does Outliers in Categorical Feature varibales exist?

So, I was working on an Exploratory Data analysis project, after dealing with all the preprocessing of numerical features of the dataset when I started analyzing categorical data(nominal) there I ...
0
votes
0answers
18 views

Deep learning's auto extraction of representation

I am following up on a paper that demonstrates using deep learning (CNN) for classification. Specifically, their approach transformed the spatial data into fixed-length segments appropriate for CNN ...
1
vote
0answers
14 views

Get best performing feature

A data set that looks like this ...
2
votes
1answer
18 views

Why do we take the ratio of two features?

I've just learned that one technique for feature engineering consist of taking a ratio feature: feature1/feature2 , but I'm quite confused and I have questions: Why does this work ? Is this ...
0
votes
0answers
5 views

Cancel effect of external factor from dataset

In my problem I have a dataset with features: 1,2,3,...,n and another variable z, that is not part of my dataset, but every sample in the dataset has a corresponding z value. I might even see a trend ...
0
votes
1answer
19 views

sample space for a feature in machine learning [duplicate]

In machine learning data set each feature is considered as a random variable. Random variable is a function which maps the outcomes in sample space to a real value. Now I am trying to understand since ...
0
votes
1answer
24 views

Two ML models use different features. Does knowing the features of one model help improve the accuracy of the other model?

Suppose two firms are operating in the same field (e.g. insurance). If firm 1 knows which features firm 2 is using in their model, can firm 1 improve its model using that information? What if firm 1 ...
0
votes
0answers
13 views

Converting matrix to spatio-temporal feature vector

Given a matrix representing a video, where the rows represent video frames and the columns represent frame features, are there any techniques I can use to create a single feature vector from this ...
0
votes
1answer
42 views

How to discover relationships between features?

I'm an undergraduate fairly new to statistics. I am trying to find relationships between the features of a dataset. The dataset in question consists of 5000 objects each with up to 23 features. I was ...
0
votes
1answer
14 views

Does it make sense to do feature selection after PCA?

I have a dataset of 50 features that resulted after PCA was employed (originally, the dataset had 343 features. The 50 features are the principal components obtained with PCA). Does it make sense to ...
0
votes
0answers
21 views

How Helmert Encoding is done here?

I was going through an article on Helmert Coding there I encountered an example in which I was not able to understand how Helmert coding is done. I went through How to calculate Helmert Coding this ...
0
votes
0answers
10 views

Feature Engineering: How to deal with imbalanced numerical/categorical features

I'm analyzing a data set and solving a classification problem and find that values concentrate on one number in many features. For example, a categorical feature 'loan' indicating a person having loan ...
1
vote
0answers
37 views

About Feature Engineering Tips When “discriminative algorithm care about no modeling the probability of the language”

I was going over my old NLP course slides and one of the pages is about using Structured Perceptron for tagging. It claims that because the algorithm is discriminative, it doesn't care about modeling ...
1
vote
0answers
14 views

Classification of unnecessary pauses in a telephone call

So I'm working on a project where I'm interested in classifying a call as having excessive unnecessary pauses. This call has two speakers. And I also have the timestamps for each dialogue uttered by ...
1
vote
0answers
29 views

what is the impact of using large number of features compared to a small data?

I have time series data with 25 features and 181 observations, and the number of classes are 7. I used 3 models svm,random forest and xgboost to classify but the performance was really bad for each. i ...
1
vote
1answer
14 views

Using POS Tags and NERs as Features for Text Classification or Sentiment Analysis

I am trying to implement text classification and sentiment analysis from the documents. I always use POS tags as features in the following way. Mike is playing football I would convert it into ...
1
vote
0answers
5 views

Feature hashing and interpretability

I am working on a classification project where nearly all raw features (~30) are categorical such as category ID, city, or responsible team ID, some with cardinality > 600. I am using a feature hasher ...
0
votes
1answer
9 views

How to apply imputation when creating an analytical base table?

I am asked to read up on how to deal with missing values. From what I read I can use imputation with a package like MICE (for R) to automate this process. However I also read that when I am missing ...
0
votes
0answers
18 views

How to choose values for a Numeric Feature in a Decision Tree

I have a question about Random Forest and when it comes to Features for the Decision Tree. Let us assume that we have a Numeric Feature named: RSI Now let us assume that we have registered values ...
1
vote
1answer
19 views

Feature Engineering with Focus on KNN

I have seen a number of helpful posts such as this one on feature engineering, but I am specifically looking for something that may be helpful when using KNN. In my experience, some features work best ...
3
votes
1answer
30 views

Why do I get a different RSE when I call the summary of two identical linear models?

I am trying to find the best transformations for my data to use in a linear model. I call summary(lm(log10(Y)~X3^2) and get a RSE of 0.1787. Then I saved my data ...
0
votes
0answers
5 views

interesting features out of list of hair colors per person

lets say I have a dataset where each row -each data point - is a different person (about 1500 people). for each of them, I have several features. one of the feature is "hair color thought life". this ...
0
votes
0answers
9 views

Lasso Feature Selection on Batches of Training Data

I would like to perform lasso regression to select important features in a very large matrix (165K x 32K). I want to reduce the features from 32K prior to modeling, however, the file is too large to ...
0
votes
0answers
13 views

embedding a graph in n dimensional vector space and feed into a machine learning model

So I want to do some graph classification and regression. That is right! the training set are graphs. So my question is how can we embed a graph into a n dimensional vector space? Suppose the graph I'...
0
votes
0answers
11 views

How to control for primary predictive variable?

I'm trying to fit a model to predict customer churn. Specifically, I'm interested in how product feature adoption (e.g. web, mobile, digital services offered) affect churn. However, based on ...
1
vote
1answer
11 views

Multivalued feature construction

I have a task of representing a users feature matrix to be input for statistical machine learning classifiers, i have features like gender , age etc but I also have a multivalue feature called as "...
0
votes
0answers
9 views

What is the relationship (if any) between the number of input features and underfitting/ overfitting in ML/DL models?

Firstly below are a few points on this topic based on my understanding: Overfitting occurs when a particular model is too complex for the given data. This results in the model memorizing the data ...
0
votes
0answers
8 views

Continuous/Discrete - Categorical dependency test

I'm preparing the data to train a binary classification model. I know that eliminating features that do not have a dependency relationship with the target is a good practice. In my set of features I ...
1
vote
0answers
25 views

How to calculate Mahalanobis distance in very high dimensions with both continuous and categorical variables?

The objective is outlier detection via a distance measure. Does mahalanobis distance suffer from curse of dimensionality just like Eucledian distance for very high dimensions? (say around 5000 ...
0
votes
1answer
21 views

Fairly comparing performance of ML models trained with different numbers of features

I am training an ML model for a supervised classification problem. For this, I have been provided with two datasets. They both contain the same number of samples, however dataset 1 includes data for ...
1
vote
1answer
38 views

Expected Counts in Chi-Squared Goodness-of-Fit Tests of Normality

I have a variable with of 200 values that I would like to test for normality using the Chi-square Goodness of Fit test. To do this, I have to calculate, for each value, the expected value in a normal ...
0
votes
0answers
8 views

Priority between feature engineering and normalisation

My question is related to the priority between feature engineering (for example a simple transformation) and normalisation. It is a general question and I am not sure I understand all the ...
0
votes
0answers
6 views

Feature extraction for exponentially damped signals

I am looking into exponentially damped signals where it is a stationary signal (after implementing the Adfuller statistical test) and I would like to look into how can I extract meaningful features ...
0
votes
0answers
7 views

Is there I guide to decide which transformation to choose for different scenarios/ types of data and distribution?

1) how do i decide which transformation or scaling to use before passing our data into machine learning model. Can someone please guide me on which transformation to use in different situations. There ...
0
votes
0answers
11 views

handling counting features in classification model

I'm working on training a binary classification model. In my data I have 29 numerical features, continuous and discrete, apart from the target. Discrete features are all count features. I know that ...
0
votes
0answers
13 views

Should I impute the missing values of timeseries data?

I have the following task - predicting the next 12 hours of PM10 particles based on historical data of previous 24 hours of PM10, O3 (ozone), CO (carbon monoxide), and others (not included) using RNN'...
0
votes
1answer
15 views

How do you interpret your features when you standardize your data?

Let's say I have built a boosting tree or neural network and I standardized my features beforehand. When I built my model, I split my data into training, validation, and test sets - each with their ...
0
votes
0answers
34 views

How do you code missing values if 0 is meaningful?

Per this deep learning book I am reading: In general, with neural networks, it’s safe to input missing values as 0, with the condition that 0 isn’t already a meaningful value. The network will ...
2
votes
1answer
32 views

Handling zeros in features of a binary classification problem

I'm working on training a binary classification model. In my data I have 29 numerical features, continuous and discrete, apart from the target which is categorical. I have 29 features, 8 of them have ...
1
vote
0answers
24 views

How to deal with a features that overweight others in a regression?

I have been facing a problem that has been taking quite a while to over. In my problem I have basically 3 input features in my model and one single output. I have been using GP to fit my model to data,...
0
votes
0answers
30 views

Implementing Scikit Learn's FeatureHasher for High Cardinality Categorical Data

Background: I am working on a binary classification of health insurance claims. The data I am working with has approximately 1 million rows and a mix of numeric features and categorical features (all ...
0
votes
0answers
10 views

Is there a good score function for finding stationary-covariance features from time series via variational inference?

There are various ad-hoc methods for picking differencing orders or fractional difference orders of time series. Am looking for sound scoring functions and discussions that target automatic stationary ...
0
votes
0answers
9 views

How to select the best features for Support Vector Classifier in sklearn

I have a range of different technical analysis indicators as a feature set for my SVM. I would like to think some indicators are better than others at predicting and that there must be some sort of ...
2
votes
2answers
29 views

Is constructing the target variable manually a form of data leakage?

Let's say, I have a data table with numerical features A, B, C. I do not have the target variable but I extract the target variable Y from the features A, B, and C. like so: ...
0
votes
0answers
20 views

How to Find features for my model?

So i am a newbie in all Machine Learning stuff, i am trying to build a model of detecting fake news articles, as a starting point, i am just trying to build a simple model using known classifiers (...
1
vote
0answers
41 views

Standardization vs dividing uncentered data by Standard Deviation

I am working with a dataset that involves a collection of one-hot encoded, ordinal, and numerical features. I am using a LASSO model. As the difference in scales can influence the estimates, I am ...
1
vote
1answer
16 views

Feature generation for anomaly detection

I have Room Temperature data(T1) and Outside Temperature data(T2) with me for various houses which are having HVAC system installed. I am building a system which detects faulty HVAC (heating, ...
0
votes
2answers
51 views

Feature extraction definition

I have difficulty understanding the concept of feature extraction since there are two main ways to describe it. The first one refers to mapping the raw data into a vector in R^d or the translation of ...

1
2 3 4 5
12