Questions tagged [segmentation]

In marketing/economics, the task of dividing some population such as customers into sub-groups based on some type of shared characteristics or demands. Statistically, various unsupervised and supervised methods may be used for that (clustering, conjoint analysis, tree, etc.).

Filter by
Sorted by
Tagged with
1
vote
1answer
2k views

How to implement a weight map for a U-Net [closed]

I have a question regarding the convolutional neural network known as U-Net (see link below) and hope somebody can help me out. https://lmb.informatik.uni-freiburg.de/people/ronneber/u-net/ In the ...
0
votes
1answer
33 views

How can we model the visit pattern of a customer in a retail store?

I am trying to segment customers based on how recently they visited the store. However, I am also trying to incorporate the frequency with which they visit the store. For example, in a data collected ...
2
votes
1answer
3k views

how can my loss suddenly increase while training a CNN for image segmentation?

I work with keras 1.2.2 with a tensorflow 1.4.0 backend. I'm using a unet architecture, I have 708 images of 650x650 pixels and 6 chanels. I augmented the dataset with mirrorings and rotations, for a ...
1
vote
0answers
108 views

Hierarchical clustering on dependent data

I do customer clustering based on weekly data. I don't want to rely on only one week of data so I was considering pooling the data over a few weeks together and assume that these are simply "different"...
0
votes
0answers
373 views

Customer Segmentation Using RFM Interpretation of Negative Scaled Variables

I am doing customer segmentation using RFM. Prior to proceeding with the clustering, I log transformed my Monetary variable to account for skewness. ...
1
vote
1answer
67 views

Quantify whether a set of binary segmentation models (experts) have diversity on a fixed dataset?

I have a set of models for binary segmentation task (M=10), and a set of images (N=1000). I also can collect the prediction map for all these N=1000 images, resulting in 10,000 grayscale maps. Now, ...
1
vote
1answer
4k views

Cross cluster analysis of categorical data in R [closed]

How do we perform cross cluster analysis in R. Most of my data has categorical variables {variable Marital Status (married, single, divorced); variable Education (tertiary, secondary, primary, etc.); ...
4
votes
5answers
3k views

is K-Means clustering suited to real time applications?

I want to segment a sequence of RGB images (basically it's a video) based on their colors in real time. KMeans is an easy and intuitive algorithm to use in this case, but it's execution time is very ...
0
votes
0answers
70 views

How do I run a cluster analysis on customer store visit data to identify clusters that consist of both location and time?

I have data from customer visits to a number of different stores over the course of a few months. In one column I have the time/date of the visit, in another the location of the visit, and in other ...
2
votes
1answer
2k views

Fully Convolutional Neural Network Exploding Logits and Loss

I am trying to train a fully convolutional neural network for 3D medical image segmentation, I have started from the architecture of this paper with the differences being that I have images of varying ...
1
vote
1answer
855 views

customer behavior analysis and segmentation using data from loyalty program

I'm trying to do some analysis on customers behavior. Basically, I have information on customer's loyalty points activities data (e.g. how many points they have earned, how many points they have used, ...
2
votes
1answer
36 views

Using pretrained segmantation network for unseen motives

For a research project, I need to do a segmentation on images. Since the motivation is nothing any of the big networks was ever trained on, I would ask if it still makes sense to use pretrained ...
1
vote
1answer
592 views

Can U-Net be used for counting objects?

If I understand the U-Net paper correctly, the NN output is segmentation of known objects on the image from the background. In other words, the network will try to mark all the pixels which are part ...
3
votes
1answer
418 views

Optimal classifier or optimal threshold for scoring

In practice, there can be a classifier that gives far better performance at a specific acceptable threshold than an "optimal" classifier with better average performance across range of thresholds (...
2
votes
1answer
724 views

Machine learning to find an optimal set of parameters for a segmentation algorithm

Using machine learning to find an optimal set of parameters for a given segmentation algorithm. In the "classical" case of machine learning, in the training phase, the data set is constant and the ...
2
votes
0answers
307 views

Evaluate image segmentation with the absence of ground truth

Motivation: - Evaluate the computerised image segmentation against manual segmentation; - Evaluate the difference between difference manual segmentation. Background: Given a raw medical image (...
0
votes
1answer
285 views

Customer-Segmentation based on feature importance

The problem: We have asked customer-satisfaction for various shops (variable satisfaction ranging from 1 to 4). In addition we have provided 30 shop features and our participants had to rate if the ...
9
votes
3answers
15k views

Loss function for semantic segmentation

Appologizes for misuse of technical terms. I am working on a project of semantic segmentation via convolutional neural networks (CNNs) ; trying to implement an architecture of type Encoder-Decoder, ...
1
vote
1answer
915 views

How to perform segmentation on multivariate time series?

Given a multivariate time series, which method could be applied to segment it into partitions of stationary signals. To give more context: I am given a set of acceleration signals in XYZ-Direction. ...
1
vote
1answer
91 views

Utilizing Graph Structure when using Mean Shift Clustering

Imagine we are clustering pixels in an image. If we use Mean Shift Clustering, at least in my understanding, we will embed each pixel into some dimensional space (intensity, rgb, texture, etc) and ...
0
votes
1answer
343 views

Foot Image Segmentation [closed]

I am working on segmenting plantar foot image. i am finding it difficult to find the edges of the foot without the details inside. Please take a look at the canny edge detected. It is full of noise ...
9
votes
1answer
9k views

What are the difference between Dice, Jaccard, and overlap coefficients? [closed]

I come across three different statistical measures to compare two sets, in particular to segmentation on images (e.g., comparing the similarity between the ground truth and the segmented result). ...
0
votes
1answer
46 views

Forecasting by segments : from bottom to top or vice-versa?

I need to predict tourist arrivals by country of origin, by segment (hotels, camping etc...), by purpouse of travel (leiser or business)... so by breakdown within breakdowns. My question is; I do not ...
2
votes
2answers
460 views

What are the advantages of segmentation?

Suppose you want to fit a regression model. You have a data set with multiple attributes. What would be the advantages of segmenting the data set and fitting a regression model to each of the segments?...
1
vote
0answers
314 views

supervised binning

I have continuous outcome variable and continuous independent variable. I am trying to bin the independent variable that maximizes homogeneity within bins based on the outcome and maximize separation. ...
2
votes
1answer
39 views

any difference between randomly selecting before or after an event?

Is there a mathematical difference between randomly selecting a population of users before an event vs after an event, for the purposes of experimentation? For example, let's say we want to split all ...
1
vote
1answer
437 views

What is the best way to deal with missing data in latent class models?

What is the best way to deal with missing data in latent class models? For example, Latent GOLD can estimate models with missing data (LG technical manual page 51). Simply put, the likelihood ...
2
votes
1answer
1k views

R clustering using mclust: BIC are often NA

I'm working on segmentation/clustering and trying to use Gaussian Mixture Modelling for Model-Based Clustering. I'm using the R package Mclust in order to come up with the best fit for my data. All ...
1
vote
1answer
18 views

Determine the n largest intervals of noise in an audio file

I have audio files that contain interviews with long periods of silence. n - Number of interviews for a given audio file. I need to split the audio into periods where the interviews are actually ...
1
vote
1answer
230 views

Segmentation of Geodemographic Data

I have a dataset that has 5 variables (columns). These are median house price, median income, number of people with no educational degree, number of people with high school degree, number of people ...
1
vote
0answers
37 views

Segmentation - Making Segments Sharper

I have a question. We’ve done a study that looks at the youth’s attitudes towards “social issues” such as water, sanitation and public health. We then segmented the population using factor analysis (...
4
votes
1answer
7k views

User segmentation by clustering with sparse data

Imagine that I have 100k users and 1k categories. For each user, up to 5 categories, I know how much money they have spent. Obviously my data is very sparse. Now I want to group users by the money ...
1
vote
1answer
351 views

Segmentation analysis based on Likert [closed]

I would like to do a segmentation analysis based on a Likert scale survey. I want to ask respondents to rate certain attributes on a scale of 5 points (not valuable at all, not very valuable, neutral, ...
1
vote
1answer
741 views

k means for segmenting time series [closed]

Now, I am trying to understand how to segment a multivariate time series using k- means. I understand that the basic concept is to use centroids of segments rather than centroids of data points and ...
2
votes
0answers
31 views

What are good / simple techniques available for segmenting non-cursive handwriting images?

I need to process English hand-written form fields. So the hand-writings are expected to be mostly non-cursive but the letters may occasionally overlap with each other slightly, with some punctuation ...
3
votes
0answers
173 views

Potts model and model selection

Suppose to have two vectors of random variables $\mathbf{x}=(x_1,\dots,x_n)^{\prime}$ and $\mathbf{y}=(y_i,\dots,y_n)^{\prime}$, observed over a two dimensional space domain. Let $\boldsymbol{\xi}_{...
5
votes
2answers
1k views

CRF or MRF energy functions for image segmentation

I am currently working on image segmentation for the purposes of computer vision. I have read many papers and a few books dealing with MRFs and CRFs for computer vision. All of them define an energy ...
1
vote
0answers
637 views

Cost function for image segmentation

I am currently working on image segmentation based on superpixels. My input is a data matrix that contains stixels (rectangular superpixels that span an entire column). In the matrix I have stixel ID, ...
1
vote
0answers
58 views

Classifying according to relationship between variables

I do have a large dataset and would like to classify it according to the relationship between some variables. I do not want to use clusters, because clustering results groups that are similar. I do ...
4
votes
1answer
2k views

Identify region of interest in image

I'm currently trying to work on the challenge https://www.kaggle.com/c/noaa-right-whale-recognition; I've done basic image recognition work before (Identifying plankton), but this particular challenge ...
3
votes
3answers
304 views

How to classify customers by those who use quite a lot of shops vs. mostly one specific shop

I would be interested in how to approach the following problem: A supermarket chain has 1 million customers in a region and 10 shops. For each of the customers we know the distribution for all the ...
2
votes
3answers
3k views

segmentation of univariate irregular time series

this is my first post. I have an irregular time series that exhibits large shifts in both mean and in the direction of the trend. It looks something like this (though this is far cleaner than ...
3
votes
0answers
102 views

Profiling survey respondents with both categorical and ordinal variables

I have a mixture of categorical and ordinal variables from a survey that I am trying to use to create "profiles" or segments that differ from one another with respect to a dependent variable (the ...
1
vote
0answers
298 views

Interpretation of cross validation results when comparing models

I'm trying to solve a bio-medical image segmentation problem using a binary classifier and then a spatial smoothing (assuming continuous regions). I have: Training set of 10 3D scans, a total of ~30 ...
14
votes
3answers
1k views

How can I programmatically detect segments of a data series to fit with different curves?

Are there any documented algorithms to separate sections of a given dataset into different curves of best fit? For example, most humans looking at this chart of data would readily divide it into 3 ...
3
votes
1answer
2k views

Estimating the best length of n-gram

I have a long sequence of words or letters {word1 word2 word3 word1 word1 word2 ..etc}. Lets say we extract all the ngrams (unigrams, bigrams, trigrams, 4-gram, 5-gram ....) along with their frequency ...
2
votes
0answers
36 views

Clustering stream of new customers based on future potential

I need to cluster new customer according to their future potential, but I have only information about their first transaction. I have access to all transactions for the other customers. So I can do ...
1
vote
1answer
558 views

How is survey respondent segmentation based on market opportunity score done in practice?

As per instructions, I have administered a survey to a sample population that for several different "jobs-to-be-done" asks the survey participants to rate the importance of the "job-tobe-done" and the ...
3
votes
2answers
180 views

Controling segmentation process in order to get usable segments

My aim is to create segments based on survey data. This in it self is quite straight forward: I use PCA to extract information from the survey answers, and then ...
3
votes
1answer
1k views

Best method to assign new customers to existing clusters after segmentation?

After segmenting customer base using k means algorithm into 5 clusters , how to assign a new customer to one of the existing 5 clusters? Matching just the mean of clusters with values of new ...