Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [sequential-pattern-mining]

Finding statistically relevant patterns between data examples where the values are delivered in a sequence [Wikipedia]

0
votes
0answers
3 views

Modelling probability distribution of a set of sequences (to calculate Entropy)

Let $T$ be a set of trajectories $\tau$, where $\tau=\{\mathbf{x}_1,\mathbf{x}_2,...\mathbf{x}_N\}$ with $\mathbf{x}_i\in\mathbb{R}^k$ being a vector of observations. I am looking for an efficient ...
0
votes
0answers
13 views

Grouping Similar Sequences

I have extracted a ton of log data from a mobile application. The objective of this task is to identify similar patterns of behavior. Which algorithm should I look at which will group behaviors ...
0
votes
1answer
21 views

Comparing Strings Sequences of Different Length

What's the 'best' way to compare strings of characters of different lengths, which are sequentially ordered, against an ideal sequential string of characters? The sequences come from an experiment ...
0
votes
0answers
16 views

Representative Pattern Extraction from Time Series using LSTM

I am interested in extracting a representative pattern from time series having variable time periods. I have attached an image for reference. I would like to know if a LSTM would be the appropriate ...
1
vote
1answer
41 views

Finding patterns in various-length binary sequences

I have a large number of binary sequences of different lengths (time-series of observations of the occurrence (1) and non-occurence (0) of some thing) and I am wondering how I could find patterns that ...
0
votes
0answers
28 views

How to set up data to train sequence to sequence model using random forest or decision tree?

I have to predict output time series given input time series. SO I just trained random forest with one time series and I found it partially fits all remaining time series event though I didn't trained ...
0
votes
0answers
15 views

Sequence Prediction with noise / gap using markov models

I'm trying to understand if Markov models can account for a "noise event" when predicting the next item in a sequence. For instance, if i have very frequently occurring (noise) event "F", can a ...
0
votes
0answers
19 views

Detecting purchasing patterns

I work for an e-commerce whose users take a quiz with some questions that we use to segment them. Which algorithm/approach could we use to get insight like this? ...
0
votes
0answers
13 views

Which Algorithm(s) to apply for in-game behavioural data (choice-based-game)

In the near future, I'm going to analyse in-game and log data. The main purpose is to make predictions about which choices people are going to make in the future when playing this game. As log-data ...
3
votes
0answers
33 views

Sequential Prediction: Data Modeling and Classical Algorithms

I have data that can be called demographic data. Raw data Person 0001 \begin{array}{|c|c|} \hline Feb\,1981- Apr\,85 & engaged\,\,in\,\,\underline{activity}\,\,\textit{A}\,\,of \,\,\underline{...
2
votes
1answer
103 views

How to forecast a set of different time series?

I am trying to forecast a large set of time series that feature very different characteristics. The figure below shows three exemplary series: My first idea was to identify periodical repetitions as ...
0
votes
0answers
8 views

Making use of time intervals in computing conditional probabilities in sequential data with time

I have sequential data X and a binary target y (which is the last event in the sequence). Each row represents a unique sequence of events with a label, 0 or 1. Potentially, I need to estimate a ...
1
vote
0answers
12 views

Sequential mining technique for categorical events?

I'm facing a problem where I have a short (2-8) sequence of discrete events, of variable length, and a final state. Ex.: cold, warm, warm -> soft clothing. I would like to determine what are the main ...
-2
votes
2answers
134 views

Probability of successful charging based on independent historical or sample data [closed]

I tried my best to find a solution, but failed to find a decent one. Imagine I want to charge a customer and I have last three days of random charge try data: ...
0
votes
1answer
54 views

RNN for Sequential Data

I am working with data that requires classifying if a patient will develop cancer or not in the future, based on medical tests done over time. The tests have a sequential relationship. A, then B, then ...
0
votes
1answer
58 views

Predicting time of user action in action sequence

In my system, my users will perform a set of actions in order to accomplish a task. As each action applies a load to my server, I would like to forecast potential load spikes. The actions will always ...
0
votes
0answers
23 views

Events lead to failure by sequence

I am dealing with a problem where I need to predict the failure depending on the occurrence of events in the order they occurred (sequence). Along with this, we need to identify the point where the ...
1
vote
0answers
22 views

Would an RNN/some other approach be more appropriate for this problem? [closed]

I am designing a better algorithm for an IDE to decide whether data associated with a file should be kept in a cache. The cache is used whenever a user clicks on a file, decides to close it and work ...
1
vote
0answers
38 views

Learning recurring patterns from a stream of bits

I'm trying to find recurring patterns in a stream of bits in order to construct a Gilbert-Eliot model for packet losses and retransmissions in a wireless network. The Model requires interesting ...
4
votes
2answers
1k views

Machine learning on non-fixed-length sequential data?

I have a problem which I'd like to apply machine learning (supervised classification) to, however, the data is sequential and each row in the data vector has its own length. This implies that the ...
1
vote
0answers
327 views
1
vote
1answer
42 views

Dynamic Time Warping to find distance in stochastic way

Is there a formulation of DTW that allows to deal with uncertainty or to utilize knowledge of the probabilistic structure of the signal? I would like to have a formulation similar to HMM but stay in ...
0
votes
1answer
91 views

Comparing multidimensional time series with possibly non-informative dimensions

I have several examples of multidimensional time series that correspond to a particular pattern (or class) and form a dictionary. Now, based on these examples I want to find if a new time series ...
0
votes
1answer
435 views

Unsupervised patterns finding in multidimensional time series data

I have a problem where I have multidimensional time series data (e.g. 3 dimensions from accelerometer) and I need to find some patterns in the data. I might now approximately the possible duration of ...
-1
votes
2answers
68 views

substring clustering with noise

I have sequence which is a repetition of a few strings. I have identified the start and end markers of these strings in the sequence and now, I want to cluster similar strings together. The problem is ...
2
votes
1answer
18 views

Removing trivial structure while keeping global structure

I've noticed that many pattern predictors initially use the solution of "always pick the most common thing" and sometimes struggle to ever get out of local holes like that for a while. A simple ...
0
votes
0answers
17 views

Derive sequencing probabilities from univariate data

Given a variable measured sequentially e.g. -6,-3,0,2,-3,1,-5,7,-47.. etc, what are some methods to derive some reliable sequencing probabilities? e.g. if i-2>0 and i-1 >0 then i>0 etc.
1
vote
1answer
174 views

How can I solve the sequence prediction problem?

Let's say I'm given a stream of characters, one at a time. Some example strings of characters that could occur might be "01234" or "hello how are". They might even be encodings of waveforms as ...
8
votes
3answers
401 views

High autocorrelation when taking the L-th order of difference of a sequence of independent random numbers

To explain this question in more detail, I'll first elaborate my approach: I simulated a sequence of independent random numbers $X = \{x_1,...,x_N\}$. I then take $L$ times the difference; i.e. I ...
0
votes
1answer
2k views

Classifying sequential data [closed]

I am trying to understand what are the best practices to perform supervised machine learning on sequential numerical data. My data looks like following: ...
2
votes
1answer
41 views

Studying fluctuations / trajectories over time - objective methods of grouping?

I'm trying to study fluctuations of a disease's activity over time, for example the f;uctiation in severity of chronic pain (in the absence of obvious triggers). Individuals generally demonstrate ...
1
vote
1answer
354 views

Sequence to Label Model

I have a dataset with me where the input is a sequence and output is just some labels. (No sequence in that) What is the best model to train that kind of dataset..? I was using ...
2
votes
0answers
46 views

What type of analysis for sequential data can I use to identify patterns in collaborative activities

I have a data set, which is collected every 5 second for a total of one hour using a special type of wearable device. Each data point is the amount of verbal participation ratio (measured as percent) ...
4
votes
1answer
80 views

Identify changepoints in 1/0 sequence [duplicate]

Say I have a sequence that looks like this: 0 0 0 0 0 1 0 0 0 0 1 0 1 1 1 0 0 0 0 0 0 0 0 0 0 In general terms, I am interested in determining when there is an ...
0
votes
0answers
289 views

How to deal with this sequence alignement problem?

Assume the following input sequences. ___JJJJIII___I____OOO0O______HHHHHH_____MMNNN___ AAAAAI_NNNNNNNNNNNA_AAAA_ ___MMMM______A______RR_I______KK_ which ...
7
votes
2answers
2k views

Multivariate time series clustering

I am collecting a group of multivariate time sequences. For example, there are 2000 time series. Each time series is of 12 dimensions. Are there any systematic models/algorithms that can cluster ...
2
votes
3answers
3k views

pattern recognition for sequence data

There are a lot of data sequences, I am trying to find pairs of sequences that are similar with other. Trivially, we can define some distance measure, and compare each pair of sequence in terms of ...
0
votes
2answers
95 views

“Controlling” for multiple sequential association rules?

Assume I have data along the following lines A-A-B-C A-A-B-C A-A-B-C Then I test the following sequential association rule: "A-A precedes C", which is true 100% ...
1
vote
2answers
448 views

Why does my RNN perform well on long sequences, but not on the short, easy ones?

I have a problem that has left me perplexed and baffled. I am training an RNN (with LSTM cells) to generate a sequence from the output of a CNN for the purpose of annotating images. E.g., input: ...
10
votes
2answers
5k views

Best use of LSTM for within sequence event prediction

Assume the following 1 dimensional sequence: A, B, C, Z, B, B, #, C, C, C, V, $, W, A, % ... Letters A, B, C, .. here ...
1
vote
0answers
236 views

Can we use Markov chain instead of Hidden Markov Model to classify sequential data?

I was searching for an algorithm that can classify sequential data into categories. Let's say sequence '000111' falls into category A, and '01010101' falls into category B. A lot of materials ...
4
votes
1answer
348 views

Binary Pattern Prediction

I have 400K observations, each one is a growing binary pattern where order matters. The goal is to predict the likelihood of the next character. For example, 10101010101? - as humans we can ...
0
votes
0answers
61 views

Sequential pattern mining on mutiple sequences

Can someone give me a hint about a good approach to find a frequent patterns in a multiple sequences. Each sequences is a combination of 7 characters M,E,N,S,U,R,G. The length of each sequences is ...
3
votes
1answer
73 views

How to detect variable seasonality pattern

We have predicted and actual (daily) data for past 3 years. We use 90 days of data for prediction. Generally our predictions are very accurate, but we receive unusual traffic for few days/weeks ( like ...
0
votes
1answer
139 views

Introduction to Explorative Sequential Data Analysis

Short version I am looking for introductory material to explorative data analysis of complex sequential data like website activity, hospital visits etc. Long version Currently I am facing data ...