Questions tagged [sequence-analysis]
Analysis of a DNA, RNA, or peptide sequence to understand its features, function, structure, or evolution.
137
questions
0
votes
1answer
26 views
Self Attention for Variable Length Sequence Classification
I have a problem that is not particularly unique, but I'm still having trouble to figure out exactly how it's usually done.
My training set is of the form $\mathcal{T}=\{(t_i\in \mathbb{R}^{[n,m]\...
1
vote
0answers
18 views
What are the classifiers that can be used for sequence data?
I've been going through the classifiers like Naive Bayes, Decision Tree etc. I've a sequence data like so
...
0
votes
0answers
8 views
Strength of the association between different modalities of the same variable over time
I wanted to ask for help concerning a problem that I am currently working on and for which I have not yet been able to find a reasonable solution. I am a beginner in statistics and data analytics and ...
0
votes
0answers
14 views
Sequences classification: Instances generation for training\test set
I have problem modeling issues. Basically, I have a (binary) classification problem for sequences, in which:
I need to predict the state of an object at a time i+1, given the info till time i
I have ...
0
votes
0answers
12 views
Training and testing transformer model from scratch
As you know, transformers are one of the strongest model in the field of NLP and machine translation.
I know there are many resources, but I still could not find a good tutorial teaching how to use ...
0
votes
0answers
19 views
Predicting sequence element based on the previous M and the following N elements
I have an array of sequences of equal length, each sequence contains 300 numbers (M=300). Each element in a sequence is a number from 1 to 9:
...
1
vote
0answers
19 views
Training two Hidden markov models vs two state Hidden Markov models
I have a scenario where I have log of events followed by some kind of special event (e.g Failure etc). I have two kind of sequences (events, that are observations, can be common in both sequence), ...
37
votes
4answers
5k views
Is LSTM (Long Short-Term Memory) dead?
From my own experience, LSTM has a long training time, and does not improve performance significantly in many real world tasks.
To make the question more specific, I want to ask when LSTM will work ...
1
vote
1answer
44 views
Sequences comparison metrics
I know about Edit distance, Longest Common Subsequence and their normalized versions to measure the similarity between sequences But do we have any similarity measures other than the above ones?
0
votes
0answers
14 views
Graphs to sequences
I would like to apply network metrics to sequence analysis. The approach is described in this paper https://link.springer.com/chapter/10.1007/978-3-319-95420-2_7
However I don't know how to translate ...
0
votes
0answers
4 views
Deep learning framework for sequence to numeric model
I have a very large dataset consisting of 10 base pairs of DNA (dictionary = A, C, G, T) and a numeric outcome which is a count between 0 and 10.
E.g.
GCTAGCATGA -> 2
GTAGAGTCGA -> 1
What is the ...
0
votes
1answer
923 views
How To Solve A Sequence Question [closed]
I'm taking a course on R on edx, but I have been stocked here for days. Please
Which integer values are between the maximum and minimum heights? For example, if the minimum height is 10.2 and the ...
1
vote
1answer
23 views
How is conditioning on a variable different than specifying nested random effects
How is conditioning on a variable similar to or different from using a mixed effect model?
I am a biologist. I'm analyzing my data. I have body sites nested within individuals. We're interested in ...
0
votes
0answers
23 views
Predicting the Winner of a sequence of numbers
I have various series of numbers of different lengths (ranging from 4 to 10) such as the example below:
[1.5, 5.0, 6.0, 6.0, 8.0]
[1.4, 6.0, 7.5, 9.0, 50.0, 100.0, 200.0]
For each one of them I ...
1
vote
0answers
144 views
On the convergence of infinite sum of a hypergeometric function resulted from a nested sum
I am interested in finding the CDF of the sum $U=\sum_{i=0}^N U_i$ where:
$$F_{U_i}(x)=\sum_{n=0}^\infty \frac {2(-1)^nR^{k\alpha+n\alpha}x^{k+n}}{\Gamma(k)n!\theta^{k+n}(k+n)(k\alpha+n\alpha+2)}$$
...
4
votes
1answer
30 views
Can LSTMs classify multivariate time sequences?
I've been learning about LSTMs and I commonly see them applied to the same type of task. For example, given a 1D list of values, predict which class they belong to. Or, given 8 values from 8 sensors, ...
0
votes
0answers
21 views
Adding binary variable to sequence predicting y?
I would like to predict the relationship between two independent variables and a dependent one (model1):
x1 + x2 = y
Now, x1 is a sequence of vectors (a document composed of a sequence-of-sentences)...
0
votes
0answers
9 views
Deep learning technique for finding sub pattern
I have a list of strings each with thier target output value. The output in each case is a sub string of the input
Eg
ABCFHDF-> FHD
HJLKSOK-> JLK
GSJKOPS-> JKO
My question is what area of sequence ...
0
votes
0answers
17 views
How to perform feature extraction(PseAAC)?
I am working on K-Post Translational Modification of protein.
I have gone thorugh a lot of papers. But there is no detailed view of how to extract feature like PseAAC. Any python code
/package is ...
1
vote
0answers
34 views
Analyse set of Sequences of varying length with PCA?
Task description
I have a dataset with strings indicating the sequence of the screens a user visit when making a purchase on an app.
A string could be: "1,2,1,2,3,3,4,5,6,7,3,2,5,6". Another string ...
0
votes
0answers
19 views
Optimal matching analysis for proportional data
I have a dataset constructed from twitter data consisting of users, and their proportional activity in an issue.
The data is currently stored as a dictionary of dictionary:
Current format:
...
0
votes
0answers
38 views
Predicting the loan default probability for next t intervals by predictSurvProb()
I have a loan dataset that contains details of customers for different loan types.
Every category of loan have different tenure(starting from 6Months to 60Months)
We are defining "Good" or "Bad" to a ...
0
votes
1answer
31 views
Binary Sequence Prediction Model with Time dependant features
I got a very long sequence of binary items (0 or 1). Each item is associated to a timestamp. For example :
...
1
vote
0answers
48 views
Likelihood Matrix from a Random Forest?
I'm going through the supporting material of a paper (https://science.sciencemag.org/content/360/6384/81) , trying to reproduce their results (see below, note that HVG=highly variable gene). The data ...
1
vote
0answers
20 views
Ideas for determining the optimal sequence of calls and emails to maximize the probability of a sales lead converting to a sale?
I have a large data set of sales leads that are in the form of a lead_id, a sequence of binary integers that denote the order of emails and phone calls made to a sales lead, and the binary outcome of ...
1
vote
1answer
23 views
have many error likelihoods, how to combine to get a confidence or p value?
I'm working in bioinformatics and its been a long time since I dusted on my statistics. Basically I'm working on variant calling which amounts to sequencing a large number of sequence reads and ...
3
votes
0answers
133 views
Which distance metric to use to cluster categorical sequences (clickstreams or clickpaths)?
For my research, I want to cluster website visitors based on their clickstreams to understand different information behavior patterns (i.e., customer/visitor journeys). The data can be characterized ...
0
votes
1answer
21 views
ATGC sequence of gene expression data [closed]
I am not a pro in genetics so please excuse my non-technical language.
I need dataset which contains the gene expression as well as the associated ATGC sequence with each gene expression value. For ...
1
vote
1answer
102 views
Handling missing data in Sequence Analysis (TraMineR) within the observation window
I´m using sequence analysis. I have a question about how to deal with missing data within the observation window. The starting point of the analysis is when respondents leave secondary school (t0). I ...
2
votes
1answer
188 views
Unsupervised clustering of sequence of events to subsequences
I have a big dataset of M sequences of [1 - N] events, where each event has multiple properties (start date, end date, location, ...
2
votes
1answer
57 views
Combining probabilities to find most probable window
I have a series of observations, with an associated probability that an event is occuring at timestep t, something like:
[0.8, 0.8, 0.3, 0.9, 0.2]
Events can ...
1
vote
1answer
46 views
How to understand “multimodal” RNNs for image captioning?
This paper Deep Visual-Semantic Alignments for Generating Image Descriptions on image captioning proposed a Multimodal Recurrent Neural Network architecture.
From my understanding, the multimodal RNN ...
2
votes
2answers
49 views
Localized distance function on sequential binary data
I am trying to find a good distance function for sequential data that is all binary. For now, I am using Edit distance however I have some more domain-specific knowledge that I would like to ...
2
votes
2answers
258 views
Sequence prediction based on non-sequential inputs
I have a dataset with timestamps and event values (true or false -- these are based on sensor data which detect room occupancy). I'd like to build a model that would take a timestamp as an input and ...
2
votes
0answers
41 views
What are the algorithms for fusing time series together [closed]
Assume I have multiple time series with the same length and the same range. What are the different algorithm used to fuse the time series together? what techniques would the best to combine them to ...
1
vote
0answers
47 views
Probability of Finding Two Matching Subsequences in a Sequence
I'm currently studying DNA sequencing and am trying to find a formula which gives the probability that a subsequence of length $k$ appears twice in a sequence of $L$ bases (characters); this is pretty ...
0
votes
1answer
28 views
Estimation of partitioning error in next-generation sequencing experiments
[Edited: explanation of the partitioning error]
I would like to estimate how the initial number of molecules (or the level of gene expression) affects reproducibility between technical replicates of ...
2
votes
1answer
78 views
Is there a canonical probability distribution on an ordering/permutation
What is a good way of defining a non-uniform probability distribution on a permutation of k objects?
For example, suppose the parameter was an ideal ordering, and the probability of an ordering was ...
2
votes
2answers
209 views
Using deep learning to measure the similarity between two variable length voice sequences
Usually we use DTW (Dynamic Time warpping) to measure the similarity between two variable voice sequences. However DTW is time-consuming and not easy to run in the GPU since too much control in it. I ...
1
vote
0answers
310 views
Is Length Normalization used in each step of Beam Search?
In Andrew Ng's lesson on refining Beam Search, it seems that Length Normalization is used ONLY AFTER LAST STEP of Beam Search, that is, when the B most probable sequences have been generated. My ...
-1
votes
2answers
631 views
How to stretch a time series to any length, n, without padding? [duplicate]
What algorithms are most suitable if I want to strect a time series to a certain length, n. I dont want to just pad the time series with values at the beginning or end, I want the pattern of the data ...
5
votes
0answers
539 views
traditional state-space models and LSTMs
I am trying to understand the nature of LSTMs in relation to intuitions from traditional state-space models (e.g., Kalman filtering). The code below aims to simulate a simple univariate linear state-...
2
votes
1answer
57 views
Dealing with the order of features (sequences)?
Assume we have following sequence database that is subsequently converted with one-hot encoding:
1 2 3 4
0 A B C D
1 B A D NA
2 A D C NA
One-hot encoded:
<...
2
votes
0answers
38 views
Selection of differentially expressed genes
I don't have any statistical background. Have some questions.
I see in some research papers they select differentially expressed genes based on fold change and p.value. And in some other papers I ...
2
votes
1answer
57 views
Calculating p-values for ratios of binomial variables
I have a problem that I will express in 2 ways: a math-y way and a biology way. Hopefully this will make it more clear.
Math-y way:
I have N observations of a pair of binomial variables, call them ...
4
votes
2answers
1k views
Clustering customers by their orders sequence patterns
I have dataset with clients orders. Example:
...
1
vote
0answers
390 views
Generate sequence of random autocorrelated numbers
Back in the university I was working on a program that generates a sequence of random autocorrelated numbers. Autocorrelated meaning that each next value is close to the previous one and depends on it ...
1
vote
1answer
73 views
Sequence prediction: ambiguity in training set
There is a set of sequences (train set), where each element is one or multiple tags:
A, B -- A -- Z -- Z, A
B -- A -- Z -- D
...
Given a new sequence:
...
3
votes
1answer
173 views
TraMineR: predicting class membership of new sequences
Question summary
This question pertains to analyzing dissimilarities between discrete state sequences (e.g., using TraMineR), more specifically to classifying new, ...
1
vote
0answers
383 views
