The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [functional-data-analysis]

Functional Data Analysis defines a framework where the fundamental units of analysis are functions.

75 questions
Filter by
Sorted by
Tagged with
18 views

conversion of multivariate time series into functional data analysis

i am trying to generalize the functional autoregressive model of order one to some order p, for this i calculate the functional principle components, and choose a particular pcs which explain a given ...
47 views

Interpretation of functional regression models for scalar response

I have an application scenario in which I want to determine a single outcome from the course of a series of measurements. I decided to give functional regression a try, so I read and ran the example ...
56 views

How to transform test data in Functional Principal Component Analysis in R

I am doing a functional principal component analysis on time series data, and when I finished the FPCA on train data and extracted the PCs. Next, I need to project the test data onto the PCs, here I ...
47 views

Gaussian process regression model for comparing two groups

I have a data set consisting of functional observations, where $Y_{mi}$ is the response of the $m^{th}$ functional observation from the $i^{th}$ group, $m=1,...,M$ and $i=1,2,$. The observations are ...
31 views

Showing if there is statistical significance between two data sets (data analysis) [closed]

Hey guys so I have been given a homework problem where there is a table of video views with one column being views(in millions) before an event and then the other column is views after the event. The ...
78 views

Multidimensional Principal Component Analysis

I found a lot of question about principal component analysis as well as functional PCA but only in the sense of time series and not in spatial case and multidimensional principal component analysis. ...
33 views

Functional data analysis references

I am working on a inferential framework for functional data. I have categorical independent variables and a functional response variables. Different implementations of functional linear models are ...
37 views

Bilinear Process

how to generate a functional bilinear process such as: $X_{n+1}= \int\psi(t,s)X_{n}(s)ds + \iint\phi(t,s,u)X_{n}(s)\varepsilon_{n}(u)dsdu + \varepsilon_{n+1}(t)$ ? About the first integral there ...
21 views

Analyse variation between distribution curves according to factors

I have a set of continuous distributions representing the leaf area density found at different heights through a forest canopy. e.g. like that found in Whitehurst et al. (2013): For each of these ...
83 views

Covariance kernel of a Gaussian process

I just started studying the theory of Gaussian processes. I'm mainly interested in studying functional data and I haven't found the answer to my doubt. Let's say I have some curves that I consider as ...
12 views

Calculating gradient/rate of use

I have some data regarding my pellet usage. I monitor the level of pellets in the hopper, with a certain degree of inaccuracy because of the tesselation of the pellets. I would like to calculate the ...
132 views

Which method for anomaly detection on curves of sensor data

I have data of measurements of a sensor. The sensor measures a numeric value at 20 fixed positions every few seconds. You can think of a camera traversing over a plate and measuring the amount of ...
362 views

Functional Data Analysis and Splines Regression

I'm new to Functional Data Analysis so my question will'be very simple for an expert in this topic. Operatively, when I fit a model like this, in R : model<- lm( y ~ bs( x, df = k, degree = l ) )...
44 views

Numeric Functional Regression coefficients

I'm working on some data where I have thousands of curves in the defined as: $P(t)$ that basically represent eluition profiles of some proteins. My aim is to represent each of this $P(t)$ curves ...
212 views

How to calculate RKHS norm of a function under given kernel transformation

This was a question asked before in mathoverflow but not yet got answered. I have the same problem when reading Srinivas et al (2010) [appendix B]'s paper. Here are my problems: Definitions: ...
196 views

Illustration of functional gradient descent

I'm trying to understand boosting as gradient descent (GD) in functional space. I've followed the argument in the classic paper on the subject, but would characterize my understanding as tenuous at ...
97 views

Specifying interaction formulae in a signal regression (with mgcv)

Signal regression, or scalar-on-function regression is considered a sub-class of functional regression approaches where the response variable is a scalar and the predictors can be one or more linear ...
69 views

What statistics can be used for correlating gene expression on a specific organ with its function

My hypothesis is that a gene whose function is related to an organ will have higher gene expression in that organ compared to other organs. An example of my hypothesis: From a published literature, ...
252 views

Is this feature extraction?

I have a data set consisting of a large number of univariate time series. I have empirical reasons to expect that each time series can be well described by a function with a small number of ...
21 views

27 views

Usefulness of integral operator as generalization of a matrix? (Intuition)

In this paper by Neumaier, page 5, he says [This problem] can be posed as the problem of solving the linear system $Ax=b$ where $A$ is the integral operator defined by \begin{equation} Ax(t) := ...
94 views

Effect of image resolution on visual word features

I have trained and tested an image classifier using visual words (bagoffeature MATLAB) for a simple disease/no disease classification. However, my disease set is from a different camera (50dpi) from ...
83 views

What is the basic difference between Sieves, Series and Splines estimators?

As far as I know, Sieve Estimators consists in a broader class of estimators for a function g(x) lying in a space of functions G. The estimation basically consists in choosing the function that best ...
28 views

Scalar-on-function regression with random initial time

I was trying to answer this question Estimating the effect of different histories of exposure, on a scalar response measured at the end of a study Executive summary if you don't want to read the ...
472 views

Principal Component analysis (vector space or inner product space?)

(WARNING: This question might seem dumb) I see that the optimization problem in PCA involves the notion of inner product. For example, to solve for the loadings in second principal component, the ...
525 views

How to build a machine learning system (smart system) that updates automatically?

I've been doing machine learning. I have done lots of learning related to data analysis and ML algorithms, and I've got very good results and I understand the algorithms. However, my approaches are ...
125 views

Test for difference between time-series measurements

I have an experiment where the response to a treatment is measured over time. I now want to test for if the response profile differ between the treated group and the control group. There are ...
241 views

Orthogonal and stationary basis of projection

Consider a set of $p$ stationary correlated time signals of identical duration $T$. I would like to de-correlate them by projection on an orthogonal basis but preserving stationarity. Without the ...
361 views

Multivariate multiple non linear regression

I know there are already two questions on this topic, but neither has an answer. I have a set of $N$ experiments. For each experiment, denoted by a vector of predictors $\mathbf{x}$, I measure $m$ ...
815 views

Splines for repeated measures?

I have a dataset which has repeated measures for each subject. And the linear-mixed effect model doesn't work well for the dataset. I want to know if there is any smoothing methods (e.g. splines) that ...
22 views

Optimal policy finding with given constraint

I'm trying to solve for the optimal policy function $h^*(x)$ over the domain of all policy functions $u_t = h(x_t)$ for the following problem. \begin{equation} \min_{h(x)} \, \mathbb{E}[\sum_{t=0}^{\...
143 views

Continuous response variable with zeros (Functional Data Analysis)

I am using functional linear model for scalar response. It is that I have i.e. data frame with five columns. Every value in these columns is pressure estimation to certain time ( let's say every 0.04 ...
446 views

R: Regression between Two related Dependent Variables (not paired)

I have two dependent variables that are measured during an experiment, they both change in time (independent variable). The measurements for both variables do not always coincide in time (so they are ...
3k views

From a statistical perspective: Fourier transform vs regression with Fourier basis

I am trying to understand whether discrete Fourier transform gives the same representation of a curve as a regression using Fourier basis. For example, ...
273 views

Smooth hazard function at given knots in R

Is there a way to obtain a smooth estimate of the hazard function at specific x coordinates in R? My problem is related to functional data analysis where I have a number of hazard function estimates (...
953 views

How to select the optimal number principal components in functional principal components analysis?

I am interested in the selecting the optimal number of principal components in functional principal component analysis (FPCA). There are various techniques to do that for example AIC, BIC etc. (I am ...
100 views

Confusion about when to use least-squares regression analysis

I am going through an article titled On the misuse of regression in earth science. On page 65, the author say as follows about the least-squares method. It is usual to require that the independent ...
584 views

How to select the number of basis functions and smoothing parameter in functional data analysis?

I am confused over the selection of number of basis and smoothing parameter for particular data set in functional data analysis. I have two data sets (A) Daily temperature data set of England of 228 ...
300 views

Forecasting ranges for multiple observations with quarterly data

I have 90 markets with quarterly results, with data from 2014 Q1 to 2016 Q2. I'd like to predict 2016 Q4 results. With a time-series in R, as I understand, you need a single observation over multiple ...
328 views

How to consider different samples in functional data clustering?

In the engineering context several data sources like different kinds of measurement signals (for example distances, angles and efficiencies) are very common. If it would be possible to observe these ...
52 views

confirmation and validation of a lab environment versus real life scenario

I'm having some trouble trending turbofan jet engines exhaust gas temperatures (EGT). Data collected shown that EGT measured in the test cell versus EGT measured on-wing while flying is different. ...
343 views

Multinomial Count Models

Is it possible to model a dependent variable which is both multinomial and count? If so, how would one do so with a tool such as R? For example, suppose that my dependent variable looks like this: ...