Skip to main content

Questions tagged [chemometrics]

statistics used in chemistry.

Filter by
Sorted by
Tagged with
0 votes
1 answer
26 views

Rank the sensitivity among multiple calibration curves

Let's say that, with a measurement device, we have a linear relationship between an output measurement I (in mV) and the concentration ...
Basj's user avatar
  • 632
0 votes
0 answers
38 views

Compatibility of two atom spectra

I've measured in laboratory the wavelength of the emission lines of an unknown element. I now have these values in a set (called x) along with their relative errors. Now I need to compare my ...
yZemp's user avatar
  • 1
0 votes
0 answers
18 views

Leaving duplicated entries in a dataset at pretraining stage

I'm adopting a fine-tuning approach after having pretrained a deep learning model (transformer) on a source dataset (let's call it dataset A) and then fine-tuning it on a target dataset (B). Dataset A ...
James Arten's user avatar
0 votes
0 answers
55 views

Do I understand correctly how to perform sequential binary partition?

I’m dealing with geochemical data. Let’s say I have the results of chemical analysis of a mineral with elements: A, B, C, X, Y, Z. X, Y and Z are elements belonging to the same group (let’s say they’...
Mike Surowski's user avatar
0 votes
0 answers
15 views

Opposite facing loadings of seemingly the same features

I am performing PCA analysis of NIR spectra for the analysis of the progression of a film coating process I have noticed that one of my components goes up with the film coating process (with upwards ...
phil27's user avatar
  • 1
1 vote
0 answers
23 views

Cross correlation between time series

I have to measure the cross-correlation between different time series in my dataset. The dataset contains 9358 instances of hourly averaged responses from an array of 5 metal oxide chemical sensors, ...
kirr's user avatar
  • 11
0 votes
0 answers
11 views

How to compare results to a reference with multiple measurements

I have run a pilot test in the laboratory to see which method is best out of 5 different ones. I have reference numbers for a range of measurements to compare these against and then my results for the ...
NTemp's user avatar
  • 1
1 vote
1 answer
29 views

How to make a Ramanmetrix model accept values other than the Raman spectra for input? [closed]

I am working on a project to automatically evaluate Raman spectra from a production process. It already works for some compounds with the chemometrics software Ramanmetrix (desktop version 0.5.0). ...
mimu7's user avatar
  • 13
0 votes
0 answers
17 views

How to deal with correlation in spectral data?

Currently I'm tasked with analysing data taken with optical emission spectroscopy (OES). These measurements serve the purpose of identifying regions on the sample rich in certain chemical elements (...
YPOC's user avatar
  • 175
0 votes
1 answer
42 views

Estimating the most abundant isotopomer of an isotopic distribution

i'm trying to pre-estimate the most abundant isotopomers of isotopic distributions. as a simplified example, picture a molecule with an increasing number of carbons the natural abundance of carbon's 2 ...
Estif's user avatar
  • 35
1 vote
1 answer
840 views

Reporting post-hoc test with letters (two way anova)

i am testing soil chemistry in soil that has been samples in fields subjected grazing. So two levels ( grazing treatment and soil depth). I have used a two-way ANOVA after testing for normalisation ...
martyn's user avatar
  • 21
0 votes
1 answer
77 views

How can Mass Spectrometry have high sensitivity but average reproducibility?

I am reading up on mass spec from this link: https://www.ebi.ac.uk/training/online/courses/metabolomics-introduction/designing-a-metabolomics-study/comparison-of-nmr-and-ms/ They state: The two most ...
statHacker's user avatar
2 votes
0 answers
50 views

Comparing two independent variables (one numeric, one categorical) against one categorical independent variable? ag

Sorry if this question is a repeat. I'm new to R, and writing up a chemistry-focused meta-analysis (in collaboration with a statistician, but they're on holiday until November). I have three variables ...
Snippens's user avatar
1 vote
1 answer
137 views

Reconstruct IR Spectra Based on PLS Model

I am currently using the scikit-learn package in python to setup PLS models (sklearn.cross_decomposition.PLSRegression) to predict the concentration of different substances based on IR spectra. In ...
PotatoOwl's user avatar
1 vote
0 answers
15 views

Is it valid to change the classification criteria of a model after it's been created?

(Please note, I'm a chemist with some minor experience with ML, nothing formal) I am reading this paper that is using a DNN to predict (via classification) if a certain molecule has a good score when ...
DK_chemistry's user avatar
0 votes
1 answer
685 views

Difference between the terms "Frequency" and "Abundance"

How does Abundance or Relative abundance (Chemistry) differs from statistical frequency? Or it is just another term for statistical frequency in context of chemistry? Update: here are some example ...
user avatar
1 vote
1 answer
53 views

What is the distribution of the pKa from the Henderson-Hasselbalch equation given log-normal concentrations?

Background The Henderson-Hasselbalch equation is given by $$\text{pH} = \text{pK}_{\text{a}} + \log_{10} \left( \frac{[\text{Base}]}{[\text{Acid}]} \right)$$ where $\text{pH} = -\log [\text{H}^+]$. ...
Galen's user avatar
  • 9,361
1 vote
0 answers
26 views

Question about confidence interval and standard errors on graphs

So I made a graph in R, it’s a linear regression of the same sample at different concentrations. It has a confidence interval built into it of 95%. Then I had to determine the concentration of an ...
Daniel's user avatar
  • 11
0 votes
0 answers
14 views

How can I use the trend of a graph to plot the next point?

I created a hypothesis for a chemistry assignment and then conducted an experiment. The experiment resulted in a graph that had a downward trajectory. It looked like this: I found the data points by ...
user avatar
2 votes
1 answer
440 views

Graph Classification via Random Forest

This is my first post here, just a brief presentation: my name is Gianmarco, I’m Medicinal Chemistry undergraduate student who is preparing his dissertation, my idea would be to create a classifier ...
Gianmarco Luchetti 's user avatar
1 vote
0 answers
65 views

Using compositional data analysis to represent chemical compounds

I've recently got some insights about compositional data analysis, wondering whether it could be suitable for the framework I'm currently in. Recently, I've been very interested in trying to find some ...
James Arten's user avatar
1 vote
0 answers
51 views

Fitting sums of Gaussian-like density functions

I acknowledge that similar question has been asked a couple years ago, yet it still seems unresolved. Ignoring the domain knowledge, the statistical problem behind is to fit a non-linear regression ...
drosophilaxx's user avatar
2 votes
1 answer
70 views

Unlabelled spectral data: use PCA to find distint spectra

I have many (Raman) spectra which are unlabelled. I would like to use PCA to distinguish them, i.e. say all these spectra are of type A, these other spectra are of type B... etc... Does this make ...
randomwalker's user avatar
5 votes
1 answer
376 views

Should I use the prediction interval or inverse prediction interval to calculate the uncertainty of $x$ when using reverse regression?

I'm calibrating a piece of lab instrumentation. I create solutions of known concentration ($x$) and measure my instrument response ($y$). On unknown samples, I measure the response and use the ...
Kevin Nowaczyk's user avatar
0 votes
1 answer
414 views

How to choose priors for experimental data

My question results from the subjectivity of priors, and if there are bodies of work that help to create a more objective approach towards prior choices. My question specifically is to do in the realm ...
etcetera's user avatar
1 vote
0 answers
43 views

How to test if a river affect another?

I have two rivers, two monitoring stations placed in each river, and two datasets. One river is a tributary of the other. The datasets are complete, pH, metals, field parameters (flow, temperature, ...
Alvaro Morales's user avatar
0 votes
0 answers
25 views

Model Architectures for functional graph or data series type data regression problems using PyTorch, FastAi or TensorFlow

For a university assignment, I am currently trying to build an optical sensor to supervise chemical reactions in pipes. Two sensors are installed in the pipe, around 1mm apart from each other, and ...
passwortknacker's user avatar
3 votes
1 answer
218 views

Multiple Linear Regression with more variables than samples

I'm currently learning chemometrics for my work and I have a simple question about Multiple Linear Regression (MLR). Just to explain the context: I am simply using UV-Vis-NIR spectra (2500 wavelengths)...
Snedron's user avatar
  • 31
1 vote
1 answer
100 views

Factors given by DoE can experimentally not be reached

We are running a DoE in a CCD manner at the moment. One factor is quite difficult to reach and to reproduce: Humidity because it has to be set by chemical reactions. To be more concise: The factor 56 %...
Ben's user avatar
  • 3,503
7 votes
1 answer
267 views

Determining whether new data is "in distribution" with training data

I'm hoping to use machine learning to predict chemical properties of various molecules. Many chemistry machine learning research papers that I come across talk about model generalizability issues ...
Ryan Zotti's user avatar
  • 6,707
2 votes
1 answer
179 views

How to determine statistical significance of one independent variable by two dependent variables?

(I originally asked a syntax question on stackoverflow here, but in addition to an answer I was told my statistics method itself wasn't great - so now I'm here!) Without getting too into it, we did ...
Mulligan's user avatar
3 votes
0 answers
28 views

How do I record randomly assigned data succinctly in a table

Please forgive me if I am posting this in the wrong forum. Here is the context of my question: I am conducting a drug trial, of sorts. I have 7-8 potential candidates for the treatment. Between ...
Rushi's user avatar
  • 151
0 votes
1 answer
25 views

FTIR quantitative methods to analyse / quantify changes in chemical bonds using R / Matlab

What quantitative method could I use to detect whether the radiation of sample significantly affect the chemical bond? Spectra is measured for radiated and non radiated chemical bonds and within ...
user's user avatar
  • 229
3 votes
1 answer
5k views

Clustering data based on correlation

I have a dataset where each row represents a sample and each sample is described by its chemical composition. You can see the 10 first rows of the dataset in figure 1. Figure 1 - Each row represent a ...
bjornsing's user avatar
  • 209
1 vote
0 answers
29 views

Chemical Analyses

We have two groups of chemical sample results reporting the concentration of a dissolved substance. If I want to compare the two groups I can just carry out a simple t-test. This will say whether ...
Buster's user avatar
  • 11
0 votes
0 answers
46 views

How to calculate risk ratio for chemical substances

Simple example: Three different chemical substances are given to patients (each to 5 patients). Some patients die, some not. Samples (number of patients) are not equal. How to calculate the rate of ...
Ladislav Naďo's user avatar
1 vote
1 answer
57 views

Suggestion for a statistical test

I hope this is the right forum for chemometrics related questions well. Imagine that we have a list of tabulated molecular properties for 40 different molecules such as A) dipole moments B) water ...
ACR's user avatar
  • 143
2 votes
0 answers
438 views

Interpolation versus imputation for time series on chemical profiles of water wells

So I am working with some data on water wells and time series of chemical pollutant tests on those wells. There are 10 chemicals and 10 years in the data. My goal is to do some clustering on the wells ...
krishnab's user avatar
  • 1,522
2 votes
1 answer
111 views

Function to fit acid reaction curve

Data in the image below shows a variable DME reacting to the increase in acid concentration. It looks like it has a very fast increase from when the concentration is raised from 0 to 0.5 and then a ...
Deathkill14's user avatar
  • 2,210
0 votes
0 answers
48 views

Which statistical test should I use, t-test or another one?

I want to compare two samples. Each of them was dried by two different methods, and I studied their physicochemical characteristics (pH, titratable acidity, total sugars, etc.) to see the influence of ...
fati shaun's user avatar
2 votes
1 answer
427 views

Is this an example of where I shouldn't scale before doing PCA / PLS?

I'm working with NMR spectra (it's a common chemical test). There are various peaks of the signal across a range of ppm values. I'm trying to relate the NMR spectra of various samples to a ...
Arthur's user avatar
  • 566
3 votes
0 answers
32 views

How to estimate the uncertainty of a function that has to be solved numerically

Consider I have a function: $PV_m^3 - PbV_m^2 +aV_m+ab=RT$ In this example I have measured the uncertainties in $P$ and $T$ experimentally and the errors in $a$ and $b$ can be assumed to be zero. ...
tionichm's user avatar
3 votes
0 answers
20 views

can the parameters of this nonlinear equation be reliably estimated using a limited set of experimental data?

A chemical system at equilibrium is described by this equation: $$ D_{tot} = D + D \cdot \frac {P \cdot X}{D+K_P} + D \cdot \frac {E}{D+K_E} $$ The only parameters that the experimenter can control (...
user6376297's user avatar
2 votes
0 answers
60 views

Adjacency matrix of amino-acid residue [closed]

How to get the mathematical representation of the chemical bonds in protein residue or the whole protein? Is it possible to get the connectivity matrix or a pairwise description? The example in the ...
Pol Bel's user avatar
  • 21
7 votes
2 answers
1k views

Exclude observations with measurements below limit of detection?

I am analysing a dataset for the relationship between an exposure variable x and a response y (in my case, these are urinary ...
Gux's user avatar
  • 355
1 vote
1 answer
54 views

Reporting model uncertinty

I hope I'm using the right terms here. I've generated a statistical model (PLS regression) based on LWIR (8-10.5 micrometer) spectrum from some lab samples. This model predicts the concentration of a ...
user88484's user avatar
  • 227
1 vote
0 answers
25 views

Can one use parametric regression tests (e.g., Pearson's R2) on summary statistics (that are normal) derived from non-normal data?

Can one use parametric linear regression tests (e.g., Pearson's R2) on summary statistics (e.g., mean and median) that are normal but derived from non-normal data? I am specifically dealing with mean ...
Sid Roy's user avatar
  • 11
0 votes
1 answer
3k views

Build a statistical model based on small sample size

I hope my question is not too wide and that this is the right place to ask it. I'm working in the field of spectroscopy and chemometrics. I'm building a statistical model to predict pollution levels ...
user88484's user avatar
  • 227
4 votes
2 answers
702 views

Intersections of chemistry and statistics

I am asking this question for a friend who knows a lot of chemistry and is now studying statistics, primarily since he heard this is the age of data and one should know statistics. However, he is ...
1 vote
1 answer
76 views

Matching of graph peaks over time

I am a programmer but my data analyses/statics skills are non-existent. I am a quick learner though and no problem I have set to solve has yet to become unattainable (let's hope this is not the first ...
Afonso's user avatar
  • 11