Skip to main content

Questions tagged [database]

A comprehensive collection of related data organized for convenient access, generally associated with software to update and query the data.

Filter by
Sorted by
Tagged with
0 votes
0 answers
15 views

How to specify a logistic regression with treatment happening in different times per user?

I have a dataset with a time span from 2017 to 2021. The observations contain reviews from a certain platform. I want to test the effects of Elite status changes (so from elite to non-elite and non-...
user avatar
1 vote
1 answer
174 views

differential-privacy: show $\epsilon$ -differentially privacy

In this problem we consider a sensitive dataset $x \in \{−1, 1\}^n$. We consider the bounded setting where neighboring n-dimensional datasets differ in one coordinate. $A$ mechanism is available that ...
Lifeni's user avatar
  • 305
0 votes
0 answers
23 views

Equation for all frequent itemsets

Consider that the database has only three transactions {<a1,a2,...,a100>, <a1,a2,...,a50>, <a1,2,...,a25>}. Suppose min_sup = 2. Give the equation for all frequent itemsets. Also ...
Invisible's user avatar
0 votes
1 answer
30 views

Combining location based probabilities from GPS data

I'm working with GPS data and have billions of GPS points stored in a DB. I'd like to be able to use this to create a class likelihood function that I can use somewhere else as as a visualisation or ...
RedM's user avatar
  • 111
0 votes
0 answers
22 views

Search strategy clarification for a systematic scoping review on existing statistical gene-based prediction methods

In a systematic scoping review, I use the following databases: MEDLINE, Embase, Scopus and Web of Science. In MEDLINE and Embase, I use MeSH terms only to exclude animal and plant studies, but not ...
Dovini Jayasinghe's user avatar
1 vote
0 answers
31 views

What is the best way to measure the relationship between a baseball player's performance and salary (using statistics)?

Good afternoon, In an effort to learn more about statistics and SQL programming and possibly start building a project portfolio for myself, I've taken it upon myself to investigate a particular ...
Froman's user avatar
  • 11
1 vote
0 answers
15 views

Rerunning requests in meta-analysis

When performing a meta-analysis, is it advisable to run database requests more than once (i.e. not only in the initial inclusion phase)? If so, what is the expected added value? If not, how to deal ...
user47679's user avatar
1 vote
2 answers
230 views

Mann-Whitney U test on "histogram-compressed" data?

I want to perform a very large number of Mann-Whitney U-tests between many groups from data that I will get in from a database. I would prefer to use a pre-implemented version of this test. I think ...
a_chemist's user avatar
1 vote
0 answers
55 views

Database for Macroeconomic Time-series [closed]

I have decided to improve my well-being and in case being successful write a note about this and share it with my peers for free and try to help them improve there well-being as well. But on this road,...
G.T.'s user avatar
  • 146
1 vote
0 answers
41 views

Game move win percentage

I have two simple file databases. One with the opening game move and if they won or not, and the other one which essentially should just reduce the other database into percentages. e.g. ...
Edwin Carlsson's user avatar
1 vote
1 answer
56 views

How do I transform my data so that my regressions produce meaningful coefficients?

Hi I am a novice in doing regressions and programming in R in general. In my free time, I have started with a project of analyzing the impact of COVID pandemic on US counties. I have a data frame that ...
Otakar Kořínek's user avatar
0 votes
2 answers
41 views

Ranking theory for rainfall station

I have 10 rainfall stations. Each station has a rain day, no-rain day, and NA value, all in percentages. How can I rank these stations based on the condition that the best station is station that ...
ani jaya's user avatar
1 vote
1 answer
123 views

Newbie Data Analyst Questions [closed]

I have recently applied to a Job by a startup that wants to higher a data analyst. I have been going through the rounds and it seems like they want to hire me for the position. I have recently ...
Nick's user avatar
  • 123
2 votes
0 answers
19 views

Probability: Estimating Database Size with N Smallest Random Values

Note: This was first posted on StackOverflow, but I did not have much luck there. I have a very large database. Each item in the database is assigned a uniformly distributed random value $\geq 0$ and ...
speedplane's user avatar
1 vote
1 answer
47 views

How to perform specific queries in weather data time series [closed]

I have time series data from several weather stations located in a specific area. The readings include a timestamp, the humidity and the temperature. The resolution of the data is quite high, about 6 ...
jorgeb's user avatar
  • 11
3 votes
0 answers
92 views

Which duration model to use with a fully right censored database

Currently I'm examining the duration of residence of households. I have a database at my disposal that indicates how long a specific household resides in its current home. I want to explain their ...
EQuaker's user avatar
  • 31
1 vote
0 answers
315 views

Are sqlite databases more efficient (in terms of RAM usage) than the dplyr library in R?

I have to perform a left join on two large datasets. My understanding of dplyr is that it duplicates (temporarily) the two datasets in memory (or something similar which generates a large temporary ...
mickkk's user avatar
  • 949
2 votes
1 answer
139 views

Why does "sticky noise" defy averaging attack?

I have read an interesting paper (pdf) describing how a privacy preserving technique might be breached, but I am having trouble understanding the following paragraph describing one of several layers ...
Omry Atia's user avatar
  • 605
1 vote
1 answer
99 views

An open database for propensity score matching [closed]

I need an open biological or medical database for benchmarking methods for propensity score matching. Where can I find some?
Viktor's user avatar
  • 1,025
0 votes
1 answer
177 views

Recommend a DB to process large data from MySQL [closed]

Basically, right now I'm working with data that has reached 1+ TB on MySQL and I need to run a statistical algorithm on it in the future. I also need to process the data as well. What I'm hoping to ...
Skys_'s user avatar
  • 41
1 vote
1 answer
35 views

Salinity affecting Plant Growth

I conducted an experiment where I treated 9 bean seeds to different levels of salinity (ranging from 0g to 4g of salt) when watering them, in order to determine whether if salinity affected seed ...
user avatar
1 vote
1 answer
95 views

What is the best way to prepare a database export to a statistician for statistical analysis?

I work in Rome for the Italian National Health Service (www.iss.it); I am currently working on a European clinic project called EMTICS (www.emtics.eu), I developed both the database and the website to ...
mtallon's user avatar
  • 11
3 votes
2 answers
3k views

Statistical analysis of relational database: is it possible and how?

I have been struggling with flat file databases and corresponding statistical packages for almost 20 years now (from Excel to SPSS, then Stata, and currently R). However, I have always had to convert ...
Giuseppe Biondi-Zoccai's user avatar
0 votes
0 answers
45 views

Database and Data Waehouse design and processing in Big Data

With the growing popularity of Big Data and related tools, I am looking for books that specifically deal with implementing a warehouse in one of Big Data technologies, database and data-warehouse ...
SpeedBirdNine's user avatar
4 votes
2 answers
3k views

What is the purpose of using a Laplacian distribution in adding noise for Differential Privacy?

I am reading up on Differential Privacy and it is mentioned that the technique relies on adding some controlled noise to the release of responses to queries towards a statistical database. This is ...
Pieru Poika's user avatar
0 votes
1 answer
359 views

How could i use r to add data to a table? [closed]

I am looking for an approach. We have a historical table with the consumption per week of a list of items (19.000 item). We want to predict the consumption for the next n weeks. We are thinking on ...
David's user avatar
  • 3
5 votes
2 answers
960 views

How to make an effective sampling from a database of text documents?

Problem: I want to know methods to perform an effective sampling from a database. The size of the database is about 250K text documents and in this case each text ...
Kevin Bello's user avatar
1 vote
1 answer
9k views

What is the difference (if any) between 'harmonized' and 'standardized data? [closed]

I am trying to describe the process of combining multiple datasets into a common format - e.g. a single database that enforces a common vocabulary, scale, and structure. However, I am unclear if I ...
David LeBauer's user avatar
1 vote
1 answer
302 views

Recommendation about what statistical test to use? Impact of regulatory change

I have a problem in determining the right statistical test for my research. First I will give some background information. I want to research the impact of IFRS (regulatory change) on audit fees (fees ...
Redmar's user avatar
  • 11
0 votes
1 answer
1k views

How to apply an R prediction model to very big data from SQL database in parallel.

I dont need to load the entire dataset into memory. In fact I only need 1 row at a time to apply a trained model, get the predicted response and put that response somewhere, possibly back into another ...
Gene Ekster's user avatar
-3 votes
1 answer
52 views

I am wondering what model to use [closed]

I am trying to do an analysis of popularity growth, in particular of the rate of growth in play count for artists on an online music streaming service. I want to create a postgresql db filled with ...
infinityfarm's user avatar
1 vote
1 answer
170 views

I would like to analyze the data using R and Python. How to handle 10 millions records of data? [closed]

I would like to analyze the data using R and Python, and I am unable to open text file due to huge number of records. Is there any free database software to install in PC and load the data into it and ...
StatsUser's user avatar
  • 1,819
0 votes
0 answers
18 views

Mathematics of simple performance testing [duplicate]

I have a set of sorted tables T that have known but different dimensions. There are two types of functions in this system: f(T) g(T, n), where n is an integer parameter. ... and two types of costs ...
Some Newbie's user avatar
3 votes
1 answer
64 views

Is Outlier detection in two separate databases is equal to one combined database?

Suppose that we have two databases : Database_1 and Database_2 . Database_1 has 300 samples ...
user2991243's user avatar
  • 4,251
1 vote
1 answer
34 views

What is a nonreductive database?

A database like Genbank is said to be a nonreductive database. What does that mean ?
lalal's user avatar
  • 11
0 votes
2 answers
736 views

Any suggestions for storing diverse data sets for on-line visualization?

We are trying to design a data repository for storing datasets, from many different sources, in such a way that they can easily be used in online data presentations. This data repository will be part ...
R. Schreurs's user avatar
0 votes
1 answer
120 views

Freeware similar to MS Access for SQL-less data mining, querying and reporting [closed]

I am looking for freeware similar to MS Access for data mining, querying and reporting without really writing SQL (which I know very well but sometimes I feel lazy and would rather just drag and drop)....
amphibient's user avatar
0 votes
1 answer
41 views

Dealing with a variable amount of entries for a given attribute

I want to analyze a .csv file with the results of a customer survey. One of the questions is: "Tell us the top 3 reasons you chose us.". The answers are short paragraphs of text listing a ranging ...
jessems's user avatar
  • 103
1 vote
1 answer
576 views

Statistical package that works with sql database [closed]

At my firm we have been calculating fundamental stock factors each week for over a decade. We have the performance of each of these factors. I'd like to enhance the statistical analysis of these ...
Jeffrey moeller's user avatar
3 votes
0 answers
997 views

A non-technical visualization of my database (a layman's ER Diagram?) [closed]

I would like to provide an intuitive visualization of my database for readers and users of the database that does not require technical knowledge of database structure. The figure will be included in ...
Abe's user avatar
  • 3,831
3 votes
2 answers
645 views

Organizing cluster analysis results in a database

I'm a newbie in cluster analysis so please excuse me if my question seems to be very basic. I'm using SPSS and Matlab for performing cluster analysis in a variety of datasets. Dendograms are great for ...
Diego's user avatar
  • 415
5 votes
3 answers
3k views

Suggestions on how to merge multiple datasets with an imperfect ID across databases?

I have four databases of books that I have assembled from various sources, websites, etc. I would like to merge the databases, but I face a significant merging issue in that there is no "perfect" ...
user12798's user avatar
6 votes
2 answers
367 views

Public databases of learned HMM models for NLP

I understand that HMM models model language with Parts of Speech (POS) as hidden states and words as observations. These HMM models are usually learned from large text corpora, and many of these ...
highBandWidth's user avatar
18 votes
2 answers
14k views

Quality assurance and quality control (QA/QC) guidelines for a database

Background I am overseeing the input of data from primary literature into a database. The data entry process is error prone, particularly because users must interpret experimental design, extract ...
David LeBauer's user avatar