Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [corpus-linguistics]

The tag has no usage guidance.

0
votes
1answer
16 views

How to test normalized frequencies

I have extracted the frequency of two words (can, may) from two corpora (Corpus1, Corpus2). I want to test if there is a significant difference between the counts in the two corpora, but since the ...
1
vote
0answers
21 views

How to compare multiple collocations based on their Chi2 score? How to find synonyms using collocation analysis

my question is regarding collocation analysis (i'm using R). I have following data gathered from Polish corpus: ...
1
vote
0answers
58 views

TF-IDF on a sub-corpus

I'm analyzing newspaper articles, some are 2 or 3 pages long, some a few lines long. My Corpus is made of a few thousands of dated articles spanning over a few ...
1
vote
0answers
47 views

Multiple comparisons problem in corpus linguistics

A collocation is an expression consisting of two (or more) words that correspond to some conventional way of saying things, for example strong - tea or new - car. We really want to know whether two ...
0
votes
0answers
20 views

BERT Classification fine tuning for Q & A

I want to fine-tune BERT for Q & A in a different way than the SQuAD mission: I have pairs of (question, answer) Part of them are the correct answer (Label - 1) Part of them are the incorrect ...
0
votes
0answers
11 views

What are ways to build topic topic models on a corpus with high variance in text length

As the title states, I'm currently working with a corpus that has a high variance in the document length. Each input could be anything from the size of a tweet to a a full page worth of text. I'm ...
0
votes
0answers
9 views

Substitution model for maximum likelihood in linguistic phylogenetics?

When using maximum likelihood to estimate a phylogenetic tree on the basis of linguistic data, is there a standard substitution model that one should use?