Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-translation]

Machine translation (MT) is a sub-field of computational linguistics that investigates the use of software to translate text or speech from one language to another.

0
votes
1answer
33 views

What will go wrong if we apply linear or other types of regression to translate sentences between two languages? [closed]

DISCLAIMER: I also asked this at- https://datascience.stackexchange.com/questions/52056/what-will-go-wrong-if-we-apply-linear-or-other-types-of-regression-to-translate, as I didn't get any response ...
0
votes
0answers
9 views

Is it okay to compare Test BLEU score between NMT models while using a slightly modified standard test sets?

I am using tst2013.en found here, as my test sets to get the Test BLEU score to compare to other previous models. However, I have to filter out some sentences that ...
0
votes
0answers
15 views

How to properly use BLEU score to compare your model to existing models?

So I am using the BLEU score metric to evaluate and compare my neural machine translation model's performance with existing models. However, I'm wondering how many criteria do I have to match with the ...
0
votes
0answers
13 views

What kind of errors could be responsible for low loss but disastrous BLEU in neural machine translation?

Please notice: I originally asked this question in Stackoverflow but I have been asked to move it here. I'm working on a custom neural machine translation model with the Fairseq framework (PyTorch), ...
0
votes
0answers
24 views

What validation is necessary for Conditional Random Forests?

I am using conditional random forests to rank the importance the variables in a model. For these, OOB ROC cannot be calculated (If I understand correctly). So, how may I test the validity of the model ...
0
votes
0answers
28 views

Which length is used to compute brevity penalty when there are multiple reference sequences?

In calculating combined Bleu score, we use a Brevity Penalty parameter which is dependent on Lengths of Reference sequence and Machine Output sequence. In a case where there are multiple reference ...
0
votes
0answers
147 views

Is Length Normalization used in each step of Beam Search?

In Andrew Ng's lesson on refining Beam Search, it seems that Length Normalization is used ONLY AFTER LAST STEP of Beam Search, that is, when the B most probable sequences have been generated. My ...
0
votes
0answers
50 views

I would like to represent the day-of-the-week, day-of-the-month, month-of-year as features to an RNN

I am new to ML, and I have just been reading about RNNs I am creating a simple RNN network to predict foot traffic at a store. For implementing the same I will be providing historical traffic at ...
0
votes
1answer
63 views

Adapt speech recognition for Shakespeare english

We need to be able to search the works of Shakespeare by voice. The way I see it, the goal is if I quote into the microphone: "Yet but three come one more. Two of both kinds make up four. Ere ...
4
votes
1answer
7k views

What are “residual connections” in RNNs?

In Google's paper Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation, it is stated Our LSTM RNNs have $8$ layers, with residual connections between ...
0
votes
1answer
595 views

Word representation in sequence-to-sequence learning with LSTM

I understand that in case of seq2seq learning for machine translation or question-answer systems one must encode words of sentences. Most approaches do this via word2vec representation where each word ...
1
vote
1answer
56 views

Highest value of machine translation metrics

Does anyone knows the highest and lowest values of the common machine translation metrics $BLEU_{1-4}$, $METEOR$, $ROUGE_{L}$, and $CIDEr$ and $CIDEr-D$? I know that for BLEU is 1, correct? Does the ...
1
vote
1answer
2k views

Why use the cosine distance for machine translation (Mikolov paper)?

I am currently reading the paper "Exploiting Similarities among Languages for Machine Translation" by Mikolov et al. (available here : https://static.googleusercontent.com/media/research.google.com/en/...
2
votes
1answer
34 views

In phrase-based machine translators, how does the program recognize phrases in the corpus text?

I know that a phrase-based statistical machine translator finds the probability of a correct translation by analyzing a bilingual corpus text, and it maps phrases from the one language to phrases in ...
2
votes
0answers
49 views

Was BaiduTrans the first scalable deployment of Neural Machine Translation?

I read these two tweets written on 2016-12-15 by Andrew Ng: Strong desire for global content made China 1st to develop Neural Machine Translation. US lucky to have so much english content […] ...
0
votes
1answer
658 views

NLTK: odd outputs from bleu_score

For machine translation purposes I use bleu score, which seems to be the validation mechanism of choice (used in the sutskever 2014 sequence-to-sequence). The purpose is to get as high bleu as ...
3
votes
0answers
201 views

Hessian-Free instead of LSTM for Recurrent Net Machine Translation

Last year, Ilya Sutskever and collaborators came out with a paper about a recurrent LSTM net that learns sequence to sequence mappings for machine translation. It's somewhat surprising that the ...