The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [machine-translation]

Machine translation (MT) is a sub-field of computational linguistics that investigates the use of software to translate text or speech from one language to another.

Filter by
Sorted by
Tagged with
1
vote
0answers
8 views

What is currently the best way to add a custom dictionary to a neural machine translator that uses the transformer architecture?

It's common to add a custom dictionary to a machine translator to ensure that terminology from a specific domain is correctly translated. For example, the term server should be translated differently ...
0
votes
1answer
68 views

Multi-Head attention mechanism in transformer and need of feed forward neural network

After reading the paper, "Attention is all you need," I have two questions. 1) What is the need of multi-head attention mechanism? Paper says that "Multi-head attention allows the model to jointly ...
2
votes
0answers
16 views

From a deep learning point of view, is there a lower limit on the number of hours of speech needed to train a neural net

From a deep learning practitioner's point of view, is there a lower limit on the number of hours of speech needed to train a neural net to translate speech to text? An estimate from CMU is 3000-5000 ...
0
votes
1answer
58 views

How does SGD come in the picture for Sequence to Sequence models?

I was learning that seq2seq models (from the deeplearning.ai course) try to maximize: $$ \max_{y} P_{\theta}(y_1 \dots y_{T'} \mid x_1 \dots x_T ) $$ I learned that one way they do it is via beam ...
1
vote
1answer
96 views

What is the intuition behind the positional cosine encoding in the transformer network?

I don't understand how adding the cosine encodings/functions to each of the dimension of the word vector embedding enables the network to "understand" where each word is situated in the sentence. ...
0
votes
0answers
9 views

Is it okay to compare Test BLEU score between NMT models while using a slightly modified standard test sets?

I am using tst2013.en found here, as my test sets to get the Test BLEU score to compare to other previous models. However, I have to filter out some sentences that ...
0
votes
0answers
20 views

How to properly use BLEU score to compare your model to existing models?

So I am using the BLEU score metric to evaluate and compare my neural machine translation model's performance with existing models. However, I'm wondering how many criteria do I have to match with the ...
0
votes
0answers
21 views

What kind of errors could be responsible for low loss but disastrous BLEU in neural machine translation?

Please notice: I originally asked this question in Stackoverflow but I have been asked to move it here. I'm working on a custom neural machine translation model with the Fairseq framework (PyTorch), ...
1
vote
0answers
194 views

Is Length Normalization used in each step of Beam Search?

In Andrew Ng's lesson on refining Beam Search, it seems that Length Normalization is used ONLY AFTER LAST STEP of Beam Search, that is, when the B most probable sequences have been generated. My ...
0
votes
1answer
81 views

Adapt speech recognition for Shakespeare english

We need to be able to search the works of Shakespeare by voice. The way I see it, the goal is if I quote into the microphone: "Yet but three come one more. Two of both kinds make up four. Ere ...
6
votes
1answer
10k views

What are “residual connections” in RNNs?

In Google's paper Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation, it is stated Our LSTM RNNs have $8$ layers, with residual connections between ...
0
votes
1answer
613 views

Word representation in sequence-to-sequence learning with LSTM

I understand that in case of seq2seq learning for machine translation or question-answer systems one must encode words of sentences. Most approaches do this via word2vec representation where each word ...
1
vote
1answer
58 views

Highest value of machine translation metrics

Does anyone knows the highest and lowest values of the common machine translation metrics $BLEU_{1-4}$, $METEOR$, $ROUGE_{L}$, and $CIDEr$ and $CIDEr-D$? I know that for BLEU is 1, correct? Does the ...
1
vote
1answer
2k views

Why use the cosine distance for machine translation (Mikolov paper)?

I am currently reading the paper "Exploiting Similarities among Languages for Machine Translation" by Mikolov et al. (available here : https://static.googleusercontent.com/media/research.google.com/en/...
2
votes
1answer
35 views

In phrase-based machine translators, how does the program recognize phrases in the corpus text?

I know that a phrase-based statistical machine translator finds the probability of a correct translation by analyzing a bilingual corpus text, and it maps phrases from the one language to phrases in ...
2
votes
0answers
52 views

Was BaiduTrans the first scalable deployment of Neural Machine Translation?

I read these two tweets written on 2016-12-15 by Andrew Ng: Strong desire for global content made China 1st to develop Neural Machine Translation. US lucky to have so much english content […] ...
1
vote
1answer
705 views

NLTK: odd outputs from bleu_score

For machine translation purposes I use bleu score, which seems to be the validation mechanism of choice (used in the sutskever 2014 sequence-to-sequence). The purpose is to get as high bleu as ...
3
votes
0answers
201 views

Hessian-Free instead of LSTM for Recurrent Net Machine Translation

Last year, Ilya Sutskever and collaborators came out with a paper about a recurrent LSTM net that learns sequence to sequence mappings for machine translation. It's somewhat surprising that the ...