Questions tagged [machine-translation]

Machine translation (MT) is a sub-field of computational linguistics that investigates the use of software to translate text or speech from one language to another.

14 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
22 views

From a deep learning point of view, is there a lower limit on the number of hours of speech needed to train a neural net

From a deep learning practitioner's point of view, is there a lower limit on the number of hours of speech needed to train a neural net to translate speech to text? An estimate from CMU is 3000-5000 ...
3
votes
0answers
204 views

Hessian-Free instead of LSTM for Recurrent Net Machine Translation

Last year, Ilya Sutskever and collaborators came out with a paper about a recurrent LSTM net that learns sequence to sequence mappings for machine translation. It's somewhat surprising that the ...
2
votes
1answer
38 views

In phrase-based machine translators, how does the program recognize phrases in the corpus text?

I know that a phrase-based statistical machine translator finds the probability of a correct translation by analyzing a bilingual corpus text, and it maps phrases from the one language to phrases in ...
2
votes
0answers
56 views

Was BaiduTrans the first scalable deployment of Neural Machine Translation?

I read these two tweets written on 2016-12-15 by Andrew Ng: Strong desire for global content made China 1st to develop Neural Machine Translation. US lucky to have so much english content […] @...
1
vote
1answer
19 views

How does recall help precision overcome “length-related problems?”

I'm reading the paper on the Bilingual Evaluation Understudy (BLEU) metric BLEU: A Method for Automatic Evaluation of Machine Translation (Papineni et al., 2002) and had a question regarding a quote ...
1
vote
0answers
17 views

What is currently the best way to add a custom dictionary to a neural machine translator that uses the transformer architecture?

It's common to add a custom dictionary to a machine translator to ensure that terminology from a specific domain is correctly translated. For example, the term server should be translated differently ...
1
vote
0answers
371 views

Is Length Normalization used in each step of Beam Search?

In Andrew Ng's lesson on refining Beam Search, it seems that Length Normalization is used ONLY AFTER LAST STEP of Beam Search, that is, when the B most probable sequences have been generated. My ...
1
vote
0answers
58 views

How should I choose the Encoder hyperparameters to make its memory state suitable for the Decoder in a Bidirectional Neural Network?

I'm trying to implement Neural Machine Translation following the tutorial on the Tensorflow website here https://www.tensorflow.org/versions/r1.8/tutorials/seq2seq and I was able to build a ...
0
votes
1answer
16 views

Neural Text Simplification with no appropriate dataset

I'm currently starting a research project focused on NLP. One of the steps involved in this project will be the development of a text simplification system, probably using a neural encoder-decoder ...
0
votes
0answers
23 views

Training data preparation for NMT models

I'm building a NMT model and I have some questions about the preparation of training pairs. Background: I have a list of sentences that have similar semantic meanings and I would like to make pairs ...
0
votes
0answers
44 views

Training and testing transformer model from scratch

As you know, transformers are one of the strongest model in the field of NLP and machine translation. I know there are many resources, but I still could not find a good tutorial teaching how to use ...
0
votes
1answer
22 views

What metric should I use for evaluating a reading order of text tokens given the correct ordering?

Given an ordering of tokens extracted from a document with a ground truth ordering available. What would be the correct way to evaluate the ordering? I took a look at some Machine Translation ...
0
votes
0answers
29 views

Sequence to Sequence model not training

I am working on a sequence to sequence chatbot model based on the Tensorflow NMT tutorial for a project. I have a database of about 15 million replies and around 3 million individual words. It is an ...
0
votes
0answers
81 views

Machine translation dataset is actually not parallel

I'm currently working on implementing the Transformer model for machine translation. I'm taking a look at the data that was used in the actual paper and also used by many other implementations ...