Search Results
| Search type | Search syntax |
|---|---|
| Tags | [tag] |
| Exact | "words here" |
| Author |
user:1234 user:me (yours) |
| Score |
score:3 (3+) score:0 (none) |
| Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
| Views | views:250 |
| Code | code:"if (foo != bar)" |
| Sections |
title:apples body:"apples oranges" |
| URL | url:"*.example.com" |
| Saves | in:saves |
| Status |
closed:yes duplicate:no migrated:no wiki:no |
| Types |
is:question is:answer |
| Exclude |
-[tag] -apples |
| For more details on advanced search visit our help page | |
Results tagged with natural-language
Search options not deleted
user 410763
Natural Language Processing is a set of techniques from linguistics, artificial intelligence, machine learning and statistics that aim at processing and understanding human languages.
3
votes
Accepted
Is concatenating a single integer sufficient for encoding positional embeddings in transform...
Good question.
One problem with your proposed method of encoding is that, for lengthy sequences, your positional encoding integer can end up being quite large, out-scaling the other dimensions.
This a …
- 156
5
votes
Intuitive explanation for summing the embedding and positional encoding in the Transformer's...
I've broken my head over this question for a long time.
Here's the best answer I came across, from redit.
TL;DR: It is intuitively possible that, in high dimensions, the word vectors form a smaller d …
- 156