introductionmost, successful, approaches, translation, rely, availability, parallel, corpus, set, sentence, rst, source, language, target, supervised, neural, employs, encoder, decoder, architecture, produces, representation, fed, generate, cross, entropy, loss, usually, used, training, objective, beam, search, algorithm, inference, models, state, art, performance, require, amount, statistical, parading, based, phrase, learned, methods, currently, replaced, counterparts, resource, perform, settings, ranges, extremely, zero, motivation, unsupervised, aims, translate, usage, corpora, learning, level, embedding, spaces, aligning, vector, values, mapping, applied, align, possible, properties, lastly, rening, using, network, improve, systems, however, current, despite, achieving, promising, results, novel, task, writing, published, propose, solution, author, thesis, research, activities, pointed, discussing, scope, suitable, necessary, future, smaller, data, achieve, reasonable, information, motivated, assumption, working, benet, basic, units, represented, thus, view, introduces, specic, requirements, analogy, embed, established, converting, xed, input, developed, recent, advances, fasttext, allow, semantically, successfully, analogues, harder, obtain, controversial, lowresource, related, consecutive, necessarily, available, avoiding, downsides, satisfy, linearity, interest, bilingual, existing, implies, constraint, non, linear, relationships, apply, map, conclusion, issue, multiword, expressions, combinations, meaning, derived, individual, examples, include, named, entities, hey, jude, james, bond, couch, mostly, relaxing, translated, rather, mississippi, instance, handu, estonia, kersti, kaljulaid, president, donald, trump, detect, therefore, compositionality, detection, treats, separate, single, token, vocabulary, entries, good_thesis, concatenated, underscore, form, exponentially, length, magnitude, computer, memory, moreover, sparsity, rarely, occur, interesting, observation, simple, addition, meaningful, combine, operation, effective, optimal, applying, techniques, parametrized, function, combining, separately, regression, predict, intermediate, solving, considered, neither, context, nor, standalone, study, independent, fashion, section, framework, satises, constrains, summary, following, main, contributions, dene, compositional, modeling, analytically, experimentally, dened, organized, provides, background, understand, evaluate, finally, effectively, backgroundthis, overview, role, distributed, gram, natural, convert, text, format, processing, procedure, called, consider, matrix, equals, select, corresponding, retrieve, refer, question, correspond, [lyn], distributional, hypothesis, proposed, occurring, similar, tend, underlying, vast, majority, useful, grouped, dissimilar, algebraic, semantic, classic, letw, andv, opposite, retrieving, subtract, concept, meaningfully, combined, nearest, ofw, ukrainian, dnipro, desna, candidates, due, nature, [ola], milkov, et, al, skipgram, founded, literature, chooses, surrounding, auxiliary, assume, process, semantical, expect, predictive, forward, hidden, layer, desired, weights, precise, lexicon, induction, describe, subsection, formation, highlights, pivot, transparent, [mcc], extract, converged, resulting, valued, linearly, project, output, simplest, softmax, probability, distribution, details, loosely, speaking, correct, truth, computing, backpropagation, gradient, descent, described, incorporates, subword, core, goal, en, transforming, match, transformation, reality, complex, negative, sampling, naive, advanced, subsampling, frequent, orthogonality, rotation, allowed, iteratively, joint, elements, otherwise, noncompositional, idiomatic, later, throughout, lowercasing, simplicity, demonstrate, dening, translationthis, ability, arbitrary, denition, additional, components, assuming, character, ngrams, consequently, em, bedding, preliminary, satised, correctly, shown, regularities, resulted, knowledge, supervision, interpreted, independently, missouri, longest, gauja, biggest, modelingin, power, limitations, previous, perfectly, analyze, overcome, concatenate, this_is_a_phrase, enormous, monolingual, directly, unied, addressed, differ, terms, address, designed, type, suitability, serious, firstly, intensive, infeasible, secondly, holding, advantages, denitionin, avoids, scientic_thesis, scientic, captures, pattern, estimate, remaining, compute, subset, preprocessing, truecasing, tokenization, option, randomly, glue, gluing, formed, scoring, criterion, taking, scores, comprehensive, serve, purpose, likelihood, ratio, raw, frequency, poisson, stirling, chi, square, dice, jaccard, measure, etc, external, topic, concrete, metric, empirically, chosen, simply, glued, compose, dataset, consists, sequence, _world, produced, implementation, experiment, conducted, evaluation, concretely, focused, variants, decisions, billion, bytes, english, wikipedia, contains, lowercased, trained, usingfasttextframework, epochs, default, parameters, https, github, com, maxdel, bigram_embedder, alsopbe, dimension, implemented, addsimple, addatt, scalars, concatenating, projecting, dimwise, addattdimwise, assigned, [w, concatenation, dense, relu, nonlinear, multilayer, multilnonlinear, timestep, addsimplemodel, foraddattandaddattdimwiseare, split, development, test, tune, hyperparameters, nal, comparison, smooth, zi, ifjx, ij, tolerant, outliers, interpretable, accuracy, mode, closest, check, topn, error, divide, across, various, explicit, multinonlinear, analysis, summation, baseline, decent, explained, approximately, equivalent, shares, observe, attentional, themselves, really, speech, going, being, having, tags, needed, outperform, sum, memorizing, forgetting, redundant, updating, powerful, tool, predicting, remains, alternative, satisfying, vectorsthe, explore, whether, predicted, provided, experimental, direct, performed, similarity, noun, adjectivenoun, verb, vb, strengthen, claims, evaluated, correlation, adjective, studying, touched, evidence, richness, corpuscorresponds, smpto, addto, andfulladdto, recursive, recurrent, fully, composition, discussed, presented, mimic, showed, closer, suited, multiply, proof, englishestonian, obtained, manual, estonian, suur, kass, hea, vein, wine, masintlge, cute, tasty, translator, service, kitty, automatic, affect, sentiment, closed, neighbours, account, less, sensitive, general, behaviour, framewrok, efciently, detecting, fail, difference, conclude, nd, overt, performing, stopping, regularization, compostionality, compostional, lm, movie, ward, counter, tactical, shooter, action, terror, bay, area, island, francisco, south, diego, bayshore, port, miami, southeast, simpleadd, signicant, popular, atomic, known, united, frameworok, workphrase, specied, regulated, effect, eventually