introductionmost, successful, approaches, translation, rely, availability, parallel, corpus, rst, source, target, supervised, neural, employs, encoder, decoder, architecture, produces, representation, generate, cross, entropy, loss, usually, training, objective, algorithm, inference, models, performance, require, statistical, parading, based, phrase, methods, currently, replaced, counterparts, resource, perform, ranges, extremely, zero, motivation, unsupervised, translate, usage, corpora, approach, learning, embedding, aligning, vector, mapping, applied, align, properties, method, representations, lastly, rening, using, network, systems, current, despite, achieving, promising, results, novel, published, propose, solution, thesis, research, activities, pointed, discussing, scope, suitable, necessary, future, smaller, data, achieve, reasonable, employ, information, motivated, assumption, working, benet, phrases, basic, units, represented, thus, introduces, specic, requirements, relies, analogy, embed, established, converting, xed, vectors, input, algorithms, developed, recent, advances, fasttext, semantically, successfully, analogues, embeddings, harder, obtain, controversial, lowresource, related, consecutive, necessarily, available, avoiding, downsides, satisfy, linearity, requirement, interest, bilingual, existing, implies, constraint, non, linear, relationships, apply, conclusion, issue, multiword, expressions, combinations, result, meaning, derived, individual, meanings, examples, include, named, entities, jude, james, bond, relaxing, translated, mississippi, instance, handu, estonia, kersti, kaljulaid, president, donald, trump, detect, therefore, compositionality, detection, token, vocabulary, entries, good_thesis, concatenated, underscore, practice, exponentially, vocabularies, magnitude, computer, memory, moreover, sparsity, problem, rarely, occur, observation, addition, meaningful, combine, operation, effective, optimal, combination, us, applying, techniques, parametrized, function, combining, separately, regression, predict, intermediate, solving, considered, context, standalone, independent, section, framework, satises, constrains, imply, summary, main, contributions, dene, translations, compositional, modeling, analytically, experimentally, dened, organized, provides, denes, evaluate, effectively, backgroundthis, overview, role, distributed, gram, model, natural, convert, text, format, processing, tokens, procedure, called, consider, matrix, corresponding, retrieve, refer, example, correspond, corresponds, [lyn], distributional, hypothesis, proposed, occurring, similar, contexts, tend, underlying, vast, majority, grouped, dissimilar, distances, algebraic, operations, semantic, classic, letw, andv, opposite, retrieving, expression, subtract, concept, meaningfully, combined, nearest, ofw, ukrainian, concepts, dnipro, desna, candidates, nature, [ola], architectures, milkov, et, al, continues, skipgram, founded, literature, predicts, surrounding, auxiliary, assume, process, semantical, predictive, layer, desired, weights, layers, precise, lexicon, induction, subsection, formation, highlights, pivot, transparent, [mcc], extract, converged, resulting, valued, linearly, project, output, simplest, softmax, probability, distribution, details, loosely, speaking, computing, backpropagation, gradient, descent, described, incorporates, subword, core, en, transforming, transformation, reality, complex, includes, negative, sampling, naive, advanced, subsampling, frequent, orthogonality, constrain, rotation, allowed, iteratively, joint, elements, noncompositional, idiomatic, later, throughout, lowercasing, simplicity, demonstrate, dening, translationthis, ability, arbitrary, denition, additional, components, property, assuming, incorporate, character, ngrams, consequently, em, bedding, preliminary, requires, satised, correctly, shown, regularities, technique, resulted, knowledge, supervision, interpreted, independently, missouri, longest, gauja, biggest, modelingin, limitations, previous, perfectly, analyze, subsections, overcome, concatenate, this_is_a_phrase, enormous, monolingual, directly, unied, produce, addressed, differ, assumptions, address, designed, type, suitability, serious, firstly, intensive, infeasible, secondly, overcomes, holding, advantages, denitionin, avoids, scientic_thesis, scientic, captures, pattern, estimate, remaining, compute, subset, unit, preprocessing, truecasing, tokenization, option, randomly, options, gluing, formed, scoring, criterion, provide, comprehensive, purpose, likelihood, ratio, frequency, poisson, stirling, chi, dice, jaccard, etc, external, topic, concrete, metric, empirically, simply, glued, compose, dataset, consists, sequence, _world, produced, implementation, experiment, experiments, conducted, evaluation, concretely, focused, variants, decisions, billion, bytes, english, wikipedia, contains, lowercased, trained, system, usingfasttextframework, epochs, default, parameters, https, github, com, maxdel, bigram_embedder, alsopbe, dimension, types, implemented, addsimple, addatt, scalars, concatenating, projecting, dimensions, dimwise, addattdimwise, weight, assigned, [w, matrices, concatenation, dense, relu, nonlinear, multilayer, multilnonlinear, timestep, addsimplemodel, foraddattandaddattdimwiseare, split, development, hyperparameters, nal, comparison, zi, ifjx, ij, tolerant, outliers, interpretable, accuracy, mode, closest, topn, error, across, various, explicit, multinonlinear, analysis, summation, baseline, decent, explained, approximately, equivalent, distributions, observe, attentional, themselves, contain, needed, outperform, memorizing, forgetting, redundant, updating, predicting, alternative, satisfying, vectorsthe, component, explore, whether, predicted, provided, experimental, performed, similarity, noun, adjectivenoun, verb, vb, strengthen, claims, evaluated, correlation, adjective, studying, touched, evidence, richness, corpuscorresponds, smpto, addto, andfulladdto, recursive, recurrent, functions, composition, discussed, presented, mimic, showed, closer, suited, proof, englishestonian, obtained, manual, estonian, suur, kass, hea, vein, masintlge, tasty, translator, automatic, affect, sentiment, closed, neighbours, less, sensitive, behaviour, framewrok, efciently, detecting, conclude, observations, nd, overt, performing, regularization, compostionality, compostional, lm, lms, ward, strike, tactical, shooter, action, terror, area, francisco, diego, bayshore, port, miami, southeast, simpleadd, signicant, explores, popular, capture, atomic, united, frameworok, conclusions, workphrase, specied, regulated, effect, eventually