introduction, ob, jective, solution, translation, historically, supervised, parallel, corpora, required, training, rst, using, phrase, based, statistical, neural, networks, performance, drawback, doing, necessity, increased, zero, minimal, data, called, resource, main, thesis, dissertation, develop, method, furthermore, opensource, system, spark, interest, collective, improvement, achieve, results, motivation, unsupervised, rstly, finno, ugric, extinct, inari, sami, livonian, june, secondly, estonian, english, latvian, pivot, translated, thirdly, university, tartu, helping, organization, wmt, conference, conferences, datasets, notably, french, german, aiming, compete, contribution, resolved, dictionary, completely, novel, promising, solving, interlingua, monolingual, nd, requires, human, translate, expensive, example, non, billions, less, modular, pipeline, dierent, improved, adding, semi, supervision, translating, possibility, easily, compared, systems, fewer, resources, quicker, deployment, suciently, sucient, gram, embeddings, source, software, git, available, explore, possibly, improvements, roadmap, section, organized, contains, ve, chapters, chapter, provides, overview, related, discussed, technical, methodology, crucial, described, broader, theoretical, practical, components, approach, design, additional, details, options, experiments, setup, mentioned, preprocessing, description, reported, information, analysis, quantitative, qualitative, conclusion, additionally, ject, research, decades, nally, published, analysed, essential, concept, investigated, vital, articles, relevant, improving, models, mono, lingual, innovativeness, sennrich, et, al, enhance, quality, contributions, target, dummy, domain, adapt, valid, model, generation, abilities, weights, encoder, frozen, dene, feeding, corresponding, synthetic, obtained, automatically, text, corpus, collect, evaluate, dataset, added, baseline, artetxe, shortage, basque, russian, developed, cross, exist, thus, trained, noising, introduced, generate, sensible, input, output, random, token, swaps, incorporated, modern, decoder, architecture, mechanism, aspects, dual, structure, traditionally, shared, achieved, sharing, universal, representation, independent, transform, fantastic, generated, randomly, assign, embedding, update, pre, iteratively, process, xed, separated, meaning, vector, encoding, similarly, likool, similar, architectural, entire, strategies, denoising, directly, reproduce, producing, original, decoders, resulting, produce, replacing, compromised, capture, knowledge, avoid, copying, contiguous, achieves, internal, restore, strategy, nal, operates, dually, generating, pseudo, predict, standard, central, scenario, access, traditional, focus, reliable, bound, nearest, neighbour, suggested, developing, noteworthy, perform, propose, constraints, article, lample, assumption, exists, previous, fundamental, concepts, common, latent, reconstruct, attained, initial, naive, encodes, decoding, diers, dierence, lookup, iteration, consisting, minimizing, evaluation, function, ability, version, dropping, swapping, result, iterative, learning, discriminator, binary, classication, working, whether, evaluates, dierently, firstly, dropped, probability, shue, various, comparison, us, consider, suggest, en, fr, respectively, previously, higher, managed, trans, lation, variants, continue, simpler, hyper, parameters, achieving, nicely, bilingual, carefully, initialized, derived, unsu, pervised, methods, enables, turning, translations, vice, versa, express, whichever, cornerstones, combines, approaches, simplifying, loss, easier, applied, scarce, occurrences, phrases, solutions, typically, leverage, vast, attain, distributed, representations, generalize, abundant, risk, overtting, limited, eective, straightforward, interpret, claim, leveraging, initialization, inferred, modeling, goodness, autoencoding, generates, providing, dictionaries, longer, unrelated, byte, replace, advantages, reducing, vocabulary, eliminating, presence, mapping, tokens, dened, jointly, processing, practice, joined, tokenization, joint, mention, critical, introduces, regularization, species, online, backtranslation, adversarial, removed, reduce, hyperparameters, identical, minor, populate, apparent, populated, extraction, initially, unigrams, consequently, contain, romanian, signicantly, outperform, increase, enormous, combination, necessary, starting, grams, ambiguous, provide, context, explosion, laual, laua, peal, bigram, extracting, probabilistic, joining, algorithm, ttar, fishel, selected, meaningful, reached, frequency, ltering, sampling, includes, excludes, smoothed, reverse, downsamples, frequent, calculated, formula, ngram, weight, exactly, entities, motive, cosine, similarity, vectors, primary, continuous, linear, mikolov, surrounding, correctly, collection, gramis, predicting, current, parameter, complexity, increases, disadvantage, nature, problem, morphologically, nouns, although, dier, characters, basis, enriching, subword, bo, janowski, character, varying, enhancement, represents, advantage, especially, concerning, survey, ruder, manner, recent, sparked, versions, rotation, matrix, xing, suggests, orthogonality, constraint, closed, conneau, imply, terric, inputs, singular, decomposition, nding, anchor, happening, maximize, minimize, discriminators, success, condent, procrustes, dont, signicant, impact, metric, evaluating, closest, relieves, eect, hub, dimensional, accuracies, considering, motif, assessing, precision, accuracy, simplest, relative, likelihood, started, recurrent, multilinguality, stling, tiedemann, features, ignored, onelanguage, relations, element, sequence, ective, searching, exponential, code, koehn, hypothesis, foreach, foreachtranslation, option, ifapplicable, create, stackiftoo, exponentially, growing, computationally, costly, reorder, actually, factorially, optimal, dynamic, programming, alleviated, greedy, showed, extension, breadthrst, nodes, explored, pruned, unlikely, increasing, wider, require, computing, decreasing, innite, width, reverts, breadth, usually, returned, shown, created, placed, iterate, possibilities, applicable, combine, throwing, relationship, worked, crosslingual, modularity, module, switched, benecial, laualt, freely, modied, fasttext, incorporate, info, pro, jecting, specifically, lstms, uent, computational, robust, github, catlm, categorical, domains, categories, implemented, pseudocode, nare, bigrams, trigrams, knearest, normal, followed, unnished, scored, elements, ordered, negative, logarithm, logarithms, asking, lack, reportedly, couple, simply, converge, dierences, extensive, acquired, algorithms, mos, alignment, uency, considered, validation, types, extracted, punctuation, alphanumeric, lowered, tokenized, moses, smoother, unigram, consistent, lter, infrequent, beta, default, dimensions, gpus, renement, didnt, yield, positive, pros, cons, aect, evaluated, larger, obvious, sequences, memory, complex, sake, eciency, unfortunately, partial, basic, kand, consuming, andn, vike, ngrams, it__it, this__it, is__is, is__are, small__little, small_c, test__that, one__test, test__them, see__on, it__is, this__is, is__it, on__vike, is__small, small__is, is__modest, clearly, perfect, looking, propagate, consists, imperfect, repeating, that__that, translates, diagnostically, changed, ok, entirely, optimistic, slightly, carried, keywords, horrible, reference, sneaks, examples, basically, ldi, kohvi, coee, shorter, lahendamata, ksimus, unsettled, wrongly, entries, olin, vihane, ja, nutsin, crying, nagu, juba, eldud, vesi, mahl, su, sbrad, stated, errors, suurbritannia, politsei, elnud, nad, usuvad, londoni, grenfell, toweri, isolatsioon, fassaadipaneelid, visid, panustada, juunis, toiminud, tulekahju, kiiresse, levikusse, milles, hukkus, ligikaudu, inimest, uk, police, insulation, cladding, panels, londons, contributed, rapid, re, barcelona, invest, sonic, existed, october, wherein, approximately, london, adequacy, problematic, is__said, problems, hysterical, peoliste, melu, naist, ei, sega, festivalgoers, revelry, doesn, faze, don, distribution, special, oli, minu, jaoks, eriline, hetk, suurhetk, mul, testi, challengers, olympic, farah, kuigi, viimasel, ringil, proovisid, konkurendid, neljakordset, olmpiavitjat, ra, jalt, minema, trgida, leidis, aastane, lpusirgel, judu, ning, vitis, jaga, poolnaal, siiski, mber, koguni, juubeldada, ritanud, tiitlivitja, kaheksandiknaal, vljaspool, ringiaeg, kodusaali, vitnud, jala, aega, sgava, sgavike, kauge, sugulane, ikute, properly, inconsistent, ne, seemed, commonly, aecting, ecient, optimized, hindered, per, failed, optimize, estimate, reordered, qualities, gender, pronouns, precisions, candidates, looked, candidate, referenced, de, future, updates, switching, phrasetables, allowing, vicinity, dealt, currently, hinders, alternative, faster, optimizing, tested, safely, thoroughly