introduction, ob, jective, solution, translation, historically, supervised, task, parallel, corpora, required, training, rst, using, phrase, based, statistical, neural, networks, performance, drawback, doing, necessity, increased, language, zero, minimal, amount, data, called, resource, main, thesis, dissertation, develop, method, furthermore, intend, simple, opensource, willing, system, spark, interest, collective, improvement, achieve, results, motivation, unsupervised, rstly, finno, ugric, becoming, extinct, inari, sami, speakers, livonian, june, alive, secondly, estonian, english, latvian, state, art, pivot, translated, general, view, thirdly, university, tartu, helping, organization, wmt, conference, datasets, used, compare, notably, french, german, aiming, compete, contribution, resolved, sentences, dictionary, completely, novel, promising, solving, interlingua, monolingual, nd, cheap, sense, requires, human, translate, expensive, example, non, noisy, billions, less, modular, pipeline, dierent, improved, adding, semi, supervision, translating, possibility, easily, compared, fewer, quicker, deployment, suciently, sucient, gram, embeddings, source, software, git, available, reader, explore, possibly, further, interested, roadmap, section, organized, contains, ve, chapters, provides, overview, related, discussed, technical, background, methodology, crucial, described, broader, theoretical, practical, components, approach, design, additional, details, options, experiments, setup, mentioned, preprocessing, choices, given, description, library, finally, reported, information, test, sets, analysis, quantitative, qualitative, conclusion, additionally, possible, ject, research, decades, nally, date, published, analysed, getting, however, essential, concept, investigated, vital, articles, relevant, improving, models, mono, lingual, innovativeness, sennrich, et, al, enhance, quality, authors, target, improves, dummy, domain, adapt, valid, generation, abilities, weights, encoder, frozen, dene, feeding, corresponding, synthetic, obtained, automatically, mix, text, corpus, collect, evaluate, report, added, baseline, artetxe, shortage, basque, russian, developed, cross, exist, space, share, thus, trained, noising, introduced, generate, sensible, copy, input, output, random, token, swaps, incorporated, modern, decoder, architecture, mechanism, aspects, dual, structure, traditionally, built, shared, achieved, sharing, aim, universal, representation, independent, transform, fantastic, generated, randomly, assign, update, pre, iteratively, process, xed, separated, pool, meaning, vector, encoding, similarly, likool, similar, architectural, entire, following, strategies, denoising, directly, reproduce, taking, producing, original, resulting, produce, replacing, compromised, capture, knowledge, avoid, copying, contiguous, goals, internal, restore, correct, nal, operates, dually, generating, pseudo, predict, standard, allows, settings, central, scenario, access, traditional, focus, reliable, upper, bound, nearest, neighbour, search, score, suggested, developing, noteworthy, perform, propose, due, constraints, lample, assumption, previous, fundamental, common, latent, reconstruct, attained, initial, naive, encodes, decoding, diers, dierence, lookup, level, iteration, consisting, minimizing, evaluation, function, measures, version, dropping, swapping, auto, being, itself, iterative, learning, discriminator, learned, binary, classication, working, whether, dierently, firstly, dropped, probability, shue, various, comparison, consider, suggest, en, fr, respectively, previously, higher, managed, trans, lation, variants, forward, simpler, hyper, parameters, achieving, nicely, sums, bilingual, carefully, initialized, derived, unsu, pervised, enables, turning, vice, versa, express, whichever, cornerstones, combines, simplifying, loss, easier, tune, applied, useful, scarce, occurrences, typically, leverage, vast, millions, attain, distributed, generalize, abundant, risk, overtting, limited, eective, straightforward, interpret, claim, leveraging, initialization, inferred, fashion, modeling, goodness, autoencoding, providing, longer, unrelated, byte, replace, advantages, reducing, vocabulary, eliminating, presence, unknown, mapping, dened, jointly, processing, joined, tokenization, joint, mention, critical, introduces, regularization, species, online, backtranslation, adversarial, term, removed, reduce, hyperparameters, identical, minor, populate, apparent, populated, extraction, initially, unigrams, bigger, consequently, making, romanian, signicantly, outperform, increase, enormous, combination, necessary, starting, ending, ambiguous, context, explosion, laual, laua, peal, bigram, extracting, probabilistic, joining, algorithm, ttar, fishel, selected, reason, calling, values, cannot, meaningful, reached, frequency, ltering, sampling, includes, excludes, smoothed, reverse, downsamples, frequent, calculated, formula, ngram, exactly, single, entities, motive, cosine, similarity, primary, continuous, log, linear, mikolov, surrounding, correctly, collection, gramis, predicting, current, complexity, disadvantage, nature, morphologically, nouns, although, characters, basis, enriching, subword, bo, janowski, form, varying, enhancement, represents, clear, especially, helpful, concerning, survey, ruder, manner, recent, sparked, rotation, matrix, maps, xing, orthogonality, closed, strings, conneau, imply, terric, singular, decomposition, nding, anchor, happening, player, maximize, seeks, minimize, success, condent, procrustes, dont, signicant, impact, metric, evaluating, closest, relieves, eect, hub, dimensional, accuracies, considering, motif, assessing, precision, having, simplest, relative, likelihood, everyone, started, recurrent, multilinguality, stling, tiedemann, features, ignored, onelanguage, huge, relations, separate, element, sequence, describes, ective, searching, exponential, code, beam, koehn, hypothesis, stack, foreach, foreachtranslation, ifapplicable, create, prune, stackiftoo, exponentially, growing, computationally, costly, reorder, actually, factorially, optimal, dynamic, programming, alleviated, greedy, showed, extension, breadthrst, nodes, explored, pruned, likely, unlikely, increasing, wider, computing, power, decreasing, innite, width, reverts, breadth, usually, returned, shown, created, placed, iterate, applicable, throwing, equal, length, relationship, worked, crosslingual, modularity, module, switched, benecial, switch, laualt, freely, modied, fasttext, incorporate, info, pro, jecting, cells, specifically, lstms, going, uent, computational, running, robust, github, catlm, categorical, categories, implemented, pseudocode, nare, trigrams, knearest, normal, followed, unnished, scored, ordered, negative, logarithm, asking, lack, batch, reportedly, couple, simply, converge, quickly, awfully, extensive, acquired, mos, alignment, uency, considered, validation, news, types, extracted, punctuation, alphanumeric, remain, lowered, tokenized, moses, smoother, consistent, lter, infrequent, beta, mostly, default, dimensions, gpus, tried, renement, didnt, yield, positive, cons, aect, evaluated, otherwise, larger, obvious, memory, complex, sake, eciency, unfortunately, partial, basic, kand, consuming, andn, vike, it__it, this__it, is__is, is__are, small__little, small_c, test__that, one__test, test__them, see__on, it__is, this__is, is__it, on__vike, is__small, small__is, is__modest, clearly, favors, looking, faults, propagate, consists, imperfect, repeating, that__that, diagnostically, lucky, changed, worse, ok, entirely, optimistic, slightly, understand, carried, keywords, overall, horrible, reference, sneaks, basically, ldi, kohvi, coee, shorter, lahendamata, ksimus, unsettled, question, wrongly, entries, ma, olin, vihane, ja, nutsin, crying, nagu, juba, eldud, vesi, mahl, su, sbrad, juice, stated, terrible, errors, suurbritannia, politsei, elnud, nad, usuvad, londoni, grenfell, toweri, isolatsioon, fassaadipaneelid, visid, panustada, seal, juunis, toiminud, tulekahju, kiiresse, levikusse, milles, hukkus, ligikaudu, inimest, uk, police, insulation, cladding, panels, londons, contributed, rapid, re, died, barcelona, invest, sonic, damage, existed, october, wherein, killed, approximately, adequacy, problematic, is__said, hysterical, peoliste, melu, naist, ei, sega, festivalgoers, revelry, doesn, faze, don, distribution, oli, minu, jaoks, eriline, hetk, suurhetk, mul, testi, challengers, crowd, olympic, champion, lap, farah, dug, won, kuigi, viimasel, ringil, proovisid, konkurendid, neljakordset, olmpiavitjat, ra, jalt, minema, trgida, leidis, aastane, lpusirgel, judu, ning, vitis, jaga, poolnaal, siiski, mber, koguni, juubeldada, ritanud, tiitlivitja, kaheksandiknaal, vljaspool, ringiaeg, kodusaali, vitnud, jala, aega, sgava, sgavike, kauge, sugulane, ikute, properly, inconsistent, ne, seemed, commonly, stage, remove, aecting, led, ecient, optimized, hindered, per, spent, failed, optimize, estimate, reordered, gender, pronouns, candidates, looked, referenced, de, future, switching, phrasetables, allowing, vicinity, dealt, currently, hinders, alternative, faster, optimizing, tested, safely, base, thoroughly