introduction, information, continues, data, created, stored, challenges, regarding, processing, storing, current, solution, server, physically, main, process, hadoop, ecosystem, source, industry, leading, elds, social, networking, content, streaming, online, retail, frameworks, problems, programmers, analytics, using, rst, suitable, framework, programming, implement, related, pro, jects, developing, existing, changed, programmer, worked, choosing, complicated, dierent, develop, performance, algorithms, meaning, apis, overwhelm, prototype, solutions, eld, problem, based, scripting, keywords, compiled, lower, parallelization, aspects, potentially, simplify, distributed, querying, applications, prior, knowledge, therefore, minor, dierences, solve, picking, familiar, automatically, optimized, compete, motivation, limitations, thesis, comparing, hiveql, spark, java, nd, feasible, computing, jor, comparison, implementing, mllib, compared, directly, similar, calculate, results, formulas, picked, currently, popular, according, python, ruby, learning, algorithm, specics, diers, intermediate, disk, memory, oers, logic, considered, selecting, whether, available, native, iterative, dynamic, iterations, restriction, support, procedures, requirement, command, necessary, implemented, expressed, format, pearsons, correlation, provides, linear, regression, selected, testing, requires, calculations, performed, focus, understanding, spending, implementation, require, creation, multinomial, naive, bayes, er, demonstrate, chapter, overview, models, classier, described, focuses, cluster, input, analyzed, features, discussion, conclusions, presented, mapreduce, model, directed, acyclic, graph, introduced, apache, software, designed, storage, across, computers, system, distributes, replicated, manner, modifying, changing, diculty, example, costly, moved, nodes, multiple, issue, consistency, guarantee, replicas, instantly, version, scheduling, resource, management, technology, developed, previous, split, jobtracker, daemons, monitoring, dierence, force, architecture, visual, representation, gure, consists, namenode, regulates, le, namespace, access, les, clients, datanodes, executes, operations, opening, closing, renaming, etc, determines, mapping, requests, deletion, replication, standard, deployment, instance, datanode, vice, versa, advantage, structure, output, highly, scalable, yahoo, allowed, vizualisation, later, associated, generating, splits, series, reduce, shown, lter, divided, reducers, perform, summary, illustrates, non, parallel, code, users, dont, experience, working, user, functions, inputs, outputs, writables, specied, dicult, optimize, conguration, options, customize, execution, ranging, sorting, buer, per, core, dening, environment, partition, combine, explained, mini, reducer, phase, network, trac, sending, less, issues, queries, graphs, acyclicgraphs, tez, vizual, apahe, complex, dags, overcome, imposed, lesystem, forces, mappers, temporary, modeled, ow, vertices, represent, application, movement, query, section, sourced, releasing, developments, keeping, themselves, selection, zookeeper, facebook, presto, corona, scribe, cassandra, thrift, syntax, structures, csv, benets, examples, subsection, creating, populating, displaying, result, john, estonia, mary, latvia, jane, lithuania, warehouse, infrastructure, minimal, usage, scheduler, evenly, latency, starting, udfs, dened, ei, \n, processed, webpage, claims, faster, laada, classication, sorted, daytona, graysort, benchmark, rdds, resilient, databases, displayed, modication, creates, restore, default, schema, strict, allowing, successor, shark, completely, supports, subset, hivecontext, sqlcontext, superset, tional, doing, dependencies, feature, oer, functionality, create, contexts, lack, keyword, dataframe, collection, organized, named, conceptually, equivalent, relational, database, richer, optimizations, dataframes, showing, json, dene, setappname, newj, newo, text, schemastring, javardd, newh, namea, ec, newa, rowrdd, newf, nr, selectc, nwherea, flink, dataow, cyclic, processes, hadoops, runtime, usable, required, event, semantics, events, delayed, expressions, modied, newt, cloudera, impala, analytic, massively, delivers, concurrency, achieved, circumventing, accessing, specialized, benchmarked, armbrust, et, al, clouder, ti, analyzing, amendable, enables, newer, netix, pigpen, clo, jure, dialect, lisp, harder, longer, simplies, optimization, comparable, programmatic, performing, cs, cc, st, mapper, cv, dmap, ta, newi, dr, tsum, dmain, newc, ef, rp, newp, understandable, visible, chapters, contains, slightly, lowered, noting, functional, scala, easier, smaller, closer, trial, error, variety, including, comfortable, benet, tabel, mapped, reduced, thinking, higher, interfaces, optimizing, yield, expert, novice, olston, piglatin, analysis, developers, submit, published, practical, common, utilities, clustering, collaborative, ltering, dimensionality, reduction, primitives, pipeline, needed, ml, constructing, pipelines, decreased, achieve, dealing, exceptions, methods, basic, statistics, simpler, variance, pearson, spearman, random, generation, hypothesis, stratied, sampling, classify, relationship, variables, logistic, isotonic, decision, gradient, boosted, recommender, systems, predict, ratings, alternating, unsupervised, subsets, gaussian, mixture, iteration, latent, dirichlet, allocation, bisecting, consideration, singular, decomposition, principal, component, extraction, transformation, derive, modify, initial, dataset, advanced, frequency, inverse, document, standardscaler, normalizer, chisqselector, elementwiseproduct, frequent, pattern, mining, items, itemsets, subsequences, growth, association, prex, span, mllibs, eectiveness, wiki, include, amazon, adobe, ebay, internal, dimension, sources, reporting, clusters, com, product, indices, sessions, perl, hbase, sevices, structured, node, planning, research, cpus, total, ad, researching, specic, blog, benchmarking, articles, range, spam, contest, evaluate, illustrate, description, followed, highlight, coecient, positive, negative, linearly, independent, formula, calculating, zaiontz, cov, deviation, covariance, sample, xy, np, iy, xip, yi, loaded, parsed, extracted, passed, mlib, method, calculates, context, specify, commands, relatively, contain, calculated, registration, executed, fromdata, delimited, exactly, createexternaltablec, ni, oi, xi, \t, function, assumes, increase, decrease, connection, predicts, xb, constants, constant, called, intercept, zero, slope, slopenp, xp, unknownyintercept, calculation, outcome, ratio, training, additional, evaluation, squared, predicted, dier, actual, stochastic, descent, decided, accurate, predictions, precision, increases, corrections, detail, normalize, dividing, width, produced, provided, resolution, videos, converging, register, ss, mdata, final, mentioned, nally, easily, reasonable, percentage, selections, beforehand, hiveqls, multiclass, conditional, independence, looked, separately, bayesian, probabilities, class, hearth, theorem, probability, kj, ij, yp, conditionally, occurs, provide, likelihood, occurring, mathematically, math, mithcell, greatly, fx, ng, jy, attributes, nj, probable, argmax, ip, jp, denominator, simplied, logarithm, intensive, accelerates, logarithmic, logp, lib, accuracy, addition, createtablef, sas, selectf, asc, easf, partitionbyc, asv, sfromd, agroupby, createtablet, selectu, sasa, fass, fromt, ff, mf, aont, ffromf, asa, yfromt, selecta, byu, asm, efromt, awheres, groupbyc, splitting, executors, scaling, resources, depending, cores, reconguration, university, tartu, mobile, laboratorys, distribution, proliant, servers, specications, xeon, disks, operating, ubuntu, hyper, threading, operation, assigns, physical, processor, virtual, acting, intel, downloaded, repository, datasets, generated, limits, identied, obtained, handled, average, arguments, script, displays, nishes, biggest, eciency, executor, hue, behaved, dierently, executing, aect, video, characteristics, transcoding, original, tsv, decreases, slower, adding, straightforward, concluded, started, arent, excluding, obvious, diculties, manually, sqls, par, outperformed, largest, maximum, visualized, varied, vizualization, linearregression, exception, actually, increased, sgds, highlights, workings, regressions, combined, illustrated, doable, pearons, specication, encountered, saved, variable, future, investigate, ve, remained, lacked, randomly, percentages, option, didnt, inner, optimizes, covertype, type, elevation, aspect, intintal, greater, sparks, couldve, caused, overtraining, classiers, insight, initialal, percision, focused, investigating, restrictions, altering, possibilities, thresholds, predicting, smoothing, combination, parameters, slowed, switching, approach, prefers, multiplier, gap, behavior, documentation, submitted, returned, avoided, easiest, identical, turned, strangest, showed, workaround, delete, local, metastore, happening, programs, template, display, realizing, workarounds, abandoned, conclusion, scope, carried, contained, received, ecosysem, partially, fullled, actions, lacks, knowledgeable, specifying, tested, causes, detailed, execute, investigated, studying