introductionin, life, decisions, depend, thief, steal, owners, surveillance, somewhat, surprisingly, humans, ability, consideration, controlled, experiments, shown, chimpanzees, state, art, articial, intelligence, agents, using, neural, networks, infer, perceive, richard, gregory, psychologist, author, brain, necessary, invent, imaginary, constructing, functional, writing, computer, program, perform, biological, systems, simulate, simulations, complete, having, behavior, understand, perspective, taking, computational, simulator, needed, purpose, designed, environmentapeswith, extent, customizability, experimental, environment, allowed, subordinate, chooses, whether, depending, observability, dominant, approach, mainly, training, simple, possible, reinforcement, learning, control, tried, variety, total, models, trained, amounted, assess, tasks, specic, dened, tests, performance, similar, results, capable, thesis, background, theory, relevant, examples, afterward, followed, famous, combining, methods, chapter, details, features, capabilities, explore, parameters, input, output, curriculum, used, testing, discuss, concluding, limitation, current, future, mindaccording, intention, knowledge, belief, thinking, doubt, guessing, pretending, liking, etc, called, mental, directly, observable, however, faculty, essential, navigate, social, tradition, storing, metal, container, member, guests, false, tom, allows, familiar, neither, switch, cannot, natural, processing, actions, hence, developing, efcient, interaction, including, successful, cooperation, peers, competition, rivals, looking, differs, cognitive, capacity, consider, individuals, viewpoint, according, galinsky, colleagues, competencies, motivates, understanding, contexts, describe, foreigner, differently, swipe, leftover, cheek, based, intriguingly, unique, observed, species, tomasello, apes, status, organized, hierarchically, available, putting, position, conditions, advantage, demonstrate, obtained, account, observe, indicated, ellipses, walls, average, percentage, eaten, visibility, otherwise, randomly, regardless, aim, study, solve, learningreinforcement, trial, error, interacting, particular, select, maximize, accumulated, optimize, taken, autonomous, robot, character, video, inspired, infants, effect, consequence, structure, therefore, plausible, associations, recently, succeeded, difcult, achieved, level, outperform, alphago, managed, although, explicit, strategy, due, computation, memory, challenges, algorithms, dynamic, programming, techniques, limit, fundamental, quantity, value, functionq, outcome, function, array, dimension, indicates, represents, expected, gain, actionawhile, being, approximated, bellman, optimality, equation, proved, converge, optimal, probability, sampled, repeatedly, update, describing, max, tare, timet, rate, discount, factor, andmax, highest, starting, scale, quickly, create, huge, renders, naive, implementation, unfeasible, explored, million, typically, exceeds, practical, tabular, learningdeep, refers, set, composed, stacked, layers, non, linear, units, understood, highly, simplied, neuronal, thus, insights, processes, produces, solving, spectacular, adding, mute, image, colorization, translation, beneted, rst, worldclass, players, proposed, deepmind, atari, reaching, surpass, subsection, briey, reviews, workings, basic, approximate, proceeds, saving, transitions, actiona, rewardrt, later, parametrized, vector, decrease, predictionq, target, given, rt, terminal, recent, version, byand, bywhich, updated, cost, minimized, prediction, following, yt, double, learningdouble, improved, rid, biases, occurring, estimation, adapting, dqns, resulting, estimates, yddqn, arg, ddqns, dueling, section, methodsto, pursuit, mission, require, implement, specially, focused, distract, research, efforts, representations, analysis, secondly, nd, learned, tools, built, general, scope, conducted, michael, view, types, apesis, grid, cell, lled, obstacle, programmed, usingpython, language, showing, clarity, focus, rather, algorithmic, aspects, movement, eld, vision, recursive, casting, generation, described, elsewhere, settings, congured, match, customizable, established, elements, explained, subsequent, apescan, graphical, qualities, visualizations, environmental, barriers, sub, distribution, matrix, specify, spawn, beginning, episode, converted, dirichlet, initial, locations, asubwhen, positive, zeros, entries, sending, critical, increase, bottleneck, power, provided, usually, dramatically, implemented, inject, rewarding, desired, primitive, ops, operational, divided, currently, moving, specied, complex, generated, coded, developed, below, determines, dominance, hierarchy, represented, range, effective, opponent, punished, role, executed, execute, options, calculate, shadowcasting, [ber], altercenteric, orientation, zenithal, camera, ceiling, east, altercentric, mode, egocentric, closer, viewer, center, rotating, counter, clockwise, angle, realistic, illustrated, panel, maximum, auto, pilots, generate, baseline, competitor, random, choses, item, deterministic, driven, simply, searches, unobserved, area, spotted, usingaalgorithm, incremental, limited, main, seeing, included, added, accept, passing, encapsulation, multiple, generating, masks, intialize, occupy, single, vertical, agenta, domand, agentasubhave, unlimited, treated, transparent, modelbefore, architecture, base, stream, separation, intuitively, compared, responsible, calculating, representing, estimated, respectively, encoded, symbols, jx, aja, architecturethe, splitting, difference, mention, convolutional, binary, data, feeding, complexity, keraslibrary, previous, forvandawhile, original, modied, outputwe, wanted, consisted, concatenation, maps, attributes, distinguish, receives, located, contains, everywhere, occupied, history, lastnactions, performed, form, received, forming, oat, length, restrict, replay, experience, common, selected, samples, oldest, replaced, metrics, selection, compare, subreward, required, terminate, rstly, averaged, exploration, reached, minimum, overall, speed, showed, mostly, depended, running, immediately, ip, balance, similarly, consist, sequence, increased, improve, puttinga, subto, accomplishing, domwill, helpasubto, becauseadomis, giveasubthe, compete, avoid, dom, reason, existence, thatasubhas, clue, finding, foodin, stage, taska, subhad, complicated, immediate, optimizeda, reasonable, region, exists, hyper, tuned, operation, eating, scheme, competing, subordinatea, subaim, herea, punishment, thea, applied, avoiding, finally, punishing, whenever, separately, moved, grossly, mimic, incentives, situations, aiming, per, nding, chosen, balanced, getting, trajectory, calculated, behavioral, check, created, prevented, static, reveal, clearly, illustrate, considered, suboptimally, supposed, agentadom, asub, froma, subis, visible, caseadomwas, subandadomcan, onlya, subcan, asubsupposed, domcan, subshould, asadomis, ideal, butadomhere, anda, domwhile, asubnor, whileadomdoes, sincea, domin, andadomcan, bothasuband, resultsoverall, consumed, launched, overview, design, satisfy, rank, alter, centric, ego, possibility, property, user, opportunity, tuningwe, controlling, relatively, easier, scanned, integer, stored, hidden, nodes, marking, determining, copied, theta, string, benaive, avg, maxeach, estimating, activation, functionrelu[, tanh, hyperbolic, tangent, batch, identifying, selecting, repeat, tuning, procedure, combinations, summarized, policies, constant, decreasing, ended, importantly, validation, loopy, repetition, loop, choosing, tested, relu, parameterrule, shared, decreased, stabilize, quarter, stable, picking, noted, previously, simpler, stabilizing, summarize, incorporate, plot, less, noisy, gure, converged, stability, amountof, improving, steady, competitively, equipped, shortest, achieving, bya, addition, additional, axis, irregular, interference, betweena, asubwhere, blocked, zigzag, changing, optimized, improvement, overtime, nal, domif, success, evolved, avoided, blocking, negative, assessed, passed, picked, embedded, copy, orfrom, subwent, andasubdid, thumbnail, parameterthe, stayed, concluded, expect, witnessedadomuntil, subdid, manage, occurred, faster, noticed, normal, argue, happened, dangerous, identical, changed, retrieved, successfully, coincide, principle, reson, wander, wandering, suspicious, discussionperspective, interest, equip, theapesenvironment, dene, summary, approaching, nearly, achieve, favored, performing, repetitive, occur, rewarded, tension, obtaining, nearby, promising, equipping, visual, stringent, evaluate, topic, related, share, reverse, engineer, rational, quantitative, attribution, desires, percepts, mentalizing, bayesian, inference, studied, relation, playing, pong, competitive, cooperative, fully, microsoft, [mal], collaborate, collaboration, succeed, intent, extremely, generalizable, co, handling, threaded, controller, contained, goal, variability, generalize, unseen, implied, longer, pipeline, multi, threading, optimizing, novel, envision, amount, project, generally, exploit, information, cooperate, involving, conclusionin, newapesenvironment, inferred, supported, apesenvironment, tendency, embedding, within, doing, effectively, acknowledgmentthank, almighty, allah, grace, till, thankful, raul, vicente, hosting, neuroscience, lab, patience, guidance, suggestions, comments, written, jaan, aru, insightful, advises, dedication, tambet, ardi, journey, hadthanks, daniel, axel, ilya, informative, discussions, funded, dora, plus, scholarship, necessities, university, tartu, computing, estonian, scientic, infrastructure