introductionin, decisions, surveillance, somewhat, surprisingly, humans, ability, consideration, controlled, experiments, shown, chimpanzees, articial, intelligence, agents, using, neural, networks, infer, perceive, richard, gregory, psychologist, necessary, invent, imaginary, constructing, functional, computer, program, perform, biological, systems, simulate, simulations, complete, perfect, agent, behavior, us, perspective, computational, simulation, simulator, needed, purpose, designed, environmentapeswith, extent, customizability, experimental, environment, allowed, subordinate, chimpanzee, whether, depending, observability, dominant, approach, mainly, training, network, reinforcement, learning, control, variety, approaches, total, models, trained, amounted, assess, specic, dened, performance, similar, results, capable, thesis, theory, relevant, examples, followed, famous, combining, methods, chapter, details, features, capabilities, model, explore, parameters, input, output, curriculum, testing, discuss, concluding, limitation, current, future, mindaccording, intention, knowledge, belief, thinking, doubt, guessing, pretending, etc, called, mental, directly, observable, faculty, essential, navigate, social, imagine, tradition, storing, container, example, tom, familiar, natural, processing, actions, hence, developing, efcient, interaction, including, successful, cooperation, peers, competition, rivals, looking, differs, cognitive, capacity, consider, individuals, viewpoint, according, galinsky, colleagues, competencies, motivates, understanding, contexts, foreigner, differently, swipe, leftover, based, intriguingly, unique, observed, species, tomasello, status, organized, hierarchically, available, position, conditions, differ, condition, advantage, demonstrate, obtained, positions, observe, indicated, ellipses, average, percentage, visibility, randomly, regardless, solve, learningreinforcement, trial, error, interacting, particular, action, maximize, accumulated, optimize, autonomous, robot, character, video, inspired, human, infants, effect, consequence, structure, therefore, plausible, method, associations, recently, succeeded, difcult, achieved, outperform, alphago, managed, problem, although, explicit, strategy, computation, memory, challenges, algorithms, dynamic, programming, techniques, limit, fundamental, quantity, functionq, outcome, function, array, dimension, indicates, represents, expected, actionawhile, approximated, algorithm, bellman, optimality, equation, proved, converge, optimal, probability, sampled, repeatedly, update, describing, max, tare, timet, discount, factor, andmax, highest, starting, practice, problems, create, limitations, renders, naive, implementation, unfeasible, environments, explored, typically, exceeds, practical, tabular, learningdeep, refers, composed, stacked, layers, non, linear, units, understood, highly, simplied, neuronal, thus, insights, processes, produces, solving, spectacular, adding, mute, image, colorization, translation, beneted, rst, worldclass, proposed, deepmind, atari, reaching, surpass, subsection, briey, workings, result, basic, approximate, proceeds, transitions, actiona, rewardrt, later, parametrized, vector, decrease, distance, predictionq, target, rt, terminal, recent, version, byand, bywhich, updated, minimized, prediction, yt, learningdouble, improved, biases, occurring, estimation, adapting, dqns, resulting, estimates, yddqn, arg, ddqns, dueling, section, methodsto, pursuit, mission, require, implement, specially, focused, distract, research, efforts, representations, feature, analysis, secondly, nd, scope, conducted, michael, types, apesis, grid, lled, obstacle, programmed, usingpython, subsections, showing, detail, clarity, purposes, focus, abilities, algorithmic, aspects, movement, eld, vision, recursive, casting, generation, described, congured, customizable, established, experiment, elements, explained, subsequent, sections, images, element, apescan, graphical, qualities, visualizations, environmental, barriers, represent, sub, distribution, matrix, specify, spawn, episode, converted, dirichlet, initial, locations, asubwhen, positive, zeros, entries, sending, critical, increase, bottleneck, provided, usually, dramatically, implemented, inject, rewarding, desired, representation, primitive, ops, operational, divided, currently, specied, complex, generated, coded, developed, determines, dominance, hierarchy, represented, range, effective, opponent, punished, role, determine, executed, execute, options, calculate, elds, shadowcasting, [ber], altercenteric, type, orientation, zenithal, camera, altercentric, mode, egocentric, closer, viewer, rotating, clockwise, angle, realistic, illustrated, angles, panel, maximum, ranges, pilots, generate, baseline, competitor, random, item, deterministic, simply, unobserved, area, spotted, usingaalgorithm, incremental, updates, obstacles, limited, main, special, included, added, passing, encapsulation, multiple, generating, intialize, occupy, vertical, agenta, domand, agentasubhave, unlimited, treated, transparent, modelbefore, architecture, basics, separation, intuitively, compared, responsible, calculating, representing, estimated, equations, respectively, encoded, symbols, jx, aja, architecturethe, splitting, layer, mention, convolutional, binary, data, feeding, complexity, keraslibrary, previous, forvandawhile, original, modied, outputwe, wanted, consisted, concatenation, vectors, attributes, distinguish, inputs, located, contains, occupied, indicate, lastnactions, performed, received, forming, restrict, movements, replay, experience, common, selected, samples, oldest, replaced, metrics, selection, subreward, required, terminate, rstly, averaged, episodes, exploration, reached, minimum, zero, estimate, showed, depended, immediately, ip, balance, similarly, consist, sequence, increased, puttinga, subto, accomplishing, domwill, helpasubto, becauseadomis, giveasubthe, compete, avoid, dom, existence, thatasubhas, clue, finding, foodin, taska, subhad, complicated, immediate, optimizeda, reasonable, region, exists, hyper, tuned, operation, eating, scheme, competing, subordinatea, subaim, herea, punishment, thea, applied, avoiding, punishing, separately, moved, grossly, mimic, incentives, situations, aiming, per, nding, balanced, system, trajectory, calculated, behavioral, created, prevented, static, reveal, clearly, decision, illustrate, considered, suboptimally, supposed, agentadom, asub, froma, subis, visible, caseadomwas, subandadomcan, onlya, subcan, asubsupposed, domcan, subshould, asadomis, butadomhere, anda, domwhile, asubnor, whileadomdoes, exist, sincea, domin, andadomcan, bothasuband, resultsoverall, consumed, launched, overview, design, satisfy, rank, alter, centric, ego, possibility, property, user, opportunity, parameter, tuningwe, controlling, relatively, easier, scanned, integer, stored, nodes, marking, determining, copied, theta, benaive, avg, maxeach, estimating, activation, functionrelu[, tanh, hyperbolic, tangent, identifying, selecting, tuning, procedure, combinations, summarized, policies, constant, decreasing, ended, importantly, validation, loopy, repetition, choosing, tested, relu, parameterrule, shared, decreased, stabilize, picking, noted, previously, simpler, stabilizing, summarize, incorporate, plot, less, gure, converged, stability, amountof, improving, steady, competitively, equipped, shortest, achieving, bya, addition, additional, axis, irregular, interference, betweena, asubwhere, blocked, zigzag, changing, optimized, improvement, overtime, nal, domif, success, evolved, avoided, blocking, negative, assessed, capability, passed, picked, embedded, orfrom, subwent, andasubdid, thumbnail, parameterthe, stayed, concluded, witnessedadomuntil, subdid, manage, occurred, faster, noticed, normal, argue, probably, happened, dangerous, identical, changed, retrieved, successfully, coincide, principle, ts, reson, wander, wandering, suspicious, discussionperspective, interactions, interest, equip, theapesenvironment, dene, summary, approaching, achieve, favored, performing, repetitive, occur, rewarded, tension, obtaining, promising, equipping, visual, stringent, evaluate, topic, related, reverse, rational, quantitative, attribution, beliefs, percepts, mentalizing, bayesian, inference, studied, relation, playing, pong, competitive, cooperative, microsoft, [mal], collaborate, collaboration, succeed, intent, requires, extremely, generalizable, co, handling, threaded, controller, contained, variability, items, generalize, unseen, implied, longer, sequences, pipeline, multi, threading, optimizing, novel, properties, envision, continue, project, generally, architectures, exploit, information, behaviors, cooperate, involving, schemes, conclusionin, chapters, newapesenvironment, inferred, supported, apesenvironment, tendency, working, embedding, within, improvements, doing, subordinates, effectively, acknowledgmentthank, almighty, allah, grace, raul, vicente, hosting, neuroscience, lab, patience, guidance, suggestions, comments, jaan, aru, insightful, advises, dedication, tambet, ardi, hadthanks, daniel, axel, ilya, informative, discussions, funded, dora, plus, scholarship, necessities, university, tartu, computing, estonian, scientic, infrastructure