introduction, universe, systems, comprise, interacting, elements, immediate, local, interactions, global, observable, behaviour, complex, intuitively, understood, physical, manifestations, expression, aptly, called, canonical, examples, include, human, colonies, nancial, relatively, neurons, collective, behavior, engenders, phenomena, consciousness, addition, mathematical, models, developed, theoretical, particularly, complete, knowledge, various, connected, nevertheless, emergent, structures, development, predict, initial, conditions, interaction, actually, simulating, system, cellular, automata, ising, model, quintessential, analyse, information, processing, analysis, using, quantity, classical, theory, mutual, derivations, agents, sensitivity, linear, nonlinear, random, variables, quantify, stored, transferred, modied, dierent, measuring, processed, twosubcomponents, restrictive, simplest, logic, composed, inputs, output, consider, subcomponent, capture, intricate, themselves, particular, components, input, ensemble, provide, uniquely, redundantly, synergetically, subtle, distribution, extension, needed, recently, axiomatic, framework, partial, decomposition, computing, actual, probability, distributions, non, trivial, despite, diculties, computer, science, computational, neuroscience, university, tartu, jointly, managed, develop, numerical, estimator, contextually, thesis, viewed, growing, analyses, theoretic, specically, overarching, theme, exploring, possibility, characterizing, dynamics, analysed, dimensional, extensively, studied, ferromagnetism, undergoes, phase, transition, simulated, deployed, elementary, based, measurements, novel, characterization, obtained, average, class, dynamical, increasing, practical, importance, feedforward, neural, networks, results, latter, experiment, main, referred, discussion, concrete, promising, research, severe, limitations, current, rst, example, practically, applying, facilitate, signicant, portion, devoted, providing, contained, necessary, prerequisites, thorough, literature, recent, article, wibral, et, al, notable, exception, focused, neuroscientic, applications, overview, potential, fascinating, eld, accessible, researchers, necessarily, trained, organized, chapter, suciently, depth, basic, informationtheoretic, introduced, preceding, previously, applied, focus, introduces, methodology, numerically, discusses, provides, details, experiments, reproducibility, implications, critical, approach, suggestions, future, preliminary, topics, integral, understanding, appreciating, methods, section, basics, introducing, proposed, advanced, concept, sections, familiarize, focuses, nal, assumes, previous, although, familiarity, prerequisite, solid, essential, lls, gap, brief, fundamental, concepts, appropriate, abstract, denitions, elaborated, intuitive, explanations, largely, seminal, textbook, thomas, specied, assumed, xis, discrete, variable, realizations, fx, ng, mass, function, rfx, ig, similarly, yis, fy, mg, rfy, jg, furthermore, joint, xand, ybe, entropy, functionals, dened, shannon, logarithm, units, measured, common, eulers, measurement, nats, denition, omitted, subsequent, generality, consistency, uncertainty, realization, xcan, quantied, angle, rewritten, expectation, intuition, correspond, instructive, aforementioned, binary, xwith, bernoulli, essentially, encodes, toss, ipping, pand, considered, unbiased, biased, equation, straightforward, calculate, specic, graphs, outcome, completely, deterministic, meaning, result, whatsoever, accordingly, vanishes, conversely, uncertain, unable, favour, maximum, xplotted, parameter, fundamentality, usage, ubiquitous, throughout, engineering, nance, portfolio, selection, diversity, risk, civil, ingredient, structural, optimization, design, subeld, concerned, improving, respect, specications, weight, etc, application, cognitive, characterize, conditional, generalization, multiple, analogously, jx, jj, xhas, observed, special, yare, independent, observing, xdoes, reveal, plus, kullback, leibler, distance, functions, support, relative, orkullback, importantly, negative, exactly, corresponding, notion, evaluates, yields, stressed, symmetric, satisfy, triangle, inequality, formal, mathematically, rigorous, dissimilarity, attentive, kullbackleibler, product, properties, according, observation, verify, functional, arguments, yhas, answering, orthogonal, maximized, identity, relates, directly, ij, jy, reduction, xdue, thus, knowing, ycompletely, determines, yielding, zbe, ygiven, zis, jz, zhas, property, expresses, vector, informations, univariate, semicolon, vectors, comma, dependent, eliminate, uence, isolate, interest, connectivity, regions, schizophrenic, patients, generally, worthwhile, source, target, solution, moreover, considering, unit, individual, dier, decomposing, formulation, twoinputs, setup, exist, formally, yand, sources, decomposes, unique, redundant, andcomplementary, remaining, inspired, illustrations, provided, quantifying, synergistic, grith, koch, quanties, denoted, nz, ny, denotes, depicts, equiprobable, contain, xthat, dierentiate, zdiscriminates, pr, shared, redundantinformation, suce, observe, consistent, notation, deviates, bertschinger, colon, partition, yor, zto, determine, easily, veried, noticing, merely, replication, complementary, synergeticinformation, illustrating, synergy, bothinputs, determined, zalone, observer, anyinformation, xremain, xorfunction, agreed, decomposed, described, signifying, entities, formulas, calculating, logical, relationships, stated, computable, quantities, equations, calculated, formula, heavily, relating, underdetermined, problem, tractable, inspiration, insight, contains, exploit, situation, agent, access, advantage, possess, possession, designing, designer, alice, zfrom, modify, xvia, yby, constructing, outcomes, modifyyand, notdependent, marginals, original, alljoint, assumption, marginal, pcan, constant, element, consist, asp, fq, apparent, varies, arbitrary, qfrom, expected, precisely, carried, dependencies, decompositions, identities, derived, pcould, vanishing, coincide, exists, dene, suitable, min, pm, subscript, qunder, symbol, replacing, max, constrained, problems, equivalent, solve, optimal, qwould, produce, involved, convex, minimums, involve, eective, algorithms, eciently, reliably, conditioned, extremely, eigenvalues, positive, denite, matrix, inverted, procedure, method, unstable, alleviate, iteratively, nds, suboptimal, solutions, eliminates, congurations, probabilities, programs, solved, iterations, eventually, obtain, eliminated, added, solving, resulting, qto, nd, interface, abstracting, inner, workings, outputs, scalars, software, python, programming, gurobi, nature, abruptly, transitioning, external, uenced, phenomenon, smoothly, transitions, shifts, ordered, disordered, vice, versa, condensed, physics, fairly, less, liquid, temperature, threshold, characterized, mechanism, modelling, subsection, dubbed, memory, cache, disk, electrons, material, magnetic, caused, usually, yield, magnetization, atoms, opposite, cancelling, ferromagnets, unpaired, producing, region, domain, within, unmagnetized, domains, oriented, randomly, characteristic, ferromagnetic, materials, magnetized, ferromagnet, uencing, removed, stability, substance, temperatures, agitated, vibrate, thermal, oscillation, alignment, demagnetizes, curie, conceived, wilhelm, lenz, abstracts, atomic, magnets, consisting, simply, lattice, sites, associated, conceptually, roughly, represent, site, corresponds, pointing, conguration, sof, nsites, absolute, analogous, earlier, equilibrium, boltzmann, se, denominator, energyassociated, tis, proportional, inverse, sdepends, internal, energy, observations, lower, higher, equivalently, diuse, demagnetizing, central, hamiltonian, neighboring, strength, adjacent, hdenotes, constants, environment, respectively, simplied, nearest, xed, cancel, incorporating, assumptions, simplies, interact, minus, achieved, intrinsically, trying, align, prohibition, prevents, doing, expectationof, hm, saying, approaches, zero, ernst, proved, spontaneous, therefore, lars, onsager, showed, undergo, absence, disorder, analytic, array, automaton, total, decimal, represents, infer, retain, [wei], simultaneously, update, plot, vertical, axis, evolving, illustrated, gure, notably, evolution, simplicity, patterns, emerge, shown, capable, generating, trac, turing, converge, uninteresting, homogeneous, repetitive, diverse, computationally, complexity, universality, stephen, wolfram, qualitatively, analysing, classication, scheme, partitions, diagram, ceullar, periodic, evolve, chaotically, mathematica, generator, persistent, propagating, formed, universal, computation, conjectured, related, prior, closely, boolean, vicseks, propelled, particle, harre, bossomaier, selected, behaviours, successive, skill, amateur, professional, agreeing, evidence, radical, shift, strategic, thinking, occurs, juncture, relevant, analytically, barnett, empirically, replicated, extended, discovered, transfer, directed, stochastic, processes, strictly, beforethe, quantitatively, validate, longheld, hypothesis, storage, distributed, lizier, quantitative, blinkers, dominant, conclude, conjecture, traveling, coherent, particles, chliamovitch, multi, establish, wolframs, failed, discriminate, motivating, simulations, investigating, algorithm, dissertation, detail, utilised, ensure, parameters, simulation, nding, enumerate, magnetizations, products, exhaustive, nis, increases, exponentially, intractable, modest, sized, lattices, expectations, derive, resort, enumerating, approximatethe, samples, drawn, proportion, increasingly, closer, sample, glauber, instance, markov, monte, carlo, con, ration, generated, arbitrarily, demonstrated, choosing, uniformly, ipped, accepted, rejected, acceptance, denote, dierence, energies, compact, pseudocode, iteration, generate, xuniformly, range, returning, reject, noteworthy, additions, naive, discussed, uncorrelate, ips, returned, th, lis, lag, intermediate, discarded, avoid, biasing, starting, disposable, burnin, period, entire, initialization, consists, lspin, ip, attempts, tand, initialize, sampled, sto, implementing, nite, righthand, complication, boundary, irrespective, position, usual, fewer, estimate, consisted, updates, gathered, comprised, performed, spaced, evenly, interval, encloses, subsequently, construct, stayed, illustrates, frequency, per, crepresents, location, approximately, aligned, regime, labels, created, naively, recongured, decided, partitioned, setups, repetitions, consideration, disjoint, estimating, across, randomness, vary, condence, repeated, averaged, initialized, saved, separately, nodes, parallel, eenet, cluster, estimated, inequivalent, timesteps, timestep, ensures, diers, subset, estimates, exchanging, roles, re, ecting, capabilities, transformations, pids, concentrates, dedicated, clearly, theoretically, tdecreases, conducted, validating, correctly, neighbours, conrming, opposed, evaluated, reasonable, pw, achieves, agreement, graph, representing, looking, visually, shifted, downwards, synergetic, slightly, atter, exhibiting, unproportional, redundancy, reasoning, transitivity, atries, orient, actively, unreasonable, assume, neighor, identical, plausible, interacts, explanation, relationship, unclear, nat, compared, reduce, inspection, reveals, responsible, increased, unanticipated, deeper, former, thoroughly, examined, conrm, characteristics, smaller, experimental, shaky, uctuations, nearer, validates, gradually, ensuring, depicted, visualization, principal, component, pro, ject, explicitly, mention, clusters, overlap, visual, numbered, positioned, coloured, highlighted, text, clustered, natural, boxplots, belonging, claim, justied, panel, outliers, variance, conclusions, jority, focusing, panels, gures, evident, oblivious, infrequently, minimal, repeating, ubiquituous, diagrams, justify, containing, densely, populated, diagonal, interestingly, partitioning, confusing, conundrum, zooms, structure, type, diagonals, simpler, thickness, exclusively, divided, contrast, numeric, surprising, mainly, produces, reversed, zoomed, shaped, justications, produced, zooming, similarities, stairway, travelling, plotted, collection, classied, chaotic, qualitative, coincides, larger, context, discussing, critically, concludes, numerous, ow, kinetic, commentary, lionel, argues, generalize, immense, imagine, predicting, imminent, epileptic, seizures, obtains, arising, advance, relies, automatic, grounded, relying, investigation, convenient, paramount, successful, polynomially, unmanagable, maximally, continuous, approximate, discretization, dividing, signal, performance, multivariate, gaussian, discretized, validated, terminates, interdependent, currently, logically, partitionable, distinct, reasonably, subsets, channels, desirable, argument, paragraph, network, layers, activation, feasible, discretize, signals, ne, granularity, unfeasible, activations, courbariaux, layer, softmax, handwritten, digit, database, [], epochs, training, validation, learning, curves, classier, classify, digits, loss, initially, weights, incrementally, tweaked, unorganized, investigated, discovering, derivative, rapid, triplets, triplet, epoch, remained, similar, ection, horizontal, ard, rngards, analyzing, belief, subsystems, neuron, prefer, argue, depended, pressing, improved, faster, amenable, bivariante, variate, inspire, occurrence, elementarycellular, das, genetic, perform, classifying, whether, articial, recurrent, lateral, contextual, dicult, existing, binarizing, conclusion, constituted, generalizable, popular, justication, insights, code, carrying, supervisors, treated, minor, xes, modications, working, required