networks, lately, gained, huge, popularity, learning, community, models, industries, including, self, driving, bojarski, et, al, healthcare, caruana, natural, language, processing, sutskever, necessary, achieve, accuracy, condence, prediction, interest, example, medical, diagnosis, tool, rely, contact, crew, conrmation, jiang, however, benecial, calibrated, matches, actual, percent, correct, although, shallow, neural, results, lecun, modern, tend, output, overcondent, shown, guo, deeper, wider, batch, normalization, smaller, weight, decay, less, aim, thesis, evaluate, beta, calibration, kull, context, convolutional, valid, comparison, methods, replicated, specically, variations, trained, image, datasets, imagenet, following, used, histogram, binning, isotonic, regression, temperature, scaling, parameter, version, platt, classication, chapter, background, information, described, detailed, description, previous, given, describes, ndings, area, preparation, training, procedure, giving, links, uncalibrated, gures, outcomes, lastly, overall, faced, process, replication, addition, appendix, extra, reliability, diagrams, calibrate, estimated, probabilities, contain, predicted, classes, indicates, thus, called, uncertainty, estimation, usually, hence, modify, reliable, perfectly, class, log, loss, subsection, visualize, measure, error, niculescumizil, compares, average, split, intombins, interval, possible, gap, bar, samples, bin, binb, mis, dened, set, indices, intervalim, equations, demonstrate, calculated, conf, mj, acc, label, theacc, andconf, equal, meaning, visible, expectation, expected, test, phase, exactly, practical, impossible, rst, furthermore, diagonal, depends, densenet, measuresthe, visual, accurately, scalar, superior, summarise, quality, instance, visualised, estimate, naeini, divided, based, similar, approximated, weighted, difference, nis, score, dependent, selection, parameterm, vary, ifmis, likely, reect, reality, primary, indicator, maximum, biggest, nds, returned, max, gj, medicine, crucial, worst, odds, treatment, cure, affect, heavily, differ, negative, likelihood, commonly, cross, entropy, bengio, standard, probabilistic, friedman, let^, jx, withnsamples, ygiven, ij, iis, optimizing, brier, allen, essence, square, binary, categorical, values, assigned, input, range, lower, performs, bensamples, withyas, vector, and^, length, isrand, logitsz, logits, using, softmax, function, sigmoid, probabilities^, iin, sum, sm, exp, kis, overview, afterwards, multiclass, post, added, validation, needed, tting, hyper, tuning, finally, check, nal, rate, checked, changing, assumed, share, distribution, total, introduced, extension, similarly, isx, iand, isyi, simplicity, positive, classy, probability^, additionally, valueziof, available, goal, simple, non, parametric, zadrozny, elkan, divide, intomequally, sized, mutually, exclusive, binsf, mg, boundaries, option, calculate, binsare, icovers, condencec, selectingc, mvalues, minimizes, min, showing, whether, jp, widely, piecewise, constant, functionfthat, ^p, ftries, squared, subject, wheremis, andc, mare, functionf, despite, optimise, pool, adjacent, violators, algorithm, ayer, logistic, parametersa, included, couple, scalingis, distilling, hinton, statistical, mechanics, jaynes, modication, single, parametert, parametertis, suitable, vectorz, ias, kindicates, optimal, temperaturetcan, derived, gaussian, bandc, compared, map, converted, logarithmic, space, bivariate, logarithmically, transformed, lrbilogistic, ln, tted, calibrationall, multiple, predict, changed, iare, ofkand, are^, label^, iof, isargmax, kz, common, doing, isk, gbinary, is^, xed, repeating, unnormalized, formedq, where^, classk, condence^, selected, normalized, vectorp, argmax, ofq, briey, krizhevsky, colour, dimensions, aeroplane, automobile, deer, originally, balanced, task, data, randomly, testing, deng, consists, various, million, actually, view, netzer, centred, digit, additional, combined, original, formed, taking, caltech, welinder, leaving, written, goodfellow, attempt, representation, smallest, unit, node, neuron, amount, architecture, compute, multiplied, summed, optimized, grouped, layers, concepts, base, complex, simplied, features, captured, hidden, consisting, followed, extract, abstract, convnets, grid, topology, lters, kernels, pixels, spatially, dot, products, patterns, classify, lenet, recognition, pooling, invariant, translations, pooled, unchanged, surrounding, account, intensity, aggregation, nearby, zhou, chellappa, rectangular, useful, allows, position, downsample, summarizes, downsampling, stride, rectied, linear, activation, relu, nair, sparse, propagate, gradients, activated, occurs, converts, zero, derivative, cancelled, throughout, backpropagation, ioffe, szegedy, scale, normalize, variance, current, mini, improve, performance, stability, structure, sections, residual, resnet, functionsf, wherexis, andh, underlying, mapping, inputx, identity, later, building, ultimately, mappingh, nonlinear, approximate, constructed, starting, stack, ornresidual, gwith, ltersf, global, dense, bottleneck, namely, precise, noting, sampling, fc, stochastic, depth, huang, random, dropped, bypassed, survival, linearly, according, making, previously, adding, liu, ow, enhance, propagation, encourage, reuse, determined, growth, ratek, initial, brackets, sequence, conv, convolution, fully, connected, zagoruyko, komodakis, increases, width, decreases, alleviate, diminishing, increasing, computed, earlier, fading, going, widened, enlarging, factork, parameternindicates, per, meaningn, factor, parameterkindicates, parameternshows, avg, calibrationin, necessity, firstly, capacity, effect, higher, plot, varying, displays, taken, demonstrated, association, certainly, enables, cost, accurate, pointed, precisely, relation, networksnext, approaches, mentioned, below, angle, kuleshov, ermon, online, potentially, adversarial, recalibration, technique, proposed, tested, moreover, independent, identical, assumptions, liang, structured, speech, optical, character, challenging, types, queries, users, lakshminarayanan, ensembles, bayesian, achieved, shift, pereyra, penalize, regularizing, domains, modeling, hendrycks, gimpel, detect, ofdistribution, statistics, baseline, gal, ghahramani, represent, dropout, srivastava, approximation, sacricing, computational, complexity, bendale, boult, propose, adapt, openmax, being, unknown, zhang, analysis, individual, progressive, stage, condent, proceed, keren, regressors, outputting, obtain, github, repository, preprocessing, augmentation, references, articles, preprocessed, subtracting, channel, dividing, deviation, exception, augmented, ipped, horizontally, padded, cropped, reection, manner, normalizing, horizontal, ipping, https, com, nn_calibration, pre, simonyan, zisserman, scaled, shorter, subtracted, resized, centre, perchannel, performed, noted, ne, author, occurred, separate, essential, ratios, fortunately, usable, implemented, source, library, keras, chollet, tensorflow, backend, abadi, hyperparameters, presented, nonetheless, clarity, stated, differently, descent, optimizer, nesterov, momentum, dampening, initialized, epochs, script, public, li, minibatch, running, provided, yu, improving, implementation, chen, otherwise, converging, majumdar, factorkof, insight, obtained, mof, betacal, package, scikit, pedregosa, tom, abbreviated, grey, bold, rank, easier, subscripted, ranked, separately, serialized, format, python, programming, include, performing, mostly, rather, worse, coloured, uncaluncalhistohistoisoisotemptempbeta, larger, eces, respectively, elements, unlucky, looking, created, really, indicated, lowest, largest, corresponds, largely, affected, uncal, confidenceresnet, histo, iso, temp, scenario, poorly, opposing, cannot, conrmed, conicting, ratethe, consistently, naturally, reduces, likelihoodnegative, negatively, efciencytemperature, computationally, efcient, arguably, easiest, faster, closest, competitor, converge, iterations, tesla, computing, center, university, tartu, surprisingly, outperformed, slightly, overtting, unfortunately, details, vague, mention, suggested, write, counted, projection, crops, ip, getting, patches, averaged, saying, harder, stanford, krause, started, anything, comparable, minor, contributions, modifying, having, readily, web, complications, working, properly, secondly, loaded, cropping, evaluation, implement, conclusion, regarding, clearly, future, interesting, understand