introductionclassication, task, labelling, given, instance, data, set, values, called, features, appropriate, class, example, consider, description, weight, diet, etc, whereas, classier, computer, program, performs, typically, created, supervised, learning, model, trained, algorithm, pre, labelled, reasonably, adept, predicting, correct, unlabelled, afterwards, probabilistic, further, prediction, single, outputs, probability, vector, lengthk, thekpossible, classes, index, represents, condence, corresponding, described, random, variables, xandyrespectively, understood, being, drawn, joint, distribution, relating, terms, supposed, posterior, jxx, core, assumption, forming, basis, classication, training, testing, deployment, sampled, independently, identically, distributed, ptest, however, settings, surveyors, biased, collecting, segments, population, medical, diagnostic, oversampling, disease, positive, user, demographics, preferences, commerce, social, media, sites, referred, asdataset, shift, forms, [moreno, torres, et, al, kull, flach, storkey, methods, decades, proposed, taking, advantage, properties, specic, patterns, drawbacks, requirements, dicult, accommodate, [gama, require, retraining, [sugiyama, unsuitable, [provost, fawcett, correcting, exactly, goal, measure, performance, loss, function, needed, particularly, expected, minimized, strictly, proper, scoring, [epstein, dawid, closely, related, bregman, divergences, [bregman, banerjee, especially, common, brier, score, log, reduce, reducing, predicted, variety, including, currently, known, correction, share, trait, having, ptrain, fails, process, mismatch, introduced, novel, decompositions, adjustment, precursor, calibration, [kull, termed, proved, performing, coherent, procedure, fullling, particular, across, showed, exist, squared, error, issues, adjusted, zero, clearly, nonsensical, interpreted, iterative, adjust, unreliable, failing, converge, questions, remained, reliable, compute, reduced, useful, realistic, thesis, introducing, unbounded, general, bounded, provides, equivalent, previously, used, guarantees, reduction, benet, outputting, implemented, convex, optimizers, section, depth, dataset, classifying, identifying, dierent, reviewing, popular, techniques, review, connecting, giving, deriving, presented, dened, theorems, results, series, experiments, displayed, analyzed, concluded, happensthe, dataxand, ofk, classesy, correctly, probabilityp, jj, classy, jwith, k], distributionp, withxbeing, representing, covariates, andybeing, labels, components, evidence, prior, likelihoodp, jy, jx, bayes, relation, ij, predicts, xis, optimal, underlying, principles, classical, statistical, describes, breaking, portion, pervasive, applications, [ditzler, denition, denexas, yas, andp, relates, test, wherep, trainrepresents, andptestrepresents, later, shifting, practical, going, operating, improve, motivated, subeld, transfer, broadly, involve, changing, entirely, [pan, yang, dene, domaind, gand, tasktfy, wherex, andyare, andf, maps, fromxtoywhich, asp, source, taskts, target, tasktt, aims, predictive, functionft, ind, tusing, knowledge, domaindsandts, context, subset, xtandys, added, brief, introduction, occurs, categorization, current, reviewed, causes, actual, varied, individually, consensus, categorize, mentioned, unifying, view, authors, divide, non, stationary, environment, sample, selection, bias, introduce, generators, sampling, observed, hidden, versions, denotexandyas, andx, handyhas, dier, xmay, measured, temperature, chemical, sensor, making, measurement, sensitive, unstable, heat, recorded, lose, accuracy, reality, shifted, graphical, framework, showing, aects, simpler, included, main, categories, aecting, representation, dierence, xhandyh, inuencing, xandy, dotted, dashed, necessarily, representative, variablexdependent, onx, ydependent, onyh, wheregis, applies, inaccuracies, represented, origin, aectingxandy, contextcshifting, indicate, ideally, collector, uniformly, easier, collect, following, conditions, sucient, necessary, classify, [hein, support, rst, states, featuresxcan, featuresxwith, classycan, collection, regions, unsampled, technically, observational, inaccurate, hardly, uncalibrated, instrumentation, misrepresent, rate, less, calibrated, arise, measuring, becoming, accurate, reasonable, solutions, simply, repairing, improving, doing, gure, usually, applied, using, service, customer, season, business, attempt, reapply, although, truly, caused, modelled, terminology, describing, intuitively, concept, types, compared, generated, equally, centered, coordinate, variance, negative, likelihood, guaranteed, clear, candidate, moved, ratio, reader, easily, original, haveptrain, lower, clothing, items, posted, online, likely, sandals, gloves, thexvariable, theyvariable, clothingp, designer, purposefully, induce, approach, trying, solve, imbalanced, [sun, practitioners, smaller, [japkowicz, stephen, distinction, causal, eitherx, yory, claim, onlyy, xproblems, experience, thex, yproblem, assessing, patients, developing, lung, cancer, risk, factors, exposed, radon, history, xvariable, completely, plausible, individuals, diagnosed, rare, balancing, counter, reasons, chooses, referenced, shif, attempting, concern, rarely, learned, unseen, retrained, neither, imitate, perfectly, undersampling, prestigious, psychology, department, behaviors, student, body, public, younger, wealthier, split, domain, former, addressed, reweighting, subvariety, instanced, problematic, conditional, conditioned, respectively, doesnt, latter, challenging, relatively, uncommon, adaptive, possible, remaining, covered, illustration, changed, adapt, option, extra, impractical, situations, severe, worsen, exotic, groupings, listed, below, experienced, resulting, continuously, updating, addressing, primary, resolved, include, importance, weighted, cross, validation, maximum, estimate, [shimodaira, kernel, matching, [gretton, emerging, eld, formally, [forman, quantication, estimating, [gonzlez, oclassify, [milli, barranquero, [saerens, fairly, estimation, formula, swapped, adjusting, formal, corrected, shown, worse, unclear, typical, expectation, maximization, unknown, suggest, creating, robust, various, [byrne, thoroughly, explained, slowly, adapted, infrastructure, incremental, fashion, continually, updated, production, really, automate, retrieving, pipeline, viable, range, omake, oreceive, oupdate, details, older, date, forgetting, mechanisms, identify, occurring, divergenceone, evaluate, parameters, indicating, minimize, generates, approximated, empirical, averaged, equal, length, sub, ject, entries, summing, deterministically, associated, implying, nearly, ideal, minimum, intuition, topic, connected, derived, adjusters, hope, match, psrs, [dawid, merkle, steyvers, functionfand, labely, denefto, divergencedfrom, pointato, pointbmeasured, tangent, labelspand, inequality, q[, strict, straightforward, geometry, blfs, geometric, consult, rbe, rksuch, thatis, dierentiable, relative, interior, ri, optimality, exhaustive, proven, predictor, [banerjee, stated, fulll, twice, within, additive, constant, letd, ybe, arbitrary, inr, dfor, bothe[]and, ]are, nite, letxbe, event, partial, information, arg, min, [d, letf, rd, nonnegative, thatf, rdford, assume, variablesytaking, inrd, ife[]is, unique, minimizer, ofe[, ]over, constantsx, thenf, suited, derivations, summarized, euclidean, [brier, refer, dbs, ky, base, simplex, jlog, mahalanobis, itakura, saito, symmetry, allx, required, lacking, multiply, coecient, sum, implicit, binary, logarithmic, kullback, leibler, [kullback, shannon, entropy, [shannon, sinceis, dk, innity, ylog, respect, di, whenb, rapidly, neara, concavity, [mahalanobis, generalized, clustering, [cayton, covariance, matrix, considered, generalization, identity, [itakura, frequently, audio, speech, processing, [gray, bonus, divergencein, explicitly, written, literature, proofs, proposition, rand, bd, bnotates, gradient, taken, bof, simplication, rbd, bh, givend, hc, simplifying, previous, rewrite, yields, decompositionsto, understand, irreducible, gain, amount, unless, deterministic, post, [degroot, fienberg, ak, wherey, andyi, andfbe, denote, sis, j], forecasting, advance, forecaster, approximately, actually, havep, overall, grouped, incorrectly, calibrate, mapped, isotonic, regression, [barlow, platt, scaling, [platt, separate, calculate, mapping, ofsset, fbe, anddbe, assf, predictionsis, average, unadjusted, helpful, naive, properly, rk, multiplicative, wherew, [kul, finding, trivial, apparent, despite, visible, forx, predictionss, crepresents, qrepresents, byp, predictionssbecome, predictionsc, nally, predictionsq, decreasing, closer, coherence, respective, intuitive, understanding, thatapplies, regardless, andbe, meaning, thate[], []where, thenis, withdif, quantity, depending, jonly, const, kwith, position, mand, proves, specically, decomposed, withd, ]for, subsequencev, variabless, ythe, calibrating, obvious, choice, sizeable, attainable, getting, roughly, approximate, othe, interpretable, solves, implementation, optimization, allowing, calculated, eciently, reliably, lacks, decomposable, generalizedin, addition, bounds, higher, therefore, implementing, solvable, standard, rn, ofkpredictions, theninstances, instancei, n]has, rowp, entrypi, classj, outputpq, whereqis, minimizing, additional, ofqis, setrn, restricted, equality, constraints, ensuring, kshould, n], asq, ignore, subsection, column, ofqto, inqthat, qhas, qas, nd, ana, thatp, pi, decomposes, fromptoaand, pointa, givenp, andd, suspect, ofa, originalpwould, adjustedais, indication, thata, satises, inf, pbe, andis, whereq, jp, n]and, ]g, inq, fromp, waya, pro, jection, ofpto, closest, byd, setq, visual, explanation, relationship, pto, nearest, write, complete, lagrange, multipliers, eachr, eachi, minimization, lagrangian, haven, kvariables, froma, nvariables, andkvariables, input, rf, expand, af, simplicitys, sake, representr, aas, derivatives, mimics, location, kmatrix, jd, aid, ofq, equation, satised, ei, ax, thatr, px, depend, oniandj, meansconst, jhe, ionly, oniandjmatching, implies, letpbe, letbe, letabe, contradiction, mahanlanobis, interpret, improved, motivates, constrain, requiring, ja, k]gora, theqwith, propose, ugapredictionsa, sharply, kand, thanq, casea, distant, viewpoint, greater, lemma, leta, karushkuhn, tucker, earlier, leaves, jactually, double, concerned, jwould, qi, sinceq, sop, denesq, writing, ad, knowp, sincea, andaare, ora, chosen, produces, extension, marked, bya, agreeing, bsis, correctness, global, intractable, luckily, computationally, bshas, ecient, local, assured, constrained, search, space, ob, jective, [boyd, vandenberghe, linear, forcesqto, intersection, kis, convexity, preserved, arguments, preserve, regard, newtons, ne, closed, computations, transforming, indicator, barrier, modied, solved, applying, noting, naturally, directly, experimental, resultsthe, promising, exception, demonstrate, setup, discussed, compare, downloading, openml, [vanschoren, library, casalicchio, rstudio, multiclass, downloaded, submitted, interval, fewer, discarded, thrown, le, skipped, divided, fold, saved, lexicographical, combination, performed, ma, jority, largest, ipping, minority, based, valued, encourage, notably, pearson, correlation, sorted, beginning, combined, histogram, valid, losses, estimated, varying, increased, shared, summed, induced, [diamond, boyd, judged, adding, collected, binned, check, theory, improvement, tends, recommended, violin, graphs, axis, plot, proportional, comparison, pushed, conrms, poorly, trends, absolute, certainty, outperform, slightest, increases, profound, degree, slightly, substantially, correspond, starting, conclusiondataset, recent, researchers, started, paying, deteriorate, frequent, eect, longer, demonstrated, eectiveness, database, severity, neural, networks, explored, intention, numbered, abstract, cuto, variation, arena