introductionclassication, labelling, instance, data, called, features, appropriate, class, example, consider, description, weight, diet, etc, whereas, classier, computer, program, performs, classiers, typically, created, supervised, learning, model, trained, algorithm, pre, labelled, reasonably, adept, predicting, unlabelled, probabilistic, prediction, outputs, probability, vector, lengthk, thekpossible, index, represents, condence, corresponding, described, random, variables, xandyrespectively, understood, drawn, joint, distribution, relating, supposed, output, posterior, probabilities, jxx, core, assumption, forming, basis, classication, training, testing, deployment, sampled, independently, identically, distributed, ptest, surveyors, biased, collecting, segments, population, medical, diagnostic, oversampling, disease, positive, user, demographics, preferences, commerce, social, media, sites, referred, asdataset, shift, [moreno, torres, et, al, kull, flach, storkey, methods, decades, proposed, advantage, properties, specic, patterns, drawbacks, requirements, dicult, accommodate, practice, [gama, require, retraining, [sugiyama, unsuitable, [provost, fawcett, correcting, exactly, performance, loss, function, needed, particularly, expected, minimized, models, functions, property, strictly, scoring, [epstein, dawid, closely, related, bregman, divergences, [bregman, banerjee, especially, common, brier, reduce, reducing, divergence, predicted, variety, including, currently, correction, trait, distributions, ptrain, process, mismatch, introduced, novel, decompositions, adjustment, precursor, calibration, [kull, termed, proved, performing, coherent, procedure, fullling, particular, requirement, predictions, across, showed, procedures, exist, squared, error, issues, adjusted, method, zero, clearly, nonsensical, interpreted, iterative, adjust, unreliable, failing, converge, remained, reliable, compute, reduced, realistic, thesis, introducing, unbounded, bounded, provides, equivalent, previously, guarantees, reduction, benet, outputting, implemented, convex, optimizers, section, depth, dataset, classifying, identifying, dierent, reviewing, popular, techniques, connecting, examples, deriving, decomposition, presented, dened, theorems, results, series, experiments, displayed, analyzed, concluded, happensthe, dataxand, ofk, classesy, correctly, probabilityp, jj, classy, jwith, k], distributionp, withxbeing, variable, representing, covariates, andybeing, labels, components, evidence, prior, likelihoodp, jy, jx, bayes, theorem, relation, ij, predicts, xis, optimal, underlying, principles, classical, statistical, instances, breaking, portion, pervasive, problem, applications, [ditzler, denition, denexas, yas, andp, relates, wherep, trainrepresents, andptestrepresents, later, shifting, practical, application, operating, motivated, subeld, transfer, broadly, involve, changing, entirely, [pan, yang, dene, domaind, gand, tasktfy, wherex, andyare, andf, fromxtoywhich, asp, source, taskts, target, tasktt, predictive, functionft, ind, tusing, knowledge, domaindsandts, context, subset, problems, xtandys, added, brief, introduction, occurs, categorization, current, reviewed, causes, actual, varied, individually, consensus, categorize, mentioned, unifying, result, non, stationary, environment, sample, selection, bias, introduce, generators, sampling, observed, versions, denotexandyas, andx, handyhas, dier, xmay, represent, measured, temperature, chemical, sensor, measurement, sensitive, unstable, environments, recorded, accuracy, reality, temperatures, shifted, graphical, framework, showing, aects, simpler, included, main, categories, aecting, representation, dierence, xhandyh, inuencing, xandy, dotted, dashed, necessarily, representative, variablexdependent, onx, ydependent, onyh, wheregis, applies, inaccuracies, represented, origin, aectingxandy, contextcshifting, indicate, ideally, collector, uniformly, easier, collect, conditions, sucient, necessary, classify, [hein, support, condition, rst, featuresxcan, featuresxwith, classycan, collection, regions, unsampled, technically, observational, inaccurate, measurements, perfect, uncalibrated, instrumentation, misrepresent, less, calibrated, measuring, accurate, reasonable, solutions, simply, repairing, improving, doing, gure, usually, applied, using, business, attempt, reapply, although, caused, modelled, terminology, describing, intuitively, covariate, concept, types, compared, generated, equally, centered, coordinate, variance, negative, likelihood, guaranteed, candidate, gures, moved, ratio, easily, original, haveptrain, lower, items, posted, online, sandals, thexvariable, type, category, theyvariable, descriptions, clothingp, designer, purposefully, induce, approach, trying, solve, imbalanced, [sun, practitioners, apply, smaller, [japkowicz, stephen, distinction, causal, eitherx, yory, claim, onlyy, xproblems, experience, thex, yproblem, assessing, patients, developing, lung, cancer, risk, factors, exposed, radon, xvariable, completely, plausible, practitioner, individuals, diagnosed, rare, balancing, referenced, shif, strike, attempting, concern, rarely, unseen, retrained, perform, imitate, perfectly, undersampling, prestigious, psychology, department, behaviors, student, students, younger, wealthier, split, domain, former, addressed, reweighting, subvariety, instanced, samples, problematic, region, solution, conditional, conditioned, respectively, doesnt, latter, challenging, relatively, uncommon, adaptive, remaining, covered, illustration, changed, adapt, option, impractical, situations, severe, worsen, exotic, groupings, listed, experienced, resulting, continuously, updating, addressing, primary, situation, resolved, approaches, include, importance, weighted, cross, validation, maximum, estimate, [shimodaira, kernel, matching, [gretton, emerging, eld, formally, decade, [forman, quantication, estimating, [gonzlez, oclassify, [milli, barranquero, [saerens, fairly, estimation, formula, swapped, adjusting, formal, corrected, shown, unclear, typical, expectation, maximization, suggest, creating, robust, various, [byrne, thoroughly, explained, adapted, infrastructure, incremental, continually, updated, production, automate, retrieving, label, pipeline, viable, range, omake, oreceive, oupdate, details, dierences, older, forgetting, mechanisms, identify, occurring, divergenceone, evaluate, parameters, indicates, indicating, minimize, generates, approximated, empirical, averaged, vectors, sub, ject, entries, summing, deterministically, associated, implying, generate, minimum, intuition, topic, connected, derived, adjusters, psrs, [dawid, merkle, steyvers, functionfand, labely, denefto, divergencedfrom, pointato, pointbmeasured, tangent, labelspand, inequality, q[, strict, straightforward, geometry, blfs, geometric, consult, rbe, rksuch, thatis, dierentiable, relative, interior, ri, optimality, exhaustive, proven, predictor, [banerjee, stated, fulll, within, additive, constant, letd, ybe, arbitrary, inr, dfor, bothe[]and, ]are, nite, letxbe, event, partial, information, arg, min, [d, letf, rd, nonnegative, thatf, rdford, assume, variablesytaking, inrd, ife[]is, unique, minimizer, ofe[, ]over, constantsx, thenf, suited, derivations, sections, summarized, euclidean, distance, [brier, refer, dbs, ky, simplex, jlog, mahalanobis, itakura, saito, symmetry, allx, required, lacking, coecient, implicit, binary, special, logarithmic, kullback, leibler, [kullback, shannon, entropy, [shannon, sinceis, dk, innity, ylog, respect, di, whenb, neara, concavity, [mahalanobis, generalized, clustering, elds, [cayton, covariance, matrix, considered, generalization, identity, [itakura, frequently, audio, processing, [gray, bonus, divergencein, explicitly, literature, proofs, proposition, rand, bd, bnotates, gradient, proof, bof, simplication, rbd, bh, givend, hc, simplifying, previous, rewrite, yields, decompositionsto, sources, irreducible, unless, deterministic, [degroot, fienberg, ak, wherey, andyi, andfbe, denote, sis, j], forecasting, advance, forecaster, predict, approximately, actually, havep, occur, grouped, incorrectly, grouping, calibrate, mapped, isotonic, regression, [barlow, platt, scaling, [platt, calculate, mapping, ofsset, js, fbe, anddbe, assf, predictionsis, average, unadjusted, naive, properly, rk, multiplicative, ks, wherew, weights, [kul, finding, trivial, apparent, despite, visible, forx, predictionss, crepresents, qrepresents, byp, predictionssbecome, predictionsc, nally, predictionsq, decreasing, closer, coherence, respective, intuitive, understanding, thatapplies, regardless, andbe, meaning, thate[], []where, thenis, withdif, quantity, depending, jonly, const, kwith, position, mand, reduces, specically, decomposed, withd, ]for, subsequencev, variabless, ythe, calibrating, obvious, denitions, sizeable, attainable, roughly, approximate, othe, adjustments, interpretable, solves, implementation, optimization, allowing, calculated, eciently, reliably, lacks, provide, decomposable, generalizedin, addition, bounds, higher, therefore, implementing, solvable, standard, rn, ofkpredictions, theninstances, instancei, n]has, rowp, entrypi, classj, outputpq, whereqis, minimizing, additional, ofqis, setrn, restricted, equality, constraints, ensuring, kshould, n], asq, entry, ignore, subsection, averages, ofqto, inqthat, constraint, qhas, qas, adjuster, nd, ana, thatp, pi, decomposes, fromptoaand, exists, pointa, givenp, andd, suspect, ofa, originalpwould, adjustedais, indication, thata, satises, inf, pbe, andis, whereq, jp, n]and, ]g, nds, inq, fromp, waya, pro, jection, ofpto, closest, byd, setq, visual, explanation, relationship, pto, nearest, complete, lagrange, multipliers, eachr, eachi, minimization, lagrangian, haven, kvariables, froma, nvariables, andkvariables, input, rf, expand, af, simplicitys, sake, representr, aas, derivatives, mimics, location, kmatrix, jd, ofq, equation, satised, ei, thatr, px, oniandj, meansconst, jhe, ionly, oniandjmatching, implies, letpbe, letbe, letabe, us, contradiction, mahanlanobis, interpret, improved, motivates, constrain, requiring, ja, k]gora, theqwith, propose, ugapredictionsa, sharply, kand, thanq, casea, distant, viewpoint, greater, lemma, leta, karushkuhn, tucker, earlier, jactually, concerned, jwould, qi, sinceq, sop, denesq, ad, knowp, sincea, andaare, ora, produces, extension, marked, bya, agreeing, bsis, correctness, global, intractable, luckily, computationally, bshas, ecient, feature, local, assured, constrained, ob, jective, [boyd, vandenberghe, linear, forcesqto, intersection, kis, convexity, preserved, arguments, preserve, individual, regard, argument, newtons, ne, closed, computations, transforming, indicator, barrier, modied, solved, applying, noting, naturally, directly, experimental, resultsthe, promising, exception, demonstrate, setup, discussed, downloading, datasets, openml, [vanschoren, casalicchio, rstudio, multiclass, downloaded, submitted, interval, fewer, discarded, le, skipped, divided, saved, lexicographical, combination, performed, jority, largest, imitates, es, ipping, minority, based, valued, encourage, notably, pearson, correlation, sorted, combined, histogram, valid, estimated, varying, estimations, increased, shared, summed, induced, [diamond, boyd, experiment, judged, shifts, adding, collected, binned, theory, suggests, improvement, tends, pattern, recommended, violin, graphs, axis, plot, proportional, comparison, pushed, conrms, poorly, trends, absolute, certainty, outperform, disappears, slightest, increases, outperforms, profound, trend, degree, slightly, substantially, correspond, starting, conclusiondataset, recent, researchers, started, paying, issue, deteriorate, frequent, eect, longer, demonstrated, includes, algorithms, eectiveness, database, degrees, severity, neural, networks, eects, explored, intention, numbered, abstract, cuto, variation, arena