Jump to ContentJump to Main Navigation
Machine Learning in Non-Stationary EnvironmentsIntroduction to Covariate Shift Adaptation$
Users without a subscription are not able to see the full content.

Masashi Sugiyama and Motoaki Kawanabe

Print publication date: 2012

Print ISBN-13: 9780262017091

Published to MIT Press Scholarship Online: September 2013

DOI: 10.7551/mitpress/9780262017091.001.0001

Show Summary Details
Page of

PRINTED FROM MIT PRESS SCHOLARSHIP ONLINE (www.mitpress.universitypressscholarship.com). (c) Copyright The MIT Press, 2022. All Rights Reserved. An individual user may print out a PDF of a single chapter of a monograph in MITSO for personal use.date: 30 June 2022

Importance Estimation

Importance Estimation

(p.72) (p.73) 4 Importance Estimation
Machine Learning in Non-Stationary Environments

Masashi Sugiyama

Motoaki Kawanabe

The MIT Press

This chapter discusses the problem of importance estimation. Importance-weighting techniques play essential roles in covariate shift adaptation. However, the importance values are usually unknown a priori, so they must be estimated from data samples. The chapter introduces importance estimation methods, including importance estimation via kernel density estimation, the kernel mean matching method, a logistic regression approach, the Kullback–Leibler importance estimation procedure, and the least-squares importance fitting methods. The latter methods allow one to estimate the importance weights without performing through density estimation. Since density estimation is known to be difficult, the direct importance estimation approaches would be more accurate and preferable in practice. The numerical behavior of direct importance estimation methods is illustrated through experiments. Characteristics of importance estimation methods are also discussed.

Keywords:   importance-weighting techniques, covariate shift adaptation, kernel density estimation, kernel mean matching, logistic regression, Kullback–Leibler importance estimation, least-squares importance fitting

MIT Press Scholarship Online requires a subscription or purchase to access the full text of books within the service. Public users can however freely search the site and view the abstracts and keywords for each book and chapter.

Please, subscribe or login to access full text content.

If you think you should have access to this title, please contact your librarian.

To troubleshoot, please check our FAQs, and if you can't find the answer there, please contact us.