Tiếp theoHướng dẫn tiếp theo
Chuyển đổi phong cách video sang video
AI trực quan
HƯỚNG DẪN KỸ THUẬT
Log, Box-Cox, and Yeo-Johnson transformations reshape numeric distributions, often reducing right skew and stabilizing variation before modeling.
Nghe hướng dẫn nàyAI thuật lại · ~3 min
They change the scale and interpretation of values, so transformation choice, fitted parameters, and inverse predictions must be handled carefully.
A transformation changes the numerical scale of a variable to make patterns easier for a model to represent. A logarithm grows slowly for large positive values, so it can reduce right skew and turn multiplicative relationships into additive ones. The change also means differences on the transformed scale no longer correspond to equal absolute differences on the original scale. The ordinary logarithm requires positive inputs. A log1p transform uses log(1 plus x) and accommodates zero but still requires x greater than negative one. Adding an arbitrary constant to permit negatives changes the interpretation and should be justified. Box-Cox considers a family of power transformations and estimates a parameter, but its standard form requires strictly positive values. Yeo-Johnson is another power-transform family that can handle zero and negative values. These methods can help with skewed features or targets, but they are not universal preprocessing requirements. Tree-based models may be less sensitive to monotonic rescaling than models based on linear relationships or distance, though distribution changes can still affect some workflows. A transform does not remove outliers, establish normality, fix biased sampling, or guarantee better predictions. Compare model behavior and errors on held-out data. For target transformations, fit the transformation parameters on training data and transform training targets accordingly. At prediction time, apply the inverse transformation to return to the original units. Because nonlinear inverses do not preserve averages, simply exponentiating an average predicted log value can produce a biased estimate of the original-scale conditional mean. The appropriate correction depends on the modeling assumptions and evaluation objective. Use a pipeline to avoid fitting transformation parameters using validation or test examples. Record the transform and fitted parameter so inference uses the same mapping. Report metrics in a scale that matches the practical task, and inspect residuals and subgroup effects rather than judging only the transformed distribution.
A model of positive income values uses a log transform to reduce right skew, then reports predictions back on the original scale with the inverse transform.
A pipeline applies Box-Cox to a strictly positive measurement and fits its parameter using training data only.
A dataset includes zero and negative values, so the analyst considers Yeo-Johnson or another justified method instead of applying a plain logarithm.
A team compares residual behavior and held-out performance before and after transformation rather than assuming a more Gaussian-looking feature guarantees a better model.
Transformations will continue to be useful as transparent tools for matching model assumptions and representing multiplicative structure. Automated pipelines can fit parameters safely and preserve inverse mappings, while modern models may reduce the need for manual distribution shaping in some tasks. Neither trend removes the need to compare outcomes on the scale that users care about. As deployment pipelines evolve, teams should retain transformation metadata and monitor input ranges for values the fitted mapping did not represent well. Record the fitted parameters with the model artifact.
Bản tin miễn phí
Ba câu chuyện AI đã được xác minh vào mỗi buổi sáng các ngày trong tuần, được viết bằng tiếng Anh đơn giản. Miễn phí mãi mãi, không có quảng cáo.
Một email mỗi ngày trong tuần. Hủy đăng ký trong một cú nhấp chuột. Chúng tôi không bao giờ bán hoặc chia sẻ địa chỉ của bạn.
Tự kiểm tra
Phản hồi tức thì về mọi câu trả lời và chứng chỉ có thể chia sẻ với ID có thể xác minh sau khi bạn vượt qua khóa học.
Hỗ trợ giáo dục AI miễn phí. AI Understanding là tổ chức phi lợi nhuận 501(c)(3) — không bao giờ có quảng cáo, không có tường phí. Hãy quyên góp
Log, Box-Cox, and Yeo-Johnson transformations reshape numeric distributions, often reducing right skew and stabilizing variation before modeling. They change the scale and interpretation of values, so transformation choice, fitted parameters, and inverse predictions must be handled carefully.
The logarithm grows more slowly for larger inputs and can reduce right skew.
Yeo-Johnson supports positive and negative inputs with separate branches.
Using held-out data to estimate preprocessing parameters leaks information into evaluation.
The inverse transform returns predictions to the target's original units.
For nonlinear functions, the inverse of an expectation generally differs from the expectation on the original scale.
Tiếp tục học hỏi
Đã chọn thêm hướng dẫn cho chủ đề này
Tiếp theoHướng dẫn tiếp theo
Chuyển đổi phong cách video sang video
AI trực quan