Data Intervention and Attribution Validation
How to validate data attribution through deletion, correction, reweighting, counterfactual examples, retraining, and random deletion baselines.
How to validate data attribution through deletion, correction, reweighting, counterfactual examples, retraining, and random deletion baselines.
A practical comparison of instance-level attribution methods for NLP: gradient similarity, influence functions, and TracIn, including assumptions and limitations.
A compact interview narrative for a training-data attribution thesis: research question, method, contribution, limitations, and PhD extensions.
Why exact Shapley is expensive and how scalable attribution uses sampling, surrogate models, datamodels, and group-to-document-to-example hierarchies.
Attribution scores are estimates. This note separates estimator bias, sampling variance, training randomness, evaluation uncertainty, and bootstrap confidence intervals.
A research-oriented guide to training-data attribution: attribution units, utility functions, Shapley values, influence methods, causality, scalability, and uncertainty.