dataset bias

Dataset Bias refers to systematic errors or skews in training data that cause models to learn unintended, misleading patterns — the model captures the bias in the data rather than the true underlying relationship, leading to poor generalization and fairness issues.

Common Dataset Biases

• Selection Bias: The data is not representative of the real-world distribution — sampling is skewed.
• Label Bias: Labels are systematically wrong for certain subgroups — annotator bias or measurement bias.
• Representation Bias: Certain groups, conditions, or scenarios are underrepresented in the dataset.
• Measurement Bias: The features or labels are measured differently for different subgroups.

Why It Matters

• Fairness: Dataset bias is the primary cause of algorithmic unfairness — biased data produces biased models.
• Generalization Failure: Models trained on biased data fail when deployed on the true distribution.
• Semiconductor: Training data from a single fab, tool, or time period creates bias toward those specific conditions.

Dataset Bias is garbage in, garbage out — systematic data errors that cause models to learn the wrong patterns instead of the true signal.