Pack · 6 talks · 3h 08m to watch, 35 min to read

Data quality for machine learning

A table loads successfully and still gives the model the wrong evidence. A column can disappear, an event can change meaning, or a labeler can answer a different question from the one you intended. More rows will not repair those failures. Begin by defining what makes data wrong and tracing a suspicious result back through its processing. Convoy's incidents show why checking schemas alone is insufficient. GoCardless then moves expectations toward the producers, while a second contracts talk separates prevention from detection and helps decide where to invest. Labeling instructions bring the same discipline to human-created training data. Finish with a smaller, carefully checked starting dataset and a way to select useful examples, so improving quality does not require cleaning every source before you can begin.

2
Samuel Partee, Redis & Chad Sanderson, Gable & Joe Reis, Ternary Data & Maria Zhang, Proactive AI Lab Inc & Pushkar Garg, Clari Inc · 27:15 · AIQCON 2024
Data Quality = Quality AI

Why here: Convoy's pricing incidents expose two different breaks: a removed column and machine-generated bids entering data previously produced by people. The second can preserve the table's shape while changing its meaning. That expands the diagnosis from missing fields to source behavior, setting up the need for explicit producer commitments.

3
Andrew Jones, GoCardless · 34:30 · MLOps Meetup
Driving ML Data Quality with Data Contracts

Why here: Upstream teams can publish a defined data interface instead of exposing internal tables and leaving consumers to repair every change. Jones shows GoCardless's response, including ownership, versioning and migration expectations. The contract is an agreement about what downstream work may rely on, with the implementation serving that agreement.

5
Charles Brecque, TextMine · 12:59 · AI in Production 2024
Data Labeling Best Practices

Why here: People producing labels also need an unambiguous agreement. Brecque's document-extraction examples show how unclear instructions and guessed answers teach unwanted behavior. The setting is fine-tuning, but the quality question is broader: do the instructions and available evidence support the answer your training record claims?

6
Cody Coleman · 1:11:01 · MLOps Coffee Sessions
Data Selection for Data-Centric AI: Data Quality Over Quantity

Why last: You do not have to repair the whole archive to begin. Coleman recommends a small clean source, checks after each transformation, and gradual expansion. His uncertain bowling images also show how example selection can reveal cases people would overlook. This turns the preceding quality requirements into a bounded first dataset and a deliberate way to improve it.