GUIDA TECNICA

Schede modello e schede tecniche per set di dati

A model card is a short, structured document that explains what an AI model is for, how it was evaluated, how well it performs for different groups and conditions, and where it should not be used.

Ascolta questa guidaNarrato dall'IA · ~3 min

In questa pagina3 minuti di lettura
  1. Panoramica
  2. Immersione profonda
  3. Implementazione nel mondo reale
  4. The Future of Model Cards and Datasheets for Datasets
  5. Metterlo in pratica
  6. Continua a esplorare
  7. Domande frequenti

Panoramica

A datasheet for datasets does the same for training data: why the data was collected, what it contains, how it was gathered and labeled, and how it should be maintained. These documents matter because they let buyers, users, auditors and regulators judge whether a system is fit for purpose, and laws such as the EU AI Act now require similar documentation.

Immersione profonda

Model cards were proposed by Margaret Mitchell and colleagues in the paper "Model Cards for Model Reporting", presented at the ACM FAT* conference in 2019. The suggested sections are model details, intended use, factors (such as demographic or environmental conditions), metrics, evaluation data, training data, quantitative analyses, ethical considerations, and caveats and recommendations. The key idea is disaggregated evaluation: reporting performance separately for relevant subgroups rather than as one average score that can hide failures. Datasheets for Datasets, by Timnit Gebru and colleagues, first circulated in 2018 and was later published in Communications of the ACM. It borrows from electronics datasheets. Dataset creators answer questions about motivation, composition, collection process, preprocessing and labeling, uses, distribution and maintenance. Related formats include data statements for language datasets and data cards. System cards, used by Meta and OpenAI since 2022 and prominently for GPT-4 in 2023, document a whole deployed system, including safety testing and mitigations, rather than only the model. Regulation has turned much of this practice into a requirement. The EU AI Act requires technical documentation for high-risk AI systems, set out in Annex IV. Providers of general-purpose AI models must keep technical documentation, give information to downstream providers, and publish a summary of training content using a Commission template. A common misconception is that a model card proves a model is safe. It is a disclosure, not a certification, and a card can be incomplete, outdated or written like marketing. Its value depends on honest limitations and evaluations that someone else can reproduce.

Implementazione nel mondo reale

A hospital evaluating a skin-lesion classifier reads its model card and finds accuracy was reported separately by skin tone. It then decides to run its own local validation before use.

A Hugging Face model repository shows a model card with YAML metadata listing its license, training datasets, languages and benchmark results, and people can filter search results by those fields.

A research team publishes a speech dataset with a datasheet that records speakers' consent, recording conditions and the accents that are under-represented.

An AI lab releases a system card for a chatbot describing red-teaming results, safety mitigations and the risks that remain, beyond what a basic model card covers.

The Future of Model Cards and Datasheets for Datasets

Documentation is moving from voluntary best practice toward a compliance requirement. The EU AI Act, procurement rules and standards such as ISO/IEC 42001 all expect structured records of how a system was built and tested. Machine-readable formats and automated generation will likely become more common, so that cards can be checked and compared. The ongoing challenges are keeping documents accurate as models are updated, disclosing enough about training data without exposing trade secrets or personal information, and making sure readers actually use the documents when deciding.

Metterlo in pratica

Perché è importante

  • Costo e budget. Le decisioni relative all'architettura determinano prestazioni e costi operativi per anni.
  • Decisioni più chiare. La formazione tecnica aiuta i team a scegliere lo stack giusto, non solo quello più nuovo.
  • Controllo di qualità. Migliori scelte ingegneristiche riducono gli incidenti legati all’affidabilità nella produzione.

Attenzione

  • L'ottimizzazione di un benchmark può nascondere debolezze di sistema più ampie.
  • I costi delle infrastrutture e della manutenzione sono spesso sottostimati.
  • Le lacune in termini di sicurezza e osservabilità possono aumentare man mano che i sistemi diventano più complessi.

Prossimi passi

  1. Definire obiettivi di latenza, qualità e costi prima dell'implementazione.
  2. Benchmark in condizioni di carico e dati realistiche.
  3. Monitoraggio dello strumento per errori, deriva e impatto sull'utente.
  4. Preparare percorsi di rollback e risposta agli incidenti prima della scalabilità.

Continua a esplorare

Newsletter gratuita

Ricevi il briefing quotidiano sull'IA

Tre storie verificate sull'IA ogni mattina nei giorni feriali, scritte in un inglese semplice. Gratuito per sempre, senza pubblicità.

Un'email ogni giorno feriale. Disiscriviti con un clic. Non vendiamo né condividiamo mai il tuo indirizzo.

Mettiti alla prova

Take the Model Cards and Datasheets for Datasets quiz

Feedback immediato su ogni risposta e un certificato condivisibile con un ID verificabile una volta superato un corso.

Inizia il quiz

Sostieni l'istruzione gratuita sull'IA. AI Understanding è un'organizzazione non profit 501(c)(3) — nessun annuncio, nessun paywall, mai. Fai una donazione

Domande frequenti

What is Model Cards and Datasheets for Datasets?

A model card is a short, structured document that explains what an AI model is for, how it was evaluated, how well it performs for different groups and conditions, and where it should not be used. A datasheet for datasets does the same for training data: why the data was collected, what it contains, how it was gathered and labeled, and how it should be maintained. These documents matter because they let buyers, users, auditors and regulators judge whether a system is fit for purpose, and laws such as the EU AI Act now require similar documentation.

Qual è lo scopo principale di una scheda modello?

A model card gives readers what they need to judge whether a model fits a particular use, including where it performs poorly.

Chi ha guidato il giornale che ha proposto le carte modello?

Margaret Mitchell and colleagues presented "Model Cards for Model Reporting" at ACM FAT* in 2019.

Cos’è la valutazione disaggregata?

Splitting results by subgroup exposes failures that an overall average would hide.

Datasheets for Datasets prende in prestito la sua idea da quale campo?

Electronic components come with datasheets that describe their characteristics. Gebru and colleagues applied that idea to datasets.

In cosa differisce una scheda di sistema da una scheda modello base?

System cards, such as OpenAI's for GPT-4, describe a deployed product's risks, red-teaming and safeguards.