No official summary available for this bill.
[Congressional Bills 118th Congress]
[From the U.S. Government Publishing Office]
[H.R. 9466 Introduced in House (IH)]
<DOC>
118th CONGRESS
2d Session
H. R. 9466
To direct the National Institute of Standards and Technology to catalog
and evaluate emerging practices and norms for communicating certain
characteristics of artificial intelligence systems, including relating
to transparency, robustness, resilience, security, safety, and
usability, and for other purposes.
_______________________________________________________________________
IN THE HOUSE OF REPRESENTATIVES
September 6, 2024
Mr. Baird (for himself and Mr. Lieu) introduced the following bill;
which was referred to the Committee on Science, Space, and Technology
_______________________________________________________________________
A BILL
To direct the National Institute of Standards and Technology to catalog
and evaluate emerging practices and norms for communicating certain
characteristics of artificial intelligence systems, including relating
to transparency, robustness, resilience, security, safety, and
usability, and for other purposes.
Be it enacted by the Senate and House of Representatives of the
United States of America in Congress assembled,
SECTION 1. SHORT TITLE.
This Act may be cited as the ``AI Development Practices Act of
2024''.
SEC. 2. NIST RESEARCH ON DEVELOPMENT BEST PRACTICES.
Section 22A of the National Institute of Standards and Technology
Act (15 U.S.C. 278h-1) is amended--
(1) by redesignating subsection (h) as subsection (i); and
(2) by inserting after subsection (g) the following new
subsection:
``(h) Assessment of the Practices of Artificial Intelligence
Development.--
``(1) In general.--The Director of the National Institute
of Standards and Technology (in this subsection referred to as
the `Director') shall, subject to the availability of
appropriations, develop, and periodically update, in
collaboration with other public and private sector
organizations, voluntary guidance for practices and guidelines
relating to the development, release, and assessment of
artificial intelligence systems. Such guidelines shall satisfy
the following:
``(A) Define methods and guidelines for developing
reasonable risk tolerances for various use cases of
artificial intelligence systems based on the following:
``(i) The risks associated with the
intended and unintended applications, use
cases, and outcomes of the artificial
intelligence system at issue, based on the
guidelines specified in the voluntary risk
management framework for trustworthy artificial
intelligence systems, or successor framework,
authorized under subsection (c), which may
include different categories of risk, such as
the following:
``(I) Security risks, including
threats to national security.
``(II) Economic risks, including
threats to economic opportunities.
``(III) Social risks, including
infringement upon constitutional
rights, privileges, or liberties.
``(ii) Such other factors as the Director
determines appropriate and consistent with this
subsection.
``(B) Categorize and list practices and norms for
communicating relevant characteristics, including
robustness, resilience, security, safety, fairness,
privacy, validation, reliability, accountability, and
usability, of artificial intelligence systems, and
including any characteristics identified by the
voluntary risk management framework for trustworthy
artificial intelligence systems, or successor
framework, authorized under subsection (c). Such
practices and norms may relate to the following:
``(i) Documentation of training and
evaluation datasets, such as information and
statistics about a dataset's size, curation,
annotation, and sources, and the protocols for
a dataset's selection, creators, provenance,
processing, augmentation, filters, inclusion of
personally identifiable information, and
intellectual property usage.
``(ii) Documentation of model information,
such as a model's development stages, training
objectives, training strategies, inference
objectives, capabilities, reproducibility of
capabilities, input and output modalities,
components, size, and architecture.
``(iii) Evaluation of benchmarks for multi-
metric assessments, such as an assessment of an
appropriate combination of robustness,
resilience, security, safety, fairness,
privacy, accuracy, validity, reliability,
accountability, usability, transparency,
efficiency, and calibration, and any
characteristics identified by the voluntary
risk management framework for trustworthy
artificial intelligence systems, or successor
framework, authorized under subsection (c).
``(iv) Metrics and methodologies for
evaluations of artificial intelligence systems,
such as establishing evaluation datasets.
``(v) Public reporting of artificial
intelligence systems' capabilities,
limitations, and possible areas of appropriate
and inappropriate use.
``(vi) Disclosure of security practices,
such as artificial intelligence red teaming and
third-party assessments, that were used in the
development of an artificial intelligence
system.
``(vii) How to release to the public
components of an artificial intelligence system
or information about an artificial intelligence
system, including aspects of the model,
associated training data, and license
agreements.
``(viii) Approaches and channels for
collaboration and knowledge-sharing of best
practices across industry, governments, civil
society, and academia.
``(ix) Such other categories as the
Director determines appropriate and consistent
with this subsection.
``(C) For each practice and norm categorized and
listed in accordance with subparagraph (B), provide
recommendations and practices for utilizing such
practice or norm.
``(2) Implementation.--In conducting the Director's duties
under paragraph (1), the Director shall carry out the
following:
``(A) Update the voluntary risk management
framework for trustworthy artificial intelligence
systems, or successor framework, authorized under
subsection (c) as the Director determines appropriate.
``(B) Ensure that voluntary guidance developed in
paragraph (1) is based on international standards and
industry best practices to the extent possible and
practical.
``(C) Not prescribe or otherwise require the use of
specific information or communications technology
products or services.
``(D) Collaborate with public, industry, and
academic entities as the Director determines
appropriate, including conducting periodic outreach to
receive public input from public, industry, and
academic stakeholders.
``(3) Report.--In conducting the Director's duties under
paragraph (1), the Director shall, not later than 18 months
after the date of the enactment of this subsection, brief the
Committee on Science, Space, and Technology of the House of
Representatives and the Committee on Commerce, Science, and
Transportation of the Senate on the following:
``(A) New or updated materials, programs, or
systems that were produced as a result of carrying out
this subsection.
``(B) Policy recommendations of the Director that
could facilitate and improve communication and
coordination between the private sector and relevant
Federal agencies regarding implementing the recommended
practices identified in this subsection.
``(4) Definitions.--In this subsection:
``(A) Artificial intelligence red teaming.--The
term `artificial intelligence red teaming' means a
structured testing of adversarial efforts to find flaws
and vulnerabilities in an artificial intelligence
system and identify risks, flaws, and vulnerabilities
of artificial intelligence systems, such as harmful
outputs from such system, unforeseen or undesirable
system behaviors, limitations, and potential risks
associated with the misuse of such system.
``(B) Artificial intelligence system.--The term
`artificial intelligence system' has the meaning given
such term in section 7223 of the Advancing American AI
Act (40 U.S.C. 11301 note; as enacted as part of title
LXXII of division G of the James M. Inhofe National
Defense Authorization Act for Fiscal Year 2023; Public
Law 117-263).''.
<all>
Introduced in House
Introduced in House
Referred to the House Committee on Science, Space, and Technology.
Committee Consideration and Mark-up Session Held
Ordered to be Reported by Voice Vote.
Llama 3.2 · runs locally in your browser
Ask anything about this bill. The AI reads the full text to answer.
Enter to send · Shift+Enter for new line