Despite recent upheaval in the AI policy landscape, AI evaluations—including AI red-teaming—will remain fundamental to understanding and governing the usage of AI systems and their impact on society. This blog post draws from a December 2024 CSET workshop on AI testing to outline challenges associated with improving red-teaming and suggest recommendations on how to address those challenges.

What are the major questions that will define the AI policy landscape in 2025? Andrew Imbrie explores the five issues he's tracking.

The Emerging Technology Observatory’s AGORA (AI GOvernance and Regulatory Archive) is a living collection of AI-relevant laws, regulations, standards, and other governance documents from the United States and around the world. Updated regularly, AGORA includes summaries, document text, thematic tags, and filters to help users quickly discover and analyze key developments in AI governance.

Donald Trump's first term as president coincided with the beginning of three important trends that continue to shape the AI world: the rise of transformer-based models, surging AI investment, and a more hawkish foreign policy approach to China. But important questions remain about what Trump's second term will mean for AI. In this excerpt from policy.ai — CSET's newsletter on artificial intelligence, emerging technology, and security policy — Alex Friedland explores what Donald Trump's presidency will mean for AI policy, semiconductors, and private AI investment.

On October 24, the White House issued the first-ever National Security Memorandum on Artificial Intelligence. CSET's experts answer pressing questions and what it means for U.S. national security and AI development.

This blog post describes key takeaways from the NATO-Ukraine Defense Innovators Forum, held in Krakow, Poland in June 2024. It overviews changing concepts of operation, battlefield realities, and technological aspirations and innovations in Ukraine, with a focus on uncrewed aerial vehicles (UAVs) and counter-UAV systems. It builds upon CSET’s previous blog from the Future of Drones in Ukraine conference held in Warsaw in November 2023.

This year, CSET researchers returned to the DEF CON cybersecurity conference to explore how understandings of AI red-teaming practices have evolved among cybersecurity practitioners and AI experts. This blog post, a companion to "How I Won DEF CON’s Generative AI Red-Teaming Challenge", summarizes our takeaways and concludes with a list of outstanding research questions regarding AI red-teaming, some of which CSET hopes to address in future work.

In August 2024, CSET Research Fellow Colin Shea-Blymyer attended DEF CON, the world’s largest hacking convention to break powerful artificial intelligence systems. He participated in the AI red-teaming challenge, and won. This blog post details his experiences with the challenge, what it took to win the grand prize, and what he learned about the state of AI testing.

Artificial intelligence is becoming more integrated into the sciences. One of the scientific fields experiencing this is computational biology, which uses computer modeling to understand biological mechanisms and systems. This blog post provides an understanding of important research trends in these subject areas, and how advancements in AI can improve the speed and efficiency of computational biology to improve human health and well-being.

This blog post recounts the development of a Python-based data collection pipeline project completed in the summer of 2024 by CSET inaugural intern Jordan Monts. During his project research and work, he used the Requests and BeautifulSoup libraries to create a two-part system to gather and process web data, support ongoing research initiatives, and strengthen his skills in data processing as well as application programming interface (API) management.