Publications

CSET produces evidence-driven analysis in a variety of forms, from informative graphics and translations to expert testimony and published reports. Our key areas of inquiry are the foundations of artificial intelligence — such as talent, data and computational power — as well as how AI can be used in cybersecurity and other national security settings. We also do research on the policy tools that can be used to shape AI’s development and use, and on biotechnology.

Analysis

AI Safety and Automation Bias

Lauren Kahn, Emelia Probasco, and Ronnie Kinoshita
| November 2024

Automation bias is a critical issue for artificial intelligence deployment. It can cause otherwise knowledgeable users to make crucial and even obvious errors. Organizational, technical, and educational leaders can mitigate these biases through training, design, and processes. This paper explores automation bias and ways to mitigate it through three case studies: Tesla’s autopilot incidents, aviation incidents at Boeing and Airbus, and Army and Navy air defense incidents.

Applications


Workforce


Filter publications
Data Brief

Identifying Emerging Technologies in Research

Catherine Aiken, James Dunham, Jennifer Melot, and Zachary Arnold
| December 2024

This paper presents two new methods for identifying research relevant to emerging technology. The authors developed and deployed technology topic classification and targeted research field scoring over a corpus of scientific literature to identify research relevant to cybersecurity, LLM development, and chips fabrication and design—expanding CSET’s existing set of topic classifications for AI, computer vision, NLP, robotics, and AI safety. The paper summarizes motivation, methods, and results.

Data Brief

A Quantitative Assessment of Department of Defense S&T Publication Collaborations

Emelia Probasco and Autumn Toney
| June 2024

While the effects of the U.S. Department of Defense’s broad investments in research and development go far beyond what is publicly disclosed, authors affiliated with the DOD do publish papers about their research. This analysis examines more than 100,000 papers by DOD-affiliated authors since 2000 and offers insight into the patterns of research publication and collaboration by the DOD.

Data Brief

Spurring Science

Christian Schoeberl and Hanna Dohmen
| November 2023

This data brief analyzes over 200,000 U.S. government grants awarded to industry and academic recipients for artificial intelligence research between January 2017 and May 2023. The authors find that while the majority of federal grants are awarded to academic recipients, industry played an outsized role in U.S. government grant funding of AI research. Moreover, departments within the U.S. Department of Defense appear to prioritize funding industry and AI research relative to other funding agencies.

AI has the potential to revolutionize approaches to climate change research. Using CSET's Map of Science, this data brief maps the production of research publications at the intersection of AI and climate change to better understand how AI methods are being applied to climate change-related research.

Data Brief

The Antimicrobial Resistance Research Landscape and Emerging Solutions

Vikram Venkatram and Katherine Quinn
| November 2023

Antimicrobial resistance (AMR) is one of the world’s most pressing global health threats. Basic research is the first step towards identifying solutions. This brief examines the AMR research landscape since 2000, finding that the amount of research is increasing and that the U.S. is a leading publisher, but also that novel solutions like phages and synthetic antimicrobial production are a small portion of that research.

Data Brief

Bayh-Dole Patent Trends

Sara Abdulla and Jack Corrigan
| August 2023

This brief examines trends in patents generated through federally funded research, otherwise known as Bayh-Dole patents. We find that while Bayh-Dole patents make up a small proportion of U.S. patents overall, they are much more common in certain fields, especially in biosciences and national defense related fields. Academic institutions are major recipients of Bayh-Dole patents, and the funding landscape for patent-producing research has shifted since Bayh-Dole came into effect in 1980.

Data Brief

Assessing South Korea’s AI Ecosystem

Cole McFaul, Husanjot Chahal, Rebecca Gelles, and Margarita Konaev
| August 2023

This data brief examines South Korea’s progress in its development of artificial intelligence. The authors find that the country excels in semiconductor manufacturing, is a global leader in the production of AI patents, and is an important contributor to AI research. At the same time, the AI investment ecosystem remains nascent and despite having a highly developed AI workforce, the demand for AI talent may soon outpace supply.

Data Brief

U.S. and Chinese Military AI Purchases

Margarita Konaev, Ryan Fedasiuk, Jack Corrigan, Ellen Lu, Alex Stephenson, Helen Toner, and Rebecca Gelles
| August 2023

This data brief uses procurement records published by the U.S. Department of Defense and China’s People’s Liberation Army between April and November of 2020 to assess, and, where appropriate, compare what each military is buying when it comes to artificial intelligence. We find that the two militaries are prioritizing similar application areas, especially intelligent and autonomous vehicles and AI applications for intelligence, surveillance and reconnaissance.

Data Brief

Voices of Innovation

Sara Abdulla and Husanjot Chahal
| July 2023

This data brief identifies the most influential AI researchers in the United States between 2010 and 2021 via three metrics: number of AI publications, citations, and AI h-index. It examines their demographic profiles, career trajectories, and research collaboration rates, finding that most are men in the later stages of their career, largely concentrated in 10 elite universities and companies, and that nearly 70 percent of America’s top AI researchers were born abroad.

Data Brief

Who Cares About Trust?

Autumn Toney and Emelia Probasco
| July 2023

Artificial intelligence-enabled systems are transforming society and driving an intense focus on what policy and technical communities can do to ensure that those systems are trustworthy and used responsibly. This analysis draws on prior work about the use of trustworthy AI terms to identify 18 clusters of research papers that contribute to the development of trustworthy AI. In identifying these clusters, the analysis also reveals that some concepts, like "explainability," are forming distinct research areas, whereas other concepts, like "reliability," appear to be accepted as metrics and broadly applied.