We’re hiring! If you’re interested in joining our team, check out the positions in the “Job Openings” section below or consult our careers page.
Google’s Joke-Explaining Language Model and the Future of LLMs: Earlier this week, Google debuted its new 540 billion parameter Pathways Language Model (PaLM), which appears to show significant improvements over state-of-the-art large language models across a number of benchmarks and tasks. In its announcement, Google included several impressive demonstrations of the model’s abilities, including joke explanation, chain-of-thought and cause-and-effect reasoning, and code generation. PaLM’s size and performance were made possible by Google’s Pathways system, which enabled training across thousands of accelerator chips at high levels of efficiency. GPT-3 and subsequent large autoregressive language models have shown that increasing the size of a model results in improved performance — which accounts for the last few years’ dramatic rise in model size. However, most of them were trained on a single system or used pipeline parallelism to train across multiple GPU clusters or TPU pods (with a maximum scale of 4096 TPU chips). Pathways allowed Google to conduct pipeline-free training at high levels of efficiency across two TPU pods containing 6144 chips. While these scaling advances make it feasible to use even larger compute infrastructures to build better models, given the high cost of compute, they may also centralize cutting-edge AI development even further among a small group of well-financed institutions.
The budget includes a $773 billion request for the Pentagon, approximately $30 billion higher than Congress approved for the FY2022 budget. Under the proposed budget, the DOD’s total Research, Development, Test and Evaluation (RDT&E) spending would soar to its highest level ever — $130.1 billion, more than 9 percent higher than FY2022 levels. While the Pentagon’s Science and Technology budget would fall by 13 percent — to approximately $16.5 billion — DARPA would see a 7 percent boost to $4.1 billion. That builds on the 10 percent increase it already received for FY2022. The request also establishes and funds the office of the Chief Digital and Artificial Intelligence Officer — the new unit meant to oversee the work of three of the Pentagon’s primary AI and data offices and its key AI efforts.
It would direct $880 million to the NSF Directorate for Technology, Innovation, and Partnerships — a new directorate, announced last month, that will focus on advancing critical and emerging technologies and bringing them to market.
In Translation CSET’s translations of significant foreign language documents on AI
PRC State Laboratory Recap:2016 Annual Report on State Key Laboratories. This document lists all of China’s state key laboratories and summarizes their key accomplishments in 2016. An appendix includes contact information for all 254 state key labs and all seven pilot national laboratories. The document also briefly notes the results of a 2016 evaluation of the 75 biology- and medicine-related state key labs, which gave one lab a failing grade and identified another eight as in need of improvement.
If you have a foreign-language document related to security and emerging technologies that you’d like translated into English, CSET may be able to help! Click here for details.
We’re hiring! Please apply or share the roles below with candidates in your network:
Data Scientist: We are currently seeking applications for a Data Scientist to explore research questions leveraging CSET’s unique data holdings. Apply by April 18.
UI/UX Designer: We are currently seeking applications for a UI/UX Designer to perform user interviews, write user stories, create user interface mockups, and conduct usability testing for public-facing Emerging Technology Observatory products. Apply by April 18.
Please bookmark our careers page to stay up to date on all active job postings. You can also subscribe to receive job announcements by updating your subscription preferences in the footer of this email.
Director of Biotechnology Programs and Senior Fellow Anna Puglisi joined Craig Singleton, Bonnie Glick, Phelim Kine and RADM (ret.) Mark Montgomery for a Foundation for Defense of Democracies event, “Disrupting China’s Military-Academic Complex.” Senator Marco Rubio and Jonathan Schanzer provided opening remarks. Watch a recording of the event here.
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.