Leaders of some of the world’s biggest artificial intelligence companies urged global cooperation and stronger safety measures during a United Nations Security Council meeting on Wednesday. The emergency session focused on the growing power of AI and concerns about how the technology could affect societies, governments, and global security.
OpenAI Chief Executive Sam Altman told members of the Security Council that the rapid development of AI requires careful oversight. He said governments and technology companies must work together to reduce risks while still allowing innovation to continue.
Altman described the current period as a critical moment for the industry. He warned that future AI systems could become more capable and more independent. As that happens, institutions may struggle to keep pace with the speed of technological change.
He also expressed concern that advanced AI could place too much influence in the hands of a small number of organizations or individuals. According to Altman, the industry should not accept excessive risks simply because the technology offers major benefits.
Altman called for international cooperation on AI policy. He said countries with competing interests have worked together before when faced with important technological challenges. He argued that artificial intelligence should be treated in a similar way.
The Security Council meeting came after several weeks of debate about AI safety. Researchers, technology executives, and policymakers have raised concerns about the possibility of highly advanced systems operating beyond human control. At the same time, some political leaders continue to oppose efforts that could slow development.
Anthropic Chief Executive Dario Amodei also addressed the council. He said stronger safety standards will be needed as AI models become more powerful. Amodei explained that his company plans to improve protections designed to prevent misuse of advanced systems.
He pledged that Anthropic would slow the release of new AI technologies whenever necessary to ensure they meet safety requirements. Amodei said protecting the public must remain a priority as the technology evolves.
He also warned that poorly managed AI could become a serious threat. According to Amodei, the risks could extend beyond individual companies and affect humanity as a whole if safeguards are not properly implemented.
Another speaker was Clement Delangue, chief executive of Hugging Face. His company recently faced a cyberattack linked to autonomous AI software. The incident became one of several recent events that increased concerns about the growing capabilities of artificial intelligence systems.
Delangue said AI can create new risks, but it can also help defend against them. He noted that his company used AI tools to respond to and manage the attack. He argued that open-source AI remains important because it allows researchers and organizations to better understand and improve the technology.
The discussion also highlighted concerns from within the AI industry. Earlier this month, researcher Jacob Coxon left the sector and publicly criticized leading AI firms. He accused major companies of moving too quickly in their efforts to develop systems capable of improving themselves.
Altman acknowledged the need for balance. He said companies should avoid both blind optimism and extreme pessimism when discussing AI. Instead, he argued for a practical approach that recognizes both the opportunities and the risks.
Canadian computer scientist Yoshua Bengio, one of the pioneers of modern AI research, also spoke at the meeting. He said public concern about recent advances is growing and should be transformed into meaningful action. Bengio encouraged governments and organizations to develop solutions that improve safety without stopping progress.
The discussion took place shortly before a planned summit between U.S. President Donald Trump and Chinese President Xi Jinping, where artificial intelligence is expected to be one of the topics on the agenda.
Several technology leaders have recently called for international standards and oversight. OpenAI has urged the United States to take a leading role in developing global AI rules. Other countries have also expressed interest in creating shared standards.
However, major differences remain over how AI should be regulated. Some governments support stronger international coordination, while others believe new restrictions could slow innovation. Those competing views are likely to remain at the center of future debates as AI continues to advance and reshape industries around the world.
