OpenAI Employees Warn of Advanced AI Dangers
Several current and former employees of OpenAI and Google DeepMind today shared an open letter warning of the dangers of advanced AI and the current lack of oversight of companies working on AI technology.
The employees suggest there are a number of risks that we are facing from AI development, including further entrenchment of existing inequalities, manipulation and misinformation, and loss of control of autonomous AI systems, which the letter says could lead to human extinction.
AI companies have "strong financial incentives" to forge ahead with development and to avoid sharing information about their protective measures and risk levels. "We do not think they can all be relied upon to share it voluntarily," reads the letter, which says that it is up to current and former employees to speak out.
So long as there is no effective government oversight of these corporations, current and former employees are among the few people who can hold them accountable to the public. Yet broad confidentiality agreements block us from voicing our concerns, except to the very companies that may be failing to address these issues. Ordinary whistleblower protections are insufficient because they focus on illegal activity, whereas many of the risks we are concerned about are not yet regulated.
Employees are ultimately calling on AI companies to offer solid whistleblower protections for speaking out about the risks of AI.
- Avoid creating or enforcing agreements that prevent criticism for risk-related concerns.
- Offer a verifiably anonymous process for employees to raise risk-related concerns to the board, regulators, and independent organizations with relevant expertise.
- Support a culture of open criticism to allow employees to raise risk-related concerns about technologies to the public, the board, regulators, and more, as long as trade secrets are protected.
- Avoid retaliating against employees who publicly share risk-related confidential information after other processes have failed.
A total of 13 employees signed the letter, including seven former OpenAI employees, four current OpenAI employees, one former Google DeepMind employee, and one current Google DeepMind employee. OpenAI has threatened employees with loss of vested equity for speaking up, and it makes them sign draconian NDA agreements that muzzle criticism.
The letter comes as Apple prepares to announce multiple AI-powered features for iOS 18 and other software updates on Monday. Apple is working on its own AI functionality that will be baked into apps across the operating system, plus it has signed a deal with OpenAI to integrate ChatGPT features into iOS 18.
Popular Stories
Barclays analyst Tom O'Malley and his colleagues recently traveled to Asia to meet with various electronics manufacturers and suppliers. In a research note this week, outlining key takeaways from the trip, the analysts said they have "confirmed" that a fourth-generation iPhone SE with an Apple-designed 5G modem is slated to launch towards the end of the first quarter next year. In line with previo...
Apple released the AirTag in April 2021, so it is now three over and a half years old. While the AirTag has not received any hardware updates since then, a new version of the item tracking accessory is rumored to be in development.
Below, we recap rumors about a second-generation AirTag.
Timing
Apple is aiming to release a new AirTag in mid-2025, according to Bloomberg's Mark Gurman....
While the Logitech MX Master 3 is a terrific mouse for the Mac, reports claiming that Apple CEO Tim Cook prefers that mouse over the Magic Mouse are false.
The Wall Street Journal last month published an interview with Cook, in which he said he uses every Apple product every day. Soon after, The Verge's Wes Davis attempted to replicate using every Apple product in a single day. During that...
Apple today released iOS 18.1.1 and iPadOS 18.1.1, minor updates to the iOS 18 and iPadOS 18 operating systems that debuted earlier in September. iOS 18.1.1 and iPadOS 18.1.1 come three weeks after the launch of iOS 18.1.
The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. Apple has also released iOS 17.7.2 for...
AT&T has begun displaying "Turbo" in the iPhone carrier label for customers subscribed to its premium network prioritization service, according to reports on Reddit. The new indicator seems to have started appearing after users updated to iOS 18.1.1, but that could be just coincidence.
Image credit: Reddit user No_Highlight7476
The Turbo feature provides enhanced network performance through ...
In a research note with Hong Kong-based investment bank Haitong today, obtained by MacRumors, Apple analyst Jeff Pu said he agrees with a recent rumor claiming that the so-called "iPhone 17 Air" will be around 6mm thick.
"We agreed with the recent chatter of an 6mm thickness ultra-slim design of the iPhone 17 Slim model," he wrote.
If that measurement proves to be accurate, there would be ...
The iOS 18.1.1, iPadOS 18.1.1, and macOS Sequoia 15.1.1 updates that Apple released today address JavaScriptCore and WebKit vulnerabilities that Apple says have been actively exploited on some devices.
With the JavaScriptCore vulnerability, processing maliciously crafted web content could lead to arbitrary code execution. The WebKit vulnerability had the same issue with maliciously crafted...
