Business Blockbuster - Helpng business to be more visible on Google

Daily Bulletin

AI heavyweights call for end to ‘superintelligence’ research

  • Written by: Mary-Anne Williams, Michael J Crouch Chair in Innovation, School of Management and Governance, UNSW Sydney
AI heavyweights call for end to ‘superintelligence’ research

I have worked in AI for more than three decades, including with pioneers such as John McCarthy, who coined the term “artificial intelligence” in 1955.

In the past few years, scientific breakthroughs have produced AI tools that promise unprecedented advances in medicine, science, business and education.

At the same time, leading AI companies have the stated goal to create superintelligence: not merely smarter tools, but AI systems that significantly outperform all humans on essentially all cognitive tasks.

Superintelligence isn’t just hype. It’s a strategic goal determined by a privileged few, and backed by hundreds of billions of dollars in investment, business incentives, frontier AI technology, and some of the world’s best researchers.

What was once science fiction has become a concrete engineering goal for the coming decade. In response, I and hundreds of other scientists, global leaders and public figures have put our names to a public statement calling for superintelligence research to stop.

What the statement says

The new statement, released today by the AI safety nonprofit Future of Life Institute, is not a call for a temporary pause, as we saw in 2023. It is a short, unequivocal call for a global ban:

We call for a prohibition on the development of superintelligence, not lifted before there is broad scientific consensus that it will be done safely and controllably, and strong public buy-in.

The list of signatories represents a remarkably broad coalition, bridging divides that few other issues can. The “godfathers” of modern AI are present, such as Yoshua Bengio and Geoff Hinton. So are leading safety researchers such as UC Berkeley’s Stuart Russell.

But the concern has broken free of academic circles. The list includes tech and business leaders such as Apple cofounder Steve Wozniak and Virgin’s Richard Branson. It includes high-level political and military figures from both sides of US politics, such as former National Security Advisor Susan Rice and former chairman of the Joint Chiefs of Staff Mike Mullen. It also includes prominent media figures such as Glenn Beck and former Trump strategist Steve Bannon, together with artists such as Will.I.am and respected historians such as Yuval Noah Harari.

Why superintelligence poses a unique challenge

Human intelligence has reshaped the planet in profound ways. We have rerouted rivers to generate electricity and irrigate farmland, transforming entire ecosystems. We have webbed the globe with financial markets, supply chains, air traffic systems: enormous feats of coordination that depend on our ability to reason, predict, plan, innovate and build technology.

Superintelligence could extend this trajectory, but with a crucial difference. People will no longer be in control.

The danger is not so much a machine that wants to destroy us, but one that pursues its goals with superhuman competence and indifference to our needs.

Imagine a superintelligent agent tasked with ending climate change. It might logically decide to eliminate the species that’s producing greenhouse gases.

Instruct it to maximise human happiness, and it might find a way to trap every human brain in a perpetual dopamine loop. Or, in Swedish philosopher Nick Bostrom’s famous example, a superintelligence tasked with producing as many paperclips as possible might try to convert all of Earth’s matter, including us, into raw material for its factories.

The issue is not malice but mismatch: a system that understands its instructions too literally, with the power to act cleverly and swiftly.

History shows what can go wrong when our systems grow beyond our capacity to predict, contain or control them.

The 2008 financial crisis began with financial instruments so intricate that even their creators could not foresee how they would interact until the entire system collapsed. Cane toads introduced in Australia to fight pests have instead devastated native species. The COVID pandemic exposed how global travel networks can turn local outbreaks into worldwide crises.

Now we stand on the verge of creating something far more complex: a mind that can rewrite its own code, redesign and achieve its goals, and out-think every human combined.

A history of inadequate governance

For years, efforts to manage AI have focused on risks such as algorithmic bias, data privacy, and the impact of automation on jobs.

These are important issues. But they fail to address the systemic risks of creating superintelligent autonomous agents. The focus has been on applications, not the ultimate stated goal of AI companies to create superintelligence.

The new statement on superintelligence aims to start a global conversation not just on specific AI tools, but on the very destination AI developers are steering us toward.

The goal of AI should be about creating powerful tools to serve humanity. This does not mean autonomous superintelligent agents that can operate beyond human control without aligning with human well-being.

We can have a future of AI-powered medical breakthroughs, scientific discovery, and personalised education. None of these require us to build an uncontrollable superintelligence that could unilaterally decide the fate of humanity.

Authors: Mary-Anne Williams, Michael J Crouch Chair in Innovation, School of Management and Governance, UNSW Sydney

Read more https://theconversation.com/ai-heavyweights-call-for-end-to-superintelligence-research-267961

Business News

The Growing Demand for Durable Plastic Packaging Supplies Across Australia

Why Do Australian Businesses Need Reliable Plastic Packaging Supplies? Businesses need packaging that can withstand everyday handling, storage, and distribution without creating avoidable delays. Pla...

Daily Bulletin - avatar Daily Bulletin

Office Cleaning Melbourne: Choosing the Right Scope for Your Office

A well-planned office cleaning Melbourne arrangement starts with a clear understanding of the premises and the people who use it. An office may include private work areas, shared desks, reception, mee...

Daily Bulletin - avatar Daily Bulletin

How Businesses Can Prepare for Unexpected Power Outages

Power failures can occur quickly. The supply may be interrupted by bad weather, issues with the electricity network, damaged equipment or local construction work. This can be just a hassle for a fam...

Daily Bulletin - avatar Daily Bulletin

How Chatswood Tutoring Can Fit Into a Student’s Weekly Routine

Create a Predictable Weekly Structure A consistent weekly routine can make study easier to manage when students are balancing several subjects. Chatswood tutoring can provide a fixed learning point a...

Daily Bulletin - avatar Daily Bulletin

The Rise of Digital Marketplaces in the Australian Trade Sector

For decades, the Australian trade and construction sector operated almost entirely on word-of-mouth recommendations and local community networks. Small business owners typically relied on local newspa...

Daily Bulletin - avatar Daily Bulletin

How Immigration Lawyers Can Help

Introduction Visa decisions can shape employment, family life, study plans, travel, and future residence. A small omission can lead to delay, added expense, or refusal. Immigration lawyers assess l...

Daily Bulletin - avatar Daily Bulletin

How Industrial Drying Equipment Supports Efficient Processing

Many industrial processes require moisture to be removed from compressed air, products or process materials before they move to the next stage. Excess moisture can affect equipment performance, produc...

Daily Bulletin - avatar Daily Bulletin

Practical Ways a Whiteboard Can Improve Workplace Communication

Effective communication helps teams stay organised, share ideas and keep track of important information. While digital tools are now common in many workplaces, a whiteboard continues to provide a simp...

Daily Bulletin - avatar Daily Bulletin

Designing Eco-Friendly Custom Water Bottles for Your Next Event

The Evolution of Sustainable Event Merchandise Event planning has undergone a massive transformation over the last decade. Gone are the days when organizers could hand out cheap, single use plastic...

Daily Bulletin - avatar Daily Bulletin

The Daily Magazine

Work Boots vs Safety Shoes: Which Footwear Is Right for Your Workplace?

Not every job calls for a heavy pair of boots. Walk through a modern warehouse, factory floor or dis...

Master Bedroom Wall Decor Guide: Sizing, Layouts and Styling Ideas for Every Space

The main bedroom is often the last room in the house to get any attention. The living room gets the ...

What to Consider Before Installing a Built-In Wardrobe

Living in a modest home teaches you a lot. You learn how to keep a small kitchen tidy, where to hi...

Top 5 Mortgage Brokers in Sydney: How to Choose the Right One in 2027

Finding a mortgage broker in Sydney is not particularly difficult. Finding one who understands your ...

How Much Life Does Your Roof Have Left? Recognizing When Replacement Becomes Necessary

A roof can age quietly for years. From the street, everything may look reassuringly ordinary, even w...

How Australian Drivers Can Make Their Cars Harder to Steal

Most people don't think much about car theft until it happens to them, or to someone they know. Th...

The Short-Term Rental Rules Australian Owners Can’t Afford to Guess At

A holiday let looks simple from the outside: a spare property, a listing, some guests. Underneath ...

The Risks Of Removing Ear Wax Without Professional Guidance

Ear wax is an essential component of the hygiene process since it acts as a barrier between the ea...

Plumbing Call-Out Fees in Perth Explained

When you hire a plumber to fix a problem with a dripping tap, leaking pipe, or whatever it might be...