Business Blockbuster - Helpng business to be more visible on Google

Daily Bulletin

Researchers warn we could run out of data to train AI by 2026. What then?

  • Written by: Rita Matulionyte, Senior Lecturer in Law, Macquarie University
Researchers warn we could run out of data to train AI by 2026. What then?

As artificial intelligence (AI) reaches the peak of its popularity, researchers have warned the industry might be running out of training data – the fuel that runs powerful AI systems. This could slow down the growth of AI models, especially large language models, and may even alter the trajectory of the AI revolution.

But why is a potential lack of data an issue, considering how much there are on the web? And is there a way to address the risk?

Read more: AI to Z: all the terms you need to know to keep up in the AI hype age

Why high-quality data are important for AI

We need a lot of data to train powerful, accurate and high-quality AI algorithms. For instance, ChatGPT was trained on 570 gigabytes of text data, or about 300 billion words.

Similarly, the stable diffusion algorithm (which is behind many AI image-generating apps such as DALL-E, Lensa and Midjourney) was trained on the LIAON-5B dataset comprising of 5.8 billion image-text pairs. If an algorithm is trained on an insufficient amount of data, it will produce inaccurate or low-quality outputs.

The quality of the training data is also important. Low-quality data such as social media posts or blurry photographs are easy to source, but aren’t sufficient to train high-performing AI models.

Text taken from social media platforms might be biased or prejudiced, or may include disinformation or illegal content which could be replicated by the model. For example, when Microsoft tried to train its AI bot using Twitter content, it learned to produce racist and misogynistic outputs.

This is why AI developers seek out high-quality content such as text from books, online articles, scientific papers, Wikipedia, and certain filtered web content. The Google Assistant was trained on 11,000 romance novels taken from self-publishing site Smashwords to make it more conversational.

Do we have enough data?

The AI industry has been training AI systems on ever-larger datasets, which is why we now have high-performing models such as ChatGPT or DALL-E 3. At the same time, research shows online data stocks are growing much slower than datasets used to train AI.

In a paper published last year, a group of researchers predicted we will run out of high-quality text data before 2026 if the current AI training trends continue. They also estimated low-quality language data will be exhausted sometime between 2030 and 2050, and low-quality image data between 2030 and 2060.

AI could contribute up to US$15.7 trillion (A$24.1 trillion) to the world economy by 2030, according to accounting and consulting group PwC. But running out of usable data could slow down its development.

Should we be worried?

While the above points might alarm some AI fans, the situation may not be as bad as it seems. There are many unknowns about how AI models will develop in the future, as well as a few ways to address the risk of data shortages.

One opportunity is for AI developers to improve algorithms so they use the data they already have more efficiently.

It’s likely in the coming years they will be able to train high-performing AI systems using less data, and possibly less computational power. This would also help reduce AI’s carbon footprint.

Another option is to use AI to create synthetic data to train systems. In other words, developers can simply generate the data they need, curated to suit their particular AI model.

Several projects are already using synthetic content, often sourced from data-generating services such as Mostly AI. This will become more common in the future.

Developers are also searching for content outside the free online space, such as that held by large publishers and offline repositories. Think about the millions of texts published before the internet. Made available digitally, they could provide a new source of data for AI projects.

News Corp, one of the world’s largest news content owners (which has much of its content behind a paywall) recently said it was negotiating content deals with AI developers. Such deals would force AI companies to pay for training data – whereas they have mostly scraped it off the internet for free so far.

Content creators have protested against the unauthorised use of their content to train AI models, with some suing companies such as Microsoft, OpenAI and Stability AI. Being remunerated for their work may help restore some of the power imbalance that exists between creatives and AI companies.

Read more: No, the Lensa AI app technically isn’t stealing artists' work – but it will majorly shake up the art world

Authors: Rita Matulionyte, Senior Lecturer in Law, Macquarie University

Read more https://theconversation.com/researchers-warn-we-could-run-out-of-data-to-train-ai-by-2026-what-then-216741

Business News

The Growing Demand for Durable Plastic Packaging Supplies Across Australia

Why Do Australian Businesses Need Reliable Plastic Packaging Supplies? Businesses need packaging that can withstand everyday handling, storage, and distribution without creating avoidable delays. Pla...

Daily Bulletin - avatar Daily Bulletin

Office Cleaning Melbourne: Choosing the Right Scope for Your Office

A well-planned office cleaning Melbourne arrangement starts with a clear understanding of the premises and the people who use it. An office may include private work areas, shared desks, reception, mee...

Daily Bulletin - avatar Daily Bulletin

How Businesses Can Prepare for Unexpected Power Outages

Power failures can occur quickly. The supply may be interrupted by bad weather, issues with the electricity network, damaged equipment or local construction work. This can be just a hassle for a fam...

Daily Bulletin - avatar Daily Bulletin

How Chatswood Tutoring Can Fit Into a Student’s Weekly Routine

Create a Predictable Weekly Structure A consistent weekly routine can make study easier to manage when students are balancing several subjects. Chatswood tutoring can provide a fixed learning point a...

Daily Bulletin - avatar Daily Bulletin

The Rise of Digital Marketplaces in the Australian Trade Sector

For decades, the Australian trade and construction sector operated almost entirely on word-of-mouth recommendations and local community networks. Small business owners typically relied on local newspa...

Daily Bulletin - avatar Daily Bulletin

How Immigration Lawyers Can Help

Introduction Visa decisions can shape employment, family life, study plans, travel, and future residence. A small omission can lead to delay, added expense, or refusal. Immigration lawyers assess l...

Daily Bulletin - avatar Daily Bulletin

How Industrial Drying Equipment Supports Efficient Processing

Many industrial processes require moisture to be removed from compressed air, products or process materials before they move to the next stage. Excess moisture can affect equipment performance, produc...

Daily Bulletin - avatar Daily Bulletin

Practical Ways a Whiteboard Can Improve Workplace Communication

Effective communication helps teams stay organised, share ideas and keep track of important information. While digital tools are now common in many workplaces, a whiteboard continues to provide a simp...

Daily Bulletin - avatar Daily Bulletin

Designing Eco-Friendly Custom Water Bottles for Your Next Event

The Evolution of Sustainable Event Merchandise Event planning has undergone a massive transformation over the last decade. Gone are the days when organizers could hand out cheap, single use plastic...

Daily Bulletin - avatar Daily Bulletin

The Daily Magazine

Work Boots vs Safety Shoes: Which Footwear Is Right for Your Workplace?

Not every job calls for a heavy pair of boots. Walk through a modern warehouse, factory floor or dis...

Master Bedroom Wall Decor Guide: Sizing, Layouts and Styling Ideas for Every Space

The main bedroom is often the last room in the house to get any attention. The living room gets the ...

What to Consider Before Installing a Built-In Wardrobe

Living in a modest home teaches you a lot. You learn how to keep a small kitchen tidy, where to hi...

Top 5 Mortgage Brokers in Sydney: How to Choose the Right One in 2027

Finding a mortgage broker in Sydney is not particularly difficult. Finding one who understands your ...

How Much Life Does Your Roof Have Left? Recognizing When Replacement Becomes Necessary

A roof can age quietly for years. From the street, everything may look reassuringly ordinary, even w...

How Australian Drivers Can Make Their Cars Harder to Steal

Most people don't think much about car theft until it happens to them, or to someone they know. Th...

The Short-Term Rental Rules Australian Owners Can’t Afford to Guess At

A holiday let looks simple from the outside: a spare property, a listing, some guests. Underneath ...

The Risks Of Removing Ear Wax Without Professional Guidance

Ear wax is an essential component of the hygiene process since it acts as a barrier between the ea...

Plumbing Call-Out Fees in Perth Explained

When you hire a plumber to fix a problem with a dripping tap, leaking pipe, or whatever it might be...