Business Blockbuster - Helpng business to be more visible on Google

Daily Bulletin

What the hyperproduction of AI slop is doing to science

  • Written by: Vitomir Kovanovic, Associate Professor and Associate Director of the Centre for Change and Complexity in Learning (C3L), Education Futures, University of South Australia
What the hyperproduction of AI slop is doing to science

Over the past three years, generative artificial intelligence (AI) has had a profound impact on society. AI’s impact on human writing, in particular, has been enormous.

The large language models that power AI tools such as ChatGPT are trained on a wide variety of textual data, and they can now produce complex and high-quality texts of their own.

Most importantly, the widespread use of AI tools has resulted in hyperproduction of so-called “AI slop”: low-quality AI-generated outputs produced with minimal or even no human effort.

Much has been said about what AI writing means for education, work, and culture. But what about science? Does AI improve academic writing, or does it merely produce “scientific AI slop”?

According to a new study by researchers from UC Berkeley and Cornell University, published in Science, the slop is winning.

Generative AI boosts academic productivity

The researchers analysed abstracts from more than a million preprint articles (publicly available articles yet to undergo peer review) released between 2018 and 2024.

They examined whether use of AI is linked to higher academic productivity, manuscript quality and use of more diverse literature.

The number of preprints an author produced was a measure of their productivity, while eventual publication in a journal was a measure of an article’s quality.

The study found that when an author started using AI, the number of preprints they produced increased dramatically. Depending on the preprint platform, the overall number of articles an author published per month after adopting AI increased between 36.2% and 59.8%.

The increase was biggest among non-native English speakers, and especially for Asian authors, where it ranged from 43% to 89.3%. For authors from English-speaking institutions and with “Caucasian” names, the increase was more modest, in the range of 23.7% to 46.2%.

These results suggest AI was often used by non-native speakers to improve their written English.

What about the article quality?

The study found articles written with AI used more complex language on average than those written without AI.

However, among articles written without AI, ones that used more complex language were more likely to be published.

This suggests that more complex and high-quality writing is perceived as having greater scientific merit.

However, when it comes to articles written with AI support, this relationship was reversed – the more complex the language, the less likely the article was to be published. This suggests that AI-generated complex language was used to hide the low quality of the scholarly work.

AI increased the variety of academic sources

The study also looked at the differences in article downloads originating from Google and Microsoft search platforms.

Microsoft’s Bing search engine introduced an AI-powered Bing Chat feature in February 2023. This allowed the researchers to compare what kind of articles were recommended by AI-enhanced search versus regular search engine.

Interestingly, Bing users were exposed to a greater variety of sources than Google users, and also to more recent publications. This is likely caused by a technique used by Bing Chat called retrieval-augmented generation, which combines search results with AI prompting.

In any case, fears that AI search would be “stuck” recommending old, widely used sources was not justified.

Moving forward

AI has had significant impact on scientific writing and academic publishing. It has become an integral part of academic writing for many scientists, especially for non-native speakers and it is here to stay.

As AI is becoming embedded in many applications such as word processors, email apps, and spreadsheets, it will be soon impossible not to use AI whether we like it or not.

Most importantly for science, AI is challenging the use of complex high-quality language as the indicator of scholarly merit. Quick screening and evaluation of articles based on language quality is increasingly unreliable and better methods are urgently needed.

As complex language is increasingly used to cover up weak scholarly contributions, critical and in-depth evaluations of study methodologies and contributions during peer review are essential.

One approach is to “fight fire with fire” and use AI review tools, such as the one recently published by Andrew Ng at Stanford. Given the ever-growing number of manuscript submissions and already high workload of academic journal editors, such approaches might be the only viable option.

Authors: Vitomir Kovanovic, Associate Professor and Associate Director of the Centre for Change and Complexity in Learning (C3L), Education Futures, University of South Australia

Read more https://theconversation.com/what-the-hyperproduction-of-ai-slop-is-doing-to-science-272250

Business News

The Growing Demand for Durable Plastic Packaging Supplies Across Australia

Why Do Australian Businesses Need Reliable Plastic Packaging Supplies? Businesses need packaging that can withstand everyday handling, storage, and distribution without creating avoidable delays. Pla...

Daily Bulletin - avatar Daily Bulletin

Office Cleaning Melbourne: Choosing the Right Scope for Your Office

A well-planned office cleaning Melbourne arrangement starts with a clear understanding of the premises and the people who use it. An office may include private work areas, shared desks, reception, mee...

Daily Bulletin - avatar Daily Bulletin

How Businesses Can Prepare for Unexpected Power Outages

Power failures can occur quickly. The supply may be interrupted by bad weather, issues with the electricity network, damaged equipment or local construction work. This can be just a hassle for a fam...

Daily Bulletin - avatar Daily Bulletin

How Chatswood Tutoring Can Fit Into a Student’s Weekly Routine

Create a Predictable Weekly Structure A consistent weekly routine can make study easier to manage when students are balancing several subjects. Chatswood tutoring can provide a fixed learning point a...

Daily Bulletin - avatar Daily Bulletin

The Rise of Digital Marketplaces in the Australian Trade Sector

For decades, the Australian trade and construction sector operated almost entirely on word-of-mouth recommendations and local community networks. Small business owners typically relied on local newspa...

Daily Bulletin - avatar Daily Bulletin

How Immigration Lawyers Can Help

Introduction Visa decisions can shape employment, family life, study plans, travel, and future residence. A small omission can lead to delay, added expense, or refusal. Immigration lawyers assess l...

Daily Bulletin - avatar Daily Bulletin

How Industrial Drying Equipment Supports Efficient Processing

Many industrial processes require moisture to be removed from compressed air, products or process materials before they move to the next stage. Excess moisture can affect equipment performance, produc...

Daily Bulletin - avatar Daily Bulletin

Practical Ways a Whiteboard Can Improve Workplace Communication

Effective communication helps teams stay organised, share ideas and keep track of important information. While digital tools are now common in many workplaces, a whiteboard continues to provide a simp...

Daily Bulletin - avatar Daily Bulletin

Designing Eco-Friendly Custom Water Bottles for Your Next Event

The Evolution of Sustainable Event Merchandise Event planning has undergone a massive transformation over the last decade. Gone are the days when organizers could hand out cheap, single use plastic...

Daily Bulletin - avatar Daily Bulletin

The Daily Magazine

Work Boots vs Safety Shoes: Which Footwear Is Right for Your Workplace?

Not every job calls for a heavy pair of boots. Walk through a modern warehouse, factory floor or dis...

Master Bedroom Wall Decor Guide: Sizing, Layouts and Styling Ideas for Every Space

The main bedroom is often the last room in the house to get any attention. The living room gets the ...

What to Consider Before Installing a Built-In Wardrobe

Living in a modest home teaches you a lot. You learn how to keep a small kitchen tidy, where to hi...

Top 5 Mortgage Brokers in Sydney: How to Choose the Right One in 2027

Finding a mortgage broker in Sydney is not particularly difficult. Finding one who understands your ...

How Much Life Does Your Roof Have Left? Recognizing When Replacement Becomes Necessary

A roof can age quietly for years. From the street, everything may look reassuringly ordinary, even w...

How Australian Drivers Can Make Their Cars Harder to Steal

Most people don't think much about car theft until it happens to them, or to someone they know. Th...

The Short-Term Rental Rules Australian Owners Can’t Afford to Guess At

A holiday let looks simple from the outside: a spare property, a listing, some guests. Underneath ...

The Risks Of Removing Ear Wax Without Professional Guidance

Ear wax is an essential component of the hygiene process since it acts as a barrier between the ea...

Plumbing Call-Out Fees in Perth Explained

When you hire a plumber to fix a problem with a dripping tap, leaking pipe, or whatever it might be...