Business Blockbuster - Helpng business to be more visible on Google

Daily Bulletin

Researchers created a chatbot to help teach a university law class – but the AI kept messing up

  • Written by: Armin Alimardani, Senior Lecturer in Law and Emerging Technologies, University of Wollongong
Researchers created a chatbot to help teach a university law class – but the AI kept messing up

“AI tutors” have been hyped as a way to revolutionise education.

The idea is generative artificial intelligence tools (such as ChatGPT) could adapt to any teaching style set by a teacher. The AI could guide students step-by-step through problems and offer hints without giving away answers. It could then deliver precise, immediate feedback tailored to the student’s individual learning gaps.

Despite the enthusiasm, there is limited research testing how well AI performs in teaching environments, especially within structured university courses.

In our new study, we developed our own AI tool for a university law class. We wanted to know, can it genuinely support personalised learning or are we expecting too much?

Our study

In 2022, we developed SmartTest, a customisable educational chatbot, as part of a broader project to democratise access to AI tools in education.

Unlike generic chatbots, SmartTest is purpose-built for educators, allowing them to embed questions, model answers and prompts. This means the chatbot can ask relevant questions, deliver accurate and consistent feedback and minimise hallucinations (or mistakes). SmartTest is also instructed to use the Socratic method, encouraging students to think, rather than spoon-feeding them answers.

We trialled SmartTest over five test cycles in a criminal law course (which one of us was coordinating) at the University of Wollongong in 2023.

Each cycle introduced varying degrees of complexity. The first three cycles used short hypothetical criminal law scenarios (for example, is the accused guilty of theft in this scenario?). The last two cycles used simple short-answer questions (for example, what’s the maximum sentencing discount for a guilty plea?).

An average of 35 students interacted with SmartTest in each cycle across several criminal law tutorials. Participation was voluntary and anonymous, with students interacting with SmartTest on their own devices for up to ten minutes per session. Students’ conversations with SmartTest – their attempts at answering the question, and the immediate feedback they received from the chatbot – were recorded in our database.

After the final test cycle, we surveyed students about their experience.

An example of SmartTest's interaction with students.
An example of SmartTest’s interactions with students. Reproduced with permission from Snowflake Inc., Author provided (no reuse)

What we found

SmartTest showed promise in guiding students and helping them identify gaps in their understanding.

However, in the first three cycles (the problem-scenario questions), between 40% and 54% of conversations had at least one example of inaccurate, misleading, or incorrect feedback.

When we shifted to much simpler short-answer format in cycles four and five, the error rate dropped significantly to between 6% and 27%. However, even in these best-performing cycles, some errors persisted. For example, sometimes SmartTest would affirm an incorrect answer before providing the correct one, which risks confusing students.

A significant revelation was the sheer effort required to get the chatbot working effectively in our tests. Far from a time-saving silver bullet, integrating SmartTest involved painstaking prompt engineering and rigorous manual assessments from educators (in this case, us). This paradox – where a tool promoted as labour-saving demands significant labour – calls into question its practical benefits for already time-poor educators.

Inconsistency is a core issue

SmartTest’s behaviour was also unpredictable. Under identical conditions, it sometimes offered excellent feedback and at other times provided incorrect, confusing or misleading information.

For an educational tool tasked with supporting student learning, this raises serious concerns about reliability and trustworthiness.

To assess if newer models improved performance, we replaced the underlying generative AI powering SmartTest (ChatGPT-4) with newer models, such as ChatGPT-4.5, which was released in 2025.

We tested these models by replicating instances where SmartTest provided poor feedback to students in our study. The newer models did not consistently outperform older ones. Sometimes, their responses were even less accurate or useful from a teaching perspective. As such, newer more advanced AI models do not automatically translate to better educational outcomes.

What does this mean for students and teachers?

The implications for students and university staff are mixed.

Generative AI may support low-stakes, formative learning activities. But in our study, it could not provide the reliability, nuance and subject-matter depth needed for many educational contexts.

On the plus side, our survey results indicated students appreciated the immediate feedback and conversational tone of SmartTest. Some mentioned it reduced anxiety and made them more comfortable expressing uncertainty. However, this benefit came with a catch: incorrect or misleading answers could just as easily reinforce misunderstandings as clarify them.

Most students (76%) preferred having access to SmartTest rather than no opportunity to practise questions. However, when given the choice between receiving immediate feedback from AI or waiting one or more days for feedback from human tutors, only 27% preferred AI. Nearly half preferred human feedback with a delay and the rest were indifferent.

This suggests a critical challenge. Students enjoy the convenience of AI tools, but they still place higher trust in human educators.

A need for caution

Our findings suggest generative AI should still be treated as an experimental educational aid.

The potential is real – but so are the limitations. Relying too heavily on AI without rigorous evaluation risks compromising the very educational outcomes we are aiming to enhance.

Authors: Armin Alimardani, Senior Lecturer in Law and Emerging Technologies, University of Wollongong

Read more https://theconversation.com/researchers-created-a-chatbot-to-help-teach-a-university-law-class-but-the-ai-kept-messing-up-257551

Business News

The Growing Demand for Durable Plastic Packaging Supplies Across Australia

Why Do Australian Businesses Need Reliable Plastic Packaging Supplies? Businesses need packaging that can withstand everyday handling, storage, and distribution without creating avoidable delays. Pla...

Daily Bulletin - avatar Daily Bulletin

Office Cleaning Melbourne: Choosing the Right Scope for Your Office

A well-planned office cleaning Melbourne arrangement starts with a clear understanding of the premises and the people who use it. An office may include private work areas, shared desks, reception, mee...

Daily Bulletin - avatar Daily Bulletin

How Businesses Can Prepare for Unexpected Power Outages

Power failures can occur quickly. The supply may be interrupted by bad weather, issues with the electricity network, damaged equipment or local construction work. This can be just a hassle for a fam...

Daily Bulletin - avatar Daily Bulletin

How Chatswood Tutoring Can Fit Into a Student’s Weekly Routine

Create a Predictable Weekly Structure A consistent weekly routine can make study easier to manage when students are balancing several subjects. Chatswood tutoring can provide a fixed learning point a...

Daily Bulletin - avatar Daily Bulletin

The Rise of Digital Marketplaces in the Australian Trade Sector

For decades, the Australian trade and construction sector operated almost entirely on word-of-mouth recommendations and local community networks. Small business owners typically relied on local newspa...

Daily Bulletin - avatar Daily Bulletin

How Immigration Lawyers Can Help

Introduction Visa decisions can shape employment, family life, study plans, travel, and future residence. A small omission can lead to delay, added expense, or refusal. Immigration lawyers assess l...

Daily Bulletin - avatar Daily Bulletin

How Industrial Drying Equipment Supports Efficient Processing

Many industrial processes require moisture to be removed from compressed air, products or process materials before they move to the next stage. Excess moisture can affect equipment performance, produc...

Daily Bulletin - avatar Daily Bulletin

Practical Ways a Whiteboard Can Improve Workplace Communication

Effective communication helps teams stay organised, share ideas and keep track of important information. While digital tools are now common in many workplaces, a whiteboard continues to provide a simp...

Daily Bulletin - avatar Daily Bulletin

Designing Eco-Friendly Custom Water Bottles for Your Next Event

The Evolution of Sustainable Event Merchandise Event planning has undergone a massive transformation over the last decade. Gone are the days when organizers could hand out cheap, single use plastic...

Daily Bulletin - avatar Daily Bulletin

The Daily Magazine

How Much Life Does Your Roof Have Left? Recognizing When Replacement Becomes Necessary

A roof can age quietly for years. From the street, everything may look reassuringly ordinary, even w...

How Australian Drivers Can Make Their Cars Harder to Steal

Most people don't think much about car theft until it happens to them, or to someone they know. Th...

The Short-Term Rental Rules Australian Owners Can’t Afford to Guess At

A holiday let looks simple from the outside: a spare property, a listing, some guests. Underneath ...

The Risks Of Removing Ear Wax Without Professional Guidance

Ear wax is an essential component of the hygiene process since it acts as a barrier between the ea...

Plumbing Call-Out Fees in Perth Explained

When you hire a plumber to fix a problem with a dripping tap, leaking pipe, or whatever it might be...

Workshop Tool Maintenance: A Practical Guide to Drills, Sanders and Table Saws

A drill that strips every screw head. A sander that leaves swirl marks however long you work the pan...

How Architecture and Engineering Firms Can Improve Project Profitability

Project profitability remains one of the most persistent challenges for architecture and engineering...

The Blossoming World of Fresh Flower Delivery: An In-Depth Exploration

In recent years, the demand for fresh flower delivery in Sydney has soared, driven in part by the ...

How Penrith SMEs Can Keep Stock and Equipment Working for the Business

For Penrith SMEs in 2026, efficient inventory starts with reliable stock data: what is on hand, wher...