Surprisingly Useful AI Article Enhancements
Melbourne-based AI venture builder, AIBUILD, has launched an AI Content Verifier platform designed to flag AI-generated and suspicious content across text, images, audio and video, targeting the growing wave of voice-cloning and impersonation scams affecting Australian small businesses.
The multi-modal system analyses communications for inconsistencies in language, structure, provenance and content patterns, rather than assessing each element in isolation. It has been trained on thousands of real corporate and government communications to recognise the patterns of official messaging.
The platform is currently being used in government operations and is set to be rolled out to businesses.
The scale of the problem
According to data from the National Anti-Scam Centre’s Targeting Scams Report 2025, small businesses lodged 2,228 reports to Scamwatch in 2025, with 287 reporting financial losses amounting to $9.5 million – 27.9 per cent lower than 2024.
Small businesses also reported the highest overall loss to investment scams at $6.2 million, a decrease of 27.6 per cent from 2024.
Separately, Australians lost an estimated $25.8 million to AI voice-cloning scams in the first half of 2025 alone, according to AI expert, Dominique Carlon, from Swinburne University of Technology. In those cases, scammers used generative AI to clone the voices of family members, bosses and public figures, sometimes from just a few seconds of audio lifted from social media.
Why existing tools fall short
The CEO and Co-Founder of AIBUILD, Yifei Wang, who also lectures in AI at the University of Melbourne, pointed to a shift in the nature of scam communications as the motivation behind the platform.
“Not only has there been a significant increase in targeted scams, these scammers are getting far better at fooling business owners,” Wang stated.
“They now have bigger teams and far more resources, and because of this, a new front has opened: AI voice-cloning and impersonation scams.”
Wang noted that existing detection tools were not designed for this type of threat.
“Most existing detection tools weren’t built for this. They scan only text in isolation, missing the image, the context, or the structural fingerprints that separate a genuine communication from a fabricated one,” he explained.
“What we’ve built responds directly to this issue: the AI Content Verifier, a multi-modal system that assesses whether text, images, audio and video are authentic, manipulated or AI-generated.”
How the system works
AIBUILD’s platform differs from generic detection tools in that it analyses text, imagery, audio and video together, looking for inconsistencies across multiple dimensions rather than checking each content type separately.
The system has been trained on thousands of real corporate and government communications, giving it a baseline understanding of the patterns and structure typical of official messaging.
In internal testing of the system’s image-detection capability across 600 images from government communications, including content generated by AI models, AIBUILD reports it correctly identified AI-modified images 98 to 100 per cent of the time, with a false positive rate of 1 per cent or lower on authentic images.
Related: Best Business Laptops for work & school
Related: Best Gaming Laptops
Related: Best Portable Laptop
When MFA is not enough
Business owner, Michael Wilczynski, who runs National Accounts Group, experienced a sophisticated impersonation attack that bypassed multi-factor authentication (MFA) safeguards.
“Earlier this year our firm was hit by an incredibly sophisticated attack posing as a trusted associate of the business,” Wilczynski recounted.
“The scam email was sent through our accounting software provider’s own servers, so it passed every authentication check. The attackers then defeated multi-factor authentication, took over an account, posed as a trusted supplier and quietly changed bank details so a legitimate payment went to a fraudulent account.”
“The way they leveraged AI to do this is what worries me most.”
Wilczynski highlighted that even the traditional safeguard of phone verification is now under threat from voice-cloning technology.
“The standard advice after every payment scam is ‘pick up the phone and verify’. AI voice cloning is now attacking exactly that safeguard. A finance officer who calls to check new bank details, or takes a call from ‘the director’ approving an urgent payment, can no longer trust their ears,” he warned.
“It’s a concerning time we are living in, but the more systems we have at our disposal to outsmart these scammers, the better, especially ones that are adapting to how quickly these scams are evolving.”
Verifying before acting
Wang framed the platform as a pre-emptive check rather than a post-incident response tool.
“The scams costing Australians the most money today aren’t the obvious ones, they’re the ones that pass every gut check – the right logo, the right voice, the right urgency at the right moment,” Wang observed.
“We built the AI Content Verifier because by the time something feels wrong, it’s often too late to check. This gives people a way to verify before they act, not after.”
About AIBUILD
AIBUILD is an Australian AI venture builder and technology company founded in 2017. It works with institutions, government agencies and research organisations both nationally and internationally, and has been supported by multiple government grants and R&D programs. The company holds several proprietary innovation patents across its portfolio of AI-powered technologies. More information is available at www.aibuild.com.
Last Updated on September 2, 2026 by Nick Ross
Interesting point about how AI voice cloning is making traditional verification methods less reliable. Having an additional layer like TruthScan Deepfake Detector can be really useful for checking suspicious audio, images, and videos before taking action.