ASIC tests AI usage to read public submissions

ASIC Joe Longo Senate Committee artificial intelligence

21 May 2024
| By Laura Dew |
image
image
expand image

ASIC chair Joe Longo has told a Senate select committee that it has been running two pilot AI programs, including one to read public submissions.

Appearing before the Senate Select Committee on Adopting Artificial Intelligence today (21 May), the panel discussed how the corporate regulator is exploring AI and its potential regulation.

Asked if the regulator utilises AI in its own operations, Longo said it has been running two pilot programs.  

“We do use AI, the first is in a pilot Commonwealth program on the use of Copilot and the second is using AI technology to read submissions. In ASIC’s world we are often having to read and absorb submissions because we consult heavily with the market so we ran a pilot to see if the AI could ‘read’ all those submissions and come up with accurate analysis to save hundreds of hours of human time.”

Graham Jefferson, digital and legal transformation lead at ASIC, added: “We’ve already been using machine learning for longer than AI has been topical and more recently we have been running these pilot programs.”

The Microsoft Copilot program involved 150 ASIC employees using it for a month, then providing feedback on how it worked for them. Meanwhile, the large language model pilot tested AI summaries of submissions against human counterparts, with submissions coming from those made to a parliamentary joint inquiry into consulting companies. This involved the use of the two US programs: Amazon Web Services and Llama2 which is run by Meta. 

Jefferson said: “The pilot the chair mentioned was a standalone large language model to test whether generative AI could produce accurate summaries of submissions. The pilot was a success, but it is not something that we’ll be using going forward. 

“We did a comparison of what the large language model generated and what our staff generated in a blind comparison and the results were not sufficiently good for us to use that technique in that particular way at this stage.”

Expanding on this, Longo added: “The AI gave a bland summary of the submissions, it wasn’t necessarily misleading, but it didn’t capture what the submissions were saying while the human was able to capture and pull out nuances.”

“We were particularly interested in any mentions of ASIC in the submissions to the inquiry, but the AI summaries were quite generic and the nuance wasn’t there compared to when the summarising work was carried out by an ASIC employee," concluded Jefferson. 

Read more about:

AUTHOR

Submitted by Chris Cornish on Tue, 2024-05-21 10:38

Needed to add - "consult heavily with the market " ... but don't publish or listen to submissions if they differ from our pre-determined viewpoint.

Add new comment

The content of this field is kept private and will not be shown publicly.

Recommended for you

sub-bgsidebar subscription

Never miss the latest news and developments in wealth management industry

MARKET INSIGHTS

JOHN GILLIES

tHOSE 989 WHO ARE CEASED WILL GO ON TO LIVE A LONG AND HEALTHY LIFE JG...

4 days 18 hours ago
Chris Cornish

What a sticth-up. Looks like Labor Senator Jess Walsh follows Stephen Jones who follows what the industry super funds ...

4 days 15 hours ago
Peter Swan

This report is a blatant display of far-left factional partisanship, treating superannuation funds as state property and...

4 days 16 hours ago

ASIC has cancelled the AFS licence of a Sydney wealth firm, the fifth Sydney firm to see a cancellation since the start of the year....

2 weeks 5 days ago

More than 20 winners from the funds management industry have been crowned at this year’s awards....

1 week 5 days ago

ASIC has obtained interim orders from the Federal Court to freeze the assets of a registered managed fund and prevent its former director from leaving Australia. ...

6 days 15 hours ago

TOP PERFORMING FUNDS

ACS FIXED INT - AUSTRALIA/GLOBAL BOND