The computer says no. But can I believe him?: Thoughts on auditing artificial intelligence

BIDS + IES + CHAI + CLTC

Lecture

April 5, 2022
12:00pm to 1:00pm
Virtual Participation

Cost

Free

Register

BIDS Visiting Fellow Anni Hellman, a 2021-2022 EU Fellow with the Berkeley Institute of European Studies, presented this talk on Tuesday, April 5, 2022, at 12:00 – 1:00 PM Pacific. The event was held both in person and over Zoom. Pre-registration was required. This event was free to attend.

The computer says no. But can I believe him?: Thoughts on auditing artificial intelligence

​Speaker: Anni Hellman, Deputy Head of Unit, EU Commission Directorate-General for Communications Networks, Content and Technology

An audit is a tool used to verify compliance with regulations and controls. This requires in-depth analysis to understand the functioning of the object of the audit. If the object of the audit is an artificial intelligence-based system, understanding how the system came up with its results may be a challenge: the AI may be very complex, or its operation may be based on training, which it carries out through an iterative process that we may not be able to observe. How then do we know whether the AI is treating us fairly and that its assessments are sound and objective?

The European Commission has issued a proposal for an Artificial Intelligence Act to the European Parliament and Council. This Proposal comprises several requirements specifically for AI-based software that would be used in legislative areas considered to be “high risk,” as they could “create adverse impact on people’s safety or their fundamental rights.” How can compliance with these requirements be verified, and can that be done ex-post, or is an ex-ante audit necessary?

Event Sponsors: BIDS and the ​Berkeley Institute of European Studies, the Berkeley Center for Long-Term Cybersecurity, and the Berkeley Center for Human-Compatible Artificial Intelligence

Event Contact: cltcevents@berkeley.edu

Speaker(s)

Anni Hellman

Deputy Head of Unit, EU Commission Directorate-General for Communications Networks, Content and Technology

Anni Hellman – the Deputy Head of Unit at the EU Commission Directorate-General for Communications Networks, Content and Technology – was a BIDS Visiting Fellow and an EU Fellow in the Berkeley Institute of European Studies at University of California, Berkeley, in 2021-2022. She is a mathematician, qualified insurance actuary and a Fellow of the Actuarial Association of Finland, and holds degrees in mathematics, actuarial sciences and computer sciences. In the European Commission, her unit (Media convergence and social media) has focused on the challenges of social media, with two main strands or work: policy on how to tackle the challenges of disinformation, and how to work towards ensuring the integrity of social media through a multidisciplinary approach and through funding of research projects. In Berkeley, Hellman has returned partly to her mathematical roots to look into the challenges of artificial intelligence in general and algorithms in particular – can AI be audited? – as well as the disinformation challenge from a mathematical perspective. Hellman aims to combine her backgrounds in pure and actuarial mathematics, in audit practices and in working on and with the European legislative instruments.