AISI discusses role of third-party evaluators in assessing AI safety

25/10/2024 | AI Safety Institute

The UK AI Safety Institute (AISI) has published a blog article outlining the role of third-party evaluators in ensuring AI safety and thereby fostering transparency and trust among stakeholders and the wider public. AISI stresses that while the science of model evaluations is still developing, they cannot yet provide definitive safety certifications; however, such evaluations can still lead to safety improvements.

The blog examines the need for a structured framework for testing frontier AI systems, highlighting the importance of both pre- and post-deployment evaluations to identify potential risks, especially during significant system updates. It discusses what should be tested—such as misuse risks, societal impacts, the functioning of autonomous systems, and the robustness of safety mechanisms—while also aiming to establish a methodology to identify which systems merit evaluation.

The AISI also notes the need for an ongoing debate within the scientific community to refine testing practices and methodologies in response to evolving AI technologies.

Read Full Story
Risk management, safety assessment, impact assessment

What is this page?

You are reading a summary article on the Privacy Newsfeed, a free resource for DPOs and other professionals with privacy or data protection responsibilities helping them stay informed of industry news all in one place. The information here is a brief snippet relating to a single piece of original content or several articles about a common topic or thread. The main contributor is listed in the top left-hand corner, just beneath the article title.

The Privacy Newsfeed monitors over 300 global publications, of which more than 5,750 summary articles have been posted to the online archive dating back to the beginning of 2020. A weekly roundup is available by email every Friday.

Freevacy has been shortlisted in the Best Educator category.
The PICCASO Privacy Awards recognise the people making an outstanding contribution to this dynamic and fast-growing sector.