English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Tools annual

Global: Zendy Free Plan

Global: Zendy Tools monthly

Global: Zendy Plus monthly

Background: Although AI algorithms and applications become more and popular in the healthcare sector, only few institutions have an operational AI strategy. Identifying the best suited processes for ML algorithm implementation and adoption is a big challenge. Also, raising human confidence in AI systems is elementary to building trustworthy, socially beneficial and responsible AI. A commonly agreed AI auditing framework that provides best practices and tools could help speeding up the adoption process. In this paper, we first highlight important concepts in the field of AI auditing and then restructure and subsume them into an ML auditing core criteria catalog. Methods: We conducted a scoping study where we analyzed sources being associated with the term &#x201C;Auditable AI&#x201D; in a qualitative way. We utilized best practices from Mayring [1], Miles and Huberman [2] as well as Bortz and D&#x00F6;ring [3]. Based on referrals, additional relevant white papers and sources in the field of AI auditing were also included. The literature base was compared using inductively constructed categories. Afterwards, the findings were reflected on and synthesized into a resulting ML auditing core criteria catalog. Results: The catalog is grouped into the categories: Conceptual Basics, Data &#x0026; Algorithm Design and Assessment Metrics. As a practical guide, it consists of 30 questions developed to cover the mentioned categories and to guide ML implementation teams. Discussion: Our consensus-based ML auditing criteria catalog is intended as a starting point for the development of evaluation strategies by specific stakeholders. We believe it will be beneficial to healthcare organizations who have been or will start implementing ML algorithms. Not only to help them being prepared for any upcoming legally required audit activities, but also to create a better, well-received and accepted products. Potential limitations could be overcome by utilizing the proposed catalog in practice on real use cases and to expose gaps and further improve the catalog. Thus, this paper is seen as a starting point towards the development of a framework, where essential technical components can be specified.

Designing an ML Auditing Criteria Catalog as Starting Point for the Development of a Framework