The aims of the Focus Group are described by the group’s Chair, Thomas Wiegand, Executive Director of the Fraunhofer Heinrich Hertz Institute and Professor at TU Berlin:
“The Focus Group plans to establish a framework and associated processes for the performance evaluation of AI algorithms in health. This will be a complicated and challenging task, one we will undertake step-by-step, beginning with this first Call for Proposals.”
Iterative Calls for Proposals will guide the Focus Group’s development of evaluation methods to assess the degree to which ‘AI for Health’ use cases have achieved Proof of Concept.
“Performance benchmarking will determine whether or not AI algorithms are fit for purpose, of the standard necessary to automate certain tasks in the health sector,” says Marcel Salathé, Vice-Chair of the Focus Group and Professor at École polytechnique fédérale de Lausanne (EPFL).
The Focus Group’s work will depend heavily on data. The group is in search of datasets able to become reference data for performance benchmarking.
“The Focus Group will support multi-stakeholder collaboration to address the challenges surrounding data availability in the health context,” says Vice-Chair of the Focus Group, Ramesh Krishnamurthy, Senior Advisor to the WHO Department of Information, Evidence and Research.
“WHO has committed key assets to this work, including senior WHO officials able to shape this discussion and drive this collaboration forward,” says Krishnamurthy.
Illustration Photo: Cloud computing in healthcare (credits: Photo by NEC Corporation of America with Creative Commons license.)