- Mirror 25th Sep 2019 11:45:50 GMT +0300
For More of This and Other Stories, Grab Your Copy of the Standard Newspaper.
More than 30 AI algorithms for healthcare have already been approved by the US Food and Drug Administration, and there have been strong market forces driving their development. Reports of AI outperforming humans in diagnostic testing have also generated much excitement and debate. "Diagnosis of disease using deep learning algorithms holds enormous potential," Prof Denniston said. However, the study, published in The Lancet Digital Health, notes that only a few studies were of sufficient quality to be included in the analysis. It means the true power of AI which combines algorithms, big data and state of the art computers to emulate human intelligence remains uncertain. There was a lack of direct comparisons between the performance of humans and machines, and validation in real clinical environments. "We reviewed over 20,500 articles, but less than 1 per cent of these were sufficiently robust in their design and reporting that independent reviewers had high confidence in their claims," said Prof Denniston. "What's more, only 25 studies validated the AI models externally - using medical images from a different population - and just 14 studies actually compared the performance of AI and health professionals using the same test sample." Prof Denniston and colleagues called for higher standards of research and reporting to improve future evaluations. "Evidence on how AI algorithms will change patient outcomes needs to come from comparisons with alternative diagnostic tests in randomised controlled trials," said co-author Dr Livia Faes, of Moorfields Eye Hospital, London. "So far, there are hardly any such trials where diagnostic decisions made by an AI algorithm are acted upon to see what then happens to outcomes which really matter to patients, like timely treatment, time to discharge from hospital, or even survival rates." Dr Tessa Cook, of the University of Pennsylvania, USA, who was not involved in the study, said comparing AI to doctors in the real world where data is "messy, elusive, and imperfect" is challenging. Writing in the journal, she said: "Perhaps the better conclusion is that, the narrow public body of work comparing AI to human physicians, AI is no worse than humans, but the data are sparse and it may be too soon to tell."We are undertaking a survey to help us improve our content for you. This will only take 1 minute of your time, please give us your feedback by clicking HERE. All responses will be confidential.



