Artificial intelligence (AI) technology developed by the RIKEN Center for Advanced Intelligence Project (AIP) in Japan has successfully found features in pathology images from human cancer patients, without annotation, that could be understood by human doctors. Further, the AI identified features relevant to cancer prognosis that were not previously noted by pathologists, leading to a higher accuracy of prostate cancer recurrence compared to pathologist-based diagnosis. Combining the predictions made by the AI with predictions by human pathologists led to an even greater accuracy.
According to Yoichiro Yamamoto, the first author of the study published in Nature Communications, “This technology could contribute to personalized medicine by making highly accurate prediction of cancer recurrence possible by acquiring new knowledge from images. It could also contribute to understanding how AI can be used safely in medicine by helping to resolve the issue of AI being seen as a ‘black box.’”
Automatically annotated 3D whole-mount pathology image
The deep learning algorithm automatically discovers features from diagnostic annotation-free histopathology images and presents them in an understandable way. Areas with a high probability of cancer recurrence are shown by height and color on the 3D pathology image.
The research group led by Yamamoto and Go Kimura, in collaboration with a number of university hospitals in Japan, adopted an approach called “unsupervised learning.” As long as humans teach the AI, it is not possible to acquire knowledge beyond what is currently known. Rather than being “taught” medical knowledge, the AI was asked to learn using unsupervised deep neural networks, known as autoencoders, without being given any medical knowledge. The researchers developed a method for translating the features found by the AI—only numbers initially—into high-resolution images that can be understood by humans.
Outline of the method
First, unsupervised deep neural networks were applied to pathology images without being taught any medical knowledge. Next, the features (a series of numbers that humans cannot directly understand) acquired by AI were translated into high-resolution images that can be understood by humans and were automatically assigned optimum weights to make images interpretable.
To perform this feat the group acquired 13,188 whole-mount pathology slide images of the prostate from Nippon Medical School Hospital (NMSH), The amount of data was enormous, equivalent to approximately 86 billion image patches (sub-images divided for deep neural networks), and the computation was performed on AIP’s powerful RAIDEN supercomputer.
Supercomputer RAIDEN
RAIDEN, which stands for Riken AIp Deep learning ENvironment, is the flagship supercomputer of the RIKEN Center for Advanced Intelligence Project, RIKEN’s research arm that specializes in AI.
The AI learned using pathology images without diagnostic annotation from 11 million image patches. Features found by AI included cancer diagnostic criteria that have been used worldwide, on the Gleason score, but also features involving the stroma—connective tissues supporting an organ—in non-cancer areas that experts were not aware of. In order to evaluate these AI-found features, the research group verified the performance of recurrence prediction using the remaining cases from NMSH (internal validation). The group found that the features discovered by the AI were more accurate (AUC=0.820) than predictions made based on the human-established cancer criteria developed by pathologists, the Gleason score (AUC=0.744). Furthermore, combining both AI-found features and the human-established criteria predicted the recurrence more accurately than using either method alone (AUC=0.842). The group confirmed the results using another dataset including 2,276 whole-mount pathology images (10 billion image patches) from St. Marianna University Hospital and Aichi Medical University Hospital (external validation).
Comparison of prediction accuracy for prostate cancer recurrence
The numbers in the figure shows the areas under the receiver operating characteristic curves (AUCs) for biochemical recurrence one year after surgical resection of prostate cancer.
“I was very happy,” says Yamamoto, “to discover that the AI was able to identify cancer on its own from unannotated pathology images. I was extremely surprised to see that AI found features that can be used to predict recurrence that pathologists had not identified.”
He continues, “We have shown that AI can automatically acquire human-understandable knowledge from diagnostic annotation-free histopathology images. This ‘newborn’ knowledge could be useful for patients by allowing highly-accurate predictions of cancer recurrence. What is very nice is that we found that combining the AI’s predictions with those of a pathologist increased the accuracy even further, showing that AI can be used hand-in-hand with doctors to improve medical care. In addition, the AI can be used as a tool to discover characteristics of diseases that have not been noted so far, and since it does not require human knowledge, it could be used in other fields outside medicine.”
Reference
Y. Yamamoto et al, Automated acquisition of explainable knowledge from unannotated histopathology images, Nature Communications (2019), doi: 10.1038/s41467-019-13647-8
*This paper is the 5th most read physics article on Nature Communications in 2019. For more information (External Link)
Contact
- Team Leader
Yoichiro Yamamoto
Pathology Informatics Team
RIKEN Center for Advanced Intelligence Project
Inquiries: https://aip.riken.jp/contactus/biz/ - Masataka Sasabe
RIKEN International Affairs Division
E-mail: pr [at] riken.jp
Media Coverage
EurekAlert! (Dec.18) (Science Daily, Medical Express, Science Codex, News Trotteur, Lab Manager, Lab Manager, ecancer, HEALTH CANAL), News Medical (Dec.18), HB (Dec.18, in Russian), Naked Science (Dec.18, in Russian), Yandex (Dec.19, in Russian), Companion UA (Dec.19, in Russian), Zhuanlan Zhihu(Dec.19, in Chinese), molbuk.ua (Dec.20, in Russian), MedIndia (Dec.20), hightech.plus (Dec.21, in Russian), The Evidence Base (Dec.23), Scientific Amerian (Dec.31, in Arabic), Physics World (Jan.29) (Swiss Cognitive)
