AI Boosts Cancer Screens to Nearly 100 Percent Accuracy

In In The News by Barbara Jacoby

By: Christopher Wanjek


Diagnosing cancer is about to get more accurate, with the help of artificial intelligence.

Pathologists have diagnosed diseases in more or less the same way for the past 100 years, by laboring over a microscope reviewing biopsy samples on little glass slides. Working almost robotically, they sift through millions of normal cells to identify just a few diseased ones. The task is tedious and prone to human error.

But now, scientists and engineers have created a technique that uses artificial intelligence (AI) and can differentiate cancer cells from normal cells almost as well as a top-notch pathologist. A Harvard-based team demonstrated the AI method as part of a competition at the 2016 International Symposium of Biomedical Imaging in Prague, showing how it could pinpoint, with 92 percent accuracy,cancer cells among samples of breast tissue cells. That accuracy was far better than the other AI methods in the competition, landing the team first place.

Humans still have the edge: Pathologists beat the robots in this competition with their ability to identify 96 percent of the biopsy samples with cancer cells. [Super-Intelligent Machines: 7 Robotic Futures]

But the real surprise came when pathologists were teamed up with the Harvard team’s AI. Together, the artificial intelligence and good, ole human intelligence identified 99.5 percent of the cancerous biopsies.

While the thought of trusting Dr. Robot with your medical analysis may seem a bit scary, some scientists see great promise in AI-assisted doctor services.

“Our guiding hypothesis is that ‘AI plus pathologist’ will be superior to pathologist alone,” said Dr. Andrew Beck, of Beth Israel Deaconess Medical Center and Harvard Medical School in Boston, who led the creation of the winning AI design. “If we and the larger research community are able to demonstrate that the use of AI tools significantly reduces diagnostic errors, I believe patients, physicians, health care payers and health systems will be supportive of the addition of AI tools in the clinical workflow,” he told Live Science.

The contest, held in April, invited AI designs from around the world created by private companies and academic research organizations. The goal was to spur interest in creating more accurate AI methods of disease diagnosis.

“The fact that computers [in the April competition] had almost comparable performance to humans is way beyond what I had anticipated,” said Jeroen van der Laak of Radboud University Medical Center in the Netherlands, who organized the contest. “It is a clear indication that artificial intelligence is going to shape the way we deal with histopathological images in years to come.”

The contest organizers chose the topic of breast cancer detection — more specifically, metastatic cancer cells in sentinel lymph node biopsies — as a real-world test of an important public health issue. Among U.S. women, breast cancer is the second most common type of cancer (after skin cancer) and the second deadliest type of cancer (after lung cancer), according to the Centers for Disease Control and Prevention.

A sentinel lymph node biopsy is a surgical procedure in which a sample of tissue is removed from a sentinel node, the first in a group of lymph nodes, or glands, where cancer cells might spread after leaving the original site. A multicenter study published in 2003 in the Journal of the American College of Surgeons found that these biopsies, using traditional human analysis, were 96-percent accurate, with a false-negative rate of 8 percent.

Because cancer surgeons rely on the biopsies to decide what tissue to remove or leave in place, often at the very moment a cancer is beginning to spread, accuracy in the biopsy analysis is crucial.

Beck’s group used a process called “deep learning” to essentially teach a computer to better recognize what cancer cells look like. This process is a machine-learning algorithm used in applications such as speech recognition; it makes the system more and more accurate with each use. In preparation for the contest, Beck’s group fed the computer thousands of images of cancer cells.

The team identified examples for which the computer was prone to make a mistake in cancer identification and retrained the computer using greater numbers of more difficult examples.

The development of such automated diagnostics has been a goal for the AI field for the past 30 years, as computers became more commonplace in labs, Beck said. But only recently has the field seen the improvements in scanning, storage, computational power and algorithms necessary to make this possible.

Don’t worry, pathologists won’t be fading away. Beck said the field will evolve to adopt new skill sets. For example, pitfalls to avoid with AI include a system that routinely misses a particular rare form of cancer the AI hasn’t seen before or that is routinely thrown off by an artifact in the biopsy image, he said. Humans will be needed to continuously teach the robots.

Beck’s team includes postdocs in his Harvard lab, Dayong Wang and Humayun Irshad, along with Harvard graduate student Rishab Gargya and MIT researcher Aditya Khosla. A technical report describing this work was posted yesterday (June 20) on the open-access e-print archive