The Dark Secret at the Heart of AI - MIT Technology Review:
"...The resulting program, which the researchers named Deep Patient, was trained using data from about 700,000 individuals, and when tested on new records, it proved incredibly good at predicting disease.
Without any expert instruction, Deep Patient had discovered patterns hidden in the hospital data that seemed to indicate when people were on the way to a wide range of ailments, including cancer of the liver.
There are a lot of methods that are “pretty good” at predicting disease from a patient’s records, says Joel Dudley, who leads the Mount Sinai team.
But, he adds, “this was just way better.”
“We can build these models, but we don’t know how they work.”
At the same time, Deep Patient is a bit puzzling.
It appears to anticipate the onset of psychiatric disorders like schizophrenia surprisingly well.
But since schizophrenia is notoriously difficult for physicians to predict, Dudley wondered how this was possible.
He still doesn’t know.
The new tool offers no clue as to how it does this..."