A rtificial Intelligence Could Revolutionize Science—If We Can Trust It

Mitch Leslie

Engineering ›› 2024, Vol. 35 ›› Issue (4) : 4 -6.

PDF (384KB)
Engineering ›› 2024, Vol. 35 ›› Issue (4) :4 -6. DOI: 10.1016/j.eng.2024.03.002
News & Highlights
A rtificial Intelligence Could Revolutionize Science—If We Can Trust It
Author information +
History +
PDF (384KB)

Graphical abstract

Cite this article

Download citation ▾
Mitch Leslie. A rtificial Intelligence Could Revolutionize Science—If We Can Trust It. Engineering, 2024, 35 (4) : 4-6 DOI:10.1016/j.eng.2024.03.002

登录浏览全文

4963

注册一个新账户 忘记密码

A drug developer trying to devise a new cancer treatment, a virologist investigating how a virus invades cells, an evolutionary biologist probing the effects of mutations on an organism’s fitness—these are just some of the scientists who need to know the three-dimensional structures of specific proteins. However, deducing a protein’s shape through experiments is laborious and costly [1]. By the early 2020s, researchers had succeeded with only about 200 000 of the molecules, less than 0.1% of the total that known organisms produce [2]. But in mid-2022, scientists announced that an artificial intelligence (AI) model known as AlphaFold, developed by the London, UK-based Google subsidiary DeepMind, had predicted the structures of almost all of the more than 220 million unsolved proteins (Fig. 1) [3], [4]. Experimentally determining the structures of 200 000 proteins took researchers about 50 years and cost around 2 billion USD, said Marc Zimmer, professor of chemistry at Connecticut College in New London, CT, USA. “AlphaFold can do that in a couple of days for essentially nothing because it is online.”
AI is not only illuminating the architecture of existing molecules. It is also inventing new ones. Several AI-designed drugs have reached clinical trials, and for the first time one has progressed to a phase II trial that will test whether it works [5]. And AI is delivering news-worthy discoveries in other areas of research, including geology [6], physics [7], neuroscience [8], and math [9]. AI “is making connections we have never made before. That is the breakthrough,” said Zimmer.
But some researchers worry about the increasing reliance on AI in science. AI can mislead. It concocts false results, a problem known as hallucination [10], [11]. And even accurate findings may not be scientifically relevant. Like all scientific discoveries, those made by AI need to be confirmed. But many researchers are skimping on this step, said Casey Bennett, assistant professor of computing and digital media at DePaul University in Chicago, IL, USA. “A lot of people are not following the scientific process to do it correctly to verify the answer.” Moreover, researchers may not be able to validate some of AI’s results because its procedure for drawing conclusions is often obscure, a problem that some experts worry could spark a “reproducibility crisis” in science [12], [13].
AI encompasses several technologies, including robotics. But researchers often use the AI variety known as machine learning, in which computers draw inferences or identify patterns by poring over vast data sets [14]. “Machine learning is good at picking out patterns that are beyond our cognitive capabilities,” said Bennett. That power has already made AI indispensable for several fields, including astronomy. Without help from machine learning, astronomers could not hope to analyze the huge amounts of data generated by telescopes and other instruments, said Chris Impey, professor of astronomy at the University of Arizona in Tucson, AZ, USA. For example, he noted, the Vera C. Rubin Observatory in Chile, which is set to begin a ten-year survey of the southern sky in 2024, will produce up to 40 TB of data every night. AI’s ability to detect anomalies makes it particularly valuable, he said, allowing researchers to identify novel objects that might otherwise go unnoticed. “In astronomy, you do not always know what you are looking for.” Astronomers have already used AI to pinpoint a new planet outside our Solar System, reveal an asteroid that could potentially strike Earth, and make other discoveries [15], [16].
As noted above, researchers trying to crack one of the toughest problems in biology—predicting how proteins fold into complex shapes—have also received a game-changing boost from AI [4]. A protein’s structure dictates how it works but predicting a protein’s shape from only its sequence of amino acids, or chemical building blocks, is extremely difficult [17]. Although researchers have been testing the predictive abilities of AI models—including a previous version of AlphaFold—for decades, it was not until a 2020 protein folding contest, the Critical Assessment of Protein Structure Prediction, that the technology showed its prowess. AlphaFold beat the more than 50 other competitors by a large margin, and two-thirds of its predictions were as accurate as experimentally determined structures—a significant jump in performance for AI models [18], [19].
DeepMind scientists had trained the model by feeding it the known structures of about 170 000 proteins. When AlphaFold is tasked with predicting the shape of an unsolved protein, it uses these structures as a guide to determine which amino acids might be near each other [18]. The model’s developers improved on the previous version of AlphaFold by adding an algorithm that builds a protein’s structure by starting with small pieces and moving on to larger and larger ones [18], [20].
AlphaFold’s success set off a rush to apply it. More than 400 000 people accessed the AlphaFold database in the first nine months after it went online, and the number of papers that referenced the model more than quadrupled in the same time [21]. Researchers have enlisted AlphaFold to uncover a potential new drug for treating liver cancer [22], predict the structure of a key protein from a dangerous virus [23], and generate the most comprehensive model of the nuclear pore complex, the elaborate molecular channel that controls what enters and exits the nucleus of a cell [21]. “We can suddenly do things really easily that were extremely difficult or impossible before,” said Zimmer. DeepMind has also released an upgraded version of AlphaFold that can forecast how proteins will interact with other types of molecules, a capability that could benefit drug developers [24].
Some news articles declared that AlphaFold had “solved” the protein folding problem, but AI models do not deliver the final word on molecular structure, cautioned Tamir Gonen, professor of biological chemistry at the University of California, LA, USA. AlphaFold often gets the overall structure of proteins right, he said. That capability has made it easier for scientists studying specific proteins to obtain models of what the molecules might look like, and that “may help them explain their experiments,” Gonen said. “I choose my words carefully,” he added, because predicted structures from AlphaFold can also be wrong. “You have to validate these models. If you do not and take them as truth, you could have a big problem,” said Gonen. In short, he said, AI is not ready to take over from biologists. “There may come a time when we no longer need to solve structures experimentally, but we are not there yet.”
AlphaFold also struggles with certain protein features, Julie Forman-Kay, senior scientist at the Hospital for Sick Children Research Institute in Toronto, Canada, and other researchers have found. All human proteins contain sections, known as intrinsically disordered regions, that do not fold into a definite shape and instead continually shift among different conformations [25]. More than one-third of the amino acids in proteins are in disordered regions, and proteins range from having almost no disorder to being completely disordered [26]. In 2023, Forman-Kay and her team analyzed how AlphaFold handles intrinsically disordered regions. Researchers had thought that AlphaFold would mark its predictions for these regions as uncertain, thus warning users that the putative structures were possibly incorrect. But about 15% of the time, the model assumes that these regions will fold into specific shapes and gives its predictions a high level of confidence, Forman-Kay and her colleagues reported [27]. In most of these cases, the disordered region likely adopts a particular shape under certain conditions, such as when it binds to another protein, said Forman-Kay. But those conditions are unknown, and many times disordered regions fold into different structures under different conditions, making AlphaFold’s predicted structures inaccurate, she said. Few scientists are aware of these limitations, Forman-Kay said, and they may mistakenly conclude that the model’s predictions are definitive. She still believes that AI provides important insights into protein folding, but researchers need to recognize that “it is just a tool” and needs to be applied cautiously.
AI does not just help researchers analyze data. In fields such as space science and astrophysics, it can also help decide what data scientists see. Today, spacecraft and observational satellites can gather much more data than they have the bandwidth to transmit back to Earth. That is why more and more space missions also include on-board computers equipped with AI modules. These AI systems filter out bad or low-quality data, allowing the craft to send only the high-quality data back to Earth [28]. Giving AI algorithms that power also places a large burden on them, said Simon Wing, a physicist at Johns Hopkins University Applied Physics Laboratory in Laurel, MD, USA. “We need to be careful if we use [AI] to reduce data,” he said. If the AI is not trained or applied properly, “it may misclassify useful data as bad. If that happened, the data would be lost forever.”
Bennett worries that many of the published results produced by AI models are wrong or irrelevant. Researchers are not taking care to double-check that their findings are accurate and scientifically informative, he said. “The problem is not, ‘Can I find a pattern?’ That is easy. The problem is finding out which patterns are meaningful in the real world. That is hard.” The underlying cause, according to Bennett, is that researchers who do not understand AI’s subtleties and limitations are rushing to use it. He thinks that before scientists apply AI in their research, they should have to pass a certification course set up by a professional body like the organizations that license lawyers and doctors. “Machine learning, just like surgery, requires the proper level of training and experience,” he said. “Otherwise, we can produce misleading answers and bad solutions.”
Other researchers do not go that far. But some scientists who acknowledge AI’s constraints are working to give its results more credence. AI’s co-called black box problem—how the models arrive at their conclusions is often mysterious—has long been a concern [29]. Even some of AlphaFold’s “thinking” is inexplicable, the chief executive officer of DeepMind has admitted [30]. To overcome the problem, researchers are developing so-called explainable AI, models that follow specific rules and procedures so that their reasoning is transparent [31].
That is just one step that could make AI results more credible, but scientists also need a clearer understanding of what the models can and cannot achieve, experts say. AI tools can be illuminating, said Wing, “as long as they are used correctly, and their limitations are acknowledged.”

References

[1]

Seay TH. Has AlphaFold actually solved biology’s protein-folding problem? [Internet]. Washington, DC: Science News; 2023 Sep 23 [cited 2023 Dec 31]. Available from: https://www.sciencenews.org/article/alphafold-ai-protein-structure-folding-prediction

[2]

Metz C. A.I.. predicts the shape of nearly every protein known to science [Internet]. New York City:The New York Times; 2022 Jul 28 [cited 2023 Dec 31]. Available from: https://www.nytimes.com/2022/07/28/science/ai-deepmind-proteins.html

[3]

E. Callaway. ‘The entire protein universe’: AI predicts shape of nearly every known protein. Nature, 608 (7921) (2022), pp. 15-16.

[4]

S. O’Neill. Machine learning turbocharges structural biology. Engineering, 12 (2022), pp. 9-11.

[5]

Smyth J. Biotech begins human trials of drug designed by artificial intelligence [Internet]. London: Financial Times; 2023 Jun 26 [cited 2023 Dec 31]. Available from: https://www.ft.com/content/82071cf2-f0da-432b-b815-606d602871fc

[6]

Witze A. AI predicts how many earthquake aftershocks will strike—and their strength [Internet]. London: Nature; 2023 Sep 28 [cited 2023 Dec 31]. Available from: https://www.nature.com/articles/d41586-023-02934-6

[7]

Jarman S. Particle physicists get AI help with beam dynamics [Internet]. Bristol: Physics World; 2023 May 23 [cited 2023 Dec 31]. Available from: https://physicsworld.com/a/particle-physicists-get-ai-help-with-beam-dynamics/

[8]

Rosso C. New AI tracks neurons in moving animals [Internet]. New York City:Psychology Today; 2023 Dec 15 [cited 2023 Dec 31]. Available from: https://www.psychologytoday.com/us/blog/the-future-brain/202312/new-ai-tracks-neurons-in-moving-animals

[9]

D. Castelvecchi. DeepMind AI outdoes human mathematicians on unsolved problem. Nature, 625 (7993) (2024), pp. 12-13.

[10]

Thorbecke C. AI tools make things up a lot, and that’s a huge problem [Internet]. New York City:CNN Business; 2023 Aug 29 [cited 2023 Dec 31]. Available from: https://www.cnn.com/2023/08/29/tech/ai-chatbot-hallucinations/index.html

[11]

D. Mackenzie. Surprising advances in generative artificial intelligence prompt amazement—and worries. Engineering, 25 (2023), pp. 9-11.

[12]

P. Ball. Is AI leading to a reproducibility crisis in science?. Nature, 624 (7990) (2023), pp. 22-25.

[13]

Wong M. Science is becoming less human [Internet]. Washington, DC: The Atlantic; 2023 Dec 11 [cited 2023 Dec 31]. Available from: https://www.theatlantic.com/technology/archive/2023/12/ai-scientific-research/676304/

[14]

Brown S. Machine learning, explained [Internet]. Cambridge: MIT Sloan School of Management; 2021 Apr 21 [cited 2023 Dec 31]. Available from: https://mitsloan.mit.edu/ideas-made-to-matter/machine-learning-explained

[15]

Sutter P. AI is already helping astronomers make incredible discoveries. Here’s how [Internet]. New York City:Space; 2023 Oct 4 [cited 2023 Dec 31]. Available from: https://www.space.com/astronomy-research-ai-future

[16]

Impey C. AI is helping astronomers make new discoveries and learn about the universe faster than ever before [Internet]. Melbourne: The Conversation; 2023 May 3 [cited 2023 Dec 31]. Available from: https://theconversation.com/ai-is-helping-astronomers-make-new-discoveries-and-learn-about-the-universe-faster-than-ever-before-204351

[17]

R.F. Service. ‘The game has changed’. AI triumphs at solving protein structures. Science, 370 (2020), pp. 1144-1145.

[18]

Heaven WD. DeepMind’s protein-folding AI has solved a 50-year-old grand challenge of biology [Internet]. Cambridge: MIT Technology Review; 2020 Nov 30 [cited 2023 Dec 31]. Available from: https://www.technologyreview.com/2020/11/30/1012712/deepmind-protein-folding-ai-solved-biology-science-drugs-disease/

[19]

S. O’Neill. Artificial intelligence cracks a 50-year-old grand challenge in biology. Engineering, 7 (6) (2021), pp. 706-708.

[20]

Howes L. DeepMind AI predicts protein structures [Internet]. Washington, DC: Chemical & Engineering News; 2022 Dec 1 [cited 2023 Dec 31]. Available from: https://cen.acs.org/physical-chemistry/protein-folding/DeepMind-AI-predicts-protein-structures/98/web/2020/12

[21]

E. Callaway. What’s next for the AI protein-folding revolution. Nature, 604 (2022), pp. 234-238.

[22]

First application of AlphaFold in identifying potential liver cancer drug [Internet]. New Rochelle: Genetic Engineering & Biotechnology News; 2023 Jan 24 [cited 2023 Dec 31]. Available from: https://www.genengnews.com/insights/first-application-of-alphafold-in-identifying-potential-liver-cancer-drug/

[23]

E. Callaway. How AlphaFold and other AI tools could help us prepare for the next pandemic. Nature, 622 (2023), pp. 440-441.

[24]

Palmer K, Trang B. DeepMind touts AlphaFold’s new skills as protein-folding AI models face off [Internet]. Boston: STAT; 2023 Oct 31[cited 2023 Dec 31]. Available from: https://www.statnews.com/2023/10/31/protein-folding-structure-ai-deepmind-alphafold-rosettafold/

[25]

Timmer J. Google’s AI protein folder IDs structure where none seemingly existed [Internet]. New York City: Ars Technica; 2023 Sep 20 [cited 2023 Dec 31]. Available from: https://arstechnica.com/science/2023/09/googles-ai-software-brings-order-to-protein-chaos/

[26]

B. Tsang, I. Pritišanac, S.W. Scherer, A.M. Moses, J.D. Forman-Kay. Phase separation as a missing mechanism for interpretation of disease mutations. Cell, 183 (7) (2020), pp. 1742-1756.

[27]

T.R. Alderson, I. Pritišanac, Đ. Kolarić, A.M. Moses, J.D. Forman-Kay. Systematic identification of conditionally folded intrinsically disordered regions by AlphaFold2. Proc Natl Acad Sci USA, 120 (44) (2023), e2304302120.

[28]

Artificial intelligence in space [Internet]. Paris: European Space Agency; 2023 Aug 3 [cited 2023 Dec 31]. Available from: https://www.esa.int/Enabling_Support/Preparing_for_the_Future/Discovery_and_Preparation/Artificial_intelligence_in_space

[29]

Bagchi S. What is a black box? A computer scientist explains what it means when the inner workings of AIs are hidden [Internet]. Melbourne: The Conversation; 2023 May 22 [cited 2023 Dec 31]. Available from: https://theconversation.com/what-is-a-black-box-a-computer-scientist-explains-what-it-means-when-the-inner-workings-of-ais-are-hidden-203888

[30]

T. Lewis. The AI biologist: DeepMind’s Demis Hassabis explains how artificial intelligence solved one of the biggest problems in biology. Sci Am, 328 (2) (2023), pp. 28-30.

[31]

What is explainable AI [Internet]. Armonk: IBM; [cited 2023 Dec 31]. Available from: https://www.ibm.com/topics/explainable-ai

RIGHTS & PERMISSIONS

THE AUTHOR

PDF (384KB)

6746

Accesses

0

Citation

Detail

Sections
Recommended

/