7 Companies Building Foundation Models in Biology and Chemical Synthesis

by Andrii Buvailo, PhD          Biopharma insight

Disclaimer: All opinions expressed by Contributors are their own and do not represent those of their employers, or BiopharmaTrend.com.
Contributors are fully responsible for assuring they own any required copyright for any content they submit to BiopharmaTrend.com. This website and its owners shall not be liable for neither information and content submitted for publication by Contributors, nor its accuracy.

   668    Comments 0
Topics: Emerging Technologies   
Share:   Share in LinkedIn  Share in Reddit  Share in X  Share in Hacker News  Share in Facebook  Send by email

In the past three years, AI foundation models have been on fire, swiftly entering various industries. The most prominent examples of foundation models are the GPT-3 and GPT-4 models, which form the basis of ChatGPT.

These are huge models trained on enormous volumes of data, often in a self-supervised or unsupervised manner (without the need for labeled data). Thanks to special model design, including transformer architecture and attention algorithms, foundation models are very generalizable, allowing their adaptation to a diverse array of downstream tasks, unlike traditional AI models that excel in single tasks like, say, predicting molecule-target interaction.

For instance, Deep Genomics unveiled BigRNA, a pioneering AI foundation model for uncovering RNA biology and therapeutics. According to Deep Genomics, it is the first transformer neural network engineered for transcriptomics. BigRNA is informed by nearly two billion adjustable parameters and has been trained on thousands of datasets, totaling over a trillion genomic signals.

A month earlier, Ginkgo Bioworks, Inc. and Google Cloud announced a 5-year partnership where Ginkgo would work to develop new, state-of-the-art large language models (LLMs). The AI foundation model would be focused on genomics, protein function, and synthetic biology and would be running on Google Cloud's Vertex AI platform. The model is supposed to help Ginkgo's customers accelerate innovation and discovery in fields as diverse as drug discovery, agriculture, industrial manufacturing, and biosecurity.

Continue reading

This content available exclusively for BPT Mebmers

Topics: Emerging Technologies   

Share:   Share in LinkedIn  Share in Reddit  Share in X  Share in Hacker News  Share in Facebook  Send by email

Comments:

There are no comments yet. You can be the first.

Leave a Reply

Your email address will not be published. Required fields are marked *