Effective scaling and a flexible task interface enable large language models to excel at many
tasks. We present PaLI (Pathways Language and Image model), a model that extends this …

This paper presents contrastive-tuning, a simple method employing contrastive training to
align image and text models while still taking advantage of their pre-training. In our empirical …

Vision Transformers (ViT) have been shown to attain highly competitive performance for a
wide range of vision applications, such as image classification, object detection and semantic …

Background and Methods The prevention of disability in elderly people poses a challenge for
health care and social services. We conducted a three-year, randomized, controlled trial of …

Convolutional Neural Networks (CNNs) are the go-to model for computer vision. Recently,
attention-based networks, such as the Vision Transformer, have also become popular. In this …

Contrastive pretraining on image-text pairs from the web is one of the most popular large-scale
pretraining strategies for vision backbones, especially in the context of large multimodal …

The scaling of Transformers has driven breakthrough capabilities for language models. At
present, the largest large language models (LLMs) contain upwards of 100B parameters. …

Background: Elderly patients taking inappropriate drugs are at increased risk for adverse
outcomes. We investigated the prevalence of inappropriate drug use and its predisposing …

Human-induced atmospheric composition changes cause a radiative imbalance at the top
of the atmosphere which is driving global warming. This Earth energy imbalance (EEI) is the …

We present the training recipe and results of scaling up PaLI-X, a multilingual vision and
language model, both in terms of size of the components and the breadth of its training task …