SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer
Abstract
SPoT improves adaptation of frozen language models by transferring soft prompts across tasks.
Type
Publication
Proceedings of the Annual Meeting of the Association for Computational Linguistics
Rami Al-Rfou
Member of Technical Staff - TLM
My research interests include language modeling, embodied AI, motion forecasting, and multilingual modeling.