openreview.net

Turing Complete Transformers: Two Transformers Are More Powerful...

This paper presents Find+Replace transformers, a family of multi-transformer architectures that can provably do things no single transformer can, and which outperforms GPT-4 on several challenging...