They needed an architecture that could take advantage of the scale, first. That'...

		hiddencost on April 15, 2023 \| parent \| context \| favorite \| on: Sam Altman: OpenAI is not training GPT-5 and "won'... They needed an architecture that could take advantage of the scale, first. That's what BERT did.