capabilities that appear only in models above a certain scale and are not predictable by extrapolating from smaller models. Wei et al. (2022) defined an emergent ability as one that is "not present in smaller models but is present in larger models," with performance transitioning sharply from near-c