This #EMNLP2024 outstanding paper (https://aclanthology.org/2024.emnlp-main.53/, https://underline.io/events/469/sessions/18820/lecture/106175-language-models-learn-rare-phenomena-from-less-rare-phenomena-the-case-of-the-missing-aanns) LMs can learn a rare grammatical construction like "a beautiful five days", even without any examples in the training data, by generalizing from more common phenomenon.
Comments