A preprint claims that “ideas from theoretical linguistics have played no role in [NLP]”. Outside the confines of Chomskyan linguistics folks have long been working on incorporating storage, retrieval, gating and attention in theories of language, with direct relevance to computational models. The only way to give any content to the claim is by giving the notion “theoretical linguistics” the narrowest conceivable reading.