Understanding Syllogistic Reasoning in LLMs from Formal and Natural Language Perspectives

Aheli Poddar, Saptarshi Sahoo, Sujata Ghosh

Understanding Syllogistic Reasoning in LLMs from Formal and Natural Language Perspectives: 4 upvotes on Hugging Face Daily Papers, #22 of 24 papers on 2025-12-23. Day-by-day upvote history.

We study syllogistic reasoning in LLMs from the logical and natural language perspectives. In process, we explore fundamental reasoning capabilities of the LLMs and the direction this research is moving forward. To aid in our studies, we use 14 large language models and investigate their syllogistic reasoning capabilities in terms of symbolic inferences as well as natural language understanding. Even though this reasoning mechanism is not a uniform emergent property across LLMs, the perfect symbolic performances in certain models make us wonder whether LLMs are becoming more and more formal reasoning mechanisms, rather than making explicit the nuances of human reasoning.

Paper page on Hugging Face · arXiv

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.