Is the GSM-Symbolic math benchmark now memorized by post-2024 models?
An evaluation-integrity study testing whether post-2024 language models have memorized the GSM-Symbolic math benchmark, using symbolic variants to detect contamination.
Priority flagship project in the research program
Symbolic variant design to distinguish memorization from reasoning
Pre-registered before any model was evaluated