When LLM Judges Inflate Scores: Exploring Overrating in Relevance Assessment

Published in Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2026) , 2026