top of page
SCIENCE OF SCIENCE

​

  • S. Koneru, J. Wu, S. Rajtmajer. Context Selection for Hypothesis and Statistical Evidence Extraction from Full-Text Scientific Articles. ACM/IEEE Joint Conference on Digital Libraries (JCDL), October 2026.

  • X. Wei, G. Grigoryan, A. Vargas, S. Rajtmajer, J. Wu. Toward Explainable Replicability Assessment of Findings in the Social and Behavioral Sciences. ACM/IEEE Joint Conference on Digital Libraries (JCDL), October 2026. (short paper)

  • T. Chakravorti, P. Venkit, S. Ghosh, S. Rajtmajer. Beyond Detection: Governing GenAI in Academic Peer Review as a Sociotechnical Challenge. AAAI/ACM Conference on Artificial Intelligence, Ethics and Society (AIES), October 2026.

  • B. Nguyen, D. Soós, Q. Ma, R. Obadage,  Z. Ranjan, S. Koneru, A. Szabelska, A. Gill, T. M. Errington, S. Nematova, S. Rajtmajer, J. Wu, M. Jiang. ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), August 2026.

  • T. Chakravorti, R. Fraleigh, T. Fritton, C. Griffin, V. Singh, S. Koneru, C. Lee Giles, D. Pennock, A. Kwasnica, S. Rajtmajer. Human-AI Collaboration for Estimating Scientific Replicability. The 5th International Conference on Hybrid Human-Artificial Intelligence (HHAI), July 2026.

  • T. Chakravorti, C. Wu, S. Koneru, S. Rajtmajer. AI for Research Assessment: Opportunities and Challenges from India. Proceedings of the iConference (iConf), March 2026.

  • R. Obadage, S. Rajtmajer, J. Wu. CC30k: A Citation Contexts Dataset for Reproducibility-Oriented Sentiment Analysis. Joint Conference on Digital Libraries (JCDL), December 2025.

  • T. Chakravorti, S. Gautam, S. Rajtmajer. Embracing Transparency: A Study of Open Science Practices Among Early Career HCI Researchers. PLoS ONE, November 2025.

  • T. Chakravorti, X. Wang, P. Narayanan Venkit, S. Koneru, K. Munger, S. Rajtmajer. Social Scientists on the Role of AI in Research. AAAI/ACM Conference on AI, Ethics, and Society (AIES), October 2025.

  • R. R. Obadage, K. Thennakoon, S. Rajtmajer, and J. Wu. (2025). [Re] Network Deconvolution. ReScience C 10, 1, #4.

  • T. Chakravorti, S. Koneru, S. Rajtmajer. Reproducibility and replicability in research: What 452 professors think in Universities across the USA and India. PLoS ONE 20(3): e0319334, March 2025.

  • R. Obradage, S. Rajtmajer, J. Wu. Can citations tell us about a paper's reproducibility? A case study of machine learning papers. ACM Conference on Reproducibility and Replicability (ACM REP), June 2024. Short paper.

  • S. Koneru, J. Wu, S. Rajtmajer. Can LLMs discern evidence for scientific hypotheses? Case studies in the social sciences. Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), May 2024.

  • C. Wu, X. Wang, J. Carroll, S. Rajtmajer. Reacting to Generative AI: Insights from Student and Faculty Discussions on Reddit. ACM Conference on Web Science (WebSci), May 2024.

  • C. Wu, T. Chakravorti, J. Carroll, S. Rajtmajer. Integrating measures of replicability into scholarly search: Challenges and opportunities. ACM Conference on Human Factors in Computing Systems (CHI), May 2024.

  • S. Koneru, X. Wei, J. Wu, S. Rajtmajer. Can machine learning algorithms predict publication outcomes? A case study of COVID-19 preprints. AI4SciSci Workshop at the International Conference on Data Mining (ICDM), December 2023.

  • K. Ajayi, M. Hasan Choudhury, S. Rajtmajer, J. Wu.  A Study on Reproducibility and Replicability of Table Structure Recognition Methods. International Conference on Document Analysis and Recognition (ICDAR), August 2023.

  • ​S. Koneru, M. Smith, D. Guarrera, J. Robinson, S. Rajtmajer. The evolution of scientific literature as metastable knowledge states. PLoS ONE, July 2023.

  • K. Ajayi, M. Hasan Choudhury, S. Rajtmajer, J. Wu.  A Study on Reproducibility and Replicability of Table Structure Recognition Methods. International Conference on Document Analysis and Recognition (ICDAR), August 2023.

  • T. Chakravorti, R. Fraleigh, T. Fritton, M. McLaughlin, V. Singh, C. Griffin, A. Kwasnica, C. Pennock, C. Lee Giles and S. Rajtmajer. A prototype hybrid prediction market for estimating replicability of published work. The Second International Conference on Hybrid Human-Artificial Intelligence (HHAI), June 2023.

  • T. Chakravorti, V. Singh, M. McLaughlin, R. Fraleigh, C. Griffin, A. Kwasnica, D. Pennock, C. Lee Giles and S. Rajtmajer. Artificial prediction markets present a novel opportunity for human-AI collaboration. 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS), May 2023. Extended Abstract.

  • D. Priestley, J. Staph, S. Koneru, S. Rajtmajer, A. Cwiek, S. Vervoordt, F. Hillary. Establishing ground truth in the traumatic brain injury literature: if replication is the answer, then what are the questions? Brain Communications, December 2022.

  • S. Rajtmajer, T. Errington, F. Hillary. How failure to falsify in high-volume science contributes to the replication crisis. eLife, August 2022.

  • E. Cruz Cortes, S. Rajtmajer, D. Ghosh. Structural Interventions on Automated Decision Making Systems. ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT), June 2022.

  • L. Salasbil, J. Wu, M. Choudhury, W. Ingram, E. Fox, S. Rajtmajer and C. Lee Giles. A Study of Computational Reproducibility using URLs Linking to Open Access Datasets and Software. Sci-K @ The Web Conf, April 2022.

  • S. Rajtmajer, C. Griffin, J. Wu, R. Fraleigh, L. Balaji, A. Squicciarini, A. Kwasnica, D. Pennock, M. McLaughlin, T. Fritton, N. Nakshatri, A. Menon, S.A. Modukuri, R. Nivargi, X. Wei, C.L. Giles. A synthetic prediction market for estimating confidence in published work. AAAI 2022 Demonstrations, February 2022.

  • E. Cruz Cortes, S. Rajtmajer, D. Ghosh. Structural Interventions on Automated Decision Making Systems. NeurIPS workshop on Algorithmic Fairness through the Lens of Causality and Robustness (NeurIPS AFCR), December 2021.

  • A. Cwiek, S. Rajtmajer, B. Wyble, V. Honavar, F. Hillary. Feeding the machine: challenges to reproducible predictive modeling in resting-state connectomics. Network Neuroscience, October 2021.

  • S. Lanka, S. Rajtmajer, J. Wu, C. Lee Giles. Extraction and evaluation of statistical information from social and behavioral science papers. Workshop on Scientific Knowledge (Sci-K) at The Web Conference, April 2021.

  • S. Modukuri, S. Rajtmajer, A. Squicciarini, J. Wu, L. Giles. Understanding and predicting retractions of published work. AAAI-21 Workshop on Scientific Document Understanding (AAAI-SDU), February 2021. 

  • J. Wu, P. Wang, X. Wei, S. Rajtmajer, C. Lee Giles, C. Griffin. Accurate Acknowledgement Entity Recognition in CORD-19 Papers. Workshop on Scholarly Document Processing and Shared Tasks at The Conference on Empirical Methods in Natural Language Processing (EMNLP SDP), November 2020. 

bottom of page