Ramneet Kaur

Research Interests

Education

News

• Principal Investigator on DARPA's TIAMAT Program (Sep 2025)
• Panelist on "Ethical Governance and the Development of Responsible AI" at the UN Women Asia and the Pacific and Ewha Womans University, Seoul, Korea (Sep 2025)
• Awarded with Best Paper Candidate (ICCPS'25, ICCPS'23)
• Invited Talk at Plaksha University, India (Dec 2024)
• Moderator of the "Security in the Age of AI” panel at the conference by Thrive-WiSE Micro Conference (Sep 2024)
• Awarded with Reusable and Reproducible ACM Badge (ICCPS'23, ICCPS'22)
• Distinguished Paper Award (ICCPS'22)
• Spot Award 2024, SRI for contributions to DARPA's ANSR program (Dec 2024)
• CPS Rising Star Selected as one of the top 20% CPS researchers in USA (May 2023)
• Keshab K Parhi Endowment Prize Finalist & Best M.S. Thesis Award (IIT Kharagpur, 2014)
• Departmental Recognition Award in the 4th Year B.S. for Top 2.5% of class
• Departmental Recognition Award in the 3rd Year B.S. for Top 1% of class

Publications

Conference Publications

• 1. Polysemantic Dropout: Conformal OOD Detection for Specialized LLMs
  Ayush Gupta, Ramneet Kaur, Anirban Roy, Adam D. Cobb, Rama Chellappa, and Susmit Jha.
  The 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP).
• 2. Safety Monitoring for Learning-Enabled Cyber-Physical Systems in Out-of-Distribution Scenarios
  Vivian Lin, Ramneet Kaur, Yahan Yang, Souradeep Dutta, Yiannis Kantaros, Anirban Roy, Susmit Jha, Oleg Sokolsky, Insup Lee.
  ICCPS'25: 16th ACM / IEEE International Conference on Cyber-Physical Systems, Irvine, California, 2025.
• 3. Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference
  Colin Samplawski, Adam D. Cobb, Manoj Acharya, Ramneet Kaur, Susmit Jha.
  The 41st Conference on Uncertainty in Artificial Intelligence (UAI), 2025.
• 4. Monitoring safety properties for autonomous driving systems with vision-language models
  Felipe Toledo, Sebastian Elbaum, Divya Gopinath, Ramneet Kaur, Ravi Mangal, Corina S. Păsăreanu, Anirban Roy, and Susmit Jha.
  2025 IEEE Engineering Reliable Autonomous Systems (ERAS).
• 5. Zero-shot Detection of Out-of-Context Objects Using Foundation Models
  Anirban Roy, Adam D. Cobb, Ramneet Kaur, Sumit Jha, Nathaniel Bastian, Alexander Berenbeim, Robert Thomso, Iain Cruickshank, Alvaro Velasquez, Susmit Jha.
  WACV'25: IEEE/CVF Winter Conference on Applications of Computer Vision, Tucson, Arizona, 2025.
• 6. Taylor-Model Physics-Informed Neural Networks (PINNs) for Ordinary Differential Equations
  Chandra Kanth Nagesh, Sriram Sankaranarayanan, Ramneet Kaur, Tuhin Sahai, Susmit Jha.
  2nd International Conference on Neuro-symbolic Systems (NeuS), 2025.
• 7. Automating Weak Label Generation for Data Programming with Clinicians in the Loop
  Jean Park, Sydney Pugh, Kaustubh Sridhar, Mengyu Liu, Ramneet Kaur, Souradeep Dutta, Elena Bernardis, Oleg Sokolsky, Insup Lee.
  2024 IEEE / ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).
• 8. CODiT: Conformal Out-of-Distribution Detection in Time-Series Data for Cyber-Physical Systems
  Ramneet Kaur, Kaustubh Sridhar, Sangdon Park, Yahan Yang, Susmit Jha, Anirban Roy, Oleg Sokolsky, Insup Lee.
  ICCPS'23: 14th ACM / IEEE International Conference on Cyber-Physical Systems, San Antonio, Texas, 2023.
• 9. Predicting Out-of-Distribution Performance of Deep Neural Networks Using Model Conformance
  Ramneet Kaur, Susmit Jha, Anirban Roy, Oleg Sokolsky, Insup Lee.
  ICAA'23: 2nd IEEE International Conference on Assured Autonomy, Laurel, Maryland, 2023.
• 10. iDECODE: In-Distribution Equivariance for Conformal Out-of-Distribution Detection
  Ramneet Kaur, Susmit Jha, Anirban Roy, Sangdon Park, Edgar Dobriban, Oleg Sokolsky, Insup Lee.
  AAAI'22: 36th AAAI Conference on Artificial Intelligence.
• 11. Interpretable Detection of Distribution Shifts in Learning Enabled Cyber-Physical Systems
  Yahan Yang, Ramneet Kaur, Souradeep Dutta, Insup Lee.
  ICCPS'22: 13th ACM / IEEE International Conference on Cyber-Physical Systems, Milan, Italy, 2022.
• 12. Runtime verification of parametric properties using SMEDL
  Teng Zhang, Ramneet Kaur, Insup Lee, Oleg Sokolsky.
  From Reactive Systems to Cyber-Physical Systems in Computer Science, Springer, Cham, 2019.
• 13. Parameter Invariant Monitoring for Signal Temporal Logic
  Nima Roohi, Ramneet Kaur, James Weimer, Oleg Sokolsky, Insup Lee.
  HSCC'18: 21st International Conference on Hybrid Systems: Computation and Control, Porto, Portugal, 2018.

Journal Publications

• 1. Out-of-Distribution Detection in Dependent Data for Cyber-Physical Systems with Conformal Guarantees
  Ramneet Kaur, Yahan Yang, Oleg Sokolsky, Insup Lee.
  TCPS'24: ACM Journal on Transactions on Cyber-Physical Systems.
• 2. Memory-based Distribution Shift Detection for Learning Enabled Cyber-Physical Systems with Statistical Guarantees
  Yahan Yang, Ramneet Kaur, Souradeep Dutta, Insup Lee.
  TCPS'24: ACM Journal on Transactions on Cyber-Physical Systems.

Workshop Publications

• 1. Breaking Bad: Interpretability-Based Safety Audits of State-of-the-Art LLMs
  Krishiv Agarwal*, Ramneet Kaur*, Colin Samplawski, Manoj Acharya, Anirban Roy, Daniel Elenius, Brian Matejek, Adam D. Cobb, Susmit Jha.
  NeurIPS Workshop on Lock-LLM: Prevent Unauthorized Knowledge Use from LLMs, 2025.
• 2. A Preliminary Study into the Conceptual Design of Aircraft using Simulation-Based Inference
  Aurelien Ghiglino, Daniel Elenius, Anirban Roy, Ramneet Kaur, Manoj Acharya, Colin Samplawski, Brian Matejek, Susmit Jha, Juan Alonso, Adam D. Cobb.
  NeurIPS Workshop on Machine Learning and the Physical Sciences, 2025.
• 3. Addressing Uncertainty in LLMs to Enhance Reliability in Generative AI
  Ramneet Kaur, Colin Samplawski, Adam D. Cobb, Anirban Roy, Brian Matejek, Manoj Acharya, Daniel Elenius, Alexander M. Berenbeim, John A. Pavlik, Nathaniel D. Bastian, Susmit Jha.
  NeurIPS Safe Generative AI Workshop, 2024.
• 4. Enhancing Semantic Clustering for Uncertainty Quantification & Conformal Prediction by LLMs
  Ramneet Kaur, Colin Samplawski, Adam D. Cobb, Anirban Roy, Brian Matejek, Manoj Acharya, Daniel Elenius, Alexander M. Berenbeim, John A. Pavlik, Nathaniel D. Bastian, Susmit Jha.
  Neurips Workshop on Statistical Frontiers in LLMs and Foundation Models, 2024.
• 5. Post-Hoc Uncertainty Quantification for Neurosymbolic Artificial Intelligence
  Alexander Berenbeim, Ramneet Kaur, Adam D. Cobb, Anirban Roy, Susmit Jha, Nathaniel D. Bastian.
  MILCOM'24 - 2024 IEEE Military Communications Conference (MILCOM).
• 6. Automated Labeling Function Generation using Distance Functions for Physiological Alarm Suppression
  Sydney Pugh, Souradeep Dutta, Ramneet Kaur, Yahan Yang, Elena Bernardis, Insup Lee.
  Proceedings of the ACM / IEEE 14th International Conference on Cyber-Physical Systems (with CPS-IoT Week), San Antonio, Texas, 2023.
• 7. CODiT: Conformal Out-of-Distribution Detection in Time-Series Data
  Ramneet Kaur, Kaustubh Sridhar, Sangdon Park, Susmit Jha, Anirban Roy, Oleg Sokolsky, Insup Lee.
  PODS'22: ICML 2022 Workshop on Principles of Distribution Shift.
• 8. Detecting OODs as datapoints with High Uncertainty
  Ramneet Kaur, Susmit Jha, Anirban Roy, Sangdon Park, Oleg Sokolsky, Insup Lee.
  UDL'21: ICML 2021 Workshop on Uncertainty and Robustness in Deep Learning.
• 9. Assurance Case Patterns for Cyber-Physical Systems with Deep Neural Networks
  Ramneet Kaur, Radoslav Ivanov, Matthew Cleaveland, Oleg Sokolsky, and Insup Lee.
  DECSOS'20: 15th International Workshop on Dependable Smart Embedded and Cyber-Physical Systems and Systems-of-Systems at SAFECOMP, Lisbon, Portugal, 2020.
• 10. Towards Formalization of Wireless Vehicular Networking
  Ramneet Kaur, Jungyeol Kim, Oleg Sokolsky, Saswati Sarkar, Radoslav Ivanov, Insup Lee.
  DESTION'20: IEEE Workshop on Design Automation for CPS and IoT, Sydney, Australia, 220.

Dissertation and Technical Reports

• 1. Screening Out-of-Distribution Inputs for Reliable AI Predictions
  Ramneet Kaur
  Ph.D. Dissertation: Computer and Information Science, University of Pennsylvania, 2023.
• 2. A machine learning model to automatically identify fast-paced online videos for children
  Claire Christensen, Anirban Roy, Madeline Cincebeaux, Ramneet Kaur. 2025.
  Technical Report.
• 3. Using Semantic Information for Defining and Detecting OOD Inputs
  Ramneet Kaur, Xiayan Ji, Souradeep Dutta, Michele Caprio, Yahan Yang, Elena Bernardis, Oleg Sokolsky, Insup Lee.
  Arxiv'23: arXiv:2302.11019.
• 4. Detection of Adversarial Physical Attacks in Time-Series Image Data
  Ramneet Kaur*, Yiannis Kantaros*, Wenwen Si*, James Weimer, Insup Lee.
  Arxiv'23: arXiv:2304.13919.
• 5. Towards Alternative Techniques for Improving Adversarial Robustness: Analysis of Adversarial Training at a Spectrum of Perturbations
  Kaustubh Sridhar, Souradeep Dutta, Ramneet Kaur, James Weimer, Oleg Sokolsky, Insup Lee.
  Arxiv'22: arXiv:2206.06496.
• 6. Are all outliers alike? on understanding the diversity of outliers for detecting OODs
  Ramneet Kaur, Susmit Jha, Anirban Roy, Oleg Sokolsky, Insup Lee.
  Arxiv'21: arXiv:2103.12628.
• 7. Self-driving vehicle verification towards a benchmark
  Nima Roohi, Ramneet Kaur, James Weimer, Oleg Sokolsky, Insup Lee.
  Arxiv’18: arXiv:1806.08810 (2018).
• 8. Applications of Lovász local lemma: Existence and Computation of Combinatorial Structures
  Ramneet Kaur
  M.S. Dissertation: Department of Computer Science and Engineering, IIT Kharagpur, 2014.

Student Mentoring

Industry and Research Experience