Jiayang Song

Incoming Assistant Professor at Leiden University

me_2025_formal.jpg

Leiden, The Netherlands

From October 2026

About Me

I am an incoming Assistant Professor at the Leiden Institute of Advanced Computer Science (LIACS), Leiden University. I currently serve as an Assistant Professor in the School of Computer Science and Engineering at Macau University of Science and Technology.

My work connects software engineering and artificial intelligence to make AI systems safer, more reliable, and easier to understand. I received my Ph.D. from the University of Alberta in 2025, with a research focus on software engineering and intelligent systems, my M.Eng. from the University of Toronto in 2021, and my B.Eng. from Western University in 2019.

Research Interests

My research centers on Quality Assurance for Trustworthy AI Systems. I develop methods for testing, evaluation, analysis, repair, and enhancement to understand how AI systems behave and fail, and to improve their safety, reliability, robustness, and explainability throughout development and operation. Two questions guide my work: How can we establish trust in complex AI systems? How can we integrate AI reliably into the physical world?

My current work and future directions span three connected areas:

  • Trustworthy foundation models. Testing and understanding language and multimodal models, including uncertainty estimation, confidence calibration, multilingual safety alignment, modality bias, and video and audio understanding. I am also interested in how models reason internally and how their representations shape their behavior.
  • Embodied AI and cyber-physical systems. Evaluating and improving AI systems that interact with the physical world, particularly autonomous driving and robotic manipulation. This includes testing vision-language-action models, reconstructing simulation scenarios from real-world data, monitoring safety, and repairing unsafe behavior.
  • AI for software and system development. Using foundation models to support task planning, reward design, and software development, while building quality assurance into these workflows. A future direction is test-driven human-AI collaboration, where testing provides evidence for assessing and improving AI-generated programs.

My long-term vision is to establish quality assurance across the full AI system lifecycle and enable AI agents to work reliably with people, software, and physical environments. This includes advancing models that can reason about physical laws and causal relationships, and understanding how trustworthiness emerges from the interactions among these components.

Prospective Students

Ph.D. opportunities will be advertised on Leiden University’s official careers website. I will add links to the vacancy announcements here once they are available.

I also welcome master’s and undergraduate students interested in research and collaboration in these areas. Please feel free to email me with a brief introduction, your research interests, and any relevant experience.

News

Jan 05, 2026 Our paper Antidote or Placebo? Unraveling the Efficacy of Neuron Coverage Criteria on Testing Transformer-based Language Models is accepted at ACM Transactions on Software Engineering and Methodology (TOSEM).
May 08, 2025 Our paper Towards Testing and Evaluating Vision-Language-Action Models for Robotic Manipulation: An Empirical Study is accepted at The ACM International Conference on the Foundations of Software Engineering (FSE).

Selected Publications

  1. LLM
    look.png
    Look before you leap: An exploratory study of uncertainty measurement for large language models
    Yuheng Huang, Jiayang Song, Zhijie Wang, and 4 more authors
    IEEE Transactions on Software Engineering., 2024
  2. AI-CPS
    ai-cps-benchmark.png
    When cyber-physical systems meet AI: A benchmark, an evaluation, and a way forward
    Jiayang Song, Deyun Lyu, Zhenya Zhang, and 3 more authors
    In Proceedings of the 44th International Conference on Software Engineering: Software Engineering in Practice, 2022
  3. AI-CPS
    siege.png
    SIEGE: A Semantics-Guided Safety Enhancement Framework for AI-Enabled Cyber-Physical Systems
    Jiayang Song, Xuan Xie, and Lei Ma
    IEEE Transactions on Software Engineering, 2023
  4. LLM
    luna.png
    LUNA: A Model-Based Universal Analysis Framework for Large Language Models
    Da Song, Xuan Xie, Jiayang Song, and 4 more authors
    IEEE Transactions on Software Engineering, 2024
  5. Robotics-RL
    tnnls.png
    GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Model
    Zhehua Zhou, Xuan Xie, Jiayang Song, and 2 more authors
    IEEE Transactions on Neural Networks and Learning Systems, 2024
  6. LLM
    criteria.png
    Antidote or Placebo? Unraveling the Efficacy of Neuron Coverage Criteria on Testing Transformer-based Language Models
    Xiaoning Ren, Jiayang Song, Chongyang Liu, and 3 more authors
    TOSEM, 2026