Shuhang Tan

Computer Science · Rensselaer Polytechnic Institute

Shuhang Tan

Ph.D. student in Computer Science
Rensselaer Polytechnic Institute · Troy, New York
Efficient LLMs · Model compression & distillation · Explainable AI

Pikachu made from yellow flowers on wet stone

I am a 4th-year Ph.D. student in the Department of Computer Science at Rensselaer Polytechnic Institute, advised by Prof. Radoslav Ivanov. I received my master’s degree in Computer Technology from the University of Science and Technology of China in 2023, where I worked on autonomous-driving perception and risk assessment.

My research focuses on making neural networks and large language models more efficient and interpretable. I study how model structure and information flow can guide compression while preserving useful capabilities. My work spans model pruning and knowledge distillation, graph theory-based analysis of neural networks, and explainable AI.

I am also exploring efficient inference in long-horizon settings, particularly how KV cache management can help language models retain useful context over extended interactions within limited memory budgets.

Engineering toolkit
Python / C++ · PyTorch / CUDA · Linux / Git / Docker · ROS · TypeScript / Java / SQL

Recent research & projects

GitHub →

Explainable AI & neuro-symbolic learning

Understanding Neural Networks Through Graph Curvature

Neural networks are often treated as black boxes, making it difficult to understand how their internal structure shapes their behavior. I use graph theory and geometry to analyze them as directed graphs that capture information flow, then apply Ricci curvature to identify structural bottlenecks and study two practical questions: which connections can be pruned, and which bottlenecks are associated with fragile predictions?

Graph-curvature pruning pipeline: construct a neural graph, calculate edge curvature over a calibration set, store each edge's minimum curvature, and order edges by curvature.
The graph-curvature pruning pipeline: from a trained network and calibration data to an ordering of neural connections. View full-size figure

Pruning: Post-Training Neural Network Pruning Using Graph Curvature

TMLR 2026

An interpretable post-training pruning method that identifies important information flows and structurally redundant connections using graph Ricci curvature. I accelerated the shortest-path stage of curvature computation on GPU using dynamic programming and matrix-based operations. I also extended the framework to Llama 3 and IBM Granite by constructing graph representations of transformer information flow for model analysis and pruning.

Robustness: Analyzing Neural Network Robustness Using Graph Curvature

ICAA 2024

I introduce neural data graphs and neural Ricci curvature to identify structural bottlenecks associated with model robustness. Less robust predictions exhibit stronger bottleneck structures, providing a graph-based explanation of model vulnerability.

Current exploration · Efficient LLM inference

KV Cache Management for Long-Horizon Settings

I am exploring KV cache eviction and memory management for language models operating over long contexts and extended interactions. I am interested in how to decide which cached information to retain, when to evict it, and how to allocate limited memory as context grows. The goal is to balance memory use and inference efficiency with the ability to preserve information needed later in a task.

Autonomous driving · IET Intelligent Transport Systems 2024

RCP-RF: Road-Car-Pedestrian Risk Assessment

A driving risk potential field that jointly models road geometry, lane boundaries, vehicles, and pedestrians. This framework combines the surrounding traffic scene with relative-motion estimates to assess driving risk.

Traffic scene showing the ego vehicle in red and nearby vehicles in yellow, with road position axes in meters.
Traffic scene: the ego vehicle and nearby vehicles. Enlarge figure
Driving-risk field contours across five road lanes, with a color scale from blue for lower values to red for higher values.
Driving-risk contours across the road. Enlarge figure

Earlier work · Autonomous perception

LiDAR-Based 3D Object Detection

A LiDAR-only architecture that combines voxel and range-view representations to improve small-object detection for autonomous vehicles.

Selected publications

Google Scholar →
  1. In review

    Prune What the Teacher Can Repair: Distillation-Aware Pruning for LLMs

    Under review at ICLR 2027

  2. 2026

    Post-Training Neural Network Pruning Using Graph Curvature

    Transactions on Machine Learning Research (TMLR)

  3. 2024

    Analyzing Neural Network Robustness Using Graph Curvature

    IEEE International Conference on Assured Autonomy (ICAA)

  4. 2024

    RCP-RF: A Comprehensive Road-Car-Pedestrian Risk Management Framework Based on Driving Risk Potential Field

    IET Intelligent Transport Systems

Industry Experience

February 2022 – January 2023 · Startup–lab collaboration

Perception Research Engineer · Shineauto

I developed and deployed C++/Python LiDAR perception pipelines for autonomous driving, including point-cloud clustering and 3D bounding-box estimation for real-time inference.

I integrated 3D non-maximum suppression into a Scanline clustering pipeline and deployed Voxel-RCNN on a real autonomous vehicle using ROS for on-road data collection and system testing.

July – September 2022 · Shanghai, China

Technology Intern · Morgan Stanley

I developed an internal trade-data management platform using Angular, TypeScript, Java, and SQL to support data querying, validation, revision, and record management.

My work included frontend tools for data filtering, inspection, and ID-mapping visualization, along with backend modules for database access and validation.

Education

Rensselaer Polytechnic Institute
Ph.D. in Computer Science 2023 – present · Expected April 2028
University of Science and Technology of China
Master of Computer Technology 2020 – 2023
China University of Mining and Technology
Bachelor of Electrical Engineering and Automation 2016 – 2020
University of Wisconsin–Madison
Exchange Program in Electrical Engineering 2017 – 2018

Teaching

Teaching assistant, Rensselaer Polytechnic Institute

Advanced Operating Systems
Fall 2026
Foundations of Computer Science
Spring 2024, Spring 2026
Data Structures
Fall 2023

Reviewing

Conferences

Association for the Advancement of Artificial Intelligence (AAAI)
2026, 2027
International Conference on Learning Representations (ICLR)
2027
International Conference on Cyber-Physical Systems (ICCPS)
2026

Journals

  • IET Intelligent Transport Systems
  • IEEE Transactions on Intelligent Vehicles
  • Pattern Recognition
  • Artificial Intelligence and Applications (AIA)