‘Science plus arts multiplied by faith then divided by the number of our ethnic race.’ — Nujabes, feat. Shing02, Luv(sic) pt2

About Myself

Hi! I'm a Master's student in Prof. Bing-Yu "Robin" Chen's group at National Taiwan University (CSIE, AI Program) 🇹🇼. My research lies at Sim–Real Transfer: the intersection of AI / Graphics / Robotics/ Audio/ HPC, with specializations in Physics-informed Machine Learning, Reinforcement Learning, and Graph Learning.

Research Areas

I like systematically working through critical problems that sit between disciplines, and my current interests span three core areas:

  • Visual Computing & Physics Simulation — developing neural PDE solvers (e.g., Walk-on-Spheres Monte Carlo for complex geometry) and differentiable physical simulation frameworks (hyper-elastic projective dynamics with positive-definite Hessian projection), with applications spanning CAD-driven robotic fabrication and animation workflows such as editable 3D Gaussian Splatting.

  • Embodied Systems — training Sim2Real reinforcement learning policies in Isaac Gym/Lab for robotic manipulation on Kuka, UR10, and Hiwin arms, and building large-scale digital twins that fuse multimodal sensing (WiFi, point cloud, RGBD) with graph federated learning foundation models for privacy-preserving human–scene interaction on supercomputers like Fugaku.

  • Audio Signal Processing — combining classical DSP with learned latent-space representations to design audio watermarks robust to neural resynthesis, and modeling spatial audio through room impulse responses (RIRs) in complex room acoustics.

Internships 🇫🇮 🇯🇵 🇹🇼

Along with my work at NTU, I've had the chance to do research internships and build collaborations across several international groups. I spent time at Aalto University through the 2026 Aalto Science Institute (AScI) Summer Research Programme (QuML Group, Espoo, Finland 🇫🇮; advised by Prof. Vikas Garg), and at RIKEN's Center for Computational Science (R-CCS) through the 2025 R-CCS International HPC Computational Science Internship Program (Large-Scale Digital Twin Research Team, Kobe/Osaka, Japan 🇯🇵; under Team Principal Prof. Hirozumi Yamaguchi and Prof. Hamada Rizk of Osaka University). On the industry side, I've worked in R&D at MoonShine Animation Studio (with Dir. Shaune Jan) and Delta Electronics.

Collaborations 🇺🇸 🇨🇦 🇫🇮 🇸🇬 🇹🇼

My ongoing academic collaborations extend further to Prof. Yu-Lun "Alex" Liu (NYCU, Taiwan 🇹🇼), Ziqiu Zeng (NUS, Singapore 🇸🇬), Fan Shi (NUS, Singapore 🇸🇬), Peter Yichen Chen (UBC, Canada 🇨🇦), Tiantian Liu (Meshy AI, US 🇺🇸), Prof. Yun-Nung Chen (NTU, Taiwan 🇹🇼), Prof. Hung-Yi Lee (NTU, Taiwan 🇹🇼), Prof. Shang-Tse Chen (NTU, Taiwan 🇹🇼), Kyung Lee (Aalto, Finland 🇫🇮), Nils Meyer-Kahlen (Aalto, Finland 🇫🇮), Eloi Moliner (Aalto, Finland 🇫🇮), and Prof. Xiang "Anthony" Chen (UCLA, US 🇺🇸). Working on state-of-the-art research with international teams has been one of the most rewarding parts of being in research, and is something I now actively look for.

Before Master

I also worked closely with multiple academic groups during my undergraduate studies and co-authored 8 conference papers in top-tier AI/CS venues. These include the Urban Science & Computing Lab led by Prof. Hsun-Ping Hsieh, and RAC-Coon (Robot Aided Creation and Construction Research Group) together with Prof. Yang-Ting Shen, Prof. Chia-Ching Yen, and Prof. Wen-Yu Su.

Projects/Community Services

All of my projects live on my GitHub page, spanning generative modeling, multi-agent RL, multimodal agents, 3D rendering, and intelligent systems. I also contribute back to the community as a reviewer for IEEE ITSC, ACM CHI, HRI, CSCW, and WWW.

Music — YouTube Playlist

Update sometimes, depends on your donation or my mood.

Collaboration is one of the parts of research I enjoy most — technical discussions, sharing expertise, and figuring out what we can build together. If any of the above resonates, let's discuss!

Outside of research: graffiti (in legal areas), live houses/music festivals, and traveling.

Publications

Domain #AI #Robotics #Graphics #HPC #Audio
Method #Graph #RL #DSP #Physics-informed ML

Selected (6)

UMEDA teaser

UMEDA: Unified Multi-modal Efficient Data Fusion for Privacy-Preserving Graph Federated Learning via Spectral-Gated Attention and Diffusion-Based Operator Alignment
arXiv Preprint, 2026 (1st Author). PDF
Shih-Yu Lai, Hirozumi Yamaguchi, Shang-Tse Chen, Yu-Lun Liu, Bing-Yu Chen
#AI #HPC #Graph #Physics-informed ML

ITSC 2026 teaser

MORPH-U: Multi-Objective Resilient Motion Planning for V2X-Enabled Autonomous Driving in High-Uncertainty Environments via Simulation
IEEE ITSC 2026 (1st Author, Regular Paper, Just Accepted). PDF
Shih-Yu Lai
#AI #Robotics

LATENT-MARK teaser

LATENT-MARK: An Audio Watermark Robust to Neural Resynthesis
arXiv Preprint, 2026 (Co-1st Author). PDF
Yen-Shan Chen, Shih-Yu Lai, Ying-Jung Tsou, Yi-Cheng Lin, Bing-Yu Chen, Yun-Nung Chen, Hung-Yi Lee, Shang-Tse Chen
#AI #Audio #DSP

ISC 2026 teaser

Accelerating Large-Scale Federated Graph Foundation Model Pre-training for Secure Sensing via Hierarchical Parallelism
ISC High Performance 2026 (1st Author, Research Poster, Just Accepted). PDF
Shih-Yu Lai, Fukuharu Tanaka, Hamada Rizk, Hirozumi Yamaguchi, Bing-Yu Chen
#AI #HPC #Graph

DASTGCN-SNN-DDPG teaser

Architectural CAD/CAM in Robotic Fabrication via Differentiable Energy Optimization and Few-Shot Spatiotemporal Graph RL Policy
ACM SIGGRAPH Asia 2025 (1st Author, Technical Communication). PDF Cite
Shih-Yu Lai, Chia-Ching Yen, Yang-Ting Shen, Bing-Yu Chen
#AI #Robotics #Graphics #Graph #RL #Physics-informed ML

GAT-DQN teaser

Graph Q-Learning for Automatic Assembly in Design-to-Construction
ACM SIGGRAPH Asia 2025 (1st Author, Poster). PDF Cite
Shih-Yu Lai, Chia-Ching Yen, Yang-Ting Shen, Bing-Yu Chen
#AI #Robotics #Graphics #Graph #RL

Others (6)

M3 teaser

M3: Recommendation via Attention-Graph Cluster Q-Learning with Multi-Scale Spatial Heterogeneity for Multi-Purpose, Multi-Stakeholder Green Attractions in Transportation
ACM SIGSPATIAL 2025 (1st Author, Research Full Paper). PDF Cite
Shih-Yu Lai, Tzu-Hsin Hsieh, Pei-Chi Tsai, Chao-Chun Kung, Sing-Kai Ling, Hsun-Ping Hsieh
#AI #Graph #RL

LINKin-PARK teaser

LINKin-PARK: Land Valuation Information and Knowledge in Predictive Analysis and Reporting Kit via Dual Attention-DCCNN
ACM CIKM 2024 (2nd Author, Demo Paper). PDF Cite
Teng-Yuan Tsou, Shih-Yu Lai, Hsuan-Ching Chen, Jung-Tsang Yeh, Pei-Xuan Li, Tzu-Chang Lee, Hsun-Ping Hsieh
#AI

GreenSpot teaser

GreenSpot: Improving Public Transport with GIS-Based AR and Cluster-GCN Recommendation
ACM SIGSPATIAL 2024 (1st Author, Demo Paper). PDF Cite
Shih-Yu Lai, Tzu-Hsin Hsieh, Sing-Kai Ling, Pei-Chi Tsai, Chao-Chun Kung, Hsun-Ping Hsieh
#AI #Graph

ACCEPT teaser

ACCEPT: A Context-Sensitive, Configurable, and Extensible Prediction Tool using Grid-based Data Processing and Neural Networks in Geospatial Decision Support
ACM SIGSPATIAL 2024 (2nd Author, Demo Paper). PDF Cite
Teng-Yuan Tsou, Shih-Yu Lai, Jung-Tsang Yeh, Hsuan-Ching Chen, Pei-Xuan Li, Tzu-Chang Lee, Hsun-Ping Hsieh
#AI

Footprints of Travel teaser

Footprints of Travel: AIoT and AR Enhanced Tourist Gaming Experience in Unmanned Cultural Sites
ACM CHI 2024 - EA (1st Author, Student Game Competition). PDF Cite
Shih-Yu Lai, Dai-En Liu, Zong-Fan Yeh, Chun-Che Hsu, Fu-Yao Chang, Ming-Zhi Tsai, Ruei-Hong Lin
#AI

UrbanCrowds teaser

Enhancing Urban Crowd Monitoring through Predictive Modelling System with Diverse Geospatial Datasets
ACIS 2023 (3rd Author, Proceeding). PDF Cite
Hsun-Ping Hsieh, Tzu-Chang Lee, Shih-Yu Lai, Pei-Chi Tsai, Tzu-Hsin Hsieh
#AI
No publications match the selected tags.

Thesis

M.S. Thesis (in progress): Neural Physics Solver in Complex Geometry Processing with Walk-on-Spheres Monte Carlo Method for Partial Differential Equations.

Research & Work Experience

Incoming Research Intern (Fully Funded)

Jul. 2026 – Sept. 2026
Aalto University Aalto Science Institute, Aalto University, Espoo, Finland — QuML Group (Advisor: Prof. Vikas Garg)
  • 2026 Aalto Science Institute International Summer Research Programme | Project: "Machine Learning: Foundations and New Frontiers".
  • The 1st Taiwanese hire in this program's 5-year history, securing a spot among 5,500+ applicants (135 countries) with a 1% acceptance rate.
  • Developing scalable physics-informed learning frameworks bridging numerical optimization and deep generative modeling; research aligned with Neural ODEs/SDEs and geometric deep learning.

High-Performance Computing Research Intern (Fully Funded)

Jul. 2025 – Aug. 2025
RIKEN RIKEN Center for Computational Science, Kobe/Osaka, Japan — Large-Scale Digital Twin Team (Advisor: Prof. Hirozumi Yamaguchi)
  • Large-scale digital twin & multimodal data-fusion sensing (WiFi, point cloud, RGBD) on Fugaku supercomputer.
  • Edge/cloud distributed computing with graph federated learning foundation models and differential privacy for human–scene interaction.

AI Research Engineer

Sept. 2025 – Jun. 2026
MoonShine MoonShine Animation Studio — R&D Team (Dir. Shaune Jan; Xiang ‘Anthony’ Chen, UCLA)
  • Multi-agent MLLM-as-a-judge (AutoGen) for efficient supervisor review and improved Editable 3DGS production workflows.

Research Assistant (Interactive Graphics Lab)

Nov. 2024 – Aug. 2027
NTU Communications & Multimedia Lab, National Taiwan University (Advisor: Prof. Robin Bing-Yu Chen)
  • Differentiable Projective Dynamics hyper-elastic mesh solver with positive-definite Hessian projection; 1.65×–2.26× acceleration via stable clamping strategies.

Research Assistant

Apr. 2022 – Jun. 2024
RAC-COON Robot-Aided Creation & Construction Research Group — Synchronization Lab (Prof. Yang-Ting Shen, Prof. Chia-Ching Yen, Prof. Alvin Wen-Yu Su)
  • Robotic reinforcement learning on Kuka/UR10/Hiwin in Omniverse Isaac Gym/Lab; graph RL for geometric brick assembly by mobile manipulators.
  • ROS2 systems integrating SLAM, supervised learning (YOLO, LSTM), and RL for motion control, planning, and obstacle avoidance.

Deep Learning Intern

Jul. 2023 – Aug. 2023
Delta Delta Electronics, Inc. — Power and System Business Group
  • 3D point cloud generative autoencoder trained over 74k meshes (PyTorch3D, Docker, V100).
  • XGBoost for inductance parameter prediction from electromagnetic simulation, reducing MAE to ~1% of formula-based solution.

Honors & Awards

2023 AIoT Innovation Challenge

Feb. 2023 – Jun. 2023
  • Secured 3rd Place & Sponsors Award ($30,000) from NXP Semiconductors (Awards).
  • Built a microcontroller-based SensorHub (ADI/NXP/Arduino) integrating DHT11/SCD40/PMS5003T via chips communication(I²C/UART); developed calibration tests with real-time logging in HVAC/fan/lighting control linked to Unity digital twin for vision model based crowd regulation.

Overseas Conference Travel Grant

2026
  • Travel support recipient for attending the ISC High Performance conference 2026 (June 22-26, Hamburg, Germany).

2025 Overseas Conference Travel Grant

Dec. 2025
  • Graduate student travel support recipient ($1,000) for SIGGRAPH Asia 2025 conference (December 16 – 18, Hong Kong).

Graduate Student Scholarship

2025 – 2026
  • Recipient of the graduate student scholarship for the 2025-2026 academic year.

Academic & Community Service

Reviewer

Jan. 2024 – Jan. 2025
ACM Association for Computing Machinery Conferences
  • IEEE ITSC’26
  • ACM CHI’25
  • ACM HRI’25
  • ACM CSCW’24
  • ACM WWW’25

Lead Technical Specialist

Feb. 2025 – Jun. 2025
NTU AI Club NTU AI Club, Taipei, Taiwan
  • Led academic initiatives and lectures on multimodal learning and reinforcement learning; mentored undergrads toward accepted submissions.

Mandatory Military Service

Jul. 2024 – Nov. 2024
Taiwan Air Force Taiwan Air Force