About Me
"Do not maximize the cumulative reward, minimize the instant loss"
A Master of AI Engineering student at Carnegie Mellon University. My academic interests primarily focus on RL/DL, including distributional RL, offline, and exploration methods.
I enjoy building AI-powered systems to solve real-world problems. Previously, I worked closely with Jionglong Su, researched on RL for portfolio optimization. I have also interned at Tencent and Emerson, gaining industrial experience in AI/ML and full-stack application development.
AI is poised to change the way people interact with higher-level applications, yet it still relies heavily on infrastructure support. Currently, I am immersing myself in studying system-related aspects to ensure my preparedness for the impending AI revolution.
I am actively seeking 2024 summer SDE/MLE internship opportunities in the U.S.!
Feel free to reach out if there are any opportunities, or if you are interested in my prior work.
Education
Carnegie Mellon University
Master of AI Engineering - Electrical and Computer Engineering
2023 - 2025
Concentration: Design and build AI-orchestrated systems that are adaptable, resilient, and trustworthy
Courses: 18-613 Computer Systems, 18-667 Large-Scale Distributed ML, 24-784 Trustworthy AI, etc.
University of Liverpool
Bachelor of Computer Science
2019 - 2023
Graduated with a first class degree (GPA: 3.97/4.0; Rank: 2/297 )
Activities: Table Tennis Varsity Team , Windsurfing Club
Experience
Machine Learning R&D Intern, Game AI
Jun 2022 - Oct 2022Tencent
I had an incredible time working on the PUBG game AI agent, which may have been your teammate :)
When it comes to game mastery, RL is incredibly a good choice, but it sometimes lacks human-like behavior. We focused on anthropomorphizing the behavior of the game AI using SL & RL algorithms.
I had the opportunity to dive into RL through a series of research projects during my undergrad years, which also exercised my academic skills.
We researched on RL-based portfolio optimization, and achieved to improve robustness and restricted exploration in financial environments. As a co-author, we published a paper on APIN, welcome to check it out! [Link]
Software Development Engineer Intern
Jun 2020 - Sept 2020Emerson
In my first internship, I developed a web-based examination system for Emerson employees.
I always remember what Steve Wozniak said, "Your first project isn't the greatest thing, and it may have no money value, it may go nowhere, but that is how you learn - you put so much effort into making something right if it is for yourself."