I’m currently at OctoML where I work as a senior software engineer in the MLSys team on inference, optimizations and hardware acceleration for machine learning models. I also contribute to Apache TVM & PyTorch on stuff like model compilation, coverage and auto-tuning.

I was a software engineer at Snowflake working on Data Lake and semi/un-structured data storage, like parquet and delta lake. I also interned at Microsoft Research Asia, working on transactional distributed databases.

I earned my master’s degree from UIUC CS and bachelor’s degree from PolyU. I worked with Prof. Vikram Adve on compilation of Deep Learning models with HPVM/LLVM during my master’s thesis and Prof. Zili Shao on key-value store.

Recent Work


  • Contact me at yj at shingjan dot com
  • My primary blog