Yuncong Yang

I am a second-year master's student majoring computer science at Columbia University, advised by Prof. Shih-Fu Chang. I am also fortunate to work under the supervision of Dr. Jim Fan, Prof. Yuke Zhu, and Prof. Anima Anandkumar at NVIDIA Research. Previously, I graduated from Columbia's Fu Foundation Engineering school with a B.S in Computer Science (Summa Cum Laude)

My research interest lies at the intersection of Computer Vision and Robot Learning. I am particularly interested in exploring approaches to capture and utilize rich "common sense" representations, which guide embodied agents to learn from interactions with the physical world.

CV  /  Google Scholar  /  Twitter  /  Github

profile photo

(* indicates equal contribution)

TempCLR: Temporal Alignment Representation with Contrastive Learning
Yuncong Yang*, Jiawei Ma*, Shiyuan Huang, Long Chen, Xudong Lin, Guangxing Han, Shih-Fu Chang
International Conference on Learning Representations (ICLR), 2023
paper / code

We proposed TempCLR, a new contrastive learning framework that considers sequence-level temporal order consistency. The sequence-level framework improves multimodal representation learning in video understanding.

MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Linxi Fan, Guanzhi Wang*, Yunfan Jiang*, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, Animashree Anandkumar
Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2022   (Outstanding Paper Award, Featured Paper Presentation)
project page / paper / code

We introduce MineDojo, a new framework based on the popular Minecraft game for building generally capable, open-ended embodied agents.

Few-Shot End-to-End Object Detection via Constantly Concentrated Encoding across Heads
Jiawei Ma, Guangxing Han, Shiyuan Huang, Yuncong Yang, Shih-Fu Chang
European Conference on Computer Vision (ECCV), 2022
paper / code comming soon

Misc Projects
Adversarial Training with Support Dataset for Prototypical Network on Few Shot Learning
COMS 6998 Security Robustness ML Systems, Fall 2021

Dynamic Grasping with Moving Obstacles
COMS 6998 Topics in Robot Learning, Fall 2021

Teaching Assistant: COMS 4732 Computer Vision (Spring 2022)

Thanks for the template from Jon Barron!