Juan Carlos Niebles

bio

Juan Carlos Niebles received an Engineering degree in Electronics from Universidad del Norte (Colombia) in 2002, an M.Sc. degree in Electrical and Computer Engineering from University of Illinois at Urbana-Champaign in 2007, and a Ph.D. degree in Electrical Engineering from Princeton University in 2011.

He is Research Director at Salesforce and Adjunct Professor of Computer Science at Stanford since 2021. He is co-Director of the Stanford Vision and Learning Lab. Before that, he was Associate Director of Research at the Stanford-Toyota Center for AI Research and a Senior Research Scientist at the Stanford AI Lab between 2015 and 2021. He was also an Associate Professor of Electrical and Electronic Engineering in Universidad del Norte (Colombia) between 2011 and 2019.

His research interests are in computer vision and machine learning, with a focus on visual recognition and understanding of human actions and activities, objects, scenes, and events.

He serves as Area Chair for CVPR, ICCV and ECCV, as well as Associate Editor for IEEE TPAMI. He is also a member of the AI Index Steering Committee and is the Curriculum Director for Stanford-AI4ALL.

He is a recipient of a Google Faculty Research award (2015), the Microsoft Research Faculty Fellowship (2012), a Google Research award (2011) and a Fulbright Fellowship (2005).

research

My research work is in computer vision. The goal of my research is to enable computers and robots to perceive the visual world by developing novel computer vision algorithms for automatic analysis of images and videos.

From the scientific point of view, we tackle fundamental open problems in computer vision research related to the visual recognition and understanding of human actions and activities, objects, scenes, and events.

From the application perspective, we develop systems that solve practical world problems by introducing cutting-edge computer vision technologies into new application domains.

timeline

Tweets by jcniebles

news

Sep 2023	My team at Salesforce Research is hiring! We are looking for strong candidates for Researcher Scientist and Applied Scientist roles in the areas of Multimodal AI (video + language, multimodal understanding and generation, etc) and AI Agents (simulation and planning).
Jun 2023	I am an invited speaker at the 5th CVPR Precognition Workshop.
Jan 2023	I am an Area Chair for ICCV 2023.

selected publications

UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild

Can Qin, Shu Zhang, Ning Yu, Yihao Feng, Xinyi Yang, Yingbo Zhou, Huan Wang, Juan Carlos Niebles, Caiming Xiong, Silvio Savarese, and 3 more authors

In Advances in Neural Information Processing Systems (NeurIPS), Dec 2023

arXiv Bib Code Website

@inproceedings{Qin_NeurIPS_2023,
  author = {Qin, Can and Zhang, Shu and Yu, Ning and Feng, Yihao and Yang, Xinyi and Zhou, Yingbo and Wang, Huan and Niebles, Juan Carlos and Xiong, Caiming and Savarese, Silvio and Ermon, Stefano and Fu, Yun and Xu, Ran},
  title = {UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild},
  booktitle = {Advances in Neural Information Processing Systems (NeurIPS)},
  address = {New Orleans, USA},
  month = dec,
  year = {2023},
}

Procedure-Aware Pre-Training for Instructional Video Understanding

Honglu Zhou, Roberto Martín-Martín, Mubbasir Kapadia, Silvio Savarese, and Juan Carlos Niebles

In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2023

arXiv Bib PDF Supp Code Poster Slides Website Video

@inproceedings{Zhou_CVPR_2023,
  author = {Zhou, Honglu and Mart\'{i}n-Mart\'{i}n, Roberto and Kapadia, Mubbasir and Savarese, Silvio and Niebles, Juan Carlos},
  title = {Procedure-Aware Pre-Training for Instructional Video Understanding},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  address = {Vancouver, Canada},
  month = jun,
  year = {2023},
}

all publications