publications

2024

  1. neurips24-sdqes.jpg
    Streaming Detection of Queried Event Start
    Cristobal Eyzaguirre, Eric Tang, Shyamal Buch, Adrien Gaidon, Jiajun Wu, and Juan Carlos Niebles
    In Advances in Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track. Vancouver, Canada. Dec 2024
  2. neurips24-apigen.jpg
    APIGen: Automated PIpeline for Generating Verifiable and Diverse Function-Calling Datasets
    Zuxin Liu, Thai Quoc Hoang, Jianguo Zhang, Ming Zhu, Tian Lan, Shirley Kokane, Juntao Tan, Weiran Yao, Zhiwei Liu, Yihao Feng, and 7 more authors
    In Advances in Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track. Vancouver, Canada. Dec 2024
  3. neurips24ikea.jpg
    IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videos
    Yunong Liu, Weiyu Liu, Shubh Khanna, Cristobal Eyzaguirre, Manling Li, Juan Carlos Niebles, Vineeth Ravi, Saumitra Mishra, and Jiajun Wu
    In Advances in Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track. Vancouver, Canada. Dec 2024
  4. xinstruct.jpg
    X-InstructBLIP: A Framework for Aligning Image, 3D, Audio, Video to LLMs and its Emergent Cross-modal Reasoning
    Artemis Panagopoulou, Le Xue, Ning Yu, Junnan Li, Dongxu Li, Shafiq Joty, Ran Xu, Silvio Savarese, Caiming Xiong, and Juan Carlos Niebles
    In European Conference on Computer Vision (ECCV). Milan, Italy. Oct 2024
  5. layoutDETR2024.jpg
    LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer
    Ning Yu, Chia-Chih Chen, Zeyuan Chen, Rui Meng, Gang Wu, Paul Josel, Juan Carlos Niebles, Caiming Xiong, and Ran Xu
    In European Conference on Computer Vision (ECCV). Milan, Italy. Oct 2024
  6. xgen-vidsyn.gif
    xGen-VideoSyn: High-fidelity Text-to-Video Synthesis with Compressed Representations
    Can Qin, Congying Xia, Krithika Ramakrishnan, Michael Ryoo, Lifu Tu, Yihao Feng, Manli Shu, Honglu Zhou, Anas Awadalla, Jun Wang, and 9 more authors
    In AI for Visual Arts Workshop and Challenges (AI4VA), in conjunction with ECCV. Milan, Italy. Sep 2024
  7. ulip2cvpr24.jpg
    ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding
    Le Xue, Ning Yu, Shu Zhang, Artemis Panagopoulou, Junnan Li, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, and 1 more author
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, Washington. Jun 2024
  8. shu-icra24.jpg
    Hierarchical Point Attention for Indoor 3D Object Detection
    Manli Shu, Le Xue, Ning Yu, Roberto Martín-Martín, Caiming Xiong, Tom Goldstein, Juan Carlos Niebles, and Ran Xu
    In IEEE International Conference on Robotics and Automation (ICRA). Yokohama, Japan. May 2024
  9. Spotlight
    yao-iclr24.png
    Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization
    Weiran Yao, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Yihao Feng, Le Xue, Rithesh R. N., Zeyuan Chen, Jianguo Zhang, Devansh Arpit, and 5 more authors
    In The Twelfth International Conference on Learning Representations (ICLR). Vienna, Austria. May 2024
  10. rex-iclr24.jpg
    REX: Rapid Exploration and eXploitation for AI agents
    Rithesh Murthy, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Le Xue, Weiran Yao, Yihao Feng, Zeyuan Chen, Akash Gokul, Devansh Arpit, and 5 more authors
    In ICLR 2024 Workshop on LLM Agents. Vienna, Austria. May 2024
  11. bolaa-iclr24.jpg
    BOLAA: Benchmarking and orchestrating LLM-augmented autonomous agents
    Zhiwei Liu, Weiran Yao, Jianguo Zhang, Le Xue, Shelby Heinecke, Rithesh Murthy, Yihao Feng, Zeyuan Chen, Juan Carlos Niebles, Devansh Arpit, and 5 more authors
    In ICLR 2024 Workshop on LLM Agents. Vienna, Austria. May 2024
  12. ohana-iclr24.jpg
    The AgentOhana: Designing Unified Data and Training Pipeline for Effective Agent Learning
    Jianguo Zhang, Tian Lan, Rithesh Murthy, Zhiwei Liu, Weiran Yao, Juntao Tan, Thai Hoang, Liangwei Yang, Yihao Feng, Zuxin Liu, and 6 more authors
    In ICLR 2024 Workshop on LLM Agents. Vienna, Austria. May 2024
  13. Causal Layering via Conditional Entropy
    Itai Feigenbaum, Devansh Arpit, Shelby Heinecke, Juan Carlos Niebles, Weiran Yao, Caiming Xiong, Silvio Savarese, and Huan Wang
    In Conference on Causal Learning and Reasoning (CLeaR). Los Angeles, California. Apr 2024

2023

  1. UniControl2023.jpg
    UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild
    Can Qin, Shu Zhang, Ning Yu, Yihao Feng, Xinyi Yang, Yingbo Zhou, Huan Wang, Juan Carlos Niebles, Caiming Xiong, Silvio Savarese, and 3 more authors
    In Advances in Neural Information Processing Systems (NeurIPS). New Orleans, USA. Dec 2023
  2. temp-neurips23.jpg
    Temporally Disentangled Representation Learning under Unknown Nonstationarity
    Xiangchen Song, Weiran Yao, Yewen Fan, Xinshuai Dong, Guangyi Chen, Juan Carlos Niebles, Eric Xing, and Kun Zhang
    In Advances in Neural Information Processing Systems (NeurIPS). New Orleans, USA. Dec 2023
  3. QichenICCV23.jpg
    Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimation
    Qichen Fu, Xingyu Liu, Ran Xu, Juan Carlos Niebles, and Kris M. Kitani
    In IEEE/CVF International Conference on Computer Vision (ICCV). Paris, France. Oct 2023
  4. paprika-cvpr23.png
    Procedure-Aware Pre-Training for Instructional Video Understanding
    Honglu Zhou, Roberto Martín-Martín, Mubbasir Kapadia, Silvio Savarese, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver, Canada. Jun 2023
  5. ulip-cvpr23.png
    ULIP: Learning Unified Representation of Language, Image and Point Cloud for 3D Understanding
    Le Xue, Mingfei Gao, Chen Xing, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, and Silvio Savarese
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver, Canada. Jun 2023
  6. mfovis-cvpr23.png
    Mask-free OVIS: Open-Vocabulary Instance Segmentation without Manual Mask Annotations
    Vibashan VS, Ning Yu, Chen Xing, Can Qin, Mingfei Gao, Juan Carlos Niebles, Vishal M. Patel, and Ran Xu
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver, Canada. Jun 2023
  7. previts_wacv23.jpg
    PreViTS: Contrastive Pretraining with Video Tracking Supervision
    Brian Chen, Ramprasaath R. Selvaraju, Shih-Fu Chang, Juan Carlos Niebles, and Nikhil Naik
    In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). Hawaii, USA. Jan 2023

2022

  1. luo2022moma.jpg
    MOMA-LRG: Language-Refined Graphs for Multi-Object Multi-Actor Activity Parsing
    Zelun Luo, Zane Durante, Linden Li, Wanze Xie, Ruochen Liu, Emily Jin, Zhuoyi Huang, Lun Yu Li, Jiajun Wu, Juan Carlos Niebles, and 2 more authors
    In Advances in Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track. New Orleans, USA. Dec 2022
  2. Oral
    eccv22Priv.jpg
    PrivHAR: Recognizing Human Actions From Privacy-preserving Lens
    Carlos Hinojosa, Miguel Marquez, Henry Arguello, Ehsan Adeli, Li Fei-Fei, and Juan Carlos Niebles
    In European Conference on Computer Vision (ECCV). Tel-Aviv, Israel. Oct 2022
  3. eccv22Open.jpg
    Open Vocabulary Object Detection with Pseudo Bounding-Box Labels
    Mingfei Gao, Chen Xing, Juan Carlos Niebles, Junnan Li, Ran Xu, Wenhao Liu, and Caiming Xiong
    In European Conference on Computer Vision (ECCV). Tel-Aviv, Israel. Oct 2022
  4. Oral
    cvpr22-atp.jpg
    Revisiting the ‘Video’ in Video-Language Understanding
    Shyamal BuchCristobal Eyzaguirre, Adrien Gaidon, Jiajun Wu, Li Fei-Fei, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA. Jun 2022
  5. cvpr22-align.jpg
    Align and Prompt: Video-and-Language Pre-training with Entity Prompts
    Dongxu Li, Junnan Li, Hongdong Li, Juan Carlos Niebles, and Steven CH Hoi
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA. Jun 2022

2021

  1. neurips21-moma.jpg
    MOMA: Multi-Object Multi-Actor Activity Parsing
    Zelun Luo, Wanze Xie, Siddharth Kapoor, Yiyun Liang, Michael Cooper, Juan Carlos Niebles, Ehsan Adeli, and Fei-Fei Li
    In Advances in Neural Information Processing Systems (NeurIPS). Online. Dec 2021
  2. tnt-bmvc21.jpg
    TNT: Text-Conditioned Network with Transductive Inference for Few-Shot Video Classification
    Andrés Villa, Juan-Manuel Perez-Rua, Vladimir Araujo, Juan Carlos NieblesVictor Escorcia, and Alvaro Soto
    In British Machine Vision Conference (BMVC). Online. Nov 2021
  3. Oral
    carlos_iccv2021.jpg
    Learning Privacy-preserving Optics for Human Pose Estimation
    Carlos HinojosaJuan Carlos Niebles, and Henry Arguello
    In IEEE/CVF International Conference on Computer Vision (ICCV). Online. Oct 2021
  4. jingwei_iccv21.gif
    Detecting Human-Object Relationships in Videos
    Jingwei Ji, Rishi Desai, and Juan Carlos Niebles
    In IEEE/CVF International Conference on Computer Vision (ICCV). Online. Oct 2021
  5. vida_iccv_2021.jpg
    TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild
    Vida Adeli, Mahsa Ehsanpour, Ian Reid, Juan Carlos Niebles, Silvio Savarese, Ehsan Adeli, and Hamid Rezatofighi
    In IEEE/CVF International Conference on Computer Vision (ICCV). Online. Oct 2021
  6. media2021-gait.jpg
    Quantifying Parkinson’s Disease Motor Severity Under Uncertainty Using MDS-UPDRS Videos
    Mandy Lu, Qingyu Zhao, Kathleen L Poston, Edith V Sullivan, Adolf Pfefferbaum, Marian Shahid, Maya Katz, Leila Montaser Kouhsari, Kevin Schulman, Arnold Milstein, and 5 more authors
    Medical Image Analysis. Oct 2021
  7. homage_cvpr21.jpg
    Home Action Genome: Cooperative Compositional Action Understanding
    Nishant Rai, Haofeng Chen, Jingwei Ji, Rishi Desai, Kazuki Kozuka, Shun Ishizaka, Ehsan Adeli, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Online. Jun 2021
  8. metadata_cvpr21.jpg
    Metadata Normalization
    Mandy Lu, Qinyu Zhao, Jiequan Zhang, Kilian Pohl, Li Fei-Fei, Juan Carlos Niebles, and Ehsan Adeli
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Online. Jun 2021
  9. ehsan_wacv2021.jpg
    Representation Learning with Statistical Independence to Mitigate Bias
    Ehsan Adeli, Qinyu Zhao, Adolf Pfefferbaum, Edith Sullivan, Li Fei-Fei, Juan Carlos Niebles, and Kilian Pohl
    In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). Online. Jan 2021

2020

  1. vida_ral2020.jpg
    Socially and Contextually Aware Human Motion and Pose Forecasting
    Vida Adeli, Ehsan Adeli, Ian Reid, Juan Carlos Niebles, and Hamid Rezatofighi
    IEEE Robotics and Automation Letters (RA-L). Oct 2020
  2. mandy_miccai2020.jpg
    Vision-based Estimation of MDS-UPDRS Gait Scores for Assessing Parkinson’s Disease Motor Severity
    Mandy Lu, Kathleen Poston, Adolf Pfefferbaum, Edith V. Sullivan, Li Fei-Fei, Kilian M. Pohl, Juan Carlos Niebles, and Ehsan Adeli
    In International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI). Online. Oct 2020
  3. vqa_ivc2020.jpg
    Explaining VQA predictions using visual grounding and a knowledge base
    Felipe Riquelme, Alfredo De Goyeneche, Yundong Zhang, Juan Carlos Niebles, and Alvaro Soto
    Image and Vision Computing. Sep 2020
  4. rubiks.jpg
    RubiksNet: Learnable 3D-Shift for Efficient Video Action Recognition
    Linxi Fan, Shyamal Buch, Guanhzi Wang, Ryan Cao, Yuke Zhu, Juan Carlos Niebles, and Li Fei-Fei
    In European Conference on Computer Vision (ECCV). Online. Aug 2020
  5. procedure2020.jpg
    Procedure Planning in Instructional Videos
    Chien-Yi Chang, De-An Huang, Danfei Xu, Ehsan Adeli, Li Fei-Fei, and Juan Carlos Niebles
    In European Conference on Computer Vision (ECCV). Online. Aug 2020
  6. seg-ral2020.jpg
    Segmenting the Future
    Hsu-kuang Chiu, Ehsan Adeli, and Juan Carlos Niebles
    IEEE Robotics and Automation Letters (RA-L). Jul 2020
  7. actiongenome-cvpr2020.jpg
    Action Genome: Actions as Compositions of Spatio-temporal Scene Graphs
    Jingwei Ji, Ranjay Krishna, Li Fei-Fei, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, Washington, USA. Jun 2020
  8. stgraph-cvpr2020.jpg
    Spatio-Temporal Graph for Video Captioning with Knowledge Distillation
    Boxiao Pan, Haoye Cai, De-An Huang, Kuan-Hui Lee, Adrien Gaidon, Ehsan Adeli, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, Washington, USA. Jun 2020
  9. tam-cvpr2020.jpg
    Few-Shot Video Classification via Temporal Alignment
    Kaidi Cao, Jingwei Ji, Zhangjie Cao, Chien-Yi Chang, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, Washington, USA. Jun 2020
  10. bingbin-icra2020.jpg
    Spatiotemporal Relationship Reasoning for Pedestrian Intent Prediction
    Bingbin Liu, Ehsan Adeli, Zhangjie Cao, Kuan-Hui Lee, Abhijeet Shenoi, Adrien Gaidon, and Juan Carlos Niebles
    IEEE Robotics and Automation Letters (RA-L) and IEEE International Conference on Robotics and Automation (ICRA). Paris, France. May 2020
  11. dean-icra2020.jpg
    Motion Reasoning for Goal-Based Imitation Learning
    De-An Huang, Yu-Wei Chao, Chris Paxton, Xinke Deng, Li Fei-Fei, Juan Carlos Niebles, Animesh Garg, and Dieter Fox
    In IEEE International Conference on Robotics and Automation (ICRA). Paris, France. May 2020
  12. wacv2020.jpg
    Disentangling Human Dynamics for Pedestrian Locomotion Forecasting with Noisy Supervision
    Karttikeya Mangalam, Ehsan Adeli, Kuan-Hui Lee, Adrien Gaidon, and Juan Carlos Niebles
    In IEEE Winter Conference on Applications of Computer Vision (WACV). Colorado, USA. Mar 2020
  13. Oral
    tcon-aaai20.png
    Adversarial Cross-Domain Action Recognition with Co-Attention
    Boxiao Pan, Zhangjie Cao, Ehsan Adeli, and Juan Carlos Niebles
    In AAAI Conference on Artificial Intelligence (AAAI). New York. Feb 2020

2019

  1. huang_iros19.jpg
    Continuous Relaxation of Symbolic Planner for One-Shot Imitation Learning
    De-An Huang, Danfei Xu, Yuke Zhu, Animesh Garg, Silvio Savarese, Li Fei-Fei, and Juan Carlos Niebles
    In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Macau, China. Nov 2019
  2. jingwei_iccv19.png
    Learning Temporal Action Proposals with Fewer Labels
    Jingwei Ji, Kaidi Cao, and Juan Carlos Niebles
    In IEEE/CVF International Conference on Computer Vision (ICCV). Seoul, South Korea. Oct 2019
  3. wang-iccv19.png
    Imitation Learning for Human Pose Prediction
    Borui Wang, Ehsan Adeli, Hsu-kuang Chiu, De-An Huang, and Juan Carlos Niebles
    In IEEE/CVF International Conference on Computer Vision (ICCV). Seoul, South Korea. Oct 2019
  4. Oral
    cvpr19-ntg.png
    Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration
    De-An Huang, Suraj Nair, Danfei Xu, Yuke Zhu, Animesh Garg, Li Fei-Fei, Silvio Savarese, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach, California, USA. Jun 2019
  5. cvpr19-d3tw.png
    D3TW: Discriminative Differentiable Dynamic Time Warping for Weakly Supervised Action Alignment and Segmentation
    Chien-Yi Chang, De-An Huang, Yanan Sui, Li Fei-Fei, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach, California, USA. Jun 2019
  6. peeking-cvpr19.png
    Peeking into the Future: Predicting Future Person Activities and Locations in Videos
    Junwei Liang, Lu Jiang, Juan Carlos Niebles, Alexander Hauptmann, and Li Fei-Fei
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach, California, USA. Jun 2019
  7. wacv2019-pose.png
    Action-Agnostic Human Pose Forecasting
    Hsu-Kuang Chiu, Ehsan Adeli, Borui Wang, De-An Huang, and Juan Carlos Niebles
    In IEEE Winter Conference on Applications of Computer Vision (WACV). Hawaii, USA. Jan 2019
  8. wacv2019-vqa.png
    Interpretable Visual Question Answering by Visual Grounding from Attention Supervision Mining
    Yundong Zhang, Juan Carlos Niebles, and Alvaro Soto
    In IEEE Winter Conference on Applications of Computer Vision (WACV). Hawaii, USA. Jan 2019

2018

  1. nips18-decomp.png
    Learning to Decompose and Disentangle Representations for Video Prediction
    Jun-Ting Hsieh, Bingbin Liu, De-An Huang, Li Fei-Fei, and Juan Carlos Niebles
    In Conference on Neural Information Processing Systems (NeurIPS). Montreal, Canada. Dec 2018
  2. zang2018emnlp.jpg
    Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation
    Xiaoxue Zang, Ashwini Pokle, Marynel Vázquez, Kevin Chen, Juan Carlos Niebles, Alvaro Soto, and Silvio Savarese
    In Conference on Empirical Methods in Natural Language Processing (EMNLP). Brussels, Belgium. Nov 2018
  3. Oral
    seg-eccv18.jpg
    End-to-End Joint Semantic Segmentation of Actors and Actions in Video
    Jingwei JiShyamal Buch, Alvaro Soto, and Juan Carlos Niebles
    In European Conference on Computer Vision (ECCV). Munich, Germany. Sep 2018
  4. modular-eccv18.jpg
    Temporal Modular Networks for Retrieving Complex Compositional Activities in Video
    Bingbin Liu, Serena Yeung, Edward Chou, De-An Huang, Li Fei-Fei, and Juan Carlos Niebles
    In European Conference on Computer Vision (ECCV). Munich, Germany. Sep 2018
  5. graph-eccv18.jpg
    Graph Distillation for Action Detection with Privileged Modalities
    Zelun Luo, Lu Jiang, Jun-Ting Hsieh, Juan Carlos Niebles, and Li Fei-Fei
    In European Conference on Computer Vision (ECCV). Munich, Germany. Sep 2018
  6. monitor-eccv18.jpg
    Liquid Pouring Monitoring via Rich Sensory Inputs
    Tz-Ying Wu, Juan-Ting Lin, Tsun-Hsuang Wang, Chan-Wei Hu, Juan Carlos Niebles, and Min Sun
    In European Conference on Computer Vision (ECCV). Munich, Germany. Sep 2018
  7. Oral
    finding-it.png
    Finding ’It’: Weakly-Supervised Reference-Aware Visual Grounding in Instructional Video
    De-An HuangShyamal Buch, Lucio Dery, Animesh Garg, Li Fei-Fei, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, Utah, USA. Jun 2018
  8. Spotlight
    cvpr18-fb.gif
    What Makes a Video a Video: Analyzing Temporal Information in Video Understanding Models and Datasets
    De-An Huang, Vignesh Ramanathan, Dhruv Mahajan, Lorenzo Torresani, Manohar Paluri, Li Fei-Fei, and Juan Carlos Niebles
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, Utah, USA. Jun 2018
  9. icra2018.png
    A Deep Learning Based Behavioral Approach to Indoor Autonomous Navigation
    Gabriel Sepúlveda, Juan Carlos Niebles, and Alvaro Soto
    In IEEE International Conference on Robotics and Automation (ICRA). Brisbane, Australia. May 2018
  10. lang-nav.png
    Behavioral Indoor Navigation With Natural Language Directions
    Xiaoxue Zang, Marynel Vázquez, Juan Carlos Niebles, Alvaro Soto, and Silvio Savarese
    In ACM/IEEE International Conference on Human Robot Interaction - Late Breaking Reports (HRI LBR). Chicago, Illinois, USA. Mar 2018

2017

  1. Spotlight
    imitation.png
    Visual Forecasting by Imitating Dynamics in Natural Sequences
    Kuo-Hao Zeng, William B. Shen, De-An Huang, Min Sun, and Juan Carlos Niebles
    In IEEE International Conference on Computer Vision (ICCV). Venice, Italy. Oct 2017
  2. densevid.png
    Dense-Captioning Events in Videos
    Ranjay Krishna, Kenji Hata, Frederic Ren, Li Fei-Fei, and Juan Carlos Niebles
    In IEEE International Conference on Computer Vision (ICCV). Venice, Italy. Oct 2017
  3. Oral
    sstad.png
    End-to-End, Single-Stream Temporal Action Detection in Untrimmed Videos
    Shyamal BuchVictor Escorcia, Bernard Ghanem, Li Fei-Fei, and Juan Carlos Niebles
    In British Machine Vision Conference (BMVC). London, UK. Sep 2017
  4. SST.jpg
    SST: Single-Stream Temporal Action Proposals
    Shyamal BuchVictor Escorcia, Chuanqi Shen, Bernard Ghanem, and Juan Carlos Niebles
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, Hawaii, USA. Jun 2017
  5. unsupervised_cvpr17.jpg
    Unsupervised Visual-Linguistic Reference Resolution in Instructional Videos
    De-An Huang, Joseph Lim, Li Fei-Fei, and Juan Carlos Niebles
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, Hawaii, USA. Jun 2017
  6. Spotlight
    agent_risk.jpg
    Agent-centric Risk Assessment: Accident Anticipation and Risky Region Localization
    Kuo-Hao Zeng, Shih-Han Chou, Fu-Hsiang Chan, Juan Carlos Niebles, and Min Sun
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, Hawaii, USA. Jun 2017
  7. sparse.jpg
    Sparse composition of body poses and atomic actions for human activity recognition in RGB-D videos
    Ivan Lillo, Juan Carlos Niebles, and Alvaro Soto
    Image and Vision Computing. Mar 2017
  8. AAAI17VideoQA.jpg
    Leveraging Video Descriptions to Learn Video Question Answering
    Kuo-Hao Zeng, Tseng-Hung Chen, Ching-Yao Chuang, Yuan-Hong Liao, Juan Carlos Niebles Sun, and  Min
    In AAAI Conference on Artificial Intelligence (AAAI). San Francisco, USA. Feb 2017

2016

  1. ectc-1.png
    Connectionist Temporal Modeling for Weakly Supervised Action Labeling
    De-An Huang, Li Fei-Fei, and Juan Carlos Niebles
    In European Conference on Computer Vision (ECCV). Amsterdam, Netherlands. Oct 2016
  2. eccv16.jpg
    DAPs: Deep Action Proposals for Action Understanding
    Victor EscorciaFabian Caba HeilbronJuan Carlos Niebles, and Bernard Ghanem
    In European Conference on Computer Vision (ECCV). Amsterdam, Netherlands. Oct 2016
  3. VTG.jpg
    Title Generation for User Generated Videos
    Kuo-Hao Zeng, Tseng-Hung Chen, Juan Carlos Niebles, and Min Sun
    In European Conference on Computer Vision (ECCV). Amsterdam, Netherlands. Oct 2016
  4. proposals.jpg
    Fast Temporal Activity Proposals for Efficient Detection of Human Actions in Untrimmed Videos
    Fabian Caba HeilbronJuan Carlos Niebles, and Bernard Ghanem
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, USA. Jun 2016
  5. actionlets3.jpg
    A Hierarchical Pose-Based Approach to Complex Action Understanding Using Dictionaries of Actionlets and Motion Poselets
    Ivan Lillo, Juan Carlos Niebles, and Alvaro Soto
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, USA. Jun 2016

2015

  1. anet_cvpr15b.jpg
    ActivityNet: A Large-Scale Video Benchmark for Human Activity Understanding
    Fabian Caba HeilbronVictor Escorcia, Bernard Ghanem, and Juan Carlos Niebles
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston, USA. Jun 2015
  2. cvpr15a.jpg
    On the Relationship between Visual Attributes and Convolutional Networks
    Victor EscorciaJuan Carlos Niebles, and Bernard Ghanem
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston, USA. Jun 2015
  3. manhattan.jpg
    Robust Manhattan Frame Estimation from a Single RGB-D Image
    Bernard Ghanem, Ali Thabet, Juan Carlos Niebles, and Fabian Caba Heilbron
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston, USA. Jun 2015

2014

  1. actioncue.jpg
    Camera Motion and Surrounding Scene Appearance as Context for Action Recognition
    Fabian Caba Heilbron, Ali Thabet, Juan Carlos Niebles, and Bernard Ghanem
    In Asian Conference on Computer Vision (ACCV). Singapore. Nov 2014
  2. automation2014.png
    Vision-based workface assessment using depth images for activity analysis of interior construction operations
    Ardalan Khosrowpour, Juan Carlos Niebles, and Mani Golparvar-Fard
    Automation in Construction. Dec 2014
  3. cvpr2014.png
    Discriminative Hierarchical Modeling of Spatio-Temporally Composable Human Activities
    Ivan Lillo, Alvaro Soto, and Juan Carlos Niebles
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Colombus, USA. Jun 2014
  4. indoor.png
    Automated Worker Activity Analysis in Indoor Environments for Direct-Work Rate Improvement from long sequences of RGB-D Images
    Ardalan Khosrowpour, Igor Fedorov, Aleksander Holynski, Juan Carlos Niebles, and Mani Golparvar-Fard
    In Construction Research Congress (CRC). Atlanta, USA. May 2014
  5. crowd.jpg
    Collecting and Annotating Human Activities in Web Videos
    Fabian Caba Heilbron, and Juan Carlos Niebles
    In ACM International Conference on Multimedia Retrieval (ICMR). Glasgow, UK. Apr 2014

2013

  1. iccvw13.jpg
    Spatio-Temporal Human-Object Interactions for Action Recognition in Videos
    Victor Escorcia, and Juan Carlos Niebles
    In IEEE International Conference on Computer Vision Workshops (ICCVW). Sydney, Australia. Dec 2013
  2. earthmoving.jpg
    Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers
    Mani Golparvar-Fard, Arsalan Heydarian, and Juan Carlos Niebles
    Advanced Engineering Informatics. Oct 2013
  3. hogc.jpg
    Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors
    Milad Memarzadeh, Mani Golparvar-Fard, and Juan Carlos Niebles
    Automation in Construction. Jul 2013

2012

  1. crc2012.jpg
    Automated Vision-based Recognition of Construction Worker Actions for Building Interior Construction Operations Using RGBD Cameras
    Victor Escorcia, Maria A. Dávila, Mani Golparvar-Fard, and Juan Carlos Niebles
    In Construction Research Congress (CRC). West Lafayette, Indiana, USA. May 2012
  2. equipment_actions.jpg
    Automated visual recognition of construction equipment actions using spatio-temporal features and multiple binary support vector machines
    Arsalan Heydarian, Mani Golparvar-Fard, and Juan Carlos Niebles
    In Construction Research Congress (CRC). West Lafayette, Indiana, USA. May 2012
  3. equipment_tracking.jpg
    Real-time and automated recognition and 2D tracking of Construction workers and equipment from Site video streams
    Milad Memarzadeh, Arsalan Heydarian, Mani Golparvar-Fard, and Juan Carlos Niebles
    In ASCE International Conference on Computing in Civil Engineering (i3CE). Clearwater Beach, Florida, USA. Jun 2012

2010

  1. Oral
    NieblesChenFei-Fei_ECCV2010_icon.jpg
    Modeling Temporal Structure of Decomposable Motion Segments for Activity Classification
    Juan Carlos Niebles, Chih-Wei Chen, and Li Fei-Fei
    In European Conference on Computer Vision (ECCV). Hersonissos, Crete, Greece. Sep 2010
  2. efficient_moving_people.jpg
    Efficient Extraction of Human Motion Volumes by Tracking
    Juan Carlos Niebles, Bohyung Han, and Li Fei-Fei
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). San Francisco, USA. Jun 2010

2009

  1. mining.jpg
    Mining Discriminative Adjectives and Prepositions for Natural Scene Recognition
    Bangpeng Yao, Juan Carlos Niebles, and Li Fei-Fei
    In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Miami, USA. Jun 2009

2008

  1. eccv08.jpg
    Extracting Moving People from Internet Videos
    Juan Carlos Niebles, Bohyung Han, Andras Ferencz, and Li Fei-Fei
    In European Conference on Computer Vision (ECCV). Marseilles, France. Oct 2008
  2. ijcv.jpg
    Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words
    Juan Carlos Niebles, Hongcheng Wang, and Li Fei-Fei
    International Journal of Computer Vision (IJCV). Sep 2008
  3. correlatons.jpg
    Spatial-Temporal Correlatons for Unsupervised Action Classification
    Silvio Savarese, Andrey Del Pozo, Juan Carlos Niebles, and Li Fei-Fei
    In IEEE Workshop on Motion and Video Computing (WMVC). Copper Mountain, Colorado, USA. Jan 2008

2007

  1. optimol.png
    OPTIMOL: a framework for Online Picture collecTion via Incremental MOdel Learning
    Li-Jia Li, Juan Carlos Niebles, and Li Fei-Fei
    In Association for the Advancement of Artificial Intelligence (AAAI) 2007 Robot Competition and Exhibition. Vancouver, Canada. Jul 2007
  2. NieblesFei-Fei_CVPR2007.jpg
    A Hierarchical Model of Shape and Appearance for Human Action Classification
    Juan Carlos Niebles, and Li Fei-Fei
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Minneapolis, USA. Jun 2007

2006

  1. Oral
    NieblesWangFei-Fei_BMVC2006.jpg
    Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words
    Juan Carlos Niebles, Hongcheng Wang, and Li Fei-Fei
    In British Machine Vision Conference (BMVC). Edinburgh, UK. Sep 2006

2004

  1. tugboat.png
    Signal Processing Unit for River Tugboat Telemetry System
    Humberto Campanella, Mauricio Pardo, Victor Manotas, Javier Páez, Juan Carlos Niebles, and David Angulo
    In Conference on Design of Circuits and Integrated Systems (DCIS). Bordeaux, France. Nov 2004

2001

  1. robots.png
    Dispositivos automatas para navegacion, deteccion y recoleccion de pelotas de tenis en ambientes conocidos
    Carlos Cubas, Marcos Consuegra, Royman Lopez, Alexis Sierra, Jorge Leon, Fernando Mendez, Carlos Ochoa, Fabian Panesso, Edgar Sotter, Fabian Manotas, and 4 more authors
    Revista Ingenieria y Desarrollo (IyD). Jan 2001