profile photo

Dweep Trivedi

I am a visiting researcher at Cognitive Learning for Vision and Robotics Lab (CLVR) at University of Southern California, advised by Prof. Joseph Lim .

Previously, I finished my Master’s in Computer Science at University of Southern California, where I worked under the guidance of Dr. Seon Ho Kim and Prof. Yan Liu. Earlier, I spent 2 years working as Software Development Engineer in Juniper Networks, Bangalore . I did my undergrad in Information and Communication Technology at DA-IICT, Gandhinagar.

Email  |  CV  |  Google Scholar  |  Github  |  Twitter  |  Linkedin


I'm interested in Deep Learning, Programmatic Reinforcement Learning, Continual Learning and Robot Learning.

profile photo Learning to Synthesize Programs as Interpretable and Generalizable Policies
Dweep Trivedi*, Jesse Zhang*, Shao-Hua Sun*, Joseph J Lim
Neural Information Processing Systems, 2021
[ PDF ] [ BibTex ] [ Code ] [ Project Page ]

We present a framework that learns to synthesize a program, detailing the procedure to solve a task in a flexible and expressive manner, solely from reward signals. To alleviate the difficulty of learning to compose programs to induce the desired agent behavior from scratch, we propose to learn a program embedding space that continuously parameterizes diverse behaviors in an unsupervised manner and then search over the learned program embedding space to yield a program that maximizes the return for a given task.

profile photo Multi-agent trajectory prediction with fuzzy query attention
Nitin Kamra , Hao Zhu, Dweep Trivedi, Ming Zhang, Yan Liu
Neural Information Processing Systems , 2020
[ PDF ] [ BibTex ] [ Code ]

We present a general architecture to address multi-agent trajectory prediction which models the crucial inductive biases of motion, namely, inertia, relative motion, intents and interactions. Specifically, we propose a relational model to flexibly model interactions between agents in diverse environments. At the core of our model lies a novel attention mechanism which models interactions by making continuous-valued (fuzzy) decisions and learning the corresponding responses. Our architecture demonstrates significant performance gains over existing state-of-the-art predictive models in diverse domains such as human crowd trajectories, US freeway traffic, NBA sports data and physics datasets.

profile photo Yet another deep learning approach for road damage detection using ensemble learning
Vinuta Hegde*, Dweep Trivedi*, Abdullah Alfarrarjeh, Aditi Deepak, Seon Ho Kim, Cyrus Shahabi
IEEE International Conference on Big Data (Big Data), 2020
[ PDF ] [ BibTex ] [ Code ]

This paper introduces deep learningbased image analysis for road damage detection and classification. Our ensemble learning approaches with test time augmentation were thoroughly evaluated using the 2020 IEEE Big Data Global Road Damage Detection Challenge Dataset. Experimental results show that our approaches achieved an F1 score of up to 0.67, allowing us to win the Challenge.

profile photo Recognizing material of a covered object: A case study with graffiti
Abdullah Alfarrarjeh*, Dweep Trivedi*, Seon Ho Kim, Hyunjun Park, Chao Huang, Cyrus Shahabi
IEEE International Conference on Image Processing (ICIP), 2019
[ PDF ] [ BibTex ]

This paper introduces the problem of recognizing covered materials which are distorted visually (e.g., materials covered by graffiti). We propose a set of approaches to solve this problem using a class of deep learning and transfer learning models, and evaluate our approaches empirically using a large-scale real world dataset that displays street scenes containing various materials which are covered with graffiti. Our experiments show that recognizing covered materials using the state-of-the-art approach for material recognition produced an mAP of 19%, while our proposed approach achieved an mAP of 60%.

profile photo A deep learning approach for road damage detection from smartphone images
Abdullah Alfarrarjeh*, Dweep Trivedi*, Seon Ho Kim, Cyrus Shahabi
IEEE International Conference on Big Data (Big Data), 2018
[ PDF ] [ BibTex ] [ Code ]

This paper describes a road damage type detection and classification solution submitted to the IEEE BigData Cup Challenge 2018. Our solution is based on the state-of-the-art deep learning methods for an object detection task. In particular, our approach utilizes an object detection algorithm to detect various types of road damages by training the detector on different image examples categorized into a set of damages defined by Japan Road Association. We evaluated our approach thoroughly using different versions of trained models. Our experiments show that our approach was able to achieve an F1 score up to 0.62.

Credits to the The Simplest template!