About Me
Hi! Welcome to my page! I am a Ph.D. candidate in Electrical Engineering and Computer Science at the UC Merced PANS Lab, advised by Dr. Shijia Pan. I have been working on algorithms in Multimodal Deep Learning (Signal, Image, Text), Transfer Learning, and applications for ubiquitous computing and healthcare from day one of my Ph.D. journey. I am actively exploring new fields including Graph Learning and Causal Machine Learning. Please feel free to contact me if you want to chat/ collaborate/ have an internship opportunity/ ask for the latest resume :-D.
Interests
- Multimodal Deep Learning (CV, NLP, Signal, etc.)
- Causal Machine Learning
- Graph Learning
- Ubiquitos Computing
Education
-
Ph.D. Student in Computer Science, 2020-Now
University of California Merced
-
M.Sc in Building Science, 2020
Carnegie Mellon University
Experience
Ph.D. Student
University of California, Merced
Working in following areas:
- Physics-informed multimodal sensing and learning algorithms.
- Causal inference for deep learning bias reduction.
- Smart healthcare with heterogeneous Internet of Things(IoT) systems.
- Representation learning and transfer learning algorithms.
Applied Scientist Intern
Amazon Inc.
Working on the visual cues-guided online text denoising for robust multimodal learning. Advised by Dr.Shasha Li, Dr. Ming Du. Supervised and advised by Dr. Arnab Dhua. Full paper in submission.
Applied Scientist Intern
Amazon Inc.
Working on the vision-language multimodal learning for language-guided compostional image-image retrieval. Advised by Dr.Xinliang Zhu, Dr. Son Tran and Dr. Rene Vidal. Supervised and advised by Dr. Arnab Dhua. Ourput paper: ProVLA @ ICCVW 2023.
Recent Publications
Quickly discover relevant content by filtering publications.
(2023).
ProVLA: Compositional Image Search with Progressive Vision-language Alignment and Multimodal Fusion.
2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW).
(2023).
CMA: Cross-Modal Association Between Wearable and Structural Vibration Signal Segments for Indoor Occupant Sensing.
IPSN 2023.
(2023).
Poster: Integrating On- and Off-body Sensing for Young Adults Failure to Launch (FTL) Behavior Profiling.
IPSN 2023.
(2022).
CIPhy: Causal Intervention with Physical Confounder from IoT Sensor Data for Robust Occupant Information Inference.
SenSys 2022 AIoT Workshop.
(2022).
MODES: multi-sensor occupancy data-driven estimation system for smart buildings.
ACM e-Energy.
(2022).
Demo: Real-Time Teeth Functional Occlusion Monitoring via In-Mouth Vibration Sensing.
IPSN 2022.
(2022).
Poster: Sedentary Posture Muscle Monitoring via Active Vibratory Sensing.
IPSN 2022 (Best Poster Award).
(2022).
VMA: Domain Variance- and Modality-Aware Model Transfer for Fine-Grained Occupant Activity Recognition.
IPSN 2022.
(2021).
AutoQual: task-oriented structural vibration sensing quality assessment leveraging co-located mobile sensing context.
CCF Transactions on Pervasive Computing and Interaction.
(2021).
Footstep-Induced Floor Vibration Dataset: Reusability and Transferability Analysis.
SenSys 2021 DATA Workshop.
(2021).
Poster: Vibration-based Indoor Occupant Gait Monitoring with Robot Vacuum Cleaners.
IoTDI 2021.
(2021).
Vibration-based indoor human sensing quality reinforcement via Thompson sampling.
Proceedings of the First International Workshop on Cyber-Physical-Human System Design and Implementation.
(2020).
A window-based sequence-to-one approach with dynamic voting for nurse care activity recognition using acceleration-based wearable sensor.
UbiComp/ISWC 2020 Workshop(Best Paper Award).
(2020).
Fine-grained activities recognition with coarse-grained labeled multi-modal data.
UbiComp/ISWC 2020 CML-IoT Workshop.
(2020).
Improving the Interoperability of gbXML Data Model through Redefining Data Mapping Rules of HVAC Systems.
ASHRAE Transactions.
(2019).
Device-free sleep stage recognition through bed frame vibration sensing.
BuildSys 2019 DFHS Workshop.
Contact Me
- 5200 Lake Road, Science & Engineering 2, Merced, CA 95348