Ambient Intelligence Lab

Publications

Sensing Modalities

all acoustics light rf vibration motion sensors biosensors multi-modal

System Challenges

all extended sensing capabilities privacy security communication computation & storage

Applications

all hci speech processing health sensing environmental sensing robotic sensing sensor security sensor privacy attack and defense

Venue Areas

all mobile computing human computer interaction security and privacy computer networks ml/ai

2026

Attacking mmWave Imaging Using Metasurfaces Based on Intensity and Time-of-Flight Manipulation
Shuning Wang, Yongjian Fu, Hao Pan, Xinyi Li, Linghui Zhong, Yaxiong Xie, Ke Sun, Guangtao Xue, Yaoxue Zhang, Ju Ren
ACM MobiCom '26  ·  01 Nov 2026
MagicPatch proposes an efficient attack on millimeter-wave security screening systems using a reflective metasurface patch that can be attached to clothing.
rf security sensor security
Unlocking Practical Cardiac Monitoring Capabilities on True Wireless Stereo Earbuds
Yongjian Fu, Ke Sun, Xinyu Zhang, Ruyao Wang, Xinyi Li, Hao Pan, Yaoxue Zhang, Ju Ren
ACM MobiCom '26  ·  01 Nov 2026
EarCardio repurposes the IMU sensors in true wireless stereo earbuds for practical cardiac monitoring by capturing in-ear ballistocardiogram signals.
motion sensors biosensors health sensing extended sensing capabilities
UWB-based Localization of Smartphones Inside a Vehicle to Prevent Distracted Driving
Kailai Cui, Ke Sun, Kang G. Shin
ACM SenSys '26  ·  01 May 2026
UWB-Prac is a real-time seat-level smartphone localization system that uses the single UWB anchor infrastructure already available in modern vehicles.
rf hci robotic sensing
From Bits to Tokens: Knowledge-Driven Generative Communication of Multimodal Data
Xingyu Chen, Zihao Feng, Wuqiong Zhao, Jianrong Ding, Ke Sun, Xinyu Zhang
USENIX NSDI '26  ·  01 May 2026
KDC transmits semantic knowledge rather than raw bits to improve communication efficiency for multimodal sensing workloads.
multi modal communication computation & storage
MoiréLens: Bringing Schlieren Imaging into Real-World Environments Using Moiré Patterns
Linzhen Zhu, Runqiu Wang, Yi Rong, Ke Sun
ACM SenSys '26  ·  01 May 2026
MoiréLens demonstrates that everyday cameras can be used for visualizing air-flow and refractive-index dynamics by converting subtle refractive-index variations into measurable Moire phase shifts.
light environmental sensing extended sensing capabilities
SoilNutri: A Passive Metasurface-based, Low-cost System for Soil Moisture and Nitrogen Monitoring
Juexing Wang, Binbin Xie, Yimeng Liu, Minhao Cui, Xiao Zhang, …, Qingxu Jin, Younsuk Dong, Hui Li, Jie Xiong, Tianxing Li
[no publisher info]  ·  16 Mar 2026  ·  doi:10.1145/3789674
rf environmental sensing extended sensing capabilities

2025

UltraPoser: Pushing the Limits of IMU-based Full-Body Pose Estimation with Ultrasound Sensing on Consumer Wearables
UltraPoser: Pushing the Limits of IMU-based Full-Body Pose Estimation with Ultrasound Sensing on Consumer Wearables
Yadong Li, Shuning Wang, Yongjian Fu, Justin Chen, Xingyu Chen, Ju Ren, Xinyu Zhang, Akshay Gadre, Ke Sun
ACM UIST '25  ·  27 Sep 2025  ·  doi:10.1145/3746059.3747714
Source Code
Video
acoustics motion sensors multi modal hci extended sensing capabilities
EveGuard: Defeating Vibration-based Side-Channel Eavesdropping with Audio Adversarial Perturbations
EveGuard: Defeating Vibration-based Side-Channel Eavesdropping with Audio Adversarial Perturbations
Jung-Woo Chang, Ke Sun, David Xia, Xinyu Zhang, Farinaz Koushanfar
IEEE S&P (Oakland) '25  ·  12 May 2025  ·  doi:10.1109/sp61157.2025.00235
Demo
acoustics vibration security privacy sensor privacy attack and defense
Poster Abstract: On-Shelf Weight Difference Estimation Through Active Vibration Sensing
Poster Abstract: On-Shelf Weight Difference Estimation Through Active Vibration Sensing
Jiale Zhang, Yuyan Wu, Jesse Codling, Julia Gersey, Adeola Bannis, Carlos Ruiz Dominguez, Ke Sun, Pei Zhang
ACM SenSys '25  ·  06 May 2025  ·  doi:10.1145/3715014.3724047
vibration extended sensing capabilities
Security Attacks on LLM-based Code Completion Tools
Security Attacks on LLM-based Code Completion Tools
Wen Cheng, Ke Sun, Xinyu Zhang, Wei Wang
AAAI '25  ·  11 Apr 2025  ·  doi:10.1609/aaai.v39i22.34537
security sensor security
Magmaw: Modality-Agnostic Adversarial Attacks on Machine Learning-Based Wireless Communication Systems
Magmaw: Modality-Agnostic Adversarial Attacks on Machine Learning-Based Wireless Communication Systems
Jung-Woo Chang, Ke Sun, Nasimeh Heydaribeni, Seira Hidano, Xinyu Zhang, Farinaz Koushanfar
NDSS '25  ·  01 Jan 2025  ·  doi:10.14722/ndss.2025.230336
rf multi modal communication security sensor security

2024

RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF Measurements
RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF Measurements
Xingyu Chen, Zihao Feng, Ke Sun, Kun Qian, Xinyu Zhang
ACM SenSys '24  ·  04 Nov 2024  ·  doi:10.1145/3666025.3699351
rf light communication extended sensing capabilities
Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic Signals
Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic Signals
Shiyang Wang, Xingchen Wang, Wenjun Jiang, Chenglin Miao, Qiming Cao, Haoyu Wang, Ke Sun, Hongfei Xue, Lu Su
ACM TOSN  ·  26 Aug 2024  ·  doi:10.1145/3677122
acoustics hci extended sensing capabilities
Multimodal Daily-Life Logging in Free-living Environment Using Non-Visual Egocentric Sensors on a Smartphone
Multimodal Daily-Life Logging in Free-living Environment Using Non-Visual Egocentric Sensors on a Smartphone
Ke Sun, Chunyu Xia, Xinyu Zhang, Hao Chen, Charlie Jianzhong Zhang
ACM IMWUT (UbiComp'24)  ·  06 Mar 2024  ·  doi:10.1145/3643553
acoustics rf motion sensors multi modal health sensing extended sensing capabilities

2023

SCALAR: Self-Calibrated Acoustic Ranging for Distributed Mobile Devices
SCALAR: Self-Calibrated Acoustic Ranging for Distributed Mobile Devices
Lei Wang, Haoran Wan, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, Wei Wang
IEEE TMC  ·  01 Jan 2023  ·  doi:10.1109/TMC.2023.3241304
acoustics hci extended sensing capabilities
StealthyIMU: Stealing Permission-protected Private Information From Smartphone Voice Assistant Using Zero-Permission Sensors
StealthyIMU: Stealing Permission-protected Private Information From Smartphone Voice Assistant Using Zero-Permission Sensors
Ke Sun, Chunyu Xia, Songlin Xu, Xinyu Zhang
NDSS  ·  01 Jan 2023  ·  doi:10.14722/ndss.2023.24077
motion sensors acoustics security privacy sensor privacy attack and defense

2022

VECTOR: Velocity Based Temperature-field Monitoring with Distributed Acoustic Devices
VECTOR: Velocity Based Temperature-field Monitoring with Distributed Acoustic Devices
Haoran Wan, Lei Wang, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, Wei Wang
ACM IMWUT (UbiComp'22)  ·  06 Sep 2022  ·  doi:10.1145/3550336
acoustics environmental sensing extended sensing capabilities
LoEar: Push the Range Limit of Acoustic Sensing for Vital Sign Monitoring
LoEar: Push the Range Limit of Acoustic Sensing for Vital Sign Monitoring
Lei Wang, Wei Li, Ke Sun, Fusang Zhang, Tao Gu, Chenren Xu, Daqing Zhang
ACM IMWUT (UbiComp'22)  ·  06 Sep 2022  ·  doi:10.1145/3550293
acoustics health sensing extended sensing capabilities

2021

Charging Task Scheduling for Directional Wireless Charger Networks
Charging Task Scheduling for Directional Wireless Charger Networks
Haipeng Dai, Ke Sun, Alex X. Liu, Lijun Zhang, Jiaqi Zheng, Guihai Chen
IEEE TMC  ·  01 Nov 2021  ·  doi:10.1109/tmc.2020.2997602
rf communication computation & storage
UltraSE: single-channel speech enhancement using ultrasound
UltraSE: single-channel speech enhancement using ultrasound
Ke Sun, Xinyu Zhang
ACM MobiCom'21  ·  09 Sep 2021  ·  doi:10.1145/3447993.3448626
acoustics multi modal speech processing extended sensing capabilities
ExGSense: Toward Facial Gesture Sensing with a Sparse Near-Eye Sensor Array
ExGSense: Toward Facial Gesture Sensing with a Sparse Near-Eye Sensor Array
Chen Chen, Ke Sun, Xinyu Zhang
ACM/IEEE IPSN'21  ·  18 May 2021  ·  doi:10.1145/3412382.3458268
biosensors hci extended sensing capabilities
WiTrace: Centimeter-Level Passive Gesture Tracking Using OFDM Signals
WiTrace: Centimeter-Level Passive Gesture Tracking Using OFDM Signals
Lei Wang, Ke Sun, Haipeng Dai, Wei Wang, Kang Huang, Alex X. Liu, Xiaoyu Wang, Qing Gu
IEEE TMC  ·  01 Apr 2021  ·  doi:10.1109/TMC.2019.2961885
rf hci extended sensing capabilities

2020

milliEgo: single-chip mmWave radar aided egomotion estimation via deep sensor fusion
milliEgo: single-chip mmWave radar aided egomotion estimation via deep sensor fusion
Chris Xiaoxuan Lu, Muhamad Risqi U. Saputra, Peijun Zhao, Yasin Almalioglu, Pedro P. B. de Gusmao, Changhao Chen, Ke Sun, Niki Trigoni, Andrew Markham
ACM SenSys'20  ·  16 Nov 2020  ·  doi:10.1145/3384419.3430776
rf motion sensors multi modal robotic sensing extended sensing capabilities
Alexa, stop spying on me speech privacy protection against voice assistants
"Alexa, stop spying on me!" speech privacy protection against voice assistants
Ke Sun, Chen Chen, Xinyu Zhang
ACM SenSys'20  ·  16 Nov 2020  ·  doi:10.1145/3384419.3430727
acoustics security privacy sensor privacy attack and defense
SpiderMon: Towards Using Cell Towers as Illuminating Sources for Keystroke Monitoring
SpiderMon: Towards Using Cell Towers as Illuminating Sources for Keystroke Monitoring
Kang Ling, Yuntang Liu, Ke Sun, Wei Wang, Lei Xie, Qing Gu
IEEE INFOCOM'20  ·  01 Jul 2020  ·  doi:10.1109/infocom41043.2020.9155447
rf security privacy sensor privacy attack and defense
Dynamic Speed Warping: Similarity-Based One-shot Learning for Device-free Gesture Signals
Dynamic Speed Warping: Similarity-Based One-shot Learning for Device-free Gesture Signals
Xun Wang, Ke Sun, Ting Zhao, Wei Wang, Qing Gu
IEEE INFOCOM'20  ·  01 Jul 2020  ·  doi:10.1109/infocom41043.2020.9155491
acoustics hci extended sensing capabilities

2018

VSkin: Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals
VSkin: Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals
Ke Sun, Ting Zhao, Wei Wang, Lei Xie
ACM MobiCom'18  ·  15 Oct 2018  ·  doi:10.1145/3241539.3241568
acoustics vibration hci extended sensing capabilities
Unlock with Your Heart: Heartbeat-based Authentication on Commercial Mobile Phones
Unlock with Your Heart: Heartbeat-based Authentication on Commercial Mobile Phones
Lei Wang, Kang Huang, Ke Sun, Wei Wang, Chen Tian, Lei Xie, Qing Gu
ACM IMWUT (UbiComp'18)  ·  18 Sep 2018  ·  doi:10.1145/3264950
motion sensors biosensors health sensing security privacy sensor privacy attack and defense
Charging Task Scheduling for Directional Wireless Charger Networks
Charging Task Scheduling for Directional Wireless Charger Networks
Haipeng Dai, Ke Sun, Alex X. Liu, Lijun Zhang, Jiaqi Zheng, Guihai Chen
ACM ICPP'18  ·  13 Aug 2018  ·  doi:10.1145/3225058.3225080
rf communication computation & storage
Depth Aware Finger Tapping on Virtual Displays
Depth Aware Finger Tapping on Virtual Displays
Ke Sun, Wei Wang, Alex X. Liu, Haipeng Dai
ACM MobiSys'18  ·  10 Jun 2018  ·  doi:10.1145/3210240.3210315
acoustics light multi modal hci extended sensing capabilities
WiTrace: Centimeter-Level Passive Gesture Tracking Using WiFi Signals
WiTrace: Centimeter-Level Passive Gesture Tracking Using WiFi Signals
Lei Wang, Ke Sun, Haipeng Dai, Alex X. Liu, Xiaoyu Wang
IEEE SECON'18  ·  01 Jun 2018  ·  doi:10.1109/sahcn.2018.8397120
rf extended sensing capabilities hci

2016

Device-free gesture tracking using acoustic signals
Device-free gesture tracking using acoustic signals
Wei Wang, Alex X. Liu, Ke Sun
ACM MobiCom'16  ·  03 Oct 2016  ·  doi:10.1145/2973750.2987385
acoustics hci extended sensing capabilities
Device-free gesture tracking using acoustic signals
Device-free gesture tracking using acoustic signals
Wei Wang, Alex X. Liu, Ke Sun
ACM MobiCom'16  ·  03 Oct 2016  ·  doi:10.1145/2973750.2973764
acoustics hci extended sensing capabilities