Ambient Intelligence Lab

Research Projects

Sensing Modality

multimodal ultrasound speech motion-sensor vibration radio-frequency biosignals vision text

Applications

human-computer-interaction home-iot industrial-iot mobile-health mobile-robotics wireless-communication security-privacy

2025

UltraPoser: Pushing the Limits of IMU-based Full-Body Pose Estimation with Ultrasound Sensing on Consumer Wearables
UltraPoser: Pushing the Limits of IMU-based Full-Body Pose Estimation with Ultrasound Sensing on Consumer Wearables
Yadong Li, Shuning Wang, Yongjian Fu, Justin Chen, Xingyu Chen, Ju Ren, Xinyu Zhang, Akshay Gadre, Ke Sun
ACM UIST '25  ·  27 Sep 2025  ·  doi:10.1145/3746059.3747714
Source Code
Video
human-computer-interaction multimodal ultrasound motion-sensor
EveGuard: Defeating Vibration-based Side-Channel Eavesdropping with Audio Adversarial Perturbations
EveGuard: Defeating Vibration-based Side-Channel Eavesdropping with Audio Adversarial Perturbations
Jung-Woo Chang, Ke Sun, David Xia, Xinyu Zhang, Farinaz Koushanfar
IEEE S&P (Oakland) '25  ·  12 May 2025  ·  doi:10.1109/sp61157.2025.00235
Demo
security-privacy speech
Poster Abstract: On-Shelf Weight Difference Estimation Through Active Vibration Sensing
Poster Abstract: On-Shelf Weight Difference Estimation Through Active Vibration Sensing
Jiale Zhang, Yuyan Wu, Jesse Codling, Julia Gersey, Adeola Bannis, Carlos Ruiz Dominguez, Ke Sun, Pei Zhang
ACM SenSys '25  ·  06 May 2025  ·  doi:10.1145/3715014.3724047
industrial-iot vibration
Security Attacks on LLM-based Code Completion Tools
Security Attacks on LLM-based Code Completion Tools
Wen Cheng, Ke Sun, Xinyu Zhang, Wei Wang
AAAI '25  ·  11 Apr 2025  ·  doi:10.1609/aaai.v39i22.34537
security-privacy text
Magmaw: Modality-Agnostic Adversarial Attacks on Machine Learning-Based Wireless Communication Systems
Magmaw: Modality-Agnostic Adversarial Attacks on Machine Learning-Based Wireless Communication Systems
Jung-Woo Chang, Ke Sun, Nasimeh Heydaribeni, Seira Hidano, Xinyu Zhang, Farinaz Koushanfar
NDSS '25  ·  01 Jan 2025  ·  doi:10.14722/ndss.2025.230336
security-privacy wireless-communication radio-frequency

2024

RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF Measurements
RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF Measurements
Xingyu Chen, Zihao Feng, Ke Sun, Kun Qian, Xinyu Zhang
ACM SenSys '24  ·  04 Nov 2024  ·  doi:10.1145/3666025.3699351
wireless-communication radio-frequency vision
Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic Signals
Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic Signals
Shiyang Wang, Xingchen Wang, Wenjun Jiang, Chenglin Miao, Qiming Cao, Haoyu Wang, Ke Sun, Hongfei Xue, Lu Su
ACM TOSN  ·  26 Aug 2024  ·  doi:10.1145/3677122
human-computer-interaction ultrasound
Multimodal Daily-Life Logging in Free-living Environment Using Non-Visual Egocentric Sensors on a Smartphone
Multimodal Daily-Life Logging in Free-living Environment Using Non-Visual Egocentric Sensors on a Smartphone
Ke Sun, Chunyu Xia, Xinyu Zhang, Hao Chen, Charlie Jianzhong Zhang
ACM IMWUT (UbiComp'24)  ·  06 Mar 2024  ·  doi:10.1145/3643553
human-computer-interaction multimodal radio-frequency motion-sensor speech text

2023

SCALAR: Self-Calibrated Acoustic Ranging for Distributed Mobile Devices
SCALAR: Self-Calibrated Acoustic Ranging for Distributed Mobile Devices
Lei Wang, Haoran Wan, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, Wei Wang
IEEE TMC  ·  01 Jan 2023  ·  doi:10.1109/TMC.2023.3241304
home-iot industrial-iot ultrasound
StealthyIMU: Stealing Permission-protected Private Information From Smartphone Voice Assistant Using Zero-Permission Sensors
StealthyIMU: Stealing Permission-protected Private Information From Smartphone Voice Assistant Using Zero-Permission Sensors
Ke Sun, Chunyu Xia, Songlin Xu, Xinyu Zhang
NDSS  ·  01 Jan 2023  ·  doi:10.14722/ndss.2023.24077
security-privacy motion-sensor speech text

2022

VECTOR: Velocity Based Temperature-field Monitoring with Distributed Acoustic Devices
VECTOR: Velocity Based Temperature-field Monitoring with Distributed Acoustic Devices
Haoran Wan, Lei Wang, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, Wei Wang
ACM IMWUT (UbiComp'22)  ·  06 Sep 2022  ·  doi:10.1145/3550336
home-iot industrial-iot ultrasound
LoEar: Push the Range Limit of Acoustic Sensing for Vital Sign Monitoring
LoEar: Push the Range Limit of Acoustic Sensing for Vital Sign Monitoring
Lei Wang, Wei Li, Ke Sun, Fusang Zhang, Tao Gu, Chenren Xu, Daqing Zhang
ACM IMWUT (UbiComp'22)  ·  06 Sep 2022  ·  doi:10.1145/3550293
home-iot mobile-health ultrasound

2021

Charging Task Scheduling for Directional Wireless Charger Networks
Charging Task Scheduling for Directional Wireless Charger Networks
Haipeng Dai, Ke Sun, Alex X. Liu, Lijun Zhang, Jiaqi Zheng, Guihai Chen
IEEE TMC  ·  01 Nov 2021  ·  doi:10.1109/tmc.2020.2997602
home-iot industrial-iot radio-frequency
UltraSE: single-channel speech enhancement using ultrasound
UltraSE: single-channel speech enhancement using ultrasound
Ke Sun, Xinyu Zhang
ACM MobiCom'21  ·  09 Sep 2021  ·  doi:10.1145/3447993.3448626
human-computer-interaction multimodal speech ultrasound
ExGSense: Toward Facial Gesture Sensing with a Sparse Near-Eye Sensor Array
ExGSense: Toward Facial Gesture Sensing with a Sparse Near-Eye Sensor Array
Chen Chen, Ke Sun, Xinyu Zhang
ACM/IEEE IPSN'21  ·  18 May 2021  ·  doi:10.1145/3412382.3458268
human-computer-interaction biosignals
WiTrace: Centimeter-Level Passive Gesture Tracking Using OFDM Signals
WiTrace: Centimeter-Level Passive Gesture Tracking Using OFDM Signals
Lei Wang, Ke Sun, Haipeng Dai, Wei Wang, Kang Huang, Alex X. Liu, Xiaoyu Wang, Qing Gu
IEEE TMC  ·  01 Apr 2021  ·  doi:10.1109/TMC.2019.2961885
human-computer-interaction radio-frequency

2020

milliEgo: single-chip mmWave radar aided egomotion estimation via deep sensor fusion
milliEgo: single-chip mmWave radar aided egomotion estimation via deep sensor fusion
Chris Xiaoxuan Lu, Muhamad Risqi U. Saputra, Peijun Zhao, Yasin Almalioglu, Pedro P. B. de Gusmao, Changhao Chen, Ke Sun, Niki Trigoni, Andrew Markham
ACM SenSys'20  ·  16 Nov 2020  ·  doi:10.1145/3384419.3430776
mobile-robotics multimodal radio-frequency motion-sensor
Alexa, stop spying on me speech privacy protection against voice assistants
"Alexa, stop spying on me!" speech privacy protection against voice assistants
Ke Sun, Chen Chen, Xinyu Zhang
ACM SenSys'20  ·  16 Nov 2020  ·  doi:10.1145/3384419.3430727
security-privacy speech ultrasound
SpiderMon: Towards Using Cell Towers as Illuminating Sources for Keystroke Monitoring
SpiderMon: Towards Using Cell Towers as Illuminating Sources for Keystroke Monitoring
Kang Ling, Yuntang Liu, Ke Sun, Wei Wang, Lei Xie, Qing Gu
IEEE INFOCOM'20  ·  01 Jul 2020  ·  doi:10.1109/infocom41043.2020.9155447
security-privacy radio-frequency
Dynamic Speed Warping: Similarity-Based One-shot Learning for Device-free Gesture Signals
Dynamic Speed Warping: Similarity-Based One-shot Learning for Device-free Gesture Signals
Xun Wang, Ke Sun, Ting Zhao, Wei Wang, Qing Gu
IEEE INFOCOM'20  ·  01 Jul 2020  ·  doi:10.1109/infocom41043.2020.9155491
human-computer-interaction ultrasound

2018

VSkin: Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals
VSkin: Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals
Ke Sun, Ting Zhao, Wei Wang, Lei Xie
ACM MobiCom'18  ·  15 Oct 2018  ·  doi:10.1145/3241539.3241568
human-computer-interaction vibration ultrasound
Unlock with Your Heart: Heartbeat-based Authentication on Commercial Mobile Phones
Unlock with Your Heart: Heartbeat-based Authentication on Commercial Mobile Phones
Lei Wang, Kang Huang, Ke Sun, Wei Wang, Chen Tian, Lei Xie, Qing Gu
ACM IMWUT (UbiComp'18)  ·  18 Sep 2018  ·  doi:10.1145/3264950
security-privacy biosignals motion-sensor
Charging Task Scheduling for Directional Wireless Charger Networks
Charging Task Scheduling for Directional Wireless Charger Networks
Haipeng Dai, Ke Sun, Alex X. Liu, Lijun Zhang, Jiaqi Zheng, Guihai Chen
ACM ICPP'18  ·  13 Aug 2018  ·  doi:10.1145/3225058.3225080
home-iot industrial-iot radio-frequency
Depth Aware Finger Tapping on Virtual Displays
Depth Aware Finger Tapping on Virtual Displays
Ke Sun, Wei Wang, Alex X. Liu, Haipeng Dai
ACM MobiSys'18  ·  10 Jun 2018  ·  doi:10.1145/3210240.3210315
human-computer-interaction multimodal ultrasound vision
WiTrace: Centimeter-Level Passive Gesture Tracking Using WiFi Signals
WiTrace: Centimeter-Level Passive Gesture Tracking Using WiFi Signals
Lei Wang, Ke Sun, Haipeng Dai, Alex X. Liu, Xiaoyu Wang
IEEE SECON'18  ·  01 Jun 2018  ·  doi:10.1109/sahcn.2018.8397120
human-computer-interaction radio-frequency

2016

Device-free gesture tracking using acoustic signals
Device-free gesture tracking using acoustic signals
Wei Wang, Alex X. Liu, Ke Sun
ACM MobiCom'16  ·  03 Oct 2016  ·  doi:10.1145/2973750.2987385
human-computer-interaction ultrasound
Device-free gesture tracking using acoustic signals
Device-free gesture tracking using acoustic signals
Wei Wang, Alex X. Liu, Ke Sun
ACM MobiCom'16  ·  03 Oct 2016  ·  doi:10.1145/2973750.2973764
human-computer-interaction ultrasound

More

Cool Tutorial
Cool Tutorial a subtitle

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.

resource publication
Cool Web App
Cool Web App a subtitle

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.

software
Cool Web Server
Cool Web Server a subtitle

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.

software

–>