Ambient Intelligence Lab

Research

AmI lab aims to co-design end-to-end mobile, wearable, and IoT systems to achieve the following requirements from different layers.

Applications Layers: Enable critical or novel applications using MWIoT systems, including

  • Human-Computer Interaction (HCI);
  • Mobile, Household, and Industrial Robotics;
  • Mobile Health
  • Environmental Sensing;
  • Autonomous Driving and UVA;
  • Multimedia for new scenarios, like 6G, Metaverse, etc.

Data Processing Layers: Design the sensor computational models for MWIoT systems to make them i). accurate; ii). intelligent; iii). robust; iv) personalized;

Systems Layers: Design the MWIoT systems to achieve

  • energy efficiency;
  • computational efficiency;
  • communication efficiency;
  • trustworthiness; and
  • privacy preservation.

Sensing Layers: Innovate low-cost solutions with minimal or no hardware modifications to maximize the potential of ubiquitous sensors on existing MWIoT systems. Except for traditional sensors like audio and vision, we specifically focus on ubiquitous MWIoT sensors, like radio frequency, ultrasound, electromagnetic, capacitive sensors, biopotential signals, and olfactory sensors, etc.

Highlighted

citation image
[no title info]
[no publisher info]  ·  [no date info]  ·  [no id info]

All

2025

EveGuard: Defeating Vibration-based Side-Channel Eavesdropping with Audio Adversarial Perturbations
EveGuard: Defeating Vibration-based Side-Channel Eavesdropping with Audio Adversarial Perturbations
Jung-Woo Chang, Ke Sun, David Xia, Xinyu Zhang, Farinaz Koushanfar
IEEE S&P (Oakland) '25  ·  12 May 2025  ·  doi:10.1109/sp61157.2025.00235
Poster Abstract: On-Shelf Weight Difference Estimation Through Active Vibration Sensing
Poster Abstract: On-Shelf Weight Difference Estimation Through Active Vibration Sensing
Jiale Zhang, Yuyan Wu, Jesse Codling, Julia Gersey, Adeola Bannis, Carlos Ruiz Dominguez, Ke Sun, Pei Zhang
ACM SenSys '25  ·  06 May 2025  ·  doi:10.1145/3715014.3724047
Security Attacks on LLM-based Code Completion Tools
Security Attacks on LLM-based Code Completion Tools
Wen Cheng, Ke Sun, Xinyu Zhang, Wei Wang
AAAI  ·  11 Apr 2025  ·  doi:10.1609/aaai.v39i22.34537
Magmaw: Modality-Agnostic Adversarial Attacks on Machine Learning-Based Wireless Communication Systems
Magmaw: Modality-Agnostic Adversarial Attacks on Machine Learning-Based Wireless Communication Systems
Jung-Woo Chang, Ke Sun, Nasimeh Heydaribeni, Seira Hidano, Xinyu Zhang, Farinaz Koushanfar
[no publisher info]  ·  01 Jan 2025  ·  doi:10.14722/ndss.2025.230336

2024

RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF Measurements
RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF Measurements
Xingyu Chen, Zihao Feng, Ke Sun, Kun Qian, Xinyu Zhang
ACM SenSys '24  ·  04 Nov 2024  ·  doi:10.1145/3666025.3699351
Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic Signals
Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic Signals
Shiyang Wang, Xingchen Wang, Wenjun Jiang, Chenglin Miao, Qiming Cao, Haoyu Wang, Ke Sun, Hongfei Xue, Lu Su
ACM TOSN  ·  26 Aug 2024  ·  doi:10.1145/3677122
Multimodal Daily-Life Logging in Free-living Environment Using Non-Visual Egocentric Sensors on a Smartphone
Multimodal Daily-Life Logging in Free-living Environment Using Non-Visual Egocentric Sensors on a Smartphone
Ke Sun, Chunyu Xia, Xinyu Zhang, Hao Chen, Charlie Jianzhong Zhang
ACM IMWUT (UbiComp'24)  ·  06 Mar 2024  ·  doi:10.1145/3643553

2023

SCALAR: Self-Calibrated Acoustic Ranging for Distributed Mobile Devices
SCALAR: Self-Calibrated Acoustic Ranging for Distributed Mobile Devices
Lei Wang, Haoran Wan, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, Wei Wang
IEEE TMC  ·  01 Jan 2023  ·  doi:10.1109/TMC.2023.3241304
StealthyIMU: Stealing Permission-protected Private Information From Smartphone Voice Assistant Using Zero-Permission Sensors
StealthyIMU: Stealing Permission-protected Private Information From Smartphone Voice Assistant Using Zero-Permission Sensors
Ke Sun, Chunyu Xia, Songlin Xu, Xinyu Zhang
NDSS  ·  01 Jan 2023  ·  doi:10.14722/ndss.2023.24077

2022

VECTOR: Velocity Based Temperature-field Monitoring with Distributed Acoustic Devices
VECTOR: Velocity Based Temperature-field Monitoring with Distributed Acoustic Devices
Haoran Wan, Lei Wang, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, Wei Wang
ACM IMWUT (UbiComp'22)  ·  06 Sep 2022  ·  doi:10.1145/3550336
LoEar: Push the Range Limit of Acoustic Sensing for Vital Sign Monitoring
LoEar: Push the Range Limit of Acoustic Sensing for Vital Sign Monitoring
Lei Wang, Wei Li, Ke Sun, Fusang Zhang, Tao Gu, Chenren Xu, Daqing Zhang
ACM IMWUT (UbiComp'22)  ·  06 Sep 2022  ·  doi:10.1145/3550293

2021

Charging Task Scheduling for Directional Wireless Charger Networks
Charging Task Scheduling for Directional Wireless Charger Networks
Haipeng Dai, Ke Sun, Alex X. Liu, Lijun Zhang, Jiaqi Zheng, Guihai Chen
IEEE TMC  ·  01 Nov 2021  ·  doi:10.1109/tmc.2020.2997602
UltraSE: single-channel speech enhancement using ultrasound
UltraSE: single-channel speech enhancement using ultrasound
Ke Sun, Xinyu Zhang
ACM MobiCom'21  ·  09 Sep 2021  ·  doi:10.1145/3447993.3448626
ExGSense: Toward Facial Gesture Sensing with a Sparse Near-Eye Sensor Array
ExGSense: Toward Facial Gesture Sensing with a Sparse Near-Eye Sensor Array
Chen Chen, Ke Sun, Xinyu Zhang
ACM/IEEE IPSN'21  ·  18 May 2021  ·  doi:10.1145/3412382.3458268
WiTrace: Centimeter-Level Passive Gesture Tracking Using OFDM Signals
WiTrace: Centimeter-Level Passive Gesture Tracking Using OFDM Signals
Lei Wang, Ke Sun, Haipeng Dai, Wei Wang, Kang Huang, Alex X. Liu, Xiaoyu Wang, Qing Gu
IEEE TMC  ·  01 Apr 2021  ·  doi:10.1109/TMC.2019.2961885

2020

milliEgo: single-chip mmWave radar aided egomotion estimation via deep sensor fusion
milliEgo: single-chip mmWave radar aided egomotion estimation via deep sensor fusion
Chris Xiaoxuan Lu, Muhamad Risqi U. Saputra, Peijun Zhao, Yasin Almalioglu, Pedro P. B. de Gusmao, Changhao Chen, Ke Sun, Niki Trigoni, Andrew Markham
ACM SenSys'20  ·  16 Nov 2020  ·  doi:10.1145/3384419.3430776
Alexa, stop spying on me speech privacy protection against voice assistants
"Alexa, stop spying on me!" speech privacy protection against voice assistants
Ke Sun, Chen Chen, Xinyu Zhang
ACM SenSys'20  ·  16 Nov 2020  ·  doi:10.1145/3384419.3430727
SpiderMon: Towards Using Cell Towers as Illuminating Sources for Keystroke Monitoring
SpiderMon: Towards Using Cell Towers as Illuminating Sources for Keystroke Monitoring
Kang Ling, Yuntang Liu, Ke Sun, Wei Wang, Lei Xie, Qing Gu
IEEE INFOCOM'20  ·  01 Jul 2020  ·  doi:10.1109/infocom41043.2020.9155447
Dynamic Speed Warping: Similarity-Based One-shot Learning for Device-free Gesture Signals
Dynamic Speed Warping: Similarity-Based One-shot Learning for Device-free Gesture Signals
Xun Wang, Ke Sun, Ting Zhao, Wei Wang, Qing Gu
IEEE INFOCOM'20  ·  01 Jul 2020  ·  doi:10.1109/infocom41043.2020.9155491

2018

VSkin: Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals
VSkin: Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals
Ke Sun, Ting Zhao, Wei Wang, Lei Xie
ACM MobiCom'18  ·  15 Oct 2018  ·  doi:10.1145/3241539.3241568
Unlock with Your Heart: Heartbeat-based Authentication on Commercial Mobile Phones
Unlock with Your Heart: Heartbeat-based Authentication on Commercial Mobile Phones
Lei Wang, Kang Huang, Ke Sun, Wei Wang, Chen Tian, Lei Xie, Qing Gu
ACM IMWUT (UbiComp'18)  ·  18 Sep 2018  ·  doi:10.1145/3264950
Charging Task Scheduling for Directional Wireless Charger Networks
Charging Task Scheduling for Directional Wireless Charger Networks
Haipeng Dai, Ke Sun, Alex X. Liu, Lijun Zhang, Jiaqi Zheng, Guihai Chen
ACM ICPP'18  ·  13 Aug 2018  ·  doi:10.1145/3225058.3225080
Depth Aware Finger Tapping on Virtual Displays
Depth Aware Finger Tapping on Virtual Displays
Ke Sun, Wei Wang, Alex X. Liu, Haipeng Dai
ACM MobiSys'18  ·  10 Jun 2018  ·  doi:10.1145/3210240.3210315
WiTrace: Centimeter-Level Passive Gesture Tracking Using WiFi Signals
WiTrace: Centimeter-Level Passive Gesture Tracking Using WiFi Signals
Lei Wang, Ke Sun, Haipeng Dai, Alex X. Liu, Xiaoyu Wang
IEEE SECON'18  ·  01 Jun 2018  ·  doi:10.1109/sahcn.2018.8397120

2016

Device-free gesture tracking using acoustic signals
Device-free gesture tracking using acoustic signals
Wei Wang, Alex X. Liu, Ke Sun
ACM MobiCom'16  ·  03 Oct 2016  ·  doi:10.1145/2973750.2987385
Device-free gesture tracking using acoustic signals
Device-free gesture tracking using acoustic signals
Wei Wang, Alex X. Liu, Ke Sun
ACM MobiCom'16  ·  03 Oct 2016  ·  doi:10.1145/2973750.2973764