{"response":{"award":[{"abstractText":"Video conferencing applications have been broadly used to connect geographically distant people for work, school, and social interactions. Because they use audio and video, and these can show information about a participant's behavior and environment, people choose to turn off microphones or cameras when they have related privacy concerns. However, microphones and cameras may leak other kinds of information beyond the semantics of what is seen and heard, raising privacy risks people are unaware of.  This project's goal is to examine those risks, looking at the many sensitive \"micro signals\" that are sent over the network through the legitimate visual and acoustic channels of video conferencing. These signals are too tiny for humans to recognize, but detectable by machines, and through careful signal processing they might inadvertently reveal information about people's location, off-camera behavior, interaction with their computer, and other things people might want to keep private. Through better understanding the risks and developing methods to mitigate them, this project will advance understanding of side channel attacks and increase online meeting privacy. The project also contributes to cyber security education through curriculum development, demo platform implementation, graduate/undergraduate student training, K-12 involvement, public outreach, and underrepresented student engagement in research.\r\n\r\nThis project advances the knowledge of acoustic sensing and visual sensing and brings the security protection of video conferencing down to the micro signal level. It exploits the two-way audio channel of video conferencing to send malicious acoustic signals remotely, which sense the user's current physical surroundings and return to the attacker with location-specific echo signals. Deep learning algorithms are developed to circumvent the echo cancellation mechanisms enforced by audio streaming systems, maximizing the retrieval of sensitive echoes for attackers. The project further uncovers the user's on-screen inputs during video calls, which are out of the webcam's view and believed to be safe, including online voting choices, touchscreen device inputs, and physical keyboard typing. The user's eye motions, keystroke-induced camera vibrations, and the monitor's screen lights are exploited for privacy inference. To prevent privacy leakage from micro signals, this project develops both targeted defense approaches, which address each attack separately, and general micro-signal removal techniques based on compression and decompression, which can handle different micro-signal attacks and their variants.\r\n\r\nThis award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.","activeAwd":"true","agency":"NSF","awardAgencyCode":"4900","awardee":"SOUTHERN METHODIST UNIVERSITY","awardeeAddress":"6425 BOAZ ST RM 130","awardeeCity":"DALLAS","awardeeCountryCode":"US","awardeeDistrict":"24","awardeeDistrictCode":"TX24","awardeeName":"Southern Methodist University","awardeePhone":"2147684708","awardeeStateCode":"TX","awardeeZipCode":"752051902","cfdaNumber":"47.070","date":"08/28/2024","dirAbbr":"CSE","divAbbr":"CPIS","estimatedTotalAmt":"619920","expDate":"05/31/2029","fundAgencyCode":"4900","fundProgramName":"Secure &Trustworthy Cyberspace","fundsObligated":["FY 2024 = $251,830.00","FY 2026 = $122,154.00"],"fundsObligatedAmt":"373984","histAwd":"false","id":"2440238","initAmendmentDate":"08/28/2024","jrnl":[{"artTitl":"Your Eyes Won't Lie: Snooping Online Voting Privacy from User Webcam","auth":"Deng, Zeyu and Zhang, Jingwei and Wang, Chen","authIndCode":"N","dgtlObjId":"https://doi.org/10.1109/SP63933.2026.00232","jrnlYr":"2026","parPblcId":"10684876"},{"artTitl":"Sniffing Location Privacy of Video Conference Users Using Free Audio Channels","auth":"Huang, Long and Wang, Chen","authIndCode":"N","dgtlObjId":"https://doi.org/10.1109/SP61157.2025.00260","jrnlYr":"2025","parPblcId":"10683664"},{"artTitl":"Your Robotic Desktop Companion: Privacy-Preserving Webcam for Video Conferencing via Motion-Augmented Human Perception","auth":"Deng, Zeyu and Shrestha, Anish and Zhang, Jingwei and Wang, Chen","authIndCode":"N","dgtlObjId":"https://doi.org/10.1109/ICCE67443.2026.11449876","jrnlYr":"2026","parPblcId":"10683666"},{"artTitl":"DrinkMR: Unobtrusive Drinking Monitoring Using Off-The-Shelf Smart Glasses","auth":"Wang, Ruxin and Gonzalez, Gabrielle and Liu, Wen and Wang, Chen and Tseng, Tung-Sung","authIndCode":"N","dgtlObjId":"https://doi.org/10.1109/MASS66014.2025.00026","jrnlYr":"2025","parPblcId":"10683670"}],"latestAmendmentDate":"07/01/2026","managingPec":"806000","orgCodeDir":"05000000","orgCodeDiv":"05240000","orgLongName":"Directorate for Computer and Information Science and Engineering","orgLongName2":"Cyber, Physical, & Intelligent Systems","orgUrl":"https://www.nsf.gov/cise","parentUeiNumber":"","pdPIName":"Chen Wang","perfAddress":"6425 BOAZ ST RM 130","perfCity":"DALLAS","perfCountryCode":"US","perfDistrict":"24","perfDistrictCode":"TX24","perfLocation":"Southern Methodist University","perfStateCode":"TX","perfZipCode":"752051902","pi":["Chen Wang cwang6@smu.edu"],"piEmail":"cwang6@smu.edu","piFirstName":"Chen","piId":"270037953","piLastName":"Wang","poEmail":"yduan@nsf.gov","poName":"Andy Duan","poPhone":"7032924286","primaryProgram":["01002829DB NSF RESEARCH & RELATED ACTIVIT","01002425DB NSF RESEARCH & RELATED ACTIVIT","01002627DB NSF RESEARCH & RELATED ACTIVIT","01002728DB NSF RESEARCH & RELATED ACTIVIT"],"progEleCode":"806000","program":"SaTC: Secure and Trustworthy Cyberspace, CAREER-Faculty Erly Career Dev, EXP PROG TO STIM COMP RES","progRefCode":"025Z, 1045, 9150","publicAccessMandate":"1","publicationResearch":["2026~Deng, Zeyu and Zhang, Jingwei and Wang, Chen~https://doi.org/10.1109/SP63933.2026.00232~Your Eyes Won't Lie: Snooping Online Voting Privacy from User Webcam~N~10684876~10684876~OSTI~2026-09-26 23:12:58.246","2025~Huang, Long and Wang, Chen~https://doi.org/10.1109/SP61157.2025.00260~Sniffing Location Privacy of Video Conference Users Using Free Audio Channels~N~10683664~10683664~OSTI~2026-05-17 18:27:41.676","2026~Deng, Zeyu and Shrestha, Anish and Zhang, Jingwei and Wang, Chen~https://doi.org/10.1109/ICCE67443.2026.11449876~Your Robotic Desktop Companion: Privacy-Preserving Webcam for Video Conferencing via Motion-Augmented Human Perception~N~10683666~10683666~OSTI~2026-05-17 18:27:41.95","2025~Wang, Ruxin and Gonzalez, Gabrielle and Liu, Wen and Wang, Chen and Tseng, Tung-Sung~https://doi.org/10.1109/MASS66014.2025.00026~DrinkMR: Unobtrusive Drinking Monitoring Using Off-The-Shelf Smart Glasses~N~10683670~10683670~OSTI~2026-05-17 18:27:42.726"],"startDate":"06/01/2024","title":"CAREER: Investigating and Combating Micro Signal Attacks in Video Conferencing","transType":"Continuing Grant","ueiNumber":"D33QGS3Q3DJ3"}],"metadata":{"offset":0,"rpp":25,"totalCount":1}}}