A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera

NSSC OpenIR > 空间技术部

	A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera
	Zhu, Ge; Yao, Xu-Ri; Sun, Zhi-Bin; Qiu, Peng; Wang, Chao; Zhai, Guang-Jie; Zhao, Qing; Zhao, Q (reprint author), Beijing Inst Technol, Sch Phys, Ctr Quantum Technol Res, Beijing 100081, Peoples R China.; Yao, XR (reprint author), Chinese Acad Sci, Natl Space Sci Ctr, Key Lab Elect & Informat Technol Space Syst, Beijing 100190, Peoples R China.
作者部门	空间技术部
发表期刊	SENSORS
	2018
卷号	18 期号:5 页码:1524
ISSN	1424-8220
语种	英语
关键词	Sound Recovery High-speed Imaging Compressive Sensing Computational Imaging Remote Sensing Vibration Analysis
摘要	This paper reports an efficient method for sound extraction from high-speed light spot videos reconstructed from the coded light spot images captured with a low-speed camera based on compressive sensing, but at the expense of consuming time. The proposed method first gets the high-speed video of the light spot that is illuminated on the vibrating target caused by sound. Then the centroid of the light spot is used to recover the sound. Simulations of the proposed method are carried out and experimental results are demonstrated. The results show that high-speed videos with a frame rate of 2000 Hz can be reconstructed with a low-speed (100 Hz) charge-coupled device (CCD) camera, which is randomly modulated by a digital micro-mirror device (DMD) 20 times during each exposure time. This means a speed improvement of 20 times is achieved. The effects of synchronization between CCD image recording and DMD modulation, the optimal sampling patterns of DMD, and sound vibration amplitudes on the performance of the proposed method are evaluated. Using this compressive camera, speech (counting from one to four in Chinese) was recovered well. This has been confirmed by directly listening to the recovered sound, and the intelligibility value (0-1) that evaluated the similarity between them was 0.8185. Although we use this compressive camera for sound detection, we expect it to be useful in applications related to vibration and motion.
收录类别	SCI
文献类型	期刊论文
条目标识符	http://ir.nssc.ac.cn/handle/122/6392
专题	空间技术部
通讯作者	Zhao, Q (reprint author), Beijing Inst Technol, Sch Phys, Ctr Quantum Technol Res, Beijing 100081, Peoples R China.; Yao, XR (reprint author), Chinese Acad Sci, Natl Space Sci Ctr, Key Lab Elect & Informat Technol Space Syst, Beijing 100190, Peoples R China.
推荐引用方式 GB/T 7714	Zhu, Ge,Yao, Xu-Ri,Sun, Zhi-Bin,et al. A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera[J]. SENSORS,2018,18(5):1524.
APA	Zhu, Ge.,Yao, Xu-Ri.,Sun, Zhi-Bin.,Qiu, Peng.,Wang, Chao.,...&Yao, XR .(2018).A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera.SENSORS,18(5),1524.
MLA	Zhu, Ge,et al."A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera".SENSORS 18.5(2018):1524.

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
20181851524.pdf（6972KB）	期刊论文	作者接受稿	开放获取	CC BY-NC-SA	请求全文