Publications -> Conference Papers

Towards Age-friendly E-commerce Through Crowd-improved Speech Recognition, Multimodal Search, and Personalized Speech Feedback


Authors: L. Meng, Q. H. Nguyen, X. Tian, Z. Shen, E. S. Chng, F. Y. Guan, C. Miao, and C. Leung
Title: Towards Age-friendly E-commerce Through Crowd-improved Speech Recognition, Multimodal Search, and Personalized Speech Feedback
Abstract: This paper presents an age-friendly system for improving the elderly’s online shopping experience. Different from most related studies focusing on website design and content organization, we propose to integrate three assistive techniques to facilitate the elderly’s browsing of products in E-commerce platforms, including the crowd-improved speech recognition, the multimodal search, and the personalized speech feedback. The first two techniques, namely, the crowd-improved speech recognition and the multimodal search, work together to allow the elderly search for desired products flexibly using either speech, an image, text, or any combination of them whichever are convenient for the elderly. The personalized speech feedback provides a speech summary of search result in a personalized voice. That is, the elderly are allowed to choose or even create their desired voices, and also can customize the voices in terms of pitch, speaking speed, and loudness. As a whole, the proposed system is expected to help and engage the elderly’s E-commerce adoption. Testing on real-world E-commerce product datasets demonstrated the usability of the proposed system.
Keywords: Age-friendly E-commerce; Enhanced user browsing; Crowd-improved speech recognition; Multimodal search; Personalized speech feedback
Conference Name: 2nd International Conference on Crowd Science and Engineering (ICCSE'17)
Location: Beijing, China
Publisher: ACM
Year: 2017
Accepted PDF File: Towards_Age-friendly_E-commerce_Through_Crowd-improved_Speech_Recognition_Multimodal_Search_and_Personalized_Speech_Feedback_accepted.pdf
Permanent Link: https://doi.org/10.1145/3126973.3129306
Reference: L. Meng, Q. H. Nguyen, X. Tian, Z. Shen, E. S. Chng, F. Y. Guan, C. Miao, and C. Leung, “Towards age-friendly e-commerce through crowd-improved speech recognition, multimodal search, and personalized speech feedback,” in Proceedings of the 2nd International Conference on Crowd Science and Engineering (ICCSE’17). ACM, July 2017, pp. 127–135.
bibtex: 
@inproceedings{LILY-c124, 
    author = {Meng, Lei and Nguyen, Quy Hy and Tian, Xiaohai and Shen, Zhiqi and Chng, Eng Siong and Guan, Frank Yunqing and Miao, Chunyan and Leung, Cyril},
    title  = {Towards Age-friendly E-commerce Through Crowd-improved Speech Recognition, Multimodal Search, and Personalized Speech Feedback},  
    booktitle = {Proceedings of the 2nd International Conference on Crowd Science and Engineering (ICCSE'17)}, 
    year  = {2017}, 
    month = {July}, 
    pages = {127-135}, 
    location = {Beijing, China},
    publisher = {ACM},
 }