一种基于音频匹配的广告检测算法

doi:10.3969/j.issn.1006-2475.2014.02.001

计算机与现代化

• 人工智能 • 下一篇

一种基于音频匹配的广告检测算法

(1.复旦大学计算机科学技术学院，上海 201203； 2.东方有线网络有限公司，上海 201203)

收稿日期:2013-11-25 出版日期:2014-02-14 发布日期:2014-02-14
作者简介:赵花婷(1989-)，女，河南濮阳人，复旦大学计算机科学技术学院硕士研究生，研究方向：多媒体信息检索; 王明敏(1973-)，女，上海人，东方有线网络有限公司高级工程师，复旦大学计算机科学技术学院博士研究生，研究方向：电视视频分析与处理。
基金资助:
国家863计划基金资助项目(2011AA01A100); 上海市科委项目(12dz1500203, 12511505303)

An Approach of Commercials Detection Based on Audio-match

(1. School of Computer Science, Fudan University, Shanghai 201203, China;
2. Shanghai OCN Co., Ltd., Shanghai 201203, China)

Received:2013-11-25 Online:2014-02-14 Published:2014-02-14

摘要/Abstract

摘要： 广告检测是指从电视节目中自动地检测出广告序列。传统方法使用基于计算机视觉算法的技术框架对视频内容进行广告检测，无法在性能和效率上满足商业化需求。本算法仅利用广告音频信息完成广告检测工作。首先抽取广告库的原始音频信息，使用短时傅里叶变换将其转化为声谱图，再应用预筛选的滤波器集合进行二值化，得到局部特征描述子，组成广告音频库；其次在广告检测过程中，以同样方法提取其特征描述子，在广告音频库中检索得到检测结果。基于音频匹配的广告检测算法具有存储小、准确度高、实时性强等诸多优点。实验表明该算法可以显著提高广告检测系统的鲁棒性和性能，可应用于现实场景中。

关键词: 广告检测, 音频匹配, 声谱图, 哈尔特征, 特征描述子, 分界点, 平滑

Abstract: Commercials detection is to extract advertising sequence out of TV shows automatically. In traditional ways, it adopted algorithm based on computer vision technology framework to detect advertisement in terms of video content. But it wouldn’t meet the demands on performance or efficiency for commercial usage. The algorithm described here used only audio information for detection. It first extracted original audio information from video, then used short-time Fourier transform to transform it into a spectrogram. And it applied binary threshold with a set of pre-boosting filters to get local feature descriptors. During the detect phase, it obtained descriptors in the same methods described above, and detected results in offline descriptor library. Audio-based detection algorithm for commercials detection had smaller storage, higher accuracy, and better real-time. Experiments showed that this algorithm could significantly improve robustness and performance of commercials detection systems, and can be applied in reality.

Key words: commercials detection, audio-match, spectrogram, Haar-like feature, feature descriptor, bounding point, smooth

中图分类号:

TP391

赵花婷1，王明敏1,2. 一种基于音频匹配的广告检测算法[J]. 计算机与现代化, doi: 10.3969/j.issn.1006-2475.2014.02.001.

ZHAO Hua-ting1, WANG Ming-min1,2 . An Approach of Commercials Detection Based on Audio-match[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2014.02.001.

参考文献 17

[1]	Lienhart R, Kuhmunch C, Effelsberg W. On the detection and recognition of television commercials[C]// Proceedings of the 1997 IEEE International Conference on Multimedia Computing and Systems. Ottawa, Canada, 1997:509-516.
[2]	Ke Y, Sukthankar R, Huston L. Efficient near-duplicate detection and sub-image retrieval[C]// Proceedings of the 2004 ACM International Conference on Multimedia. New York, USA, 2004:869-876.
[3]	Sadlier D A, Marlov S, O’Connor N E, et al. Automatic TV advertisement detection from MPEG bitstream[C]// Proceedings of the 1st International Workshop on Pattern Recognition in Information Systems. Setubal, Portugal, 2001:14-25.
[4]	Hua X S, Lu L, Zhang H J. Robust learning-based TV commercial detection[C]// Proceedings of the 2005 IEEE International Conference on Multimedia and Expo. 2005:149-152.
[5]	丁汝一,杨宁,董道国. 音视频相结合的广告检测算法[J]. 计算机工程与应用, 2012,48(22):184-188.
[6]	Ke Y, Hoiem D, Sukthankar R. Computer vision for music identification[C]// Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2005:597-604.
[7]	Jurado F, Saenz J R. Comparison between discrete STFT and wavelets for the analysis of power quality events[J]. Electric Power Systems Research, 2002,62(3):183-190.
[8]	Jones M, Viola P. Face Recognition Using Boosted Local Features[R]. Technical Report MERL-TR-2003-25, Mitsubishi Electric Research Laboratories, 2003.
[9]	Viola P, Jones M. Rapid object detection using a boosted cascade of simple features[C]// Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2001,1:511-518.
[10]	Schapire R E, Singer Y. Improved boosting algorithms using confidence-rated predictions[J]. Machine Learning, 1999,37(3):297-336.
[11]	Indyk P, Motwani R. Approximate nearest neighbors: Towards removing the curse of dimensionality[C]// Proceedings of the 30th Annual ACM Symposium on Theory of Computing. 1998:604-613.
[12]	Gionis A, Indyk P, Motwani R. Similarity search in high dimensions via hashing[C]// Proceedings of the 25th International Conference on Very Large Data Bases. 1999:518-529.
[13]	Bhattacharryya D K, Nandi S. An efficient class of SEC-DED-AUED codes[C]// Proceedings of the 1997 International Symposium on Parallel Architectures, Algorithms and Networks. 1997:410-416.
[14]	Lowe D G. Object recognition from local scale-invariant features[C]// Proceedings of the 7th IEEE International Conference on Computer Vision. 1999,2:1150-1157.
[15]	Fischler M A, Bolles R C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981,24(6):381-395.
[16]	McLachlan G, Krishnan T. The EM Algorithm and Extensions[M]. Wiley-Interscience, 1997.
[17]	Duan L Y, Wang J, Zheng Y, et al. Segmentation, categorization, and identification of commercials from TV streams using multimodal analysis[C]// Proceedings of the 14th Annual ACM International Conference on Multimedia. 2006:201-210.

一种基于音频匹配的广告检测算法

An Approach of Commercials Detection Based on Audio-match

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献 17

相关文章 12

编辑推荐

Metrics

本文评价

[1]	杜传胜, 高焕兵, 侯宇翔, 汪子建. 基于改进双向A*算法的消防机器人路径规划[J]. 计算机与现代化, 2023, 0(04): 15-19.
[2]	张骁, 吕继宇, 赵爽, 吴羽纶, 王春乐. 基于多卷积神经网络融合的SAR舰船分类[J]. 计算机与现代化, 2023, 0(01): 37-42.
[3]	徐鑫强, 何鹏, . 基于图过滤框架对图卷积滤波器灵活性的研究[J]. 计算机与现代化, 2022, 0(03): 103-110.
[4]	顾国庆, 李晓辉. 基于箱线图异常检测的指数加权平滑预测模型[J]. 计算机与现代化, 2021, 0(01): 28-33.
[5]	王宇飞1,杜天苍1,2. 基于Holt-Winters的时间序列预测在大数据监控系统中的分析与应用[J]. 计算机与现代化, 2019, 0(11): 29-.
[6]	王晓萍1，孟坤2. 基于约束处理和平滑技术的改进的进化算法[J]. 计算机与现代化, 2014, 0(9): 1-5.
[7]	戴曾1，2，廖闻剑2，彭艳兵2. 马尔科夫模型改进的时间序列预测算法研究[J]. 计算机与现代化, 2014, 0(11): 66-71.
[8]	郭峰;刘臣宇;李卫灵. 基于指数平滑法的航材消耗定额预测研究[J]. 计算机与现代化, 2012, 1(9): 163-165.
[9]	卢尧;陈蜀宇;姚章俊;刘小威. 一种高性能的TCP Vegas改进算法[J]. 计算机与现代化, 2012, 198(2): 102-107.
[10]	张华娣. 一种基于小波阈值的图像增强改进算法[J]. 计算机与现代化, 2010, 1(9): 12-15.
[11]	赵敏涯. 结合语言模型的自动文本分类的应用研究[J]. 计算机与现代化, 2010, 1(3): 141-3.
[12]	沈志超. 软件产品平滑升级的设计实现[J]. 计算机与现代化, 2009, 8(8): 157-160.