收稿日期:
2019-02-20
出版日期:
2019-07-05
发布日期:
2019-07-08
作者简介:
陈松(1988-),男,四川阆中人,助理工程师,本科,研究方向:计算机图形学,机器学习,E-mail: 578079004@qq.com; 袁训明(1965-),男,山东寿光人,高级工程师,硕士,研究方向:计算机图形学,数字图像处理,E-mail: yxm123@asialink.com。
Received:
2019-02-20
Online:
2019-07-05
Published:
2019-07-08
摘要: 分析人脸模型的动态表情合成方法并依据它们内在特点进行分类描述。尽管这个领域已经存在较多文献,但是动态人脸表情合成仍然是非常活跃的研究热点。根据输出类型的不同,分类概览二维图像平面和三维人脸曲面上的合成算法。对于二维图像平面空间合成人脸表情主要有如下几种算法:主动表情轮廓模型驱动的人脸表情合成算法,基于拉普拉斯算子迁移计算的合成方法,使用表情比率图合成框架的表情合成算法,基于面部主特征点offset驱动的人脸表情合成算法,基于通用表情映射函数的表情合成方法和近来基于深度学习的表情合成技术。对于三维空间人脸合成则主要包括:基于物理肌肉模型的合成,基于形变的表情合成,基于三维形状线性回归的表情合成,基于脸部运动图的表情合成和近来基于深度学习的三维人脸表情合成技术。对以上每一种类别讨论它们的方法论以及其主要优缺点。本工作有望帮助未来研究者更好地定位研究方向和技术突破口。
中图分类号:
陈松,袁训明. 动态人脸表情合成的模型特征驱动算法综述[J]. 计算机与现代化, doi: 10.3969/j.issn.1006-2475.2019.07.009.
CHEN Song, YUAN Xun-ming. A Survey of Dynamic Human Facial Expression Synthesis 〖JZ〗Approaches Driven by Model Features[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2019.07.009.
[1] PARKE F I, WATERS K. Computer Facial Animation[M]. A K Peters Ltd., Wellesley, Massachusetts, 1996. [2] ZHANG Q S, LIU Z C, GUO B N, et al. Geometry-driven photorealistic facial expression synthesis[J]. IEEE Transactions on Visualization and Computer Graphics, 2006,12(1):48-60. [3] LIU Z C, SHAN Y, ZHANG Z Y. Expressive expression mapping with ratio images[C]// Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. 2001:271-276. [4] TIAN L H, XIAO S J. Facial feature exaggeration according to social psychology of face perception[J]. Computer Graphics Forum, 2016,35(7):391-399. [5] YANG F, WANG J, SHECHTMAN E, et al. Expression flow for 3D-aware face component transfer[J]. ACM Transactions on Graphics, 2011,30(4): Article No. 60, DOI: 10.1145/2010324.1964955. [6] DEBEVEC P, HAWKINS T, TCHOU C, et al. Acquiring the reflectance field of a human face[C]// Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. 2000:145-156. [7] MARSCHNER S R, GUENTER B K, RAGHUPATHY S. Modeling and rendering for realistic facial animation[C]// Proceedings of the 2000 Eurographics Workshop on Rendering Techniques. 2000:231-242. [8] RIKLIN-RAVIV T, SHASHUA A. The quotient image: Class based recognition and synthesis under varying illumination conditions[C]// Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1999,2:566-571. [9] JOSHI P, TIEN W C, DESBRUN M, et al. Learning controls for blend shape based realistic facial animation[C]// Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 2003:187-192. [10]AGARWALA A, DONTCHEVA M, AGRAWALA M, et al. Interactive digital photomontage[J]. ACM Transactions on Graphics, 2004,23(3):294-302. [11]HUANG D, DE LA TORRE F. Bilinear kernel reduced rank regression for facial expression synthesis[C]// Proceedings of the 11th European Conference on Computer Vision: Part II. 2010:364-377. [12]COOTES T F, TAYLOR C J, COOPER D H, et al. Active shape models: Their training and application[J]. Computer Vision and Image Understanding, 1995,61(1):38-59. [13]COOTES T F, TAYLOR C J. Statistical Models of Appearance for Computer Vision[Z]. Manchester, United Kingdom: Manchester University, 2004. [14]BITOUK D, KUMAR N, DHILLON S, et al. Face swapping: Automatically replacing faces in photographs[J]. ACM Transactions on Graphics, 2008,27(3): Article No. 39, DOI: 10.1145/1399504.1360638. [15]FAIGIN G. The Artist’s Complete Guide to Facial Expression[M]. Watson-Guptill Publications Inc., 1990. [16]李佳,宋永红,张元林,等. 基于小波和高通滤波的人脸表情细节合成[C]// 2017中国自动化大会(CAC2017)暨国际智能制造创新大会(CIMIC2017)论文集. 2017. [17]OLSZEWSKI K, LIM J J, SAITO S, et al. High-fidelity facial and speech animation for VR HMDs[J]. ACM Transactions on Graphics, 2016,35(6):589-599. [18]SAITO S, LI T Y, LI H. Real-time facial segmentation and performance capture from RGB input[C]// Proceedings of the 2016 European Conference on Computer Vision. 2016:244-261. [19]GOODFELLOW I J, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets[C]// Proceedings of the 27th International Conference on Neural Information Processing Systems. 2014,2:2672-2680. [20]CHOI Y, CHOI M, KIM M, et al. StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation[J/OL]. (2017-11-24)[2019-01-15]. https://arxiv.org/pdf/1711.09020v1.pdf. [21]XIAO T H, HONG J P, MA J W. ELEGANT: Exchanging latent encodings with GAN for transferring multiple face attributes[C]// Proceedings of the 2018 European Conference on Computer Vision. 2018:172-187. [22]HE Z L, ZUO W M, KAN M N, et al. AttGAN: Facial Attribute Editing by Only Changing What You Want[J/OL]. (2017-12-06)[2019-01-15]. https://arxiv.org/pdf/1711.10678v2.pdf. [23]PUMAROLA A, AGUDO A, MARTINEZ A M, et al. GANimation: Anatomically-aware facial animation from a single image[C]// Proceedings of the 2018 European Conference on Computer Vision. 2018:835-851. [24]ZHOU Y Q, SHI B E. Photorealistic facial expression synthesis by the conditional difference adversarial autoencoder[C]// Proceedings of the 7th International Conference on Affective Computing and Intelligent Interaction (ACII). 2017:370-376. [25]AGARWAL S, MUKHERJEE D P. Synthesis of realistic facial expressions using expression map[J]. IEEE Transactions on Multimedia, 2019,21(4):902-914. [26]PIGHIN F, HECKER J, LISCHINSKI D, et al. Synthesizing realistic facial expressions from photographs[C]// Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques. 1998:75-84. [27]CAO C, HOU Q M, ZHOU K. Displaced dynamic expression regression for real-time facial tracking and animation[J]. ACM Transactions on Graphics, 2014,33(4):389-402. [28]CAO C, WENG Y L, LIN S, et al. 3D shape regression for real-time facial animation[J]. ACM Transactions on Graphics, 2013,32(4): Article No. 41, DOI: 10.1145/2461912.2462012. [29]KAHLER K, HABER J, YAMAUCHI H, et al. Head shop: Generating animated head models with anatomical structure[C]// Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 2002:55-63. [30]SERRA J, CETINASLAN O, RAVIKUMAR S, et al. Easy generation of facial animation using motion graphs[J]. Computer Graphics Forum, 2018,37(1):97-111. [31]THEOBALD B J, MATTHEWS I, MANGINI M, et al. Mapping and manipulating facial expression[J]. Language and Speech, 2009,52(2-3):369-386. [32]WEISE T, LI H, VAN GOOL L, et al. Face/Off: Live facial puppetry[C]// Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 2009:7-16. [33]ASTHANA A, KHWAJA A, GOECKE R. Automatic frontal face annotation and AAM building for arbitrary expressions from a single frontal image only[C]// Proceedings of the 16th IEEE International Conference on Image Processing. 2009:2445-2448. [34]HAN X G, GAO C, YU Y Z. DeepSketch2Face: A deep learning based sketching system for 3D face and caricature modeling[J]. ACM Transactions on Graphics, 2017,36(4): Article No. 126, DOI: 10.1145/3072959.3073629. [35]JACKSON A S, BULAT A, ARGYRIOU V, et al. Large pose 3D face reconstruction from a single image via direct volumetric CNN regression[C]// Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV). 2017:1031-1039. [36]FENG Y, WU F, SHAO X H, et al. Joint 3D face reconstruction and dense alignment with position map regression network[C]// Proceedings of the 2018 European Conference on Computer Vision. 2018:557-574. |
[1] | 付鸿林, 张太红, 杨雅婷, 艾孜麦提·艾瓦尼尔, 马 博. 基于生成对抗网络的维语场景文字修改网络[J]. 计算机与现代化, 2024, 0(01): 41-46. |
[2] | 王秋忆, 周 浩, 郑婷婷. 改进RetinaNet的电力设备目标检测方法[J]. 计算机与现代化, 2024, 0(01): 47-52. |
[3] | 林启钊, 彭志平, 郭 棉, 崔得龙. 基于双向多步预测的炉管温度场重构方法[J]. 计算机与现代化, 2024, 0(01): 53-58. |
[4] | 郑立瑞, 肖晓霞, 邹北骥, 刘 彬, 周 展. 基于BERT的电子病历命名实体识别[J]. 计算机与现代化, 2024, 0(01): 87-91. |
[5] | 李颖颖, 黄文培. 基于优化八叉树的场景视锥体裁剪算法[J]. 计算机与现代化, 2024, 0(01): 103-108. |
[6] | 夏千涵, 何胜煌, 吴元清, 赵乐乐. 基于可学习记忆特征金字塔网络的小样本目标检测[J]. 计算机与现代化, 2023, 0(12): 7-13. |
[7] | 周成诚, 曾庆军, 杨 康, 胡家铭, 韩春伟. 基于高效通道注意力模块的运动想象脑电识别[J]. 计算机与现代化, 2023, 0(12): 19-23. |
[8] | 曾伟平, 陈俊洪, Muhammad ASIM, 刘文印, 杨振国. 基于多阶段分形组合的点云补全算法[J]. 计算机与现代化, 2023, 0(12): 24-29. |
[9] | 白晓波, 江梦茜, 王铁山, 邵景峰, 李 勃, . 聚类质心与指数递减方法改进的哈里斯鹰算法[J]. 计算机与现代化, 2023, 0(12): 30-35. |
[10] | 邱凯星, 冯 广. 基于双重特征注意力的多标签图像分类模型[J]. 计算机与现代化, 2023, 0(12): 41-47. |
[11] | 杜 康, 郭鲁钰, 徐啟蕾, 单宝明, 张方坤. 基于模型种群分析变量选择的红外光谱建模方法[J]. 计算机与现代化, 2023, 0(12): 48-52. |
[12] | 刘语珵, 贺 奇, 董延华, 王晓宇. 结合时间相关度与课程搭配度的课程推荐方法[J]. 计算机与现代化, 2023, 0(12): 53-58. |
[13] | 张浩洋, 尹梓名, 乐珺怡, 沈达聪, 束翌俊, 杨自逸, 孔祥勇, 龚 伟. 3D-SPRNet: 一种基于并行解码器和双注意力机制的胆囊癌分割模型[J]. 计算机与现代化, 2023, 0(12): 59-66. |
[14] | 张伯泉, 麦海鹏, 陈嘉敏, 逄锦聚. 基于高灰度值注意力机制的脑白质高信号分割[J]. 计算机与现代化, 2023, 0(12): 67-75. |
[15] | 张在成, 李 健. 改进的神经渲染方法在建筑施工场景中的应用[J]. 计算机与现代化, 2023, 0(12): 76-81. |
阅读次数 | ||||||
全文 |
|
|||||
摘要 |
|
|||||