计算机与现代化 ›› 2019, Vol. 0 ›› Issue (07): 47-.doi: 10.3969/j.issn.1006-2475.2019.07.009
收稿日期:
2019-02-20
出版日期:
2019-07-05
发布日期:
2019-07-08
作者简介:
陈松(1988-),男,四川阆中人,助理工程师,本科,研究方向:计算机图形学,机器学习,E-mail: 578079004@qq.com; 袁训明(1965-),男,山东寿光人,高级工程师,硕士,研究方向:计算机图形学,数字图像处理,E-mail: yxm123@asialink.com。
Received:
2019-02-20
Online:
2019-07-05
Published:
2019-07-08
摘要: 分析人脸模型的动态表情合成方法并依据它们内在特点进行分类描述。尽管这个领域已经存在较多文献,但是动态人脸表情合成仍然是非常活跃的研究热点。根据输出类型的不同,分类概览二维图像平面和三维人脸曲面上的合成算法。对于二维图像平面空间合成人脸表情主要有如下几种算法:主动表情轮廓模型驱动的人脸表情合成算法,基于拉普拉斯算子迁移计算的合成方法,使用表情比率图合成框架的表情合成算法,基于面部主特征点offset驱动的人脸表情合成算法,基于通用表情映射函数的表情合成方法和近来基于深度学习的表情合成技术。对于三维空间人脸合成则主要包括:基于物理肌肉模型的合成,基于形变的表情合成,基于三维形状线性回归的表情合成,基于脸部运动图的表情合成和近来基于深度学习的三维人脸表情合成技术。对以上每一种类别讨论它们的方法论以及其主要优缺点。本工作有望帮助未来研究者更好地定位研究方向和技术突破口。
中图分类号:
陈松,袁训明. 动态人脸表情合成的模型特征驱动算法综述[J]. 计算机与现代化, 2019, 0(07): 47-.
CHEN Song, YUAN Xun-ming. A Survey of Dynamic Human Facial Expression Synthesis 〖JZ〗Approaches Driven by Model Features[J]. Computer and Modernization, 2019, 0(07): 47-.
[1] PARKE F I, WATERS K. Computer Facial Animation[M]. A K Peters Ltd., Wellesley, Massachusetts, 1996. [2] ZHANG Q S, LIU Z C, GUO B N, et al. Geometry-driven photorealistic facial expression synthesis[J]. IEEE Transactions on Visualization and Computer Graphics, 2006,12(1):48-60. [3] LIU Z C, SHAN Y, ZHANG Z Y. Expressive expression mapping with ratio images[C]// Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. 2001:271-276. [4] TIAN L H, XIAO S J. Facial feature exaggeration according to social psychology of face perception[J]. Computer Graphics Forum, 2016,35(7):391-399. [5] YANG F, WANG J, SHECHTMAN E, et al. Expression flow for 3D-aware face component transfer[J]. ACM Transactions on Graphics, 2011,30(4): Article No. 60, DOI: 10.1145/2010324.1964955. [6] DEBEVEC P, HAWKINS T, TCHOU C, et al. Acquiring the reflectance field of a human face[C]// Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. 2000:145-156. [7] MARSCHNER S R, GUENTER B K, RAGHUPATHY S. Modeling and rendering for realistic facial animation[C]// Proceedings of the 2000 Eurographics Workshop on Rendering Techniques. 2000:231-242. [8] RIKLIN-RAVIV T, SHASHUA A. The quotient image: Class based recognition and synthesis under varying illumination conditions[C]// Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1999,2:566-571. [9] JOSHI P, TIEN W C, DESBRUN M, et al. Learning controls for blend shape based realistic facial animation[C]// Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 2003:187-192. [10]AGARWALA A, DONTCHEVA M, AGRAWALA M, et al. Interactive digital photomontage[J]. ACM Transactions on Graphics, 2004,23(3):294-302. [11]HUANG D, DE LA TORRE F. Bilinear kernel reduced rank regression for facial expression synthesis[C]// Proceedings of the 11th European Conference on Computer Vision: Part II. 2010:364-377. [12]COOTES T F, TAYLOR C J, COOPER D H, et al. Active shape models: Their training and application[J]. Computer Vision and Image Understanding, 1995,61(1):38-59. [13]COOTES T F, TAYLOR C J. Statistical Models of Appearance for Computer Vision[Z]. Manchester, United Kingdom: Manchester University, 2004. [14]BITOUK D, KUMAR N, DHILLON S, et al. Face swapping: Automatically replacing faces in photographs[J]. ACM Transactions on Graphics, 2008,27(3): Article No. 39, DOI: 10.1145/1399504.1360638. [15]FAIGIN G. The Artist’s Complete Guide to Facial Expression[M]. Watson-Guptill Publications Inc., 1990. [16]李佳,宋永红,张元林,等. 基于小波和高通滤波的人脸表情细节合成[C]// 2017中国自动化大会(CAC2017)暨国际智能制造创新大会(CIMIC2017)论文集. 2017. [17]OLSZEWSKI K, LIM J J, SAITO S, et al. High-fidelity facial and speech animation for VR HMDs[J]. ACM Transactions on Graphics, 2016,35(6):589-599. [18]SAITO S, LI T Y, LI H. Real-time facial segmentation and performance capture from RGB input[C]// Proceedings of the 2016 European Conference on Computer Vision. 2016:244-261. [19]GOODFELLOW I J, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets[C]// Proceedings of the 27th International Conference on Neural Information Processing Systems. 2014,2:2672-2680. [20]CHOI Y, CHOI M, KIM M, et al. StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation[J/OL]. (2017-11-24)[2019-01-15]. https://arxiv.org/pdf/1711.09020v1.pdf. [21]XIAO T H, HONG J P, MA J W. ELEGANT: Exchanging latent encodings with GAN for transferring multiple face attributes[C]// Proceedings of the 2018 European Conference on Computer Vision. 2018:172-187. [22]HE Z L, ZUO W M, KAN M N, et al. AttGAN: Facial Attribute Editing by Only Changing What You Want[J/OL]. (2017-12-06)[2019-01-15]. https://arxiv.org/pdf/1711.10678v2.pdf. [23]PUMAROLA A, AGUDO A, MARTINEZ A M, et al. GANimation: Anatomically-aware facial animation from a single image[C]// Proceedings of the 2018 European Conference on Computer Vision. 2018:835-851. [24]ZHOU Y Q, SHI B E. Photorealistic facial expression synthesis by the conditional difference adversarial autoencoder[C]// Proceedings of the 7th International Conference on Affective Computing and Intelligent Interaction (ACII). 2017:370-376. [25]AGARWAL S, MUKHERJEE D P. Synthesis of realistic facial expressions using expression map[J]. IEEE Transactions on Multimedia, 2019,21(4):902-914. [26]PIGHIN F, HECKER J, LISCHINSKI D, et al. Synthesizing realistic facial expressions from photographs[C]// Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques. 1998:75-84. [27]CAO C, HOU Q M, ZHOU K. Displaced dynamic expression regression for real-time facial tracking and animation[J]. ACM Transactions on Graphics, 2014,33(4):389-402. [28]CAO C, WENG Y L, LIN S, et al. 3D shape regression for real-time facial animation[J]. ACM Transactions on Graphics, 2013,32(4): Article No. 41, DOI: 10.1145/2461912.2462012. [29]KAHLER K, HABER J, YAMAUCHI H, et al. Head shop: Generating animated head models with anatomical structure[C]// Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 2002:55-63. [30]SERRA J, CETINASLAN O, RAVIKUMAR S, et al. Easy generation of facial animation using motion graphs[J]. Computer Graphics Forum, 2018,37(1):97-111. [31]THEOBALD B J, MATTHEWS I, MANGINI M, et al. Mapping and manipulating facial expression[J]. Language and Speech, 2009,52(2-3):369-386. [32]WEISE T, LI H, VAN GOOL L, et al. Face/Off: Live facial puppetry[C]// Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 2009:7-16. [33]ASTHANA A, KHWAJA A, GOECKE R. Automatic frontal face annotation and AAM building for arbitrary expressions from a single frontal image only[C]// Proceedings of the 16th IEEE International Conference on Image Processing. 2009:2445-2448. [34]HAN X G, GAO C, YU Y Z. DeepSketch2Face: A deep learning based sketching system for 3D face and caricature modeling[J]. ACM Transactions on Graphics, 2017,36(4): Article No. 126, DOI: 10.1145/3072959.3073629. [35]JACKSON A S, BULAT A, ARGYRIOU V, et al. Large pose 3D face reconstruction from a single image via direct volumetric CNN regression[C]// Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV). 2017:1031-1039. [36]FENG Y, WU F, SHAO X H, et al. Joint 3D face reconstruction and dense alignment with position map regression network[C]// Proceedings of the 2018 European Conference on Computer Vision. 2018:557-574. |
[1] | 何思达, 陈平华. 基于意图的轻量级自注意力序列推荐模型[J]. 计算机与现代化, 2024, 0(12): 1-9. |
[2] | 郑久超, 赵新元. 基于主题与描述信息的实体链接方法[J]. 计算机与现代化, 2024, 0(12): 10-14. |
[3] | 赵晨阳, 薛涛, 刘俊华. 基于改进Stable Diffusion的时尚服饰图案生成[J]. 计算机与现代化, 2024, 0(12): 15-23. |
[4] | 黄庭培1, 马禄彪1, 李世宝2, 刘建航1. 基于WiFi和原型网络的手势识别方法[J]. 计算机与现代化, 2024, 0(12): 34-39. |
[5] | 刘云海1, 冯广1, 吴晓婷2, 杨群2. 复杂施工场景下的安全帽佩戴检测算法[J]. 计算机与现代化, 2024, 0(12): 66-71. |
[6] | 王艳媛, 茅正冲. 中英文场景文本图像的检测和识别算法[J]. 计算机与现代化, 2024, 0(12): 84-90. |
[7] | 张昆1, 张永伟1, 吴永城1, 张笑文2, 翟世臣2. 基于大模型的设备故障知识图谱自动构建方法[J]. 计算机与现代化, 2024, 0(11): 46-53. |
[8] | 张志霞, 秦志毅. 基于变分模态分解和IGJO-SVR的网络舆情预测[J]. 计算机与现代化, 2024, 0(11): 77-83. |
[9] | 万鸿炜, 陈平华. 基于Involution算子和协调反向注意力的息肉图像分割[J]. 计算机与现代化, 2024, 0(11): 84-90. |
[10] | 张宇1, 2, 黎靖1, 2, 马铭1, 2, 王众祥1, 2, 孙妍1, 2. YOLOLW:一个新的轻量级目标检测模型[J]. 计算机与现代化, 2024, 0(11): 91-98. |
[11] | 董玉玟. 基于改进YOLOv7-tiny的多尺度运动目标检测算法[J]. 计算机与现代化, 2024, 0(11): 99-105. |
[12] | 祁贤, 刘大铭, 常佳鑫. 基于改进自注意力机制的多视图三维重建[J]. 计算机与现代化, 2024, 0(11): 106-112. |
[13] | 陈凯1, 李宜汀1, 2, 全华凤1 . 基于改进YOLOv8的河道废弃瓶检测方法[J]. 计算机与现代化, 2024, 0(11): 113-120. |
[14] | 杨庆五, 罗小辉, 刘鑫. 基于Edge Drawing的工业图像圆检测算法[J]. 计算机与现代化, 2024, 0(11): 121-126. |
[15] | 周安达, 唐超颖. 雨天道路场景语义分割算法及其移动端部署[J]. 计算机与现代化, 2024, 0(10): 7-13. |
阅读次数 | ||||||
全文 |
|
|||||
摘要 |
|
|||||