臺灣博碩士論文加值系統

目　錄
摘　要 I
ABSTRACT II
誌　謝 III
目　錄 IV
圖目錄 VI
第一章 緒論 1
1.1 背景與研究動機 1
1.2 預期貢獻 3
1.3 論文架構 4
第二章 文獻探討 6
2.1 虛擬廣告 6
2.2 廣告偵測 9
2.3 角點檢測 11
2.4 光流法 16
2.4.1 Lucas-Kanade光流法 17
第三章 研究方法 19
3.1 系統流程 19
3.2 候選幀建立 21
3.2.1 物件偵測 21
3.2.2 建立候選幀 22
3.3 可嵌入區域選定 23
3.3.1 影像分割 23
3.3.2 邊緣特徵 24
3.4 虛擬廣告影像嵌入 27
3.5 嵌入區域追蹤 29
3.5.1 角點特徵檢測 29
3.5.2 畫面特徵增強 30
3.5.3 Pyramid Lucas-Kanade稀疏光流法 30
第四章 實驗結果 32
4.1 實驗說明 32
4.2 實驗結果 33
4.2.1 實驗一：建立候選幀對廣告招牌定位效果的影響 33
4.2.2 實驗二：畫面特徵增強對廣告招牌追蹤效果的影響 35
4.3 廣告圖片嵌入及嵌入區域追蹤效果 37
第五章 結論與未來展望 39
參　考　文　獻 40

[1]J. L. H. Frade, J. H. C. de Oliveira, and J. de M. E. Giraldi, “Advertising in streaming video: An integrative literature review and research agenda,” Telecommun. Policy, vol. 45, no. 9, p. 102186, Oct. 2021, doi: 10.1016/j.telpol.2021.102186.
[2]M. Pashkevich, S. Dorai-Raj, M. Kellar, and D. Zigmond, “Empowering Online Advertisements by Empowering Viewers with the Right to Choose: The Relative Effectiveness of Skippable Video Advertisements on YouTube,” J. Advert. Res., vol. 52, no. 4, pp. 451–457, Dec. 2012, doi: 10.2501/JAR-52-4-451-457.
[3]G. Cai, L. Chen, and J. Li, “Billboard advertising detection in sport TV,” in Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings., Jul. 2003, vol. 1, pp. 537–540 vol.1. doi: 10.1109/ISSPA.2003.1224759.
[4]C. Xu, K. W. Wan, S. H. Bui, and Q. Tian, “Implanting Virtual Advertisement into Broadcast Soccer Video,” pp. 264–271, 2004.
[5]Y. Li, K. W. Wan, X. Yan, and C. Xu, “Real time advertisement insertion in baseball video based on advertisement effect,” in Proceedings of the 13th annual ACM international conference on Multimedia, New York, NY, USA, Nov. 2005, pp. 343–346. doi: 10.1145/1101149.1101221.
[6]A. Patel and P. Patel, “Virtual Advertisement with Live Entertainment Program for Real-Time Video Application,” in 2010 International Conference on Advances in Computer Engineering, Jun. 2010, pp. 319–322. doi: 10.1109/ACE.2010.30.
[7]V. K. Ghassab, K. Maanicshah, N. Bouguila, and P. Green, “REP-Model: A deep learning framework for replacing ad billboards in soccer videos,” in 2020 IEEE International Symposium on Multimedia (ISM), Dec. 2020, pp. 149–153. doi: 10.1109/ISM.2020.00032.
[8]V. K. Ghassab, K. Maanicshah, P. Green, and N. Bouguila, “Content modification of soccer videos using a supervised deep learning framework,” Multimed. Tools Appl., Sep. 2021, doi: 10.1007/s11042-021-11383-0.
[9]W. Chen, J.-S. Yeh, and T.-L. Chia, “Automatic insertion of advertisements into a video sequence,” in 2010 International Conference on Machine Learning and Cybernetics, Jul. 2010, vol. 4, pp. 2121–2126. doi: 10.1109/ICMLC.2010.5580493.
[10]H. Liu, S. Jiang, Q. Huang, and C. Xu, “Lower attentive region detection for virtual content insertion in broadcast video,” in 2008 IEEE International Conference on Multimedia and Expo, Jun. 2008, pp. 1529–1532. doi: 10.1109/ICME.2008.4607738.
[11]Y. Huang, Q. Hao, and H. Yu, “Virtual ads insertion in street building views for augmented reality,” in 2011 18th IEEE International Conference on Image Processing, Sep. 2011, pp. 1117–1120. doi: 10.1109/ICIP.2011.6115623.
[12]Kim, Joohyeon and Park, Jong-Il, “Signboard Replacement in Video clip,” J. Broadcast Eng., vol. 22, no. 3, pp. 339–349, May 2017, doi: 10.5909/JBE.2017.22.3.339.
[13]I. Bacher等, 作者, 「An Advert Creation System for 3D Product Placements」, ArXiv200615131 Cs, 6月 2020. [線上]. 載於: http://arxiv.org/abs/2006.15131
[14]M. Hossari等, 作者, 「ADNet: A Deep Network for Detecting Adverts」, ArXiv181104115 Cs, 11月 2018. [線上]. 載於: http://arxiv.org/abs/1811.04115
[15]J. Li, X. Gong, and B. Li, “End-to-End Texture-Aware and Depth-Aware Embedded Advertising for Videos,” in Proceedings of the 2020 6th International Conference on Computer and Technology Applications, New York, NY, USA, Apr. 2020, pp. 57–61. doi: 10.1145/3397125.3397133.
[16]R. Girshick, J. Donahue, T. Darrell, and J. Malik, “Rich feature hierarchies for accurate object detection and semantic segmentation.” arXiv, Oct. 22, 2014. doi: 10.48550/arXiv.1311.2524.
[17]R. Girshick, “Fast R-CNN.” arXiv, Sep. 27, 2015. doi: 10.48550/arXiv.1504.08083.
[18]S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.” arXiv, Jan. 06, 2016. doi: 10.48550/arXiv.1506.01497.
[19]J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” ArXiv150602640 Cs, May 2016, Accessed: Nov. 17, 2021. [Online]. Available: http://arxiv.org/abs/1506.02640
[20]T.-Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollár, “Focal Loss for Dense Object Detection.” arXiv, Feb. 07, 2018. Accessed: Aug. 18, 2022. [Online]. Available: http://arxiv.org/abs/1708.02002
[21]W. Liu et al., “SSD: Single Shot MultiBox Detector,” vol. 9905, 2016, pp. 21–37. doi: 10.1007/978-3-319-46448-0_2.
[22]M. Tan, R. Pang, and Q. V. Le, “EfficientDet: Scalable and Efficient Object Detection.” arXiv, Jul. 27, 2020. doi: 10.48550/arXiv.1911.09070.
[23]Á. Morera, Á. Sánchez, A. B. Moreno, Á. D. Sappa, and J. F. Vélez, “SSD vs. YOLO for Detection of Outdoor Urban Advertising Panels under Multiple Variabilities,” Sensors, vol. 20, no. 16, p. 4587, Aug. 2020, doi: 10.3390/s20164587.
[42]S. Dev et al., “The CASE Dataset of Candidate Spaces for Advert Implantation,” ArXiv190308943 Cs, Apr. 2019, Accessed: Dec. 20, 2021. [Online]. Available: http://arxiv.org/abs/1903.08943
[25]H. P. Moravec, 作者, 「Towards Automatic Visual Obstacle Avoidance」, 1976年2月27日. https://dl.acm.org/doi/10.5555/1623264.1623280.
[26]“手写计算机视觉算法：Moravec角点检测算子,” Secret Land. http://zhaoxuhui.top/blog/2019/01/10/MoravecCornerDetection.html .
[27]C. Harris and M. Stephens, “A combined corner and edge detector,” in In Proc. of Fourth Alvey Vision Conference, 1988, pp. 147–151.
[28]D. Tyagi, “Introduction to Harris Corner Detector,” Data Breach, Apr. 07, 2020. https://medium.com/data-breach/introduction-to-harris-corner-detector-32a88850b3f6 (accessed Sep. 06, 2022).
[29]J. Shi and Tomasi, “Good features to track,” in 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Jun. 1994, pp. 593–600. doi: 10.1109/CVPR.1994.323794.
[30]“OpenCV: Shi-Tomasi Corner Detector & Good Features to Track.” https://docs.opencv.org/3.4/d4/d8c/tutorial_py_shi_tomasi.html
[31]J. J. Gibson, The Perception of the Visual World. 1950.
[32]“光流法（optical flow methods）,” 知乎专栏. https://zhuanlan.zhihu.com/p/384651830
[33]B. Lucas and T. Kanade, “An Iterative Image Registration Technique with an Application to Stereo Vision (IJCAI),” Apr. 1981, vol. 81.
[34]李健平/Jianping Li, “Optical flow.” http://jianping.xyz/opticalflow/
[30]「Open Images V6」. https://storage.googleapis.com/openimages/web/index.html.
[36]“Canny边缘检测算法,” . https://zhuanlan.zhihu.com/p/42122107
[37]K. Wan and C. Xu, “Automatic Content Placement in Sports Highlights,” in 2006 IEEE International Conference on Multimedia and Expo, Jul. 2006, pp. 1893–1896. doi: 10.1109/ICME.2006.262925.
[38]A. Toheed, A. Javed, A. Irtaza, H. Dawood, H. Dawood, and A. S. Alfakeeh, “An automated framework for advertisement detection and removal from sports videos using audio-visual cues,” Front. Comput. Sci., vol. 15, no. 2, p. 152313, Apr. 2021, doi: 10.1007/s11704-019-9187-9.
[39]Z. Hussain et al., “Automatic Understanding of Image and Video Advertisements,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, Jul. 2017, pp. 1100–1110. doi: 10.1109/CVPR.2017.123.
[40]T. Intasuwan, J. Kaewthong, and S. Vittayakorn, “Text and Object Detection on Billboards,” in 2018 10th International Conference on Information Technology and Electrical Engineering (ICITEE), Kuta, Jul. 2018, pp. 6–11. doi: 10.1109/ICITEED.2018.8534879.
[41]X. Chen, T. V. Nguyen, Z. Shen, and M. Kankanhalli, “LiveSense: Contextual Advertising in Live Streaming Videos,” in Proceedings of the 27th ACM International Conference on Multimedia, Nice France, Oct. 2019, pp. 392–400. doi: 10.1145/3343031.3350888.
[42]S. Dev et al., “The CASE Dataset of Candidate Spaces for Advert Implantation,” ArXiv190308943 Cs, Apr. 2019, Accessed: Dec. 20, 2021. [Online]. Available: http://arxiv.org/abs/1903.08943
[43]S. Dev et al., “The ALOS Dataset for Advert Localization in Outdoor Scenes,” in 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), Jun. 2019, pp. 1–3. doi: 10.1109/QoMEX.2019.8743280.
[44]A. Nautiyal et al., “An Advert Creation System for Next-Gen Publicity,” ArXiv180800163 Cs, Aug. 2018, Accessed: Dec. 13, 2021. [Online]. Available: http://arxiv.org/abs/1808.00163
[45]T. Mei, X.-S. Hua, and S. Li, “VideoSense: A Contextual In-Video Advertising System,” IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 12, pp. 1866–1879, Dec. 2009, doi: 10.1109/TCSVT.2009.2026949.
[46]H. E. Wong et al., “Markerless Augmented Advertising for Sports Videos,” ArXiv190709394 Cs, Jul. 2019, Accessed: Dec. 20, 2021. [Online]. Available: http://arxiv.org/abs/1907.09394
[47]G. Medioni, G. Guy, H. Rom, and A. François, “Real-Time Billboard Substitution in a Video Stream,” in Multimedia Communications, London, 1999, pp. 71–84. doi: 10.1007/978-1-4471-0859-7_6.
[48]N. Boersen, “Digital billboard damage detection using computer vision,” p. 58.
[49]I. Bacher et al., “DeepReal - A Deep Learning Based 3D Advert Integration System,” p. 2.
[50]“Learning OpenCV [Book].” https://www.oreilly.com/library/view/learning-opencv/9780596516130/ (accessed Jun. 28, 2022).
[51]C. Tomasi and T. Kanade, “Detection and Tracking of Point Features,” International Journal of Computer Vision, 1991.
[52]K. G. Derpanis, “The Harris Corner Detector,” p. 2.
[53]“OpenCV: Harris Corner Detection.” https://docs.opencv.org/3.4/dc/d0d/tutorial_py_features_harris.html (accessed Sep. 06, 2022).
[54]“OpenCV: OpenCV modules.” https://docs.opencv.org/3.4/index.html (accessed Sep. 06, 2022).
[55]“手写计算机视觉算法：Harris角点检测算子,” Secret Land. http://zhaoxuhui.top/blog/2019/01/23/HarrisCornerDetection.html (accessed Sep. 06, 2022).