臺灣博碩士論文加值系統

無論是在數位典藏資料庫、數位圖書館、或數位博物館的領域，詮釋資料的建立都是一個重要的工作，同時也經常是耗費最多人力時間成本的項目。然而，建立詮釋資料並不是一件簡單的工作，建立者需要對某個特定領域的知識有深入的了解，才能產出豐富、正確、精準的詮釋資料，進而詳實傳達數位資源的重要性。
　　正因為詮釋資料必須透過大量人力進行建置，因此在實務上經常採用「聯合目錄」的形式，亦即由原始資料典藏單位負責建立典藏物的詮釋資料，再提交至中央主管單位統一提供可整合檢索、瀏覽的介面。由原始資料典藏單位各別建立詮釋資料與數位化的過程稱為「分散建置」，而由中央整合並提供使用介面則稱為「集中管理」，此模式是在綜合考量時間、人力、資源等因素後所產生的平衡點，其衍生的問題則是詮釋資料的填寫方式難以趨於一致，進而導致後續在瀏覽、檢索、與資料鏈結上的困難。
　　本研究試圖提出一套資料前置處理的框架：ADEPT (Automated Data Enrichment Processing Technology)，目標是將符合都柏林核心集的輸入資料進行自動化的前置處理與豐富化。ADEPT框架中包含了三個主要模組，分別是：驗證模組、正規化模組、專有名詞擷取模組。透過這些模組處理過的資料將趨向一致性、符合統一的格式，同時具備人事時地物等重要資訊。除此之外，豐富化後的資料將更適合鏈結資料(linked data)，不但可與網際網路上的相關資料相互連結，更可讓詮釋資料進一步被加值利用，達到全民共享的目標。

Metadata, known as "data about data", is an important way to describe and utilize digital objects in digital archives, digital libraries, and digital museums. To present accurate, precise, and high-quality metadata is a critical task for the digital databases, and it requires not only a high cost of human resources, but also domain know-how.
　　Due to the labor-intensive nature of metadata construction, a model often employed in developing a large digital collection is to build different archives separately, then construct a central portal (such as a union catalog) for users to browse, search, and explore the entire collection. Although this model is effective in terms of time, manpower, and resources, it has some drawbacks. The main problem is inconsistency in the metadata constructed. This may be caused by misinterpretation of metadata attributes, different details when inputting data, or inadequate metadata format for interpreting specific data sets.
　　In this thesis, we propose ADEPT (Automated Data Enrichment Processing Technology), a framework for pre-processing data. ADEPT contains three primary modules: data verification, data normalization, and named-entity recognition. ADEPT aims to ensure data consistency and correctness, and increases data usability at the same time. Furthermore, the enriched metadata is more suitable for linked open data. By connecting related data, we can explore and share information and knowledge through the Web.

誌謝 ii
摘要 iii
ABSTRACT iv
目錄 v
第一章 序論 1
1.1. 問題陳述 1
1.2. 研究動機與目的 2
1.3. 研究方法設計 3
1.4. 本章小結 4
第二章 相關研究 5
2.1. 數位典藏與詮釋資料 5
2.1.1. Dublin-Core 6
2.1.2. XML 7
2.2. 語意網與資料正規化 8
2.3. 知識本體與關鍵字擷取 13
2.4. 鏈結資料與交換格式 16
2.5. DBPedia 19
2.6. 本章小結 20
第三章 研究方法 21
3.1. ADEPT架構 21
3.2. 輸入資料格式 26
3.2.1. 結構化資料 26
3.2.2. 半結構化資料 31
3.3. 正規化資料 35
3.3.1. 時間正規化 35
3.3.2. 空間正規化 41
3.4. 專有名詞擷取與補充 45
3.4.1. 詞庫比對擷取策略 46
3.4.2. 詞夾子擷取策略 47
3.5. 本章小結 49
3.6. 預期貢獻 49
第四章 系統實作 51
4.1. 系統架構 51
4.2. 輸入資料格式介紹 54
4.2.1. 詮釋資料輸入格式 54
4.2.2. 正規化規則輸入格式 56
4.2.3. 專有名詞辭庫輸入格式 58
4.3. 各模組功能介紹 62
4.3.1. 格式驗證模組介紹 63
4.3.2. 正規化模組介紹 68
4.3.3. 內建辭庫模組介紹 74
4.3.4. 自訂辭庫模組介面 80
4.4. 系統操作介紹 84
4.5. 匯出資料格式 102
4.5.1. XML with Dublin-Core/ADEPT 格式檔案 102
4.5.2. RDFa with Dublin-Core/ADEPT 格式檔案 105
4.5.3. Microdata with Dublin-Core/ADEPT格式檔案 108
4.5.4. Microformats with Dublin-Core/ADEPT格式檔案 111
4.6. 本章小結 114
第五章 實驗結果 115
5.1. 三面向檢索模型 115
5.2. 國家文化資料庫 119
5.2.1. 原始資料盤點 120
5.2.2. 資料處理程序與結果 129
5.2.3. 實驗成果 132
5.3. 文化資源庫 145
5.3.1. 原始資料盤點 146
5.3.2. 原始資料盤點資料處理程序 159
5.3.3. 實驗成果 160
5.4. 本章小結 171
第六章 結論與未來展望 174
6.1. 結論 174
6.2. 未來展望 175
參考文獻 176

[1].項潔, 陳雪華, 鄭惇方, 魏雅惠, “數位典藏加值應用之探討”, 圖書資訊學刊 第2卷第1期, pp.1-17, 2004.
[2].項潔, 翁稷安, “數位人文和歷史研究”, 數位人文在歷史學研究的應用, pp.11-20, 2011.
[3].項潔, 涂豐恩, “導論——什麼是數位人文”, 從保存到創造：開啟數位人文研究, pp.9-28, 2011.
[4].項潔, 翁稷安, “導論——數位人文的變與不變”, 數位人文要義：尋找類型與軌跡, pp.9-21, 2012.
[5].項潔, 翁稷安, “多重脈絡－－數位檔案之問題與挑戰”, 數位人文要義：尋找類型與軌跡, pp.25-59, 2012.
[6].陳昭珍, “國家文化資料庫詮釋資料格式設計理念”, 後設資料在數位典藏之研究發展：回顧與前瞻研討會, 2004.
[7].陳雪華, 陳昭珍, 陳光華, “數位圖書館/博物館中詮釋資料之理論與實作”, 圖書館學刊, 13:37-60, 1998.
[8].陳昭珍, 陳雪華, 陳光華, "數位圖書館與博物館 metadata 管理系統 -- Metalogy 之設計", 2000年台灣區網際網路研討會, 2000.
[9].陳英祥, 陳哲民, 楊正仁, “以Metalogy的詮釋資料為依據的跨圖書館搜尋引擎之設計”, 2001年台灣區網際網路研討會, 2001.
[10].范紀文, 何建明, 李德財, “從典藏資料交換角度探討Metadata設計與標準化問題”, 新世紀數位圖書館與數位博物館趨勢研討會, 2001.
[11].陳昭珍, “數位典藏計畫異質系統互通機制：以OAI建立聯合目錄的理論與實務”, 國家圖書館館刊91年第1頁, 2002.
[12].Greenberg, J., "Metadata generation: processes, people and tools", Bulletin of the American Society for Information Science and Technology, Vol. 29 No. 2, pp. 16‐19., 2002.
[13].張懷文, “詮釋資料與數位典藏長久保存取用－淺談Preservation Metadata”, 典藏國家型科技計畫電子通訊, 2004.
[14].洪淑芬, 邱婉容, "國立國立臺灣大學圖書館數位典藏 Metadata 之設計與資料庫之建置彙整", 後設資料在數位典藏之研究發展：回顧與前瞻研討會論文集, pp.237-269, 2005.
[15].林信成, 康珮熏, “建置以OAI-PMH為基礎的數位化新聞Metadata分散檢索系統”, 2005年台灣區網際網路研討會, 2005.
[16].陳淑君、城菁汝、陳雪華, “探索數位典藏的詮釋資料與索引典之多語化”, 圖圖書資訊學刊第5卷第2期, pp.49-72, 2013.
[17].賴忠勤, “數位典藏建置規劃與管理”, 佛教圖書館刊第45期, 2007.
[18].林信成, 康珮熏, “建置以OAI-PMH為基礎的數位化新聞Metadata分散檢索系統”, TANet2005, 2005.
[19].陳雪華, “Metadata在電腦圖書館所扮演的角色”, 國立成功大學圖書館期刊3期, 民國88年4月, pp.16-24, 1999.
[20].陳詩沛, 杜協昌, 項潔, “史料整體分析工具之幕後—介紹臺灣歷史數位圖書館的資料前置處理程序”, 第一屆數位典藏與數位人文國際會議, 2009.
[21].Leetaru, K.H., “Towards HPC for the digital Humanities, Arts, and Social Sciences: Needs and challenges of adapting academic HPC for big data”, IEEE 8th International Conference on E-Science (e-Science), pp.1-6, 2012.
[22].Sztyler, T., Huber, J., Noessner, J., Murdock, J., Allen, C., Niepert, M., “LODE: Linking digital humanities content to the web of data”, 2014 IEEE/ACM Joint Conference on Digital Libraries (JCDL), pp.423-424, 2014.
[23].Rui Wang, Xiangxu Meng, Shijun Liu; Hai Guo, Chenglei Yang, “Digital media service oriented digital museum Grid”, CSCWD 2009 13th International Conference on Computer Supported Cooperative Work in Design, pp.325-330, 2009.
[24].Ning Wang, Xukun Shen, “The Research on Interactive Exhibition Technology of Digital Museum Resources”, 2013 IEEE and Internet of Things (iThings/CPSCom), IEEE International Conference on and IEEE Cyber, Physical and Social Computing, Green Computing and Communications (GreenCom), pp.2067-2070, 2013.
[25].Nikolaos Aletras, Timothy Baldwin, Jey Han Lau, Mark Stevenson, "Representing Topics Labels for Exploring Digital Libraries", 2014 IEEE/ACM Joint Conference on Digital Libraries (JCDL), pp.239-248, 2014.
[26].Yao-Nan Lien, Hung-Chin Jang, Tzu-Chieh Tsai, Pei-Jeng Kuo, Chih-Lin Hu, “Mobilizing digital museum with Chinese digital archive”, 2015 8th International Conference on Ubi-Media Computing (UMEDIA), pp.134-139, 2015.
[27].Michael Day, “Metadata developments in the library community”, http://www.ukoln.ac.uk/metadata/presentations/fiat-ifta/tsld001.htm.
[28].Hepp, M., “Semantic Web and semantic Web services: father and son or indivisible twins?”, Internet Computing, IEEE vol.10, issue:2, pp.85-88, 2006.
[29].Yuangang Yao, Hui Liu, Jin Yi, Haiqiang Chen, Xianghui Zhao, Xiaoyu Ma, “An Automatic Semantic Extraction Method for Web Data Interchange”, 2014 6th International Conference on CSIT, 2014.
[30].Hui Liu, Jinglei Zhao, Ruzhan Lu, "Computing Semantic Similarities Based on Machine-Readable Dictionaries", IEEE International Workshop on Semantic Computing and Systems, pp.8-14, 2008.
[31].Yong-qiang Yang, Mu-hong Dai, Hao Chen , “An Automatic Semantic Extraction Algorithm for XML Document”, 2010 IEEE International Conference on Machine Vision and Human-machine Interface, 2010.
[32].Malik, S.K.; Rizvi, S.A.M., “Information Extraction Using Web Usage Mining, Web Scrapping and Semantic Annotation”, 2011 IEEE International Conference on Computational Intelligence and Communication Networks (CICN), pp.465-469, 2011.
[33].Wang Yong-gui, Jia Zhen, “Research on semantic Web mining”, 2010 IEEE International Conference on Computer Design and Applications (ICCDA), vol.1, pp.67-70, 2010.
[34].Yong-qiang Yang, Mu-hong Dai, Hao Chen, "An Automatic Semantic Extraction Algorithm for XML Document", 2010 International Conference on Machine Vision and Human-Machine Interface (MVHI), pp.41-44, 2010.
[35].Yuangang Yao, Lanfen Lin, "Semantic Context Enrichment and Shifting Based on Multi-dimensional Association", 2011 First ACIS/JNU International Conference on Computers, Networks, Systems and Industrial Engineering (CNSI), pp.26-30, 2011.
[36].Róbert Móro, Ivan Srba, Maroš Unþík, Mária Bieliková, Marián Šimko, "Towards Collaborative Metadata Enrichment for Adaptive Web-Based Learning", 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, pp.106-109, 2011.
[37].Karthik Gomadam, Peter Z. Yeh, Kunal Verma, John A. Miller, "Data Enrichment Using Data Sources on the Web", 2012 IEEE International Conference on Services Economics (SE), pp.46-53, 2012.
[38].Haining Yu, Binxing Fang, Xiangzhan Yu, Juan Chen, "Semantic surface representation of physical entity in the WEB of things", 2012 IEEE 2nd International Conference on Cloud Computing and Intelligent Systems (CCIS), vol.3 pp.1032-1036, 2012.
[39].Pereira, M., Martins, J.A., “aRDF: A Plugin to Expose RDFa Semantic Information Using Grails”, 2012 6th Euro American Conference on Telematics and Information Systems (EATIS), 2012.
[40].Xinyang Feng, Ying Fan, “Research on Application of RDFa in RESTful Web Services”, 2012 Sixth International Conference on Internet Computing for Science and Engineering (ICICSE), 2012.
[41].Haining Yu, Binxing Fang, Xiangzhan Yu, Juan Chen, “Semantic surface representation of physical entity in the WEB of things”, 2012 IEEE 2nd International Conference on Cloud Computing and Intelligent Systems (CCIS), 2012.
[42].Oliveira, PP., Rocha, J. “Semantic annotation tools survey”, 2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM), 2013.
[43].Azad, H.K.; Abhishek, K., “Semantic-Synaptic Web Mining: A Novel Model for Improving the Web Mining”, International Conference on Communication Systems and Network Technologies (CSNT), pp.454-457, 2014.
[44].Heiner Stuckenschmidt, Frank van Harmelen, "Ontology-based metadata generation from semi-structured information", 1st international conference on Knowledge capture, pp.163-170, 2001.
[45].Rajapaksha, S.K.; Kodagoda, N., “Internal Structure and Semantic Web Link Structure Based Ontology Ranking”, International Conference on Information and Automation for Sustainability (ICIAFS), pp.86-90, 2008.
[46].Mascardi, V., Locoro, A.; Rosso, PP., “Automatic Ontology Matching via Upper Ontologies: A Systematic Evaluation”, IEEE Transactions on Knowledge and Data Engineering, vol. 22, issue 5, pp.609-623, 2010.
[47].Xueying Zhang, Chunju Zhang, Chaoli Du, Shaonan Zhu, "SVM based extraction of spatial relations in text", 2011 IEEE International Conference on Spatial Data Mining and Geographical Knowledge Services (ICSDM), pp.529-533, 2011.
[48].bin Jamaludin, N.A., Annamalai, M., Jamil, N., Bakar, Z.A., "A Model for Keyword Profile Creation Using Extracted Keywords and Terminological Ontology", 2013 IEEE Conference on e-Learning, e-Management and e-Services (IC3e), pp.136-141, 2013.
[49].Leung, N.K.Y., Sim Kim Lau; Tsang, N., “A new methodology to streamline ontology integration processes”, 2014 Fourth International Conference on Digital Information and Communication Technology and it''s Applications (DICTAP), pp.174-179, 2014.
[50].Qian Chen, Zengru Jiang, Jinqiang Bian, "Chinese Keyword Extraction Using Semantically Weighted Network", 2014 Sixth International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), vol.2, pp.83-86, 2014.
[51].Lozano, J., Carbonera, J., Abel, M.; Pimenta, M., “Ontology View Extraction: An Approach Based on Ontological Meta-properties”, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence (ICTAI), pp.122-129, 2014.
[52].RDFa 1.1 Primer, http://www.w3.org/TR/xhtml-rdfa-primer/.
[53].Microformats, http://Microformatss.org/.
[54].HTML Microdata, http://www.w3.org/TR/microdata/.
[55].OWL Web Ontology Language, http://www.w3.org/TR/2004/REC-owl-features-20040210/.
[56].中國歷代人物傳記資料庫(CBDB), http://isites.harvard.edu/icb/icb.do?keyword=k35201.
[57]. Peter K. Bol, 陳詩沛, 于文, “人文學、數位資源、與數位工具的跨界整合”, AAS2013, 2013.
[58].Hamed Olfat, “Automatic Spatial Metadata Updating and Enrichment”, PhD Thesis, 2013.
[59].Berners-Lee, T., “Design issues of Linked Data”, http://www.w3.org/DesignIssues/LinkedData.html, 2006.
[60].柯皓仁, 陳亞寧, “鏈結資料在圖書館的應用”, http://concert.stpi.narl.org.tw/Images/upload/2013/11/HaoRenKe-Report.pdf, 2013.
[61].Paul Miller, “Linked Data Horizon Scan”, http://cloudofdata.s3.amazonaws.com/FINAL-201001-LinkedDataHorizonScan.pdf, 2010.
[62].Knap, T., Michelfeit, J., Necasky, M., “Linked Open Data Aggregation: Conflict Resolution and Aggregate Quality”, 2012 IEEE 36th Annual Computer Software and Applications Conference Workshops (COMPSACW), pp.106-111, 2012.
[63].Chunju Zhang, Xueying Zhang, Wenming Jiang, Qijun Shen, Shanqi Zhang, "Rule-Based Extraction of Spatial Relations in Natural Language Text", CiSE 2009. International Conference on Computational Intelligence and Software Engineering, pp.1-4, 2009.
[64].Jie Yuan, Peng Yue, Jianya Gong, Mingda Zhang, “A Linked Data Approach for Geospatial Data Provenance”, IEEE Transactions on Geoscience and Remote Sensing, vol. 51, issue 11, pp.5105-5112, 2013.
[65].Emamdadi, R, Kahani, M, Zarrinkalam, F., “A focused linked data crawler based on HTML link analysis”, 2014 4th International eConference on Computer and Knowledge Engineering (ICCKE), pp.74-79, 2014.
[66].Hartig, O., Ozsu, M.T., “Linked Data query processing”, 2014 IEEE 30th International Conference on Data Engineering (ICDE), pp.1286-1289, 2014.
[67].Victor de Boer1, Jan Wielemaker, Judith van Gent, Michiel Hildebrand, Antoine Isaac, Jacco van Ossenbruggen, Guus Schreiber, “Supporting Linked Data Production for Cultural Heritage institutes: The Amsterdam Museum Case Study”, 9th Extended Semantic Web Conference (ESWC), p733-747, 2012.
[68].Fuyuko Matsumura, Iwao Kobayashi, Fumihiro Kato, Tetsuro Kamura, Ikki Ohmukai, and Hideaki Takeda, “Producing and Consuming Linked Open Data on Art with a Local Community”, Third International Workshop on Consuming Linked Data (COLD2012), 2012.
[69].Pedro Szekely, Craig A. Knoblock, Fengyu Yang, Xuming Zhu, Eleanor E. Fink, Rachel Allen, “Connecting the Smithsonian American Art Museum to the Linked Data Cloud”, The Semantic Web: Semantics and Big Data, vol. 7882 of the series Lecture Notes in Computer Science pp. 593-607, 2013.
[70].Yongrui Qin, Sheng, Q.Z., Curry, E.,” Matching Over Linked Data Streams in the Internet of Things”, IEEE Internet Computing, vol. 19, issue 3, pp.21-27, 2015.
[71].國立國立臺灣大學資訊工程研究所數位典藏與自動推論實驗室, 國立國立臺灣大學數位人文研究中心, 中西曆轉換程式, http://140.112.30.230/datemap/.
[72].鄭鶴聲著, “近世中西史日對照表”, 1994.
[73].郭廷以著, “太平天國曆法考訂”, 1963.
[74].交通部運輸研究所, http://www.iot.gov.tw/.
[75].Google Maps API, https://developers.google.com/maps/.
[76].J. S. Chang, S. Chen, Y. Zheng, X. Z. Liu, S.J. Ke, “A Multiple-corpus Approach to Identification of Chinese Surname-names.” In Proceedings of Natural Language Processing Pacific Rim Symposium, 1991.
[77].Liang-Jyh Wang, Wei-Chuan Li, and Chao-Huang Chang, “Recognizing Unregistered Names for Mandarin Word Identification”, In Proceedings of COLING, 1992.
[78].James K. Batcheller, "Automating geospatial metadata generation—An integrated data management and documentation approach", Computers & Geosciences, vol.34, issue4, pp.387-398, 2008.
[79].李振昌, 李御璽, 陳信希, “中文文本人名辨識問題之研究”, 第七屆計算語言學研討會論文集, 1994.
[80].張尚斌, “詞夾子演算法在專有名詞辨識上的應用 -以歷史文件為例”, 國立臺灣大學資訊工程研究所碩士論文, 2005.
[81].謝育平, 楊龍廉, 趙建宏, 黃銘立, 古馮文, 林郁智, “使用詞夾子建立中文典籍分析加值服務”, 銘傳大學2009資訊科技與實務研討會, 2009.
[82].謝育平, “同位詞夾子:主題式分類詞庫萃取演算法”, 數位人文研究的新視野: 基礎與想像, pp.133-162, 2011.
[83].倪吉, 孔芳, 朱巧明, 李培峰, “基於可信度模型的中文人名辨識研究”, 中文信習學報, 25, 3, 2011.
[84].Okamoto, M., Kikuchi, M., Watanabe, N., Iida, T., Sasaki, K., Hattori, M., "Semi-automatic Evaluation System for Supporting Term Extraction Application Development", 2011 Fifth IEEE International Conference on Semantic Computing (ICSC), pp.7-12, 2011.
[85].彭維謙, 劉士綱, 杜協昌, 翁稷安, 項潔, “自動擷取中文典籍中人名之嘗試：以PMI(Pointwise Mutual Information)斷詞於《資治通鑑》的應用為例, 第四屆數位典藏與數位人文國際研討會, pp.53-76, 2012.
[86].何浩洋, “MARKUP：古籍文本半自動標記平台”, 第五屆數位典藏與數位人文國際研討會, pp.117-137, 2014.
[87].RFC 3174, 美國安全雜湊演算法1（SHA1）, http://www.ietf.org/rfc/rfc3174.txt.
[88].Google Map Cluster, https://github.com/googlemaps/js-marker-clusterer