齐普夫定律在中文短语知识中的呈现
Zipf's Law in Chinese Phrases
  
中文关键词:齐普夫定律 汉语短语构建 直接成分分析 汉语短语知识 汉语树库 最省力法则
英文关键词:zipf’s Law , Chinese phrases construction , immediate constituents analysis , knowledge of Chinese phrases ,Chinese treebanks , least effort
基金项目:国家自然基金项目“面向知识服务的知识组织模式与应用研究”(项目编号: 71273126 );高技术研究发展计划( 863计划)“以科技文献服务为主的搜索引擎研制”(项目编号: 2011AA01A206 );南京医科大学科技发展基金“基于知识图谱的2002 ~ 2012 年南京医科大学论文分析”(项目编号: 2012NJMU036 )?
作者单位
谢靖 School of Economics and Management 
陈静 Library of Nanjing Medical UniversitySchool of Information Management 
王东波 College of Information Science & Technology 
摘要点击次数: 2830
全文下载次数: 145
中文摘要:
      本文对大规模汉语短语树库中的短语直接成分进行了抽取,在统计各短语结构直接成分频次的基础上排序,并进行短语成分的齐普夫定律验证? 实验由局部及整体两部分组成:在局部实验中,对单一短语直接成分进行齐普夫定律验证;在整体实验中,对全部短语直接成分进行齐普夫定律验证? 实验结果表明,在汉语短语树库中,短语的直接成分分布符合齐普夫定律? 这个现象表明,从计量角度而言,汉语短语具有其内核知识,并以内核为基础在最省力原则下对不同语境进行派生,这种派生首先要围绕语法内核知识进行构建,同时又要根据不同语 境进行拓展? 本研究一方面实现了面向短语层次的语法知识抽取,从计量角度揭示了汉语短语构成的分布规律;另一方面对于中文信息处理中的短语识别?自动句法分析等研究提供短语基础知识支持,这些知识最终可应用于术语短语识别?自动标引?知识抽取?语义分析等研究?
英文摘要:
      The paper extracts immediate constituents of Chinese phrases based on large scale Chinese treebank ,Tsinghua Chinese Treebank and Penn Chinese Treebank. After arranging immediate constituents sequences according to their ranks , we take local and global tests about Zipf’s Law. In two Chinese treebanks , the phenomenon of Zipf’s Law iapparently arrested. From the point of view of quantitative linguistics , the paper proves that each of Chinese phrases has a core concept of inter relationship among various derivations. These derivations should reflect the core concept and then could be extended in different context according to Zipf’s Principle of Least Effort. On the one hand , the discovery in this paper reveals the distribution of Chinese phrases syntactic constituents by extracting syntactical knowledge on phrase level. On the other hand , this discovery will have a strong influence on the researches in Chinese information processing , such as auto identification of Chinese phrase , automatic syntactic analysis , and so on. The phrase knowledge could be applied to automatic identification of term phrases , automatic indexing , knowledge extraction , semantic analysis and so on
谢靖,陈静,王东波.齐普夫定律在中文短语知识中的呈现[J].情报学报,2014,(1):11~22
查看全文  查看/发表评论  下载PDF阅读器
关闭
Copyright © 2008 《情报学报》编辑部 地址:北京市三里河路54号 
邮编:100045 电话:010-68598273,010-68598285 E-mail: qbxb@istic.ac.cn