基于HMM模型的中文分词 finalseg

码农软件 · 软件分类 · 中文分词库 · 2019-08-29 08:56:28

授权协议: 未知
开发语言: Python
操作系统: 跨平台
软件首页: https://github.com/fxsjy/finalseg
软件文档: https://github.com/fxsjy/finalseg/blob/master/README.md
官方下载: https://github.com/fxsjy/finalseg/downloads

软件介绍

finalseg -> Chinese Words Segment Library in Python based on HMM Model 基于HMM模型的中文分词

用法

将finalseg目录放置于当前目录或者site-packages目录
import finalseg

代码示例

import finalseg

sentence_list = [
"姚晨和老凌离婚了",
"他说的确实在理",
"长春市长春节讲话"
]

print u"=默认效果"

for sentence in sentence_list:
    seg_list = finalseg.cut(sentence)
    print "/ ".join(seg_list)

print u"\n=打开新词发现功能后的效果\n"


for sentence in sentence_list:
    seg_list = finalseg.cut(sentence,find_new_word=True)
    print "/ ".join(seg_list)