【python ROUGE BLEU jiaba.cut NLP常用的指标盘算】

pip install -U nltk rouge jieba
  # Rouge

1. from rouge import Rouge
2. rouge = Rouge()
4. reference = "The quick brown fox jumps over the lazy dog"
5. candidate = "The quick brown fox jumps over the dog"
7. scores = rouge.get_scores(candidate, reference)
8. scores

复制代码

# jieba分词

1. import jieba
4. text = "我爱自然语言处理"
5. seg_list = list(jieba.cut(text, cut_all=False))
7. print("分词结果:", seg_list)

复制代码

# Bleu

1. from nltk.translate.bleu_score import sentence_bleu
3. candidates = ["this", "is", "a", "test"]
4. references = [["this", "is", "a", "test"]]
6. bleu_score = sentence_bleu(references, candidates)
7. print(f"Corpus BLEU Score: {bleu_score}")

复制代码

免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。