Metadata-Version: 2.2
Name: LangSegment
Version: 0.2.0
Summary: This is a multilingual tokenization tool that currently supports for zh/ja/en/ko, and more languages.
Home-page: https://github.com/
Author: sunnyboxs
License: BSD
Keywords: language detection,language identification,langid,langid.py,nlp,language
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: BSD License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.6
Description-Content-Type: text/markdown
Requires-Dist: numpy>=1.19.5
Requires-Dist: py3langid>=0.2.2
Dynamic: author
Dynamic: classifier
Dynamic: description
Dynamic: description-content-type
Dynamic: home-page
Dynamic: keywords
Dynamic: license
Dynamic: requires-dist
Dynamic: requires-python
Dynamic: summary

LangSegment
