Restructured the repository to use top-level
Fixed known issues in the rime-cantonese data.
[3.4.0] - 2021-12-28
parse_textfor analyzing Cantonese text data.
Characters-to-Jyutping conversion: The
characters_to_jyutpingfunction now has the
segmenterkwarg for customizing word segmentation.
Added support for Python 3.10.
Turned on Windows testing on CircleCI.
pyproject.toml. Related to preferring
setup.cfgfor specifying build metadata and options.
- Characters-to-Jyutping conversion:
characters_to_jyutpingfunction, in case rime-cantonese and HKCanCor don’t agree, rime-cantonese data (more accurate) is preferred.
Updated the rime-cantonese data to the latest
2021.05.16release, improving both characters-to-Jyutping conversion and word segmentation.
Updated the PyLangAcq dependency to v0.16.0, allowing PyCantonese’s
CHATReaderto use the new methods
setup.cfgto fully specify build metadata and options, while keeping a minimal
setup.pyfor backward compatibility. Related to the new
Dropped support for Python 3.6.
banditchecks at CircleCI builds.
[3.3.1] - 2021-05-14
Allowed PyLangAcq v0.14.* for real.
[3.3.0] - 2021-05-14
Allowed PyLangAcq v0.14.*, thereby adding the new features of the
CHATReaderand optional parallelization for CHAT data processing.
[3.2.4] - 2021-05-07
Fixed the previously inoperational methods
extend_leftof the class
CHATReaderthrough the upstream PyLangAcq package.
Retrained the part-of-speech tagger, after the minor character fix from v3.2.3.
NotImplementedErrorfor the method
CHATReader, since the upstream method works only for English.
[3.2.3] - 2021-04-12
Fixed character issues in the built-in HKCanCor data: 𥄫
[3.2.2] - 2021-03-23
Fixed a CHAT parsing issue when correction and repetition are combined, by bumping the pylangacq dependency from v0.13.0 to v0.13.1.
[3.2.1] - 2021-03-21
Fixed character issues in the built-in HKCanCor data: 𠮩𠹌, 𠻗
[3.2.0] - 2021-03-20
Note: The underlying CHAT parser, the PyLangAcq package, has been bumped to v0.13.0. All of the updates of PyLangAcq’s CHAT reader apply to this PyCantonese release as well. The details are in PyLangAcq’s changelog for v0.13.0. The changelog entries below only document updates specific to PyCantonese.
Jyutpingclass to better represent parsed Jyutping romanization.
Bumped the PyLangAcq dependency to v0.13.0.
parse_jyutpingnow returns a list of
Jyutpingobjects, rather than tuples of strings.
The following methods in the
CHATReaderclass have been deprecated:
The following arguments of the
CHATReaderhave been deprecated:
Fixed the character issues in the built-in HKCanCor data: 𠺢, 𠺝, 𡁜, 𧕴, 𥊙, 𡃓, 𠴕, 𡀔
[3.1.1] - 2021-03-18
Pinned pylangacq at 0.12.0 (the new 0.13.0 has breaking changes).
[3.1.0] - 2021-02-21
Added the function
pos_tagthat takes a segmented sentence or phrase and returns its part-of-speech tags.
Added the function
hkcancor_to_udthat maps a part-of-speech tag from the original HKCanCor annotated data to one of the tags from the Universal Dependencies v2 tagset.
Improved segmentation quality by revising the underlying wordlist data.
The test suite now covers code snippets in both the docstrings and
Fixed the issue of not opening text files with UTF-8 encoding (a possible issue on Windows).
parse_jyutpingnow return a null value (rather than raise an error) when the input is null.
The word segmentation function
segmentnow strips all whitespace from the input unsegmented string before segmenting it.
[3.0.0] - 2020-10-25
Segmentation is customizable for the following:
Maximum word length
A user-supplied list of words to allow as words
A user-supplied list of words to disallow as words
The default segmentation model has been improved with the rime-cantonese data (CC BY 4.0 license).
The conversion returns results in a word-segmented form.
The conversion model has been improved with the rime-cantonese data (CC BY 4.0 license).
Added the following functions; they are equivalent to their (now deprecated)
Added support for Python 3.9.
jyutping_to_yale: The default value of the keyword argument
as_listhas been changed from
True, so that this function is now more in line with the other “jyutping_to_X” functions for returning a list.
characters_to_jyutping: The returned valued is now a list of segmented words, where each is a 2-tuple of (Cantonese characters, Jyutping). Previously, it was a list of Jyutping strings for the individual Cantonese characters.
Switched documentation to the readthedocs theme and numpydoc docstring style.
Improved CircleCI builds with orbs.
x2yfunctions have been deprecated in favor of their equivalents named in the form of
Turned on HTTPS for the pycantonese.org domain.
[2.4.1] - 2020-10-10
Switched to the
wordsegdependency to a PyPI source instead of a GitHub direct link.
[2.4.0] - 2020-10-10
characters2jyutping()function for converting Cantonese characters to Jyutping romanization.
segment()function for word segmentation.
[2.3.0] - 2020-07-24
Added support for Python 3.7 and 3.8.
Dropped support for Python 3.4 and 3.5 (supporting 3.6, 3.7, and 3.8 now).
[2.2.0] - 2018-06-30
104 stop words.
[2.1.0] - 2018-06-11
excludeparameter in various reader methods for excluding specific participants. This parameter was implemented at pylangacq v0.10.0.
Allowed “n” to be a syllabic nasal.
Fixed corpus reader not picking up the characters.
[2.0.0] - 2016-02-06
[1.0] - 2015-09-06
Fixed the Jyutping-Yale conversion issue with “yu”
number_of_characters()for corpus access
Forced all part-of-speech tags (both in searches and internal to corpus objects) in caps, in line with the NLTK convention
[1.0dev] - 2015-09-02
Overall code restructuring
Only Python 3.x is supported from this point onwards
Used generators instead of lists for corpus access methods
Added the part-of-speech search criterion
Added Jyutping-to-Yale conversion
Added Jyutping-to-TIPA conversion
Disabled the function for reading a custom corpus dataset (it will come back)
[0.2.1] - 2015-01-25
Fixed corpus access path issues
[0.2] - 2015-01-22
The Hong Kong Cantonese Corpus is included in the package.
search()function is defined, replacing the element-specific search functions from version 0.1.
[0.1] - 2014-12-17
Basic functions available, including…
Parsing Jyutping romanization
Reading a tagged corpus data folder
Searching by a given element (onset/initial, nucleus, coda, final, character)
Searching by a character plus a range