Added the function
pos_tagthat takes a segmented sentence or phrase and returns its part-of-speech tags.
Added the function
hkcancor_to_udthat maps a part-of-speech tag from the original HKCanCor annotated data to one of the tags from the Universal Dependencies v2 tagset.
Improved segmentation quality by revising the underlying wordlist data.
The test suite now covers code snippets in both the docstrings and
Fixed the issue of not opening text files with UTF-8 encoding (a possible issue on Windows).
[3.0.0] - 2020-10-25¶
Segmentation is customizable for the following:
Maximum word length
A user-supplied list of words to allow as words
A user-supplied list of words to disallow as words
The default segmentation model has been improved with the rime-cantonese data (CC BY 4.0 license).
The conversion returns results in a word-segmented form.
The conversion model has been improved with the rime-cantonese data (CC BY 4.0 license).
Added the following functions; they are equivalent to their (now deprecated)
Added support for Python 3.9.
jyutping_to_yale: The default value of the keyword argument
as_listhas been changed from
True, so that this function is now more in line with the other “jyutping_to_X” functions for returning a list.
characters_to_jyutping: The returned valued is now a list of segmented words, where each is a 2-tuple of (Cantonese characters, Jyutping). Previously, it was a list of Jyutping strings for the individual Cantonese characters.
Switched documentation to the readthedocs theme and numpydoc docstring style.
Improved CircleCI builds with orbs.
x2yfunctions have been deprecated in favor of their equivalents named in the form of
Turned on HTTPS for the pycantonese.org domain.
[2.4.1] - 2020-10-10¶
Switched to the
wordsegdependency to a PyPI source instead of a GitHub direct link.
[2.4.0] - 2020-10-10¶
characters2jyutping()function for converting Cantonese characters to Jyutping romanization.
segment()function for word segmentation.
[2.3.0] - 2020-07-24¶
Added support for Python 3.7 and 3.8.
Dropped support for Python 3.4 and 3.5 (supporting 3.6, 3.7, and 3.8 now).
[2.1.0] - 2018-06-11¶
excludeparameter in various reader methods for excluding specific participants. This parameter was implemented at pylangacq v0.10.0.
Allowed “n” to be a syllabic nasal.
Fixed corpus reader not picking up the characters.
[2.0.0] - 2016-02-06¶
[1.0] - 2015-09-06¶
Fixed the Jyutping-Yale conversion issue with “yu”
number_of_characters()for corpus access
Forced all part-of-speech tags (both in searches and internal to corpus objects) in caps, in line with the NLTK convention
[1.0dev] - 2015-09-02¶
Overall code restructuring
Only Python 3.x is supported from this point onwards
Used generators instead of lists for corpus access methods
Added the part-of-speech search criterion
Added Jyutping-to-Yale conversion
Added Jyutping-to-TIPA conversion
Disabled the function for reading a custom corpus dataset (it will come back)
[0.2.1] - 2015-01-25¶
Fixed corpus access path issues
[0.2] - 2015-01-22¶
The Hong Kong Cantonese Corpus is included in the package.
search()function is defined, replacing the element-specific search functions from version 0.1.
[0.1] - 2014-12-17¶
Basic functions available, including…
Parsing Jyutping romanization
Reading a tagged corpus data folder
Searching by a given element (onset/initial, nucleus, coda, final, character)
Searching by a character plus a range