Struct encoding::codec::simpchinese::GB18030EncodingUnstable
[-]
[+]
[src]
pub struct GB18030Encoding;
GB 18030-2005.
This is a simplified Chinese encoding which extends GBK 1.0 to a pan-Unicode encoding. It assigns four-byte sequences to every Unicode codepoint missing from the GBK area, lexicographically ordered with occasional "gaps" for codepoints in the GBK area. Due to this compatibility decision, there is no simple relationship between these four-byte sequences and Unicode codepoints, though there exists a relatively simple mapping algorithm with a small lookup table.
The original GBK 1.0 region spans [81-FE] [40-7E 80-FE]
, and is derived from
several different revisions of a family of encodings named "GBK":
- GBK as specified in the normative annex of GB 13000.1-93, the domestic standard equivalent to Unicode 1.1, consisted of characters included in Unicode 1.1 and not in GB 2312-80.
- Windows code page 936 is the widespread extension to GBK.
- Due to the popularity of Windows code page 936, a formal encoding based on Windows code page 936 (while adding new characters) was standardized into GBK 1.0.
- Finally, GB 18030 added four-byte sequences to GBK for becoming a pan-Unicode encoding, while adding new characters to the (former) GBK region again.