[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Handling Japanese new era "令和 (Reiwa)"

On 12/04/2019 10:32, Alastair McKinstry wrote:
On 09/04/2019 02:18, Hideki Yamane wrote:
 I've noticed that Japan renews its era from 平成 (Heisei) to 令和 (Reiwa)
 (U+32FF) at 1st May and it's necessary to update some packages to deal
 with it. 

 > To Release Managers
 How do we handle with it for buster? (and stretch?)

 > Folks
 Some packages list to be updated as far as I know
 Please let me know if you've noticed more

  - unicode-data [2]

[1] https://sourceware.org/bugzilla/show_bug.cgi?id=22964
    (debian)$ LC_ALL=ja_JP.utf8 date +%EY -d 20190501
    (fedora)$ LC_ALL=ja_JP.utf8 date +%EY -d 20190501
[2] Unicode 12.1 contains "令和"

unicode-data in Buster is currently at 11.0.0; there being a major release upstream 12.0.0 just after Buster freeze.

I've uploaded 12.0.0 to unstable; 12.1 is not officially released yet. unicode-data itself is small and easy to validate, but the following packages will need to be rebuilt as they build-depend on unicode-data (and typically hard-code the tables internally):

  • ibus
  • node-unicode-tr51
  • julia
  • node-unicode-property-aliases
  • node-unicode-property-value-aliases
  • cyrus-imapd
  • libxmlada
  • courier-unicode
  • node-unicode-property-aliases-ecmascript
  • wine
  • slang2
  • re2
  • fntsample
  • console-data
  • wine-development
  • utf8proc
  • node-unicode-property-value-aliases-ecmascript
  • gucharmap
  • node-unicode-data
  • fonttools
  • wcwidth
  • jing-trang

I'm suprised to see unicode-data 12.0.0 transition to testing today; I had expected it to be blocked, and was testing all the reverse-deps (listed above).

I've tested them all against 12.1.0~pre1-1 (in experimental, with the Reiwa changes).  They work, except for:

libxmlada, utf8proc, gucharmap,  node-unicode-data. julia also failed for me, but on a local(?) unrelated issue.

The errors:


n file included from gucharmap-unicode-info.c:33:
unicode-versions.h:331:21: error: ‘GUCHARMAP_UNICODE_VERSION_12_0’ undeclared here (not in a function); did you mean ‘GUCHARMAP_UNICODE_VERSION_11_0’?
  331 |   { 0x0C77, 0x0C77, GUCHARMAP_UNICODE_VERSION_12_0 },
      |                     ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      |                     GUCHARMAP_UNICODE_VERSION_11_0
unicode-versions.h:863:21: error: ‘GUCHARMAP_UNICODE_VERSION_12_1’ undeclared here (not in a function); did you mean ‘GUCHARMAP_UNICODE_VERSION_2_1’?
  863 |   { 0x32FF, 0x32FF, GUCHARMAP_UNICODE_VERSION_12_1 },
      |                     ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      |                     GUCHARMAP_UNICODE_VERSION_2_1

This needs updating by ./gen-guch-unicode-tables.pl, which fails on:

unzip:  cannot find zipfile directory in one of /usr/share/unicode/Unihan_Readings.txt.bz2 or
        /usr/share/unicode/Unihan_Readings.txt.bz2.zip, and cannot find /usr/share/unicode/Unihan_Readings.txt.bz2.ZIP, period


raised SYSTEM.ASSERTIONS.ASSERT_FAILURE : file name too long: Egyptian_Hieroglyph_Format_Controls make[1]: *** [debian/rules:83: unicode/unicode-names-basic_latin.ads] Error 1 make[1]: Leaving directory '/tmp/libxmlada-18'


Presumes 11.0.0 only:
mkdir data
ln -s /usr/share/unicode/BidiBrackets.txt data/11.0.0-bidi-brackets.txt
ln -s /usr/share/unicode/BidiMirroring.txt data/11.0.0-bidi-mirroring.txt
ln -s /usr/share/unicode/Blocks.txt data/11.0.0-blocks.txt
ln -s /usr/share/unicode/CaseFolding.txt data/11.0.0-case-folding.txt
ln -s /usr/share/unicode/CompositionExclusions.txt data/11.0.0-composition-exclusions.txt
ln -s /usr/share/unicode/UnicodeData.txt data/11.0.0-database.txt
ln -s /usr/share/unicode/DerivedCoreProperties.txt data/11.0.0-derived-core-properties.txt
ln -s /usr/share/unicode/DerivedNormalizationProps.txt data/11.0.0-derived-normalization-properties.txt


line 2152: normalization failed for ㋿ -> 令和 line 42: Part0 # Specific cases line 70: Part1 # Character by character test checking line 1000... checking line 2000... make[1]: *** [Makefile:146: check] Error 1 make[1]: Leaving directory '/tmp/utf8proc-2.2.0' dh_auto_test: make -j2 check returned exit code 2 make: *** [debian/rules:6: build] Error 2
Time to go file RC bugs.

Also, I plan to push 12.1.0~pre-1 from experimental to unstable.



Alastair McKinstry, email: alastair@sceal.ie, matrix: @alastair:sceal.ie
Commander Vimes didn’t like the phrase “The innocent have nothing to fear,”
 believing the innocent had everything to fear, mostly from the guilty but in the longer term
 even more from those who say things like “The innocent have nothing to fear.”
 - T. Pratchett, Snuff

Reply to: