Developing a Pan-CJK IVD Collection Dr Ken Lunde | Sr Computer Scientist 2 | CJKV Type Development | Adobe Systems Incorporated @ken_lunde | @CJKType | @IVD_Registrar http://adobe.ly/2ffq6yR © 2016 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. The Ideographic Variation Database (IVD) • A database of registered Ideographic Variation Sequences (IVSes) © 2016 Adobe Systems Incorporated. All Rights Reserved. 2 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 The Ideographic Variation Database (IVD) • A database of registered Ideographic Variation Sequences (IVSes) • Each registered IVS is associated with a registered IVD collection • Shared IVSes are associated with two or more IVD collections © 2016 Adobe Systems Incorporated. All Rights Reserved. 3 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 IVD History • Five versions © 2016 Adobe Systems Incorporated. All Rights Reserved. 4 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 IVD History • Five versions • Four registered collections © 2016 Adobe Systems Incorporated. All Rights Reserved. 5 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 IVD Versions • 2007-12-14 • Adobe-Japan1 collection © 2016 Adobe Systems Incorporated. All Rights Reserved. 6 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 IVD Versions • 2007-12-14 • Adobe-Japan1 collection • 2010-11-14 • Hanyo-Denshi collection © 2016 Adobe Systems Incorporated. All Rights Reserved. 7 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 IVD Versions • 2007-12-14 • Adobe-Japan1 collection • 2010-11-14 • Hanyo-Denshi collection • 2012-03-02 • Additional registered IVSes for the Adobe-Japan1 and Hanyo-Denshi collections © 2016 Adobe Systems Incorporated. All Rights Reserved. 8 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 IVD Versions • 2007-12-14 • Adobe-Japan1 collection • 2010-11-14 • Hanyo-Denshi collection • 2012-03-02 • Additional registered IVSes for the Adobe-Japan1 and Hanyo-Denshi collections • 2014-05-16 • Moji_Joho collection © 2016 Adobe Systems Incorporated. All Rights Reserved. 9 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 IVD Versions • 2007-12-14 • Adobe-Japan1 collection • 2010-11-14 • Hanyo-Denshi collection • 2012-03-02 • Additional registered IVSes for the Adobe-Japan1 and Hanyo-Denshi collections • 2014-05-16 • Moji_Joho collection • 2016-08-15 • MSARG collection © 2016 Adobe Systems Incorporated. All Rights Reserved. 10 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Registered IVD Collections • Adobe-Japan1 • 14,679 sequences in two registrations © 2016 Adobe Systems Incorporated. All Rights Reserved. 11 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Registered IVD Collections • Adobe-Japan1 • 14,679 sequences in two registrations • Hanyo-Denshi • 13,045 sequences in two registrations © 2016 Adobe Systems Incorporated. All Rights Reserved. 12 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Registered IVD Collections • Adobe-Japan1 • 14,679 sequences in two registrations • Hanyo-Denshi • 13,045 sequences in two registrations • Moji_Joho • 10,710 sequences • 9,685 of its sequences are shared with the Hanyo-Denshi collection © 2016 Adobe Systems Incorporated. All Rights Reserved. 13 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Registered IVD Collections • Adobe-Japan1 • 14,679 sequences in two registrations • Hanyo-Denshi • 13,045 sequences in two registrations • Moji_Joho • 10,710 sequences • 9,685 of its sequences are shared with the Hanyo-Denshi collection • MSARG • 21 sequences © 2016 Adobe Systems Incorporated. All Rights Reserved. 14 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Registered IVD Collections © 2016 Adobe Systems Incorporated. All Rights Reserved. 15 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Registered IVD Collections © 2016 Adobe Systems Incorporated. All Rights Reserved. 16 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Registered IVD Collections © 2016 Adobe Systems Incorporated. All Rights Reserved. 17 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 How Are IVSes Useful? • An IVS is a sequence of a base character followed by a variation selector • Any CJK Unified Ideograph—80,388 in Unicode Version 9.0—can serve as a valid base character • There are 240 variation selectors in Plane 14 © 2016 Adobe Systems Incorporated. All Rights Reserved. 18 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 How Are IVSes Useful? • An IVS is a sequence of a base character followed by a variation selector • Any CJK Unified Ideograph—80,388 in Unicode Version 9.0—can serve as a valid base character • There are 240 variation selectors in Plane 14 • An IVS is considered “plain text” and is not affected by normalization © 2016 Adobe Systems Incorporated. All Rights Reserved. 19 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 CJK Fonts: Single-Region vs Pan-CJK • Almost all CJK fonts are single-region • One glyph per code point, except for region-specific variants • Region-specific variants can be handled via a registered IVD collection, such as Adobe-Japan1 © 2016 Adobe Systems Incorporated. All Rights Reserved. 20 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 CJK Fonts: Single-Region vs Pan-CJK • Almost all CJK fonts are single-region • One glyph per code point, except for region-specific variants • Region-specific variants can be handled via a registered IVD collection, such as Adobe-Japan1 • Developing Pan-CJK fonts is a lot of work • Multiple glyphs for tens of thousands of code points © 2016 Adobe Systems Incorporated. All Rights Reserved. 21 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Register a Pan-CJK IVD Collection? • All currently-registered IVD collections are region-specific • Three for Japan • One for Macao SAR © 2016 Adobe Systems Incorporated. All Rights Reserved. 22 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Register a Pan-CJK IVD Collection? • All currently-registered IVD collections are region-specific • Three for Japan • One for Macao SAR • A multiple-region (aka Pan-CJK) IVD collection makes a lot of sense • Regional variation is a fundamental characteristic of CJK Unified Ideographs • Regional variation using a single font resource requires language-tagging and the ‘locl’ GSUB feature • Very few environments support this functionality—Adobe InDesign and modern browsers • Regional variation is not preserved in “plain text” • Regional variation can be preserved in “plain text” environments via IVSes © 2016 Adobe Systems Incorporated. All Rights Reserved. 23 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Register a Pan-CJK IVD Collection? • All currently-registered IVD collections are region-specific • Three for Japan • One for Macao SAR • A multiple-region (aka Pan-CJK) IVD collection makes a lot of sense • Regional variation is a fundamental characteristic of CJK Unified Ideographs • Regional variation using a single font resource requires language-tagging and the ‘locl’ GSUB feature • Very few environments support this functionality—Adobe InDesign and modern browsers • Regional variation is not preserved in “plain text” • Regional variation can be preserved in “plain text” environments via IVSes • But, there are some challenges to face and hurdles to overcome… © 2016 Adobe Systems Incorporated. All Rights Reserved. 24 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs © 2016 Adobe Systems Incorporated. All Rights Reserved. 25 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ © 2016 Adobe Systems Incorporated. All Rights Reserved. 26 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ 㶶̠㶵 © 2016 Adobe Systems Incorporated. All Rights Reserved. 27 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ 㶶̠㶵 낧̠남̠낦 © 2016 Adobe Systems Incorporated. All Rights Reserved. 28 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ 㶶̠㶵 낧̠남̠낦 划̠刓̠刑̠ © 2016 Adobe Systems Incorporated. All Rights Reserved. 29 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ 㶶̠㶵 낧̠남̠낦 划̠刓̠刑̠ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ծկ̠ © 2016 Adobe Systems Incorporated. All Rights Reserved. 30 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ 㶶̠㶵 낧̠남̠낦 划̠刓̠刑̠ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ծկ̠ © 2016 Adobe Systems Incorporated. All Rights Reserved. 31 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ 㶶̠㶵 낧̠남̠낦 划̠刓̠刑̠ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ծկ̠ © 2016 Adobe Systems Incorporated. All Rights Reserved. 32 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ 㶶̠㶵 낧̠남̠낦 划̠刓̠刑̠ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ծկ̠ © 2016 Adobe Systems Incorporated. All Rights Reserved. 33 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 Regional Variation in Pan-CJK Typeface Designs ♧ 㶶̠㶵 낧̠남̠낦 划̠刓̠刑̠ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ⌍ ⌌ ծկ̠ © 2016 Adobe Systems Incorporated. All Rights Reserved. 34 IUC40—Santa Clara, CA, USA, Terra, Sol 2016-11-03 The “PanCJKV” IVD Collection • The extent to which glyphs can be shared across regions can vary… • …by typeface style • …by typeface design © 2016 Adobe Systems Incorporated. All Rights Reserved. 35 IUC40—Santa Clara, CA, USA, Terra,