<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang="EN-US" link="blue" vlink="purple"> <div class="WordSection1"> I agree, the font question does seem to be irrelevant. I was just responding to Cody’s comments. However, I’m still lost on getting the correct ligature back from the HarfBuzz shaping engine when I give it a simple Tamil word comprised of the Tamil characters ii, tta and u. According to Google, this word “ஈடு” translates to the verb “compensate.” “ஈடு” is the two glyphs ஈ and டு , the latter of which is the ligature formed by the codepoints corresponding to the glyphs ட and உ. <o:p></o:p> <o:p> </o:p> So is it a question of enabling the correct font features? Is there something beyond the basic examples that’s required to get the shaper to return the ligature for the tta and u consonant-vowel combination? Do I have a basic misunderstanding of what HarfBuzz does? <o:p></o:p> <o:p> </o:p> Here’s a bit of the code I’m using. It’s derived from the example found in git here: tangrams/harfbuzz-example (<a href="https://github.com/tangrams/harfbuzz-example/tree/a267a0032aa429b2f86959a9f083c607c506bed7">https://github.com/tangrams/harfbuzz-example/tree/a267a0032aa429b2f86959a9f083c607c506bed7</a>).<o:p></o:p> <o:p> </o:p> In that last loop in FDHBShaper, I understand that the glyph id’s are NOT Unicode code points but are the id’s assigned in the font. What I’m getting back (the output) are the same id’s that correspond to my input. Should I be getting two glyph id’s back (ஈ and டு ) for the three I input ( ஈ, ட and உ ) to the shaper?<o:p></o:p> <o:p> </o:p> #pragma once<o:p></o:p> <o:p> </o:p> #include "hb.h"<o:p></o:p> #include "hb-ft.h"<o:p></o:p> #include <vector><o:p></o:p> <o:p> </o:p> using namespace std;<o:p></o:p> <o:p> </o:p> typedef struct {<o:p></o:p> unsigned char* buffer;<o:p></o:p> unsigned int width;<o:p></o:p> unsigned int height;<o:p></o:p> float bearing_x;<o:p></o:p> float bearing_y;<o:p></o:p> } Glyph;<o:p></o:p> <o:p> </o:p> typedef struct {<o:p></o:p> std::string data;<o:p></o:p> std::string language;<o:p></o:p> hb_script_t script;<o:p></o:p> hb_direction_t direction;<o:p></o:p> const char* c_data() { return data.c_str(); };<o:p></o:p> } HBText;<o:p></o:p> <o:p> </o:p> namespace HBFeature {<o:p></o:p> const hb_tag_t KernTag = HB_TAG('k', 'e', 'r', 'n'); // kerning operations<o:p></o:p> const hb_tag_t LigaTag = HB_TAG('l', 'i', 'g', 'a'); // standard ligature substitution<o:p></o:p> const hb_tag_t CligTag = HB_TAG('c', 'l', 'i', 'g'); // contextual ligature substitution<o:p></o:p> const hb_tag_t PstsTag = HB_TAG('p', 's', 't', 's'); // ? ligature substitution<o:p></o:p> <o:p> </o:p> static hb_feature_t LigatureOff = { LigaTag, 0, 0, std::numeric_limits<unsigned int>::max() };<o:p></o:p> static hb_feature_t LigatureOn = { LigaTag, 1, 0, std::numeric_limits<unsigned int>::max() };<o:p></o:p> static hb_feature_t KerningOff = { KernTag, 0, 0, std::numeric_limits<unsigned int>::max() };<o:p></o:p> static hb_feature_t KerningOn = { KernTag, 1, 0, std::numeric_limits<unsigned int>::max() };<o:p></o:p> static hb_feature_t CligOff = { CligTag, 0, 0, std::numeric_limits<unsigned int>::max() };<o:p></o:p> static hb_feature_t CligOn = { CligTag, 1, 0, std::numeric_limits<unsigned int>::max() };<o:p></o:p> static hb_feature_t PstsOff = { PstsTag, 0, 0, std::numeric_limits<unsigned int>::max() };<o:p></o:p> static hb_feature_t PstsOn = { PstsTag, 1, 0, std::numeric_limits<unsigned int>::max() };<o:p></o:p> }<o:p></o:p> <o:p> </o:p> class FDHBShaper<o:p></o:p> {<o:p></o:p> public:<o:p></o:p> FDHBShaper(const string& fontFile);<o:p></o:p> virtual ~FDHBShaper();<o:p></o:p> <o:p> </o:p> void init();<o:p></o:p> void initText(HBText& text);<o:p></o:p> void addFeature(hb_feature_t feature);<o:p></o:p> <o:p> </o:p> private:<o:p></o:p> <o:p> </o:p> FT_Library lib;<o:p></o:p> FT_Face* face;<o:p></o:p> <o:p> </o:p> hb_font_t* font;<o:p></o:p> hb_buffer_t* buffer;<o:p></o:p> vector<hb_feature_t> features;<o:p></o:p> };<o:p></o:p> <o:p> </o:p> FDHBShaper::FDHBShaper(const string& fontFile)<o:p></o:p> {<o:p></o:p> FT_Error error = FT_Init_FreeType(&lib);<o:p></o:p> assert(!error);<o:p></o:p> <o:p> </o:p> float size = 50;<o:p></o:p> face = new FT_Face;<o:p></o:p> <o:p> </o:p> error = FT_New_Face(lib, fontFile.c_str(), 0, face);<o:p></o:p> assert(!error);<o:p></o:p> }<o:p></o:p> <o:p> </o:p> FDHBShaper::~FDHBShaper()<o:p></o:p> {<o:p></o:p> hb_buffer_destroy(buffer);<o:p></o:p> hb_font_destroy(font);<o:p></o:p> <o:p> </o:p> FT_Done_Face(*face);<o:p></o:p> delete face;<o:p></o:p> }<o:p></o:p> <o:p> </o:p> void FDHBShaper::addFeature(hb_feature_t feature)<o:p></o:p> {<o:p></o:p> features.push_back(feature);<o:p></o:p> }<o:p></o:p> <o:p> </o:p> void FDHBShaper::init()<o:p></o:p> {<o:p></o:p> font = hb_ft_font_create(*face, NULL);<o:p></o:p> buffer = hb_buffer_create();<o:p></o:p> <o:p> </o:p> hb_buffer_allocation_successful(buffer);<o:p></o:p> }<o:p></o:p> <o:p> </o:p> void FDHBShaper::initText(HBText& text)<o:p></o:p> {<o:p></o:p> hb_buffer_reset(buffer);<o:p></o:p> <o:p> </o:p> hb_buffer_set_direction(buffer, text.direction);<o:p></o:p> hb_buffer_set_script(buffer, text.script);<o:p></o:p> hb_buffer_set_language(buffer, hb_language_from_string(text.language.c_str(), text.language.size()));<o:p></o:p> size_t length = text.data.size();<o:p></o:p> <o:p> </o:p> hb_buffer_add_utf8(buffer, text.c_data(), length, 0, length);<o:p></o:p> <o:p> </o:p> hb_shape(font, buffer, features.empty() ? NULL : &features[0], features.size());<o:p></o:p> <o:p> </o:p> unsigned int glyphCount;<o:p></o:p> hb_glyph_info_t *glyphInfo = hb_buffer_get_glyph_infos(buffer, &glyphCount);<o:p></o:p> hb_glyph_position_t *glyphPos = hb_buffer_get_glyph_positions(buffer, &glyphCount);<o:p></o:p> <o:p> </o:p> for (unsigned int i = 0; i < glyphCount; ++i)<o:p></o:p> {<o:p></o:p> hb_codepoint_t glyphid = glyphInfo[i].codepoint;<o:p></o:p> }<o:p></o:p> }<o:p></o:p> <o:p> </o:p> From: Behdad Esfahbod <behdad@behdad.org> Sent: April 11, 2019 8:58 AM To: Bobby de Vos <bobby_devos@sil.org> Cc: Paul Daughetee <Daughetee@finaldraft.com>; Cody Planteen <planteen@gmail.com>; harfbuzz@lists.freedesktop.org Subject: Re: [HarfBuzz] Question on converting UTF-8 codepoints to complex glyphs<o:p></o:p> <o:p> </o:p> <div> What you say seems irrelevant to me. Jonathan is correct.<o:p></o:p> </div> <o:p> </o:p> <div> <div> On Thu, Apr 11, 2019, 11:34 AM Bobby de Vos <<a href="mailto:bobby_devos@sil.org">bobby_devos@sil.org</a>> wrote:<o:p></o:p> </div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in"> <div> Paul,<o:p></o:p> You don't need to convert the Google Tamil font to OpenType, Google has already done that at<o:p></o:p> <a href="https://github.com/googlei18n/noto-fonts/tree/master/phaseIII_only/unhinted/otf/NotoSansTamil" target="_blank">https://github.com/googlei18n/noto-fonts/tree/master/phaseIII_only/unhinted/otf/NotoSansTamil</a><o:p></o:p> However, I don't think those fonts will solve your issue. The list of shapers that you mention are different technologies to specify the complex shaping (such ligatures, positioning, sub forms, half foms, etc). Indeed, OpenType is one such technology. SIL Graphite and Apple Advanced Typography (AAT) are other technologies to do this.<o:p></o:p> TrueType fonts can contain OpenType shaping instructions. You do not have to have an OpenType font format to use OpenType shaping.<o:p></o:p> TrueType fonts have quadratic Bézier curves for their glyphs. Fonts in the OpenType font format can use the same quadratic Bézier curves, or cubic Bézier curves. The OTF files I mentioned above have cubic Bézier curves.<o:p></o:p> <a href="https://en.wikipedia.org/wiki/B%C3%A9zier_curve#Fonts" target="_blank">https://en.wikipedia.org/wiki/B%C3%A9zier_curve#Fonts</a><o:p></o:p> If I have mis-understood your situation, and/or made any errors if what I wrote, I apologize.<o:p></o:p> Bobby<o:p></o:p> <div> On 2019-04-10 3:25 p.m., Paul Daughetee wrote:<o:p></o:p> </div> <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt"> <div> Thanks for the quick response. I’m a licensed user of FontCreator Professional Edition from High-Logic and have the most recent update to version 11.5 installed. The correct ligature is displayed when I type the tta and u Tamil characters into the test string edit box in the OpenType Designer dialog. In the box just below the test string the two characters are displayed unless I check either the _shaper or psts feature check box. If one of those is checked, then the correct ligature is displayed. So I guess Google did get the Tamil font right but I cannot seem to get HarfBuzz to return a single glyph id when presented with a buffer containing the tta and u Tamil characters. I’ve tried adding various features when calling hb_shape but that doesn’t seem to change anything.<o:p></o:p> <o:p></o:p> I noticed that when I list shapers using a call to hb_shape_list_shapers, the only shaper listed is “ot”. So I guess my next try will be to convert the Google Tamil true type font to an open type font and see if that makes any difference. If it does, I guess I’ll be having a “duh” moment. <o:p></o:p> <o:p></o:p> From: Cody Planteen <a href="mailto:planteen@gmail.com" target="_blank"><planteen@gmail.com></a> Sent: April 10, 2019 12:38 PM To: Paul Daughetee <a href="mailto:Daughetee@finaldraft.com" target="_blank"> <Daughetee@finaldraft.com></a> Cc: <a href="mailto:harfbuzz@lists.freedesktop.org" target="_blank">harfbuzz@lists.freedesktop.org</a> Subject: Re: [HarfBuzz] Question on converting UTF-8 codepoints to complex glyphs<o:p></o:p> <o:p></o:p> <div> <div> <div> It's possible your font isn't doing what you think it should be. You can test this theory with the tool High-Logic FontCreator for Windows. I believe there is a free evaluation. You can open up your font, then go to Font -> OpenType Designer. In this dialog, you can enter your test string and see what glyphs come out.<o:p></o:p> </div> <div> <o:p></o:p> </div> <div> <a href="https://www.high-logic.com/font-editor/fontcreator" target="_blank">https://www.high-logic.com/font-editor/fontcreator</a><o:p></o:p> </div> <o:p></o:p> </div> </div> <o:p></o:p> <div> On Wed, Apr 10, 2019 at 1:19 PM Paul Daughetee <<a href="mailto:Daughetee@finaldraft.com" target="_blank">Daughetee@finaldraft.com</a>> wrote:<o:p></o:p> </div> <div> <div> Let me give you a little more info. I just recently built and installed vcpkg and used it to install HarfBuzz on Windows 10. It installed version 2.3.1-3 of the static libraries for Window x86. I linked my app to the HarfBuzz library and its dependencies. I added code to my app to capture single words that I could send to be processed by HarfBuzz as they were typed by the user. I installed Google’s NotoSansTamil true type font after verifying that it properly defined substitutions for the ligature that is formed by the Tamil consonant “tta” when paired with a vowel such as “u” or “I”. After processing a UTF-8 string containing the consonant and the vowel “tta” and “u” [0xE0, 0xAE, 0x9F, 0xE0, 0xAE, 0x89], the hb_glyph_info_t object I get back has tow glyph indices, the same indices as the “tta” and “u” (17, 10) rather than the index for the “ttauvowelsign” (116) ligature I expected. My code is virtually identical to the examples found in the HarfBuzz wiki and to several examples found in git. Any help here would be greatly appreciated.<o:p></o:p> <o:p></o:p> From: Behdad Esfahbod <<a href="mailto:behdad@behdad.org" target="_blank">behdad@behdad.org</a>> Sent: April 8, 2019 1:47 PM To: Paul Daughetee <<a href="mailto:Daughetee@finaldraft.com" target="_blank">Daughetee@finaldraft.com</a>> Cc: <a href="mailto:harfbuzz@lists.freedesktop.org" target="_blank">harfbuzz@lists.freedesktop.org</a> Subject: Re: [HarfBuzz] Question on converting UTF-8 codepoints to complex glyphs<o:p></o:p> <o:p></o:p> <div> <div> On Mon, Apr 8, 2019 at 4:12 PM Paul Daughetee <<a href="mailto:Daughetee@finaldraft.com" target="_blank">Daughetee@finaldraft.com</a>> wrote:<o:p></o:p> </div> <div> <blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)"> <div> <div> I’m new to HarfBuzz and attempting to use it for converting a UTF-8 string that contains one or more sets of codepoints that should combine to form single complex glyphs to the correct string of glyphs. I’ve followed numerous examples and they all lead me to the point where I use hb_buffer_get_glyph_infos to get what I thought would be a hb_glyph_info object that contains the codepoints for the glyphs I seek. So my first question is as follows. Is that what I should be getting? I ask because I’m not getting what I would expect to get.<o:p></o:p> </div> </div> </blockquote> <div> <o:p></o:p> </div> <div> Yes.<o:p></o:p> </div> <div> <o:p></o:p> </div> <div> <o:p></o:p> </div> <blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)"> <div> <div> I can’t even successfully get a complex glyph to represent the combination of the letter A and the grave accent. So if I’m just confused as to how or what HarfBuzz does, please help me find a better path. Thanks!<o:p></o:p> </div> </div> </blockquote> <div> <o:p></o:p> </div> <div> What do you get? A + grave-accent only forms one glyph if the font was designed so. It may very well be represented by two glyphs. <o:p></o:p> </div> <blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)"> <div> <div> <o:p></o:p> </div> </div> _______________________________________________ HarfBuzz mailing list <a href="mailto:HarfBuzz@lists.freedesktop.org" target="_blank">HarfBuzz@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/harfbuzz" target="_blank">https://lists.freedesktop.org/mailman/listinfo/harfbuzz</a><o:p></o:p> </blockquote> </div> <o:p></o:p> <div> <o:p></o:p> </div> -- <o:p></o:p> <div> behdad <a href="http://behdad.org/" target="_blank">http://behdad.org/</a><o:p></o:p> </div> </div> </div> </div> _______________________________________________ HarfBuzz mailing list <a href="mailto:HarfBuzz@lists.freedesktop.org" target="_blank">HarfBuzz@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/harfbuzz" target="_blank">https://lists.freedesktop.org/mailman/listinfo/harfbuzz</a><o:p></o:p> </div> <o:p> </o:p> <pre>_______________________________________________<o:p></o:p></pre> <pre>HarfBuzz mailing list<o:p></o:p></pre> <pre><a href="mailto:HarfBuzz@lists.freedesktop.org" target="_blank">HarfBuzz@lists.freedesktop.org</a><o:p></o:p></pre> <pre><a href="https://lists.freedesktop.org/mailman/listinfo/harfbuzz" target="_blank">https://lists.freedesktop.org/mailman/listinfo/harfbuzz</a><o:p></o:p></pre> </blockquote> <div> -- Bobby de Vos <a href="mailto:bobby_devos@sil.org" target="_blank">bobby_devos@sil.org</a><o:p></o:p> </div> </div> _______________________________________________ HarfBuzz mailing list <a href="mailto:HarfBuzz@lists.freedesktop.org" target="_blank">HarfBuzz@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/harfbuzz" target="_blank">https://lists.freedesktop.org/mailman/listinfo/harfbuzz</a><o:p></o:p> </blockquote> </div> </div> </body> </html>