how to add special glyphs

how to add special glyphs

[Rob Sargent]

[-- Attachment #1: Type: text/plain, Size: 533 bytes --]

I have added a "boxed x" and "CHECK MARK" to my document, but they do 
not get exported to pdf output.  They are in the .tex file, and do go 
through to the HTML.  So far I'm using these packages

    #+LaTeX_HEADER: \usepackage[T1]{fontenc}
    #+LaTeX_HEADER: \usepackage{libertine}
    #+LaTeX_HEADER: \usepackage[margin=0.80in]{geometry}
    #+LaTeX_HEADER: \usepackage{setspace}
    #+LaTeX_HEADER: \usepackage{enumitem}
    #+LaTeX_HEADER: \usepackage{endnotes}

(Bonus points for UTF8 code for the opposite of "CHECK MARK"?)

[-- Attachment #2: Type: text/html, Size: 1245 bytes --]

Re: how to add special glyphs

[Thomas S. Dye]

Rob Sargent <rsargent@xmission.com> writes:

> I have added a "boxed x" and "CHECK MARK" to my document, but 
> they do not get exported to pdf output.  They are in the .tex 
> file, and do go through to the HTML.  So far I'm using these
> packages
>
>  #+LaTeX_HEADER: \usepackage[T1]{fontenc}
>  #+LaTeX_HEADER: \usepackage{libertine}
>  #+LaTeX_HEADER: \usepackage[margin=0.80in]{geometry}
>  #+LaTeX_HEADER: \usepackage{setspace}
>  #+LaTeX_HEADER: \usepackage{enumitem}
>  #+LaTeX_HEADER: \usepackage{endnotes}
>
> (Bonus points for UTF8 code for the opposite of "CHECK MARK"?)

You need a package like wasysym that defines these symbols.  Check 
the web for David Carlisle, Scott Pakin, and Alexander Holt's "The 
Great, Big List of LaTeX Symbols" for more information.

All the best,
Tom

-- 
Thomas S. Dye
https://tsdye.online/tsdye

Re: how to add special glyphs

[Rob Sargent]

On 3/6/23 10:37, Thomas S. Dye wrote:
>
> Rob Sargent <rsargent@xmission.com> writes:
>
>> I have added a "boxed x" and "CHECK MARK" to my document, but they do 
>> not get exported to pdf output. They are in the .tex file, and do go 
>> through to the HTML.  So far I'm using these
>> packages
>>
>>  #+LaTeX_HEADER: \usepackage[T1]{fontenc}
>>  #+LaTeX_HEADER: \usepackage{libertine}
>>  #+LaTeX_HEADER: \usepackage[margin=0.80in]{geometry}
>>  #+LaTeX_HEADER: \usepackage{setspace}
>>  #+LaTeX_HEADER: \usepackage{enumitem}
>>  #+LaTeX_HEADER: \usepackage{endnotes}
>>
>> (Bonus points for UTF8 code for the opposite of "CHECK MARK"?)
>
> You need a package like wasysym that defines these symbols.  Check the 
> web for David Carlisle, Scott Pakin, and Alexander Holt's "The Great, 
> Big List of LaTeX Symbols" for more information.
>
> All the best,
> Tom
>
Thank you,
rjs

PS  I think the list got your answer twice?

Re: how to add special glyphs

[Rob Sargent]

On 3/6/23 10:42, Rob Sargent wrote:
>
>
> On 3/6/23 10:37, Thomas S. Dye wrote:
>>
>> Rob Sargent <rsargent@xmission.com> writes:
>>
>>> I have added a "boxed x" and "CHECK MARK" to my document, but they 
>>> do not get exported to pdf output. They are in the .tex file, and do 
>>> go through to the HTML.  So far I'm using these
>>> packages
>>>
>>>  #+LaTeX_HEADER: \usepackage[T1]{fontenc}
>>>  #+LaTeX_HEADER: \usepackage{libertine}
>>>  #+LaTeX_HEADER: \usepackage[margin=0.80in]{geometry}
>>>  #+LaTeX_HEADER: \usepackage{setspace}
>>>  #+LaTeX_HEADER: \usepackage{enumitem}
>>>  #+LaTeX_HEADER: \usepackage{endnotes}
>>>
>>> (Bonus points for UTF8 code for the opposite of "CHECK MARK"?)
>>
>> You need a package like wasysym that defines these symbols. Check the 
>> web for David Carlisle, Scott Pakin, and Alexander Holt's "The Great, 
>> Big List of LaTeX Symbols" for more information.
>>
>> All the best,
>> Tom
I settled for \ding{54}, but of course that doesn't work in the HTML 
export.  I keep bumping in to this works-here-not-there in export. Quite 
disappointing.

Re: how to add special glyphs

[Thomas S. Dye]

Rob Sargent <rsargent@xmission.com> writes:

> On 3/6/23 10:42, Rob Sargent wrote:

> I settled for \ding{54}, but of course that doesn't work in the 
> HTML export.  I
> keep bumping in to this works-here-not-there in export. Quite 
> disappointing.

LaTeX is great, but not for the faint of heart. 

I know two ways that might fix things for you.

One is org-entities-user, which makes a dictionary to cover html 
and LaTeX export, e.g.,
    (add-to-list 'org-entities-user '("eng" "\\ng" nil "&eng;" "g" 
    "g" "ŋ"))

Another is to use UTF-8 in LaTeX.  Here's one of my setups:

#+name: koma-article-liberation
#+header: :results silent
#+begin_src emacs-lisp
  (require 'ox-latex)
  (add-to-list
   'org-latex-classes
   '("koma-article-liberation"
     "\\documentclass{scrartcl}
  [NO-DEFAULT-PACKAGES]
  [PACKAGES]
  [EXTRA]
     \\usepackage{microtype}
     \\usepackage{amstext}
     \\usepackage{fontspec}
     \\usepackage{unicode-math}
     \\defaultfontfeatures{Ligatures=TeX}
     \\setmainfont{Liberation Serif}
     \\setsansfont{Liberation Sans}[Scale=MatchLowercase]
     \\setmonofont{Liberation Mono}[Scale=MatchLowercase]
     \\usepackage{paralist}
     \\let\\itemize\\compactitem
     \\let\\description\\compactdesc
     \\renewenvironment{enumerate}{\\begin{inparaenum}[(i)]}{\\end{inparaenum}}
     \\usepackage{fewerfloatpages}
     \\usepackage{graphicx}
     \\usepackage{textcomp}
     \\usepackage{array}
     \\usepackage[x11names]{xcolor}
     \\usepackage[colorlinks=true,allcolors=Blue4]{hyperref}
     \\usepackage[color=blue]{attachfile2}
     \\usepackage[cache=false]{minted}
     \\usemintedstyle{tango}
     \\usepackage{rotating}
     \\usepackage[authordate, giveninits=true, noibid, 
     sortcites=true, backend=biber, 
     bibencoding=utf8]{biblatex-chicago}
     \\addbibresource{tsd.bib}
     \\newcommand{\\rc}{$^{14}$C}"
     ("\\section{%s}" . "\\section*{%s}")
     ("\\subsection{%s}" . "\\subsection*{%s}")
     ("\\subsubsection{%s}" . "\\subsubsection*{%s}")
     ("\\paragraph{%s}" . "\\paragraph*{%s}")
     ("\\subparagraph{%s}" . "\\subparagraph*{%s}")))
#+end_src

The key here is the fontspec package.

If you go the UTF-8 route, then you'll need to compile with either 
XeLaTeX or LuaLaTeX, something like this:

#+name: xelatex-biber
#+header: :results silent
#+begin_src emacs-lisp
  (setq org-latex-pdf-process
        '("xelatex -interaction nonstopmode -shell-escape 
        -output-directory %o %f"
          "biber %b"
          "xelatex -interaction nonstopmode -shell-escape 
          -output-directory %o %f"
          "xelatex -interaction nonstopmode -shell-escape 
          -output-directory %o %f"))
#+end_src

hth,
Tom

-- 
Thomas S. Dye
https://tsdye.online/tsdye

Re: how to add special glyphs

[Rob Sargent]

On 3/6/23 16:06, Thomas S. Dye wrote:
>
> Rob Sargent <rsargent@xmission.com> writes:
>
>> On 3/6/23 10:42, Rob Sargent wrote:
>
>> I settled for \ding{54}, but of course that doesn't work in the HTML 
>> export.  I
>> keep bumping in to this works-here-not-there in export. Quite 
>> disappointing.
>
> LaTeX is great, but not for the faint of heart.
> I know two ways that might fix things for you.
>
> One is org-entities-user, which makes a dictionary to cover html and 
> LaTeX export, e.g.,
>    (add-to-list 'org-entities-user '("eng" "\\ng" nil "&eng;" "g"    
> "g" "ŋ"))
>
> Another is to use UTF-8 in LaTeX.  Here's one of my setups:
>
> #+name: koma-article-liberation
> #+header: :results silent
> #+begin_src emacs-lisp
>  (require 'ox-latex)
>  (add-to-list
>   'org-latex-classes
>   '("koma-article-liberation"
>     "\\documentclass{scrartcl}
>  [NO-DEFAULT-PACKAGES]
>  [PACKAGES]
>  [EXTRA]
>     \\usepackage{microtype}
>     \\usepackage{amstext}
>     \\usepackage{fontspec}
>     \\usepackage{unicode-math}
>     \\defaultfontfeatures{Ligatures=TeX}
>     \\setmainfont{Liberation Serif}
>     \\setsansfont{Liberation Sans}[Scale=MatchLowercase]
>     \\setmonofont{Liberation Mono}[Scale=MatchLowercase]
>     \\usepackage{paralist}
>     \\let\\itemize\\compactitem
>     \\let\\description\\compactdesc
> \\renewenvironment{enumerate}{\\begin{inparaenum}[(i)]}{\\end{inparaenum}}
>     \\usepackage{fewerfloatpages}
>     \\usepackage{graphicx}
>     \\usepackage{textcomp}
>     \\usepackage{array}
>     \\usepackage[x11names]{xcolor}
>     \\usepackage[colorlinks=true,allcolors=Blue4]{hyperref}
>     \\usepackage[color=blue]{attachfile2}
>     \\usepackage[cache=false]{minted}
>     \\usemintedstyle{tango}
>     \\usepackage{rotating}
>     \\usepackage[authordate, giveninits=true, noibid, sortcites=true, 
> backend=biber, bibencoding=utf8]{biblatex-chicago}
>     \\addbibresource{tsd.bib}
>     \\newcommand{\\rc}{$^{14}$C}"
>     ("\\section{%s}" . "\\section*{%s}")
>     ("\\subsection{%s}" . "\\subsection*{%s}")
>     ("\\subsubsection{%s}" . "\\subsubsection*{%s}")
>     ("\\paragraph{%s}" . "\\paragraph*{%s}")
>     ("\\subparagraph{%s}" . "\\subparagraph*{%s}")))
> #+end_src
>
> The key here is the fontspec package.
>
> If you go the UTF-8 route, then you'll need to compile with either 
> XeLaTeX or LuaLaTeX, something like this:
>
> #+name: xelatex-biber
> #+header: :results silent
> #+begin_src emacs-lisp
>  (setq org-latex-pdf-process
>        '("xelatex -interaction nonstopmode -shell-escape 
> -output-directory %o %f"
>          "biber %b"
>          "xelatex -interaction nonstopmode -shell-escape 
> -output-directory %o %f"
>          "xelatex -interaction nonstopmode -shell-escape 
> -output-directory %o %f"))
> #+end_src
>
> hth,
> Tom
>
Thanks again.

I think I have to decide on one format and stick with it.  I get bitten 
by ODT/DOC transformations, not sure I like the default look of 
LaTeX/pdf, HTML is pretty reliable but not best for handing out. Maybe 
I'll go back to "text" and call it good.


Cheers,
rjs

Re: how to add special glyphs

[Fraga, Eric]

Hi Rob,

On Monday,  6 Mar 2023 at 16:24, Rob Sargent wrote:
> I think I have to decide on one format and stick with it.  I get bitten
> by ODT/DOC transformations, not sure I like the default look of
> LaTeX/pdf, HTML is pretty reliable but not best for handing out. Maybe
> I'll go back to "text" and call it good.

For documents which I intend to export to multiple targets, PDF and HTML
specifically, I use lualatex instead of pdflatex for the PDF target.  I
insert the specific unicode characters directly in my text.  I then
include the following in my org file to ensure that the LaTeX handles
the unicode characters correctly:

#+latex_header: \usepackage{newunicodechar}
#+latex_header: \newunicodechar{α}{\ensuremath{\alpha}}
#+latex_header: \newunicodechar{δ}{\ensuremath{\delta}}
#+latex_header: \newunicodechar{Δ}{\ensuremath{\Delta}}
#+latex_header: \newunicodechar{∈}{\ensuremath{\in}}
#+latex_header: \newunicodechar{ν}{\ensuremath{\nu}}
#+latex_header: \newunicodechar{ϕ}{\ensuremath{\phi}}
#+latex_header: \newunicodechar{ï}{\"i}%"}
#+latex_header: \newunicodechar{±}{\ensuremath{\pm}}
#+latex_header: \newunicodechar{ρ}{\ensuremath{\rho}}
#+latex_header: \newunicodechar{√}{\ensuremath{\sqrt}}
#+latex_header: \newunicodechar{≻}{\ensuremath{\succ}}

This allows the characters to go straight through when exporting to HTML
but get converted to specific LaTeX when exporting to PDF.

I used this, for instance, for my recent book: https://tiny.cc/nl5yuz
This book, written in org with babel, had a lot of Julia code and one of
the nice things about Julia is you can use unicode characters for
variable and function names.  But exporting then becomes more
challenging!

For program listings, I had to also do the following:

#+latex_header: \usepackage{textgreek}
#+latex_header: \lstset{literate=
#+latex_header: {Δ}{{\textDelta}}1
#+latex_header: {δ}{{\textdelta}}1
#+latex_header: {∈}{{$\in$}}1
#+latex_header: {ï}{{\"i}}1%"}}
#+latex_header: {α}{{\textalpha}}1
#+latex_header: {β}{{\textbeta}}1
#+latex_header: {γ}{{\textgamma}}1
#+latex_header: {μ}{{\textmu}}1
#+latex_header: {π}{{\textpi}}1
#+latex_header: {ν}{{\textnu}}1
#+latex_header: {ω}{{\textomega}}1
#+latex_header: {ρ}{{\textrho}}1
#+latex_header: {ϕ}{{\textphi}}1
#+latex_header: {₁}{{$_1$}}1
#+latex_header: {₂}{{$_2$}}1
#+latex_header: {≥}{{$\ge$}}1
#+latex_header: {≤}{{$\le$}}1
#+latex_header: {≠}{{$\ne$}}1
#+latex_header: {±}{{$\pm$}}1
#+latex_header: {≻}{{$\succ$}}1
#+latex_header: }

HTH,
eric

-- 
: Eric S Fraga, with org release_9.6.1-278-ge52c53 in Emacs 30.0.50

Re: how to add special glyphs

[Ihor Radchenko]

Rob Sargent <rsargent@xmission.com> writes:

>>> You need a package like wasysym that defines these symbols. Check the 
>>> web for David Carlisle, Scott Pakin, and Alexander Holt's "The Great, 
>>> Big List of LaTeX Symbols" for more information.
>>> ...
> I settled for \ding{54}, but of course that doesn't work in the HTML 
> export.  I keep bumping in to this works-here-not-there in export. Quite 
> disappointing.

By default, Org HTML export uses MathJax to render LaTeX.
However, MathJax only supports a subset of LaTeX capabilities.
The only universal (but ugly) way to support arbitrary LaTeX is
converting LaTeX fragments to images. See "13.9.10 Math formatting in
HTML export" section of Org manual.

Alternatively, if the problem is just with unicode symbols, you can use
inline export snippets @@html:<unicode character>@@ to fine-tune HTML
export. Also, see "13.5 Macro Replacement".

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: how to add special glyphs

[Max Nikulin]

On 06/03/2023 22:42, Rob Sargent wrote:
> I have added a "boxed x" and "CHECK MARK" to my document, but they do 
> not get exported to pdf output.

LuaLaTeX may be instructed to use fallback fonts, see e.g.

https://list.orgmode.org/87bktus666.fsf_-_@posteo.net/
Juan Manuel Macías. Fallback fonts in LuaTeX via 
'luaotfload.add_fallback' (was "Fontsets"). Tue, 12 Jul 2022 15:26:57 +0000

https://list.orgmode.org/orgmode/scuirf$m7o$1@ciao.gmane.io/
Maxim Nikulin. Re: org-mode export to (latex) PDF. Sat, 17 Jul 2021
19:35:57 +0700

To my taste it is too low level.

Re: how to add special glyphs

[Rob Sargent]

On 3/7/23 08:54, Max Nikulin wrote:
> On 06/03/2023 22:42, Rob Sargent wrote:
>> I have added a "boxed x" and "CHECK MARK" to my document, but they do 
>> not get exported to pdf output.
>
> LuaLaTeX may be instructed to use fallback fonts, see e.g.
>
> https://list.orgmode.org/87bktus666.fsf_-_@posteo.net/
> Juan Manuel Macías. Fallback fonts in LuaTeX via 
> 'luaotfload.add_fallback' (was "Fontsets"). Tue, 12 Jul 2022 15:26:57 
> +0000
>
> https://list.orgmode.org/orgmode/scuirf$m7o$1@ciao.gmane.io/
> Maxim Nikulin. Re: org-mode export to (latex) PDF. Sat, 17 Jul 2021
> 19:35:57 +0700
>
> To my taste it is too low level.
That I placed the unicode into the text was "too low level"?  I could 
argue that "it's a UTF doc", or that "\ding{55}" is bizarrely high 
level.  Other's have shown methods which maximize the cross export 
experience.  I'll consider those.  I'm not sure LuaLaTex is an option 
for me.

rjs

Re: how to add special glyphs

[Max Nikulin]

On 08/03/2023 07:29, Rob Sargent wrote:
>> LuaLaTeX may be instructed to use fallback fonts, see e.g.
...
>> To my taste it is too low level.
> That I placed the unicode into the text was "too low level"?  I could 
> argue that "it's a UTF doc", or that "\ding{55}" is bizarrely high 
> level.  Other's have shown methods which maximize the cross export 
> experience.  I'll consider those.  I'm not sure LuaLaTex is an option 
> for me.

I would prefer to use Unicode symbols in UTF-8 encoded documents. While 
browsers and office software tries to find some substitution when some 
glyph is not available in requested font, configuration of LaTeX engines 
is more complicated. Support of Unicode in LuaTeX is much better than in 
pdfTeX. Unfortunately for characters outside of ~latin-1 set, all fonts 
must be carefully configured. I consider necessity to specify font per 
language and fallback fonts as too low level operations for regular users.

I do not see a robust way to determine fonts available for LaTeX to 
implement automatic configuration in ox-latex with reasonable amount of 
code.

I recommend to consider LuaLaTeX if you are going to use Unicode. 
Alternatives are PDF export through LibreOffice or through HTML and a 
browser.

Re: how to add special glyphs

[Rob Sargent]

> On Mar 8, 2023, at 3:09 AM, Pedro Andres Aranda Gutierrez <paaguti@gmail.com> wrote:
> 
> On 3/6/23 Rob Sargent <rsargent@xmission.com> wrote:
> 
>> I think I have to decide on one format and stick with it.  I get bitten
>> by ODT/DOC transformations, not sure I like the default look of
>> LaTeX/pdf, HTML is pretty reliable but not best for handing out. Maybe
>> I'll go back to "text" and call it good.
> 
> If my .2 cents can help:
> 
> At the end, I bargained with myself and settled for PDF/LaTeX. I'm using
> 
> #+LATEX_HEADER: \usepackage{helvet}
> #+LATEX_HEADER: \renewcommand\familydefault{\sfdefault}
> 
> for SansSerif fonts after some reading about adapted documents. They
> seem to work well with most LaTeX classes as well as Beamer
> presentations and handouts.
> 
> I'm spending time with listing exports because I'm not against some
> code samples being available for *reliable* copy and paste and the
> current exporters in LaTeX don't completely please me (but that's the
> real danger with LaTeX, noone but me to blame for it ;-) )
> 
> Best, /PA
> -- 
> Fragen sind nicht da um beantwortet zu werden,
> Fragen sind da um gestellt zu werden
> Georg Kreisler
> 
> Headaches with a Juju log:
> unit-basic-16: 09:17:36 WARNING juju.worker.uniter.operation we should
> run a leader-deposed hook here, but we can't yet
> 

It very much helps. Thank you

rjs

Re: how to add special glyphs

[Rob Sargent]

> On Mar 8, 2023, at 7:59 AM, Max Nikulin <manikulin@gmail.com> wrote:
> 
> On 08/03/2023 07:29, Rob Sargent wrote:
>>> LuaLaTeX may be instructed to use fallback fonts, see e.g.
> ...
>>> To my taste it is too low level.
>> That I placed the unicode into the text was "too low level"?  I could argue that "it's a UTF doc", or that "\ding{55}" is bizarrely high level.  Other's have shown methods which maximize the cross export experience.  I'll consider those.  I'm not sure LuaLaTex is an option for me.
> 
> I would prefer to use Unicode symbols in UTF-8 encoded documents. While browsers and office software tries to find some substitution when some glyph is not available in requested font, configuration of LaTeX engines is more complicated. Support of Unicode in LuaTeX is much better than in pdfTeX. Unfortunately for characters outside of ~latin-1 set, all fonts must be carefully configured. I consider necessity to specify font per language and fallback fonts as too low level operations for regular users.
> 
> I do not see a robust way to determine fonts available for LaTeX to implement automatic configuration in ox-latex with reasonable amount of code.
> 
> I recommend to consider LuaLaTeX if you are going to use Unicode. Alternatives are PDF export through LibreOffice or through HTML and a browser.
Thank you Max. Another vote for LuaTeX! And for Unicode. 

rjs

Re: how to add special glyphs

[Pedro Andres Aranda Gutierrez]

BTW,

for listings, this seems to help with the backslashes

\usepackage{upquote}
\newcommand{\BSL}{\char`\\}

Best, /PA

On Wed, 8 Mar 2023 at 16:14, Rob Sargent <rsargent@xmission.com> wrote:
>
>
>
> > On Mar 8, 2023, at 3:09 AM, Pedro Andres Aranda Gutierrez <paaguti@gmail.com> wrote:
> >
> > On 3/6/23 Rob Sargent <rsargent@xmission.com> wrote:
> >
> >> I think I have to decide on one format and stick with it.  I get bitten
> >> by ODT/DOC transformations, not sure I like the default look of
> >> LaTeX/pdf, HTML is pretty reliable but not best for handing out. Maybe
> >> I'll go back to "text" and call it good.
> >
> > If my .2 cents can help:
> >
> > At the end, I bargained with myself and settled for PDF/LaTeX. I'm using
> >
> > #+LATEX_HEADER: \usepackage{helvet}
> > #+LATEX_HEADER: \renewcommand\familydefault{\sfdefault}
> >
> > for SansSerif fonts after some reading about adapted documents. They
> > seem to work well with most LaTeX classes as well as Beamer
> > presentations and handouts.
> >
> > I'm spending time with listing exports because I'm not against some
> > code samples being available for *reliable* copy and paste and the
> > current exporters in LaTeX don't completely please me (but that's the
> > real danger with LaTeX, noone but me to blame for it ;-) )
> >
> > Best, /PA
> > --
> > Fragen sind nicht da um beantwortet zu werden,
> > Fragen sind da um gestellt zu werden
> > Georg Kreisler
> >
> > Headaches with a Juju log:
> > unit-basic-16: 09:17:36 WARNING juju.worker.uniter.operation we should
> > run a leader-deposed hook here, but we can't yet
> >
>
> It very much helps. Thank you
>
> rjs



-- 
Fragen sind nicht da um beantwortet zu werden,
Fragen sind da um gestellt zu werden
Georg Kreisler

Headaches with a Juju log:
unit-basic-16: 09:17:36 WARNING juju.worker.uniter.operation we should
run a leader-deposed hook here, but we can't yet