[BUG] Unexpected behaviour of TAB in table depending on font family [9.6.15 (release_9.6.15 @ /snap/emacs/current/usr/share/emacs/29.4/lisp/org/)]

[BUG] Unexpected behaviour of TAB in table depending on font family [9.6.15 (release_9.6.15 @ /snap/emacs/current/usr/share/emacs/29.4/lisp/org/)]

[Giovanni Pavolini]

[-- Attachment #1: Type: text/plain, Size: 5194 bytes --]

--text follows this line--

Remember to cover the basics, that is, what you expected to happen and
what in fact did happen.  You don't know how to make a good report?  See

     https://orgmode.org/manual/Feedback.html#Feedback

Your bug report will be posted to the Org mailing list.
------------------------------------------------------------------------

I wanted to customize my default font by `(custom-set-faces '(default
((t(:family "Ubuntu")))))`. Then, after `M-x org-table-create` the TAB
started creating a cell to the left of the one it should have jumped to
(see a video here (webmd video of the screencast):
https://u.pcloud.link/publink/show?code=XZVXhe0Z2K8AAQBKOwQH7uE7LkNtHYGlHQTy
). The expected behaviour is that TAB only jumps to the next cell,
without creating additional ones. The actual behaviour is, depending on
the family font used, it does create an additional cell. Not every
font causes the unexpected behaviour.

I made a list of all fonts I have installed in my machine (shell
`fc-list -b` and then get the text in "family"), and tested if
they caused the TAB to behave unexpectedly or not. The results are here
(org file):
https://u.pcloud.link/publink/show?code=XZbXhe0ZptNoWfCjJc7bKxFCXyzTgzNKdDsV
. 34 of the 173 fonts I have installed fail (cause the unexpected
behaviour).

Emacs  : GNU Emacs 29.4 (build 2, x86_64-pc-linux-gnu, GTK+ Version
3.24.20, cairo version 1.16.0)
 of 2024-06-23
Package: Org mode version 9.6.15 (release_9.6.15 @
/snap/emacs/current/usr/share/emacs/29.4/lisp/org/)

current state:
==============
(setq
 org-link-elisp-confirm-function 'yes-or-no-p
 org-bibtex-headline-format-function #[257 "\300 \236A\207" [:title] 3
"\n\n(fn ENTRY)"]
 org-persist-after-read-hook '(org-element--cache-persist-after-read)
 org-export-before-parsing-hook '(org-attach-expand-links)
 org-cycle-tab-first-hook '(org-babel-hide-result-toggle-maybe
org-babel-header-arg-expand)
 org-archive-hook '(org-attach-archive-delete-maybe)
 org-cycle-hook '(org-cycle-hide-archived-subtrees
org-cycle-show-empty-lines org-cycle-optimize-window-after-visibility-change
 org-cycle-display-inline-images)
 org-persist-before-read-hook '(org-element--cache-persist-before-read)
 org-mode-hook '(#[0 "\300\301\302\303\304$\207" [add-hook
change-major-mode-hook org-fold-show-all append local] 5]
#[0 "\300\301\302\303\304$\207" [add-hook change-major-mode-hook
org-babel-show-result-all append local] 5]
org-babel-result-hide-spec org-babel-hide-all-hashes)
 org-confirm-shell-link-function 'yes-or-no-p
 outline-isearch-open-invisible-function 'outline-isearch-open-invisible
 org-agenda-before-write-hook '(org-agenda-add-entry-text)
 org-src-mode-hook '(org-src-babel-configure-edit-buffer
org-src-mode-configure-edit-buffer)
 org-confirm-elisp-link-function 'yes-or-no-p
 org-speed-command-hook '(org-speed-command-activate
org-babel-speed-command-activate)
 org-persist-directory "/tmp/org-persist-21hJMa"
 org-fold-core-isearch-open-function 'org-fold-core--isearch-reveal
 org-persist-before-write-hook '(org-element--cache-persist-before-write)
 org-tab-first-hook '(org-babel-hide-result-toggle-maybe
org-babel-header-arg-expand)
 org-link-shell-confirm-function 'yes-or-no-p
 org-babel-pre-tangle-hook '(save-buffer)
 org-agenda-loop-over-headlines-in-active-region nil
 org-occur-hook '(org-first-headline-recenter)
 org-metadown-hook '(org-babel-pop-to-session-maybe)
 org-link-parameters '(("attachment" :follow org-attach-follow :complete
org-attach-complete-link) ("id" :follow org-id-open)
      ("eww" :follow org-eww-open :store org-eww-store-link)
      ("rmail" :follow org-rmail-open :store org-rmail-store-link)
      ("mhe" :follow org-mhe-open :store org-mhe-store-link)
      ("irc" :follow org-irc-visit :store org-irc-store-link :export
org-irc-export)
      ("info" :follow org-info-open :export org-info-export :store
org-info-store-link :insert-description
org-info-description-as-command)
      ("gnus" :follow org-gnus-open :store org-gnus-store-link)
      ("docview" :follow org-docview-open :export org-docview-export :store
org-docview-store-link)
      ("bibtex" :follow org-bibtex-open :store org-bibtex-store-link)
      ("bbdb" :follow org-bbdb-open :export org-bbdb-export :complete
org-bbdb-complete-link :store
org-bbdb-store-link)
      ("w3m" :store org-w3m-store-link) ("doi" :follow org-link-doi-open
:export org-link-doi-export)
      ("file+sys") ("file+emacs") ("shell" :follow org-link--open-shell)
      ("news" :follow #[514 "\301\300\302 Q \"\207" ["news" browse-url ":"]
6 "\n\n(fn URL ARG)"])
      ("mailto" :follow #[514 "\301\300\302 Q \"\207" ["mailto" browse-url
":"] 6 "\n\n(fn URL ARG)"])
      ("https" :follow #[514 "\301\300\302 Q \"\207" ["https" browse-url
":"] 6 "\n\n(fn URL ARG)"])
      ("http" :follow #[514 "\301\300\302 Q \"\207" ["http" browse-url ":"]
6 "\n\n(fn URL ARG)"])
      ("ftp" :follow #[514 "\301\300\302 Q \"\207" ["ftp" browse-url ":"] 6
"\n\n(fn URL ARG)"])
      ("help" :follow org-link--open-help :store org-link--store-help)
      ("file" :complete org-link-complete-file) ("elisp" :follow
org-link--open-elisp))
 org-metaup-hook '(org-babel-load-in-session-maybe)
 )

[-- Attachment #2: Type: text/html, Size: 6508 bytes --]

Re: [BUG] Unexpected behaviour of TAB in table depending on font family [9.6.15 (release_9.6.15 @ /snap/emacs/current/usr/share/emacs/29.4/lisp/org/)]

[Ihor Radchenko]

[-- Attachment #1: Type: text/plain, Size: 1694 bytes --]

Giovanni Pavolini <giovanni.pavolini@gmail.com> writes:

> I wanted to customize my default font by `(custom-set-faces '(default
> ((t(:family "Ubuntu")))))`. Then, after `M-x org-table-create` the TAB
> started creating a cell to the left of the one it should have jumped to
> (see a video here (webmd video of the screencast):
> https://u.pcloud.link/publink/show?code=XZVXhe0Z2K8AAQBKOwQH7uE7LkNtHYGlHQTy
> ). The expected behaviour is that TAB only jumps to the next cell,
> without creating additional ones. The actual behaviour is, depending on
> the family font used, it does create an additional cell. Not every
> font causes the unexpected behaviour.

[ Side note: we prefer text descriptions on the mailing lists. Videos,
  especially uploaded to third-party servers, may disappear after
  several years, leading to losing access to discussion context. Also,
  not every reader can access non-text information (consider blind users) ]

From the video the reproducer is the following:

1. emacs -q
2. Create a new Org file
3. M-x org-table-create <RET> 2x2 <RET>
4. a TAB table TAB a TAB table
5. Observe table filled with "a" and "table" cells

| a | table |
|---+-------|
| a | table |

6. M-: (custom-set-faces '(default ((t (:family "Noto Sans CJK HK")))))
7. Move point to the end of buffer
8. Repeat steps 3-4
9. Observe

| a |   | table |
|---+---+------|
|   | a | table |

I was able to reproduce using Org mode version shipped with Emacs 29.
I was unable to reproduce using the latest Org mode version.

May you please try to upgrade Org mode? Does the problem disappear then?

P.S.
Attaching the list of working/non-working fonts to keep it available for
future reference.


[-- Attachment #2: test.org --]
[-- Type: application/vnd.lotus-organizer, Size: 3235 bytes --]

Abyssinica SIL: *OK*
Andale Mono: *OK*
Ani: *OK*
AnjaliOldLipi: *OK*
Arial Black: *FAILS*
Arial: *OK*
Bitstream Charter: *OK*
C059: *OK*
Chandas: *OK*
Chilanka: *OK*
Comic Sans MS: *OK*
Courier 10 Pitch: *OK*
Courier New: *OK*
D050000L: *FAILS*
DejaVu Sans Mono: *OK*
DejaVu Sans: *OK*
DejaVu Serif: *OK*
Dhurjati: *OK*
Droid Sans Fallback: *OK*
Dyuthi: *FAILS*
FreeMono: *OK*
FreeSans: *FAILS*
FreeSerif: *OK*
Gargi: *FAILS*
Garuda: *OK*
Gayathri: *FAILS*
Georgia: *OK*
Gidugu: *FAILS*
Gubbi: *OK*
Gurajada: *OK*
Impact: *FAILS*
Jamrul: *FAILS*
KacstArt: *FAILS*
KacstBook: *FAILS*
KacstDecorative: *FAILS*
KacstDigital: *FAILS*
KacstFarsi: *FAILS*
KacstLetter: *FAILS*
KacstNaskh: *FAILS*
KacstOffice: *FAILS*
KacstOne: *OK*
KacstPen: *OK*
KacstPoster: *OK*
KacstQurn: *OK*
KacstScreen: *OK*
KacstTitle: *OK*
KacstTitleL: *OK*
Kalapi: *OK*
Kalimati: *OK*
Karumbi: *OK*
Keraleeyam: *OK*
Khmer OS System: *OK*
Khmer OS: *OK*
Kinnari: *OK*
LKLUG: *OK*
LakkiReddy: *OK*
Laksaman: *OK*
Liberation Mono: *OK*
Liberation Sans Narrow: *OK*
Liberation Sans: *OK*
Liberation Serif: *OK*
Likhan: *OK*
Lohit Assamese: *OK*
Lohit Bengali: *OK*
Lohit Devanagari: *OK*
Lohit Gujarati: *OK*
Lohit Gurmukhi: *OK*
Lohit Kannada: *OK*
Lohit Malayalam: *OK*
Lohit Odia: *OK*
Lohit Tamil Classical: *OK*
Lohit Tamil: *OK*
Lohit Telugu: *OK*
Loma: *OK*
Mallanna: *OK*
Mandali: *OK*
Manjari: *FAILS*
Meera: *OK*
Mitra: *OK*
Mukti: *FAILS*
NATS: *OK*
NTR: *OK*
Nakula: *OK*
Navilu: *OK*
Nimbus Mono PS: *OK*
Nimbus Roman: *OK*
Nimbus Sans Narrow: *OK*
Nimbus Sans: *OK*
Norasi: *OK*
Noto Color Emoji: *OK*
Noto Mono: *OK*
Noto Sans CJK HK: *FAILS*
Noto Sans CJK JP: *FAILS*
Noto Sans CJK KR: *FAILS*
Noto Sans CJK SC: *FAILS*
Noto Sans CJK TC: *FAILS*
Noto Sans Mono CJK HK: *OK*
Noto Sans Mono CJK JP: *OK*
Noto Sans Mono CJK KR: *OK*
Noto Sans Mono CJK SC: *OK*
Noto Sans Mono CJK TC: *OK*
Noto Sans Mono: *OK*
Noto Serif CJK HK: *FAILS*
Noto Serif CJK JP: *FAILS*
Noto Serif CJK KR: *FAILS*
Noto Serif CJK SC: *FAILS*
Noto Serif CJK TC: *FAILS*
OpenSymbol: *OK*
P052: *OK*
Padauk Book: *OK*
Padauk: *OK*
Pagul: *OK*
Peddana: *OK*
Phetsarath OT: *OK*
Ponnala: *OK*
Pothana2000: *OK*
Potti Sreeramulu: *FAILS*
Purisa: *OK*
Rachana: *OK*
RaghuMalayalamSans: *OK*
Ramabhadra: *OK*
Ramaraja: *OK*
Rasa: *OK*
RaviPrakash: *OK*
Rekha: *OK*
Saab: *OK*
Sahadeva: *OK*
Samanata: *OK*
Samyak Devanagari: *OK*
Samyak Gujarati: *OK*
Samyak Malayalam: *OK*
Samyak Tamil: *OK*
Sarai: *OK*
Sawasdee: *OK*
Sree Krushnadevaraya: *OK*
Standard Symbols PS: *FAILS*
Suranna: *OK*
Suravaram: *OK*
Suruma: *FAILS*
Syamala Ramana: *FAILS*
TenaliRamakrishna: *OK*
Tibetan Machine Uni: *OK*
Times New Roman: *OK*
Timmana: *OK*
Tlwg Mono: *OK*
Tlwg Typewriter: *OK*
Tlwg Typist: *OK*
Tlwg Typo: *OK*
Trebuchet MS: *OK*
URW Bookman: *OK*
URW Gothic: *OK*
Ubuntu Condensed: *OK*
Ubuntu Mono: *OK*
Ubuntu: *FAILS*
UbuntuMono Nerd Font Mono: *OK*
UbuntuMono Nerd Font Propo: *OK*
UbuntuMono Nerd Font: *OK*
Umpush: *OK*
Uroob: *OK*
Vemana2000: *OK*
Verdana: *OK*
VictorMono Nerd Font Mono: *OK*
VictorMono Nerd Font Propo: *OK*
VictorMono Nerd Font: *OK*
Waree: *OK*
Webdings: *OK*
Yrsa: *OK*
Z003: *OK*
aakar: *OK*
mry_KacstQurn: *OK*
ori1Uni: *OK*
padmaa-Bold.1.1: *OK*
padmaa: *OK*

[-- Attachment #3: Type: text/plain, Size: 224 bytes --]


-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [BUG] Unexpected behaviour of TAB in table depending on font family [9.6.15 (release_9.6.15 @ /snap/emacs/current/usr/share/emacs/29.4/lisp/org/)]

[Giovanni Pavolini]

[-- Attachment #1: Type: text/plain, Size: 2220 bytes --]

Thanks Ihor for your quick response.

I can confirm that in org 9.7.6 the behaviour for the font "Ubuntu" is the
expected one.

On Sat, 29 Jun 2024 at 08:34, Ihor Radchenko <yantar92@posteo.net> wrote:

> Giovanni Pavolini <giovanni.pavolini@gmail.com> writes:
>
> > I wanted to customize my default font by `(custom-set-faces '(default
> > ((t(:family "Ubuntu")))))`. Then, after `M-x org-table-create` the TAB
> > started creating a cell to the left of the one it should have jumped to
> > (see a video here (webmd video of the screencast):
> >
> https://u.pcloud.link/publink/show?code=XZVXhe0Z2K8AAQBKOwQH7uE7LkNtHYGlHQTy
> > ). The expected behaviour is that TAB only jumps to the next cell,
> > without creating additional ones. The actual behaviour is, depending on
> > the family font used, it does create an additional cell. Not every
> > font causes the unexpected behaviour.
>
> [ Side note: we prefer text descriptions on the mailing lists. Videos,
>   especially uploaded to third-party servers, may disappear after
>   several years, leading to losing access to discussion context. Also,
>   not every reader can access non-text information (consider blind users) ]
>
> From the video the reproducer is the following:
>
> 1. emacs -q
> 2. Create a new Org file
> 3. M-x org-table-create <RET> 2x2 <RET>
> 4. a TAB table TAB a TAB table
> 5. Observe table filled with "a" and "table" cells
>
> | a | table |
> |---+-------|
> | a | table |
>
> 6. M-: (custom-set-faces '(default ((t (:family "Noto Sans CJK HK")))))
> 7. Move point to the end of buffer
> 8. Repeat steps 3-4
> 9. Observe
>
> | a |   | table |
> |---+---+------|
> |   | a | table |
>
> I was able to reproduce using Org mode version shipped with Emacs 29.
> I was unable to reproduce using the latest Org mode version.
>
> May you please try to upgrade Org mode? Does the problem disappear then?
>
> P.S.
> Attaching the list of working/non-working fonts to keep it available for
> future reference.
>
>
> --
> Ihor Radchenko // yantar92,
> Org mode contributor,
> Learn more about Org mode at <https://orgmode.org/>.
> Support Org development at <https://liberapay.com/org-mode>,
> or support my work at <https://liberapay.com/yantar92>
>

[-- Attachment #2: Type: text/html, Size: 3243 bytes --]

Re: [BUG] Unexpected behaviour of TAB in table depending on font family [9.6.15 (release_9.6.15 @ /snap/emacs/current/usr/share/emacs/29.4/lisp/org/)]

[Ihor Radchenko]

Giovanni Pavolini <giovanni.pavolini@gmail.com> writes:

> I can confirm that in org 9.7.6 the behaviour for the font "Ubuntu" is the
> expected one.

Thanks for the update!
Closing.
Canceled.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>