Thanks Nicolas,
What version of org-mode are you using? I recently updated to 9.3.6 and am fairly certain this issue is new.
I have not compared latex output from previous org-mode versions however description labels in previous org mode versions were treated correctly by xelatex(e.g bold font in a koma script article class). This stopped working after my upgrade which prompted me to look at the latex output.
The format you get creates a properly formatted pdf.
\begin{description}
\item[{label}] information
\end{description}
Regards,
Matthew