Reproduce all characters using FromCharacterCode?

Questions
, ,
1

Performing some text analysis I encountered the following trouble. Mathematica cannot display the text symbols with code 128 through 160.
E.g., standard output with the FromCharacterCode function looks like

snap0523.jpg
snap0523.jpg692×102 48.9 KB

When using Style for output:

snap0524.jpg
snap0524.jpg684×271 83.2 KB

This problem persists for all font families. For displaying symbols the following code was used:

Table[ {q,   
  Style[  FromCharacterCode[q], FontFamily -> "Tahoma", 
   FontSize -> 25, FontColor -> Red]}, {q, 33, 255}]

(In FontFamily any font can be substituted, result will be the same.)

I suppose the problem may be OS-depending, so kindly ask colleagues to reproduce it on different platforms (I use WM 12.0, Windows 10 x64).

2

If I add the encoding, for example FromCharacterCode[q, "UTF8"], I get some error messages that may be helpful.

3

A simple search on the web suggests that those “gaps” are simply undefined (in HTML 4, e.g. here or here). Which characters are missing, what output do you expect?

4

I think Henrik is right insofar as Unicode decimal 127-159 are undefined and as such should not be expected to map to visible glyphs (160 is a non-breaking space). But what MMA seems to be offering here is some ad hoc support for ISO 8859-15 characters. On Windows, as Konstantin noticed, this should result in no visible glyphs at all. On my Mac, however (MMA v12), it produces this:

mma2.png
mma2.png1270×328 26.7 KB

So, I guess, to “fix” it, MMA would need to fully support 8859-15 for this range, and on Windows, ISO Windows 1252. But in today’s Unicode world, both encodings are obsolete and the glyphs in this range have new encodings. Compare, for example (OSX only), the old and new encodings and glyphs for the Euro symbol €:

mma.png
mma.png518×104 8.85 KB

So, probably, yes, it’s still a ‘bug’ but one which is already fixed.

5

I don’t speak on HTML symbols.
These symbols are in most fonts. E.g., MS Word enables to insert them in a document.

snap0525.jpg
snap0525.jpg763×598 184 KB

6

In fact, I try to display symbols (words) from Voynich Manuscript (font v101, Voynich MS - Text Analysis - Transliteration of the Text) for presenting results of analysis.
I’ve reproduced the majority of symbols, but some remain invisible or wrong-looking. With use of the “encoding” option in FromCharacterCode it is possible to display the range 149-158

snap0526.jpg

This is impossible without “encoding”, as I did earlier.

Code:

Table[   {q,   
  Style[  FromCharacterCode[q, "MacintoshRomanian"], 
   FontFamily -> "Voynich", FontSize -> 25, FontColor -> Red]}, {q, 
  149, 158}]

I hope that picking a proper encoding will help to display all others symbols. Thanks for assistance.