Hi Sylvain, yes its possible, but not out of the box, you need to code what you need
one possibility: you need to query by the first letter, sort, repeating by all alphabet, and append your list in the way you want to present.
other way, I would start by this one: making a loop appending all letters of the alphabet one by one to your list, and sorting the Name attribute ASC
in this last option you can also add css to get that style to the First letter, eg: A, B, C... and remove the added letter that doesn't have results under it, eg: if I added "C" but I dont find a word starting with "C" so I remove this letter from the results.
Hope I could give you some idea to solve your problem
cheers,
Carlos Lessa