Patch to allow comment translators implementation

This small patch change comments handler in a simple way to permit to
implement quite easily comment translators.

Once applied this patch, a CommentHandler is allowed to build a first
token to be returned to Lexer and to push a TokenStream for the others,
then allowing generic comment -> tokens transformer.

This can be useful to transform comment shaped program annotation that
should be translated to source code and also other interesting applications.

Please let me know if it can be applied as it is or if I can improve it

HandleComment.patch (4.71 KB)