Very easy to realize via CSS, use the Unicode value for the symbol.
(Doesn’t work in IE, of course.)

a.internal:hover:after { content: " \21AA"; /* unicode value */}

Some unicode arrows:

21A8up/down arrow with base
21A9leftwards arrow with hook
21AArightwards arrow with hook
21F0rightwards white arrow from wall
21E1upwards dashed arrow
21E2rightwards dashed arrow
21E3downwards dashed arrow
21E4leftwards arrow to bar
21E5rightwards arrow to bar
2192rightwards arrow
2193downwards arrow
2194left right arrow
2195up/down arrow
2196north west arrow
2198south east arrow
2794heavy wide-headed rightwards arrow
2798heavy south east arrow
2799heavy rightwards arrow
279Aheavy north east arrow
279Bdrafting point rightwards arrow
279Dtriangle-headed rightwards arrow
279Eheavy triangle-headed rightwards arrow