I figured I can change those by adding a "" around.
Ex: "<color:Red><size:16>**name**</size></color>" works.
This can also be changed using the skimparam attributes:
skinparam class<<optional_stereotype>> {
FontColor color
FontName name
FontSize size
FontStyle color
HeaderBackgroundColor color
}