It's a little tricky, I'd leave them mostly open to interpretation.
The only ones I can vouch almost completely sure that are males are Watercolor Baby Sea Pony Salty (pink one), in general babies, and adults with no babies (ie: Minty, Blue Belle, Butterscotch, Snuzzle, Peachy, etc. -I always...