diagonal joining line

When I am crocheting in rounds (to make a hat, for instance), why do my stitches "travel" to the right with each completed round forming a diagonal line? I don't have this problem with double crochet, but it always happens with sc and hdc. Am I "joining with slip stitch" to the wrong place?