Does it really imply you are half a person though?
Half cast means, half white, half black. Half + Half = 1.
In agreement with Grant's point about it being geographical. Had always used it with no ill feeling, but when I used it once I got to uni I was a raving racist apparently.