Brakes hot after short ride.?

I have a 96 suzuki bandit, I just replaced rear brake pads and rotor. I noticed that after a short ride, like a mile, the rear brakes get very hot even if I don't touch them. The old pads had one that was worn to the metal and one that had little wear, do I need to rebuild the caliper or is this perhaps normal, I never felt how hot the rotor was before. I think I was fooling myself into thinking that the caliper was alright, but now I'm doubting it's ok. Does the caliper need honed to be rebuilt or just replace the seals and that's good, I've never done a motorcycle caliper before and my manual is a little sketchy on this topic.