Might be only fraternal twins, I think, that were thought of as having diff fathers. Since they would look diff.
On the rare occasions it was true, the only way to tell with certainty would be DNA. But then, similarity in looks, etc, could suggest who belonged to who.