In Canto II, we learn that the Baron has had previous lovers: “There lay three garters, half a pair of gloves; / And all the trophies of his former loves. / With tender Billet-doux he lights the Pyre” (Pope 39-41). The Baron enjoys collecting trophies; signs of his failed relationships. Could it be possible that the Baron experienced a negative psychological experience – possibly sexual – and now his fear of intimacy manifests itself into having control over another’s possessions, which were taken by force?
He keeps physical items (garments) and burns the love letters (which are more emotionally intimate). By taking what is taboo (maybe not the gloves, though it could be significant that there is only half of a pair), the Baron might be suffering from castration envy. Is he afraid of the female power (or more rejection) that he attempts at humiliating them before they have the chance to emasculate