Problem with equipping perks

It’s weird every time I try to equip a different perk in slot 1 or 3 it just takes me to slot 2 so I am only able to change the second slot perk. It’s annoying because I’m basically stuck with the perks I have in there and can’t get any other specialty. Anyone else have this issue/ have a fix? I tried restarting game and console and everything and still the same.