Controller (PS5) X button only works on certain things

[xsXex]

So I'm currently having an issue where my controllers X button doesn't work in certain situations. I am able to start the game, walk around and pick up items, talk to the villagers, the problem is once I'm in their menu I can't click to talk to them, or give them items.

The same also happens in the crafting station, I can enter the menu but when I want to press on something to make, it doesn't do anything.

I've tried 2 different controllers, restarted the game, restart the PC, messed with controller setting in steam, used DS4 Windows but nothing seems to work.

Also, I can no longer use mouse and keyboard.

Any help appreciated.