Keep switching to mouse & keyboard and controller on steamdeck

[Srol =|87>]

I'm currently playing the game on the steamdeck in gaming mode.

When returning back to the lobby, the controller freakout and switch back immediately switch back to keyboard and mouse.
When moving with the joystick or pressing any button, it switch back to keyboard and mouse. I have to spam till i get lucky to press anything.

It persist only in-game and in the media tab of the gaming mode.

Link to a clip after i restart the game : https://gofile.io/d/Wq3a0a

Only solution I've found was restarting the steamdeck.
Even then, there a non-zero chance the problem persist.