XBOX 360 Controller not working for most games

[Fastpass]

I've played a lot of games recently where I just can't get my 360-controller to work over In-Home Streaming. I know there are a lot of topics but they all seem to mention specific games and I'm yet to find a general solution.

Both host and client are normal PC's. They both also use separate XBOX controllers via wireless receivers.

It's not all games - I can, for instance stream Witcher III and use my controller, same for Rogue Legacy. But when playing Drifting Lands, Rebel Galaxy or The Technomancer, no controller is detected.

If I stream the Origin client, I can then open FIFA18 and NFS Payback through Origin and have full controller support.

Also, if I stream any application that shows my host desktop (i.e. Notepad), I can then open Steam on the host computer and launch any of the games and suddenly I have full controller support. So somehow, launching the game directly from the Steam client breaks the controller support.

Just to make sure, what should the controller settings be (generic, xbox, none) on both client and host computer? Any other pro tips?