Game breaking judders when streaming 2D games!

[nickizz]

I'm at my wits end with this, for now, useless software which I have tried in every possible way to work with my oculus quest.
Purchased it yesterday, so that must mean that I have the latest version.

Problem description:

When using simple streaming (not VR) all games have unacceptable amounts of judder and
choppiness. It's like a lot of frames just get skipped. Is this what is referred to as artifacts?
The judder is visible regardless of what settings I am using in virtual desktop:
Low and insane show exactly the same amount of judder.

I have also tried to limit the quest to 60 fps, which makes it smoother. At short times the
gameplay is nice and fluid, but after some seconds the judder returns. This cycle goes on and
on, just killing the fun out of any game.

My computer is brand new and pretty much a monster for what I am throwing at it.
Call of duty infinite warfare can't be even remotely smoothly played on a rtx 2070 super with a
ryzen 3600???

(All games run smooth as butter on my monitor.)


Trial and error details:


Connection to router/Quest:


PC ethernet cable is wired to the router.
Virtual desktop shows that the quests connection speed is 866 mbps (the maximum for that
device) and latency is around 20.
The quest is connected wirelessly to the 5G Wifi network.

I have also tried to only be connected to the wifi (unwired). Oddly enough there was not
much of a difference. Perhaps lower quality here and there but more or less the same
amount of choppiness.


Placement from router:


Standing next to the router or sitting in another room does not matter. Judder and choppiness
still the same.


Codec selection:


Both HEVC and H.264 (as well as automatic) show no difference regarding this issue.


Device manager network settings:


Force 5 Ghz wifi


Router settings:


5 Ghz Wifi set at 80 hz.


Display settings:


Vsync on and off (no improvement)
Gsync off (no improvement)
Setting my 1440p monitor to 1920X1080p / 60 hz (no improvement)


Software precautions:


Shadowplay is disabled

Uninstalled Geforce Experience but it did not help


Nvidia control panel choice:


Low latency mode: On and ultra (does not improve judder)


I mean this can't be the way virtual desktop is supposed to work is it?
Is there a bug in the oculus software or what can it be?



My system:

Router: Asus RT-AC66U
2070 super
Ryzen 3600
X570 gaming edge wifi
16 gb Ram

[ggodin]

Is your computer wired with gigabit Ethernet speed? You can check the link speed in your Windows network adapters window

[nickizz]

Thanks for a fast reply.

Yes, I have checked the ethernet connection and it says 1,0 Gbit/s.
I tried hooking up my tv instead of my monitor, but to no avail.

In the virtual desktop application (seen from inside the quest) I am constantly receiving either 60 fps (or 72 fps, depending if have have set it to force 60 fps or not).

It's like the game is running fine but there are so huge fps "chops" and clipping that it becomes unusable.

Reinstalled nvidia drivers with only the mandatory options (had no effect)

(I even tried to only connect my pc to the router (desperate I know) without being connected to the "modem", but this did not work at all with the application since an internet connection was required).



My "modem" (a fiber internet box with high speeds) has a couple of cat 5 cables going into the box.
From the box to the router I am using a cat 6.
From my pc to the router I am using a cat 6.

It can't possibly be because of the other cat 5 cables going into the box? (don't know what they are good for to be honest) My network speed is 1 Gbit/s after all so it looks like it should not be an issue.

Anyway I found ***this other discussion*** on steam which had the same issue (but in VR games it seems):

Your answer below in the bottom of this discussion suggests there is a bug in the oculus software?

Almost makes me wonder if oculus have crippled virtual desctop deliberately, because I can't get it to work no matter what I do.


***Talemann 3 aug @ 14:09***
I really do have an FPS problem with VD. In steamVR it says it runs at 72fps as it should, but there is stutter all over the place. It does not matter what setting i change here. I do not have those Problems with ALVR, so i dont think it is some kind of setting or bandwith problem. It seems, it has to do with the way both apps deliver the Picture. With VD the stutter is across all types of games. I would love to use vd for steam vr games because of the better ui and overall Picturequality. But the stutter is just waaa. Btw. Is Vd grabbing the hdmi output or something? I noticed that vd only gives me a picture with my TV also turned ON. Any help?
#3

ggodin [utvecklare] 3 aug @ 16:43
Virtual Desktop streams at the equivalent of 150% in ALVR by default so that could be the reason. You need a beefy computer. You can try to lower the video resolution slider in SteamVR to see if this helps. What kind of GPU do you have btw?

As for capturing the desktop, Windows requires a detected monitor so depending on the tv/monitor, you’ll have to keep it on or you can use something like a headless ghost to fake one
#4

Talemann 3 aug @ 17:41
I have an 1070ti. The Picturequality seems to be better with vd in general and i do not experience frameloss. It stays at 72. It really looks like a good old vsync issue type of thing.
Senast ändrad av Talemann; 3 aug @ 17:42
#5

ggodin [utvecklare] 3 aug @ 18:03
Make sure to check the "Extra Latency Mode" option in the settings panel in Virtual Desktop, also make sure Nvidia gamestream is disabled
Senast ändrad av ggodin; 3 aug @ 18:14
#6

Talemann 3 aug @ 18:58
Extra Latency just made things worse. I already tried the other things you suggested in your posts before asking. I never enabled gamestream. Is it enabled by default? I dont know. ALVR and some other apps are also broken since the fw update. I really do not know whats the cause with vd. Im in the middle of some games now. The one app is broken and the other is giving me stutters. Just curious. If the game constantly gives me 72fps to my hmd, frame jumps are not possible? Are there any other things that can cause that? Wifi is superfast unifi HD APs. Lowering the bitrate gives me the same result just with bad quality. Drivers are updated. Thank you by the way for replying so fast!
#7

Talemann 3 aug @ 19:29
i did a test to verify. I started up Doom3 VR and used cmd com_showfps 1. It is at 72 all the time. I stood in front of a simple texture in game and did a strafe left/right. Its stuttering but 72fps remains. So strange issue. Same in Alien isolation.
Senast ändrad av Talemann; 3 aug @ 19:31
#8

ggodin [utvecklare] 4 aug @ 0:51
There is a bug with the latest Oculus OS which causes stutters. That being said, there is no positional timewarp so when you move your head (not just rotate) it will not be super fluid; that’s simply caused by the encoding/streaming latency. It works better with seated games in my opinion

[ggodin]

No the tracking judder has been fixed by Oculus earlier this summer and only applied to SteamVR streaming. You should be getting smooth streaming for regular desktop use. Another program on your computer could be affecting the capture

[nickizz]

Ok, thanks for the help. I'll do some major cleanup and uninstalls to see what happens.

[nickizz]

Oh my... I uninstalled every single program (except for the mandatory ones) and games. Even uninstalled my printer, xbox wireless adapter you name it. Still the same issue. I really have no idea what might be causing the conflict. Wanted this to work for gaming so bad, but guess I have to give up now. Still a decent application for watching movies (leagues better than remote desktop on bigscreen), because the rooms are better than the youtube app on the quest. Sad kitty...

[nickizz]

Hi, I'm back with an update and a ***virtual desktop question***

I tried out big screen beta on my oculus rift CV 1 , and guess what? Turns out it was also far from perfect, although it was slightly better than the quest experience.
So I guess (even though I am not really satisfied) your application is pretty good compared to the alternatives, considering I made a comparison with a wired headset application when trying big screen (not the remote application which was outright horrible and made the virtual desktop look like a technical marvel).

Observations: I did notice that I got the best results in big screen when manually setting my monitors refresh rate to 85 hz and 1080P.
Maybe it's just my imagination playing tricks on me, but virtual desktop on the quest showed something similar. (refresh rates above becomes a chug fest and locked refresh rates around 60 hz were slightly worse.

Makes me wonder if performance would have been perfect if the monitor refresh rate could be set to the native refresh rate of the quest. I feel it should not really matter because of the ability to force the refresh rate within the virtual desktop application.

Or maybe my computer was not "born" to do streaming, or my expectations were just a bit too high.

***When oculus link arrives, will virtual desktop for quest work with the oculus link wire, or do I have to get the regular Virtual desktop for rift?***

Thank you for your time.

[ggodin]

You can set a custom resolution and refresh rate in the Nvidia Control Panel. By default, Virtual Desktop will switch to 1920x1080 so if you create a resolution with a refresh rate of 72hz, it should pick that one.

As for Oculus Link, since it renders everything down before encoding, the image quality won't be great with the PC version of the app; you'll get much better quality with the mobile version streamed over Wi-Fi

[BadAtGames]

Is your CPU running multi core and hyperthreading? Just wondering if you've maybe forced it to single core for those gains but it can have a very bad effect on other things. Just a thought.

[nickizz]

Thanks for the tip! I checked this out and all logical processors are running and SMT is set to auto in the bios (which I believe is the same as "on"). It's a mystery haha :)

[nickizz]

Update:

I think that I have found the real culprit in all of this mess, and I think the error actually lies within the quest device.

I used the quest browser for a google searched and started to scroll through the search results, and there is definitely a lot of jitter and stutter when just scrolling!

I have not noticed this problem in any VR games from what I've seen though, but only when scrolling in the browser. Maybe it's related to the stutters I got in virtual desktop because the behavior looks really similar (like teared frames).