Starfish Cave

[Orydin]

I have tried several times the time of day resets when I enter and leave the cave. I can sit around outside until night time go in and come out and the sun is shining mid day. Is this a bug or am I doing something wrong?