Can´t enter Honeyside Home in Rifton

[Sengoria]

Hey, so my lingering problem is, that I cannot - for the love of everything - enter that stupid Honeyside Home. I had the quests, I bought it from stewart anuriel, I have the key. Still can´t get in.
Everytime I try the door says "open door" or "close door". It doesn´t even say the name of the compound, only the mentioned. The door opens a little bit and nothing further happens.
Had this problem in the first runthrough many years ago and it is still the same today.
Maybe some of you have an idea how to fix it?
Would appreciate some help (since google isn´t really not that helpfull. And just to add... yes Chat GTP didn´t help either).