Problems

[jomebrome01]

When i try to go to university or go on a vacation i loose my family.

[marstinson]

Two things might be at work. One, unless you take them with you, their portraits will disappear from the portrait panel. This is intended behavior. Time stops in the home neighborhood while you're away and their portraits will reappear when you return.

Two, you might be experiencing a travel glitch, which is not uncommon. Installing the Traveler mod from nraas.wikispaces.com helps smooth out those kinds of problems. My money is on the first one, though, because the glitchiness typically shows up when you try to return to the home neighborhood and your description sounds more like it's happening when you depart.