Issue with people connecting

There is a issue happening when a person connects not sure if it happens all the time but when I have one person on the server and another connects making it two. Once they fully get in the server and load character up the world like resets almost like host is being switched or something. If I am in a car it will kick me out then despawn it. Super weird I hope someone knows the fix because it is super important.