NPCs in town (especially ones that dont contribute to a story or quest) obstruct your path too much. Every time I leave my house (The Roost) Hala is standing in the pathway when I’m running toward the center of town, and she blocks me in.
I do understand some obstruction/interaction (the best example I can give is when Geralt bumps into townsfolk in Witcher 3) it changes your path somewhat, but you’re not obstructed from moving in a certain direction.