actually you could potentially have a lot more in your party if you were to start a few side and main quests at the same time that have quest specific NPCs. Such as the dog, and the two members of the blades. Thus you could have your follower, a dog, a horse, the ghost, a conjured, the quest dog, and the two blades. That should, in theory give you 8 followers in your party.