One person in front and one person in back will be good.

You have a swing tongue put on any trailer, and fit a bigger boat in your garage. You won't regret getting a bigger boat.