If the country is neutral, you should add the player units as an event on its capital.
The tricky part is that you can't add events on capital cities, so you have to add the events first then turn the city into capital afterwards.
Also make sure to add a special neutral unit there to prevent other players from capturing it before the event, otherwise they'll become the owners of the event units.