Add some washers under the spacer.
Keep in mind you may already be pretty close to maxing out your ability to properly realign the camber & caster. Once that happens, you'll need dropped brackets to go any further.
The other options are a body lift (2" or 3"), or an actual suspension lift kit.