Boost at higher rpms is actually safer than boost at low rpms. With my manual transmission, I intentionally downshift to get into higher rpms and put the throttle down to the floor all the way to 6500 rpm. I've been doing that a couple times a day for the past 6 months and ~6,000 miles, including two very abusive weekends on the sand dunes. Staying in a higher gear, lower rpms, and trying to accelerate hard would both be more strenuous on the engine, and be less effective at accomplishing the goal of accelerating quickly.

Quit worrying, put the pedal to the floor, keep it there, and enjoy