I would not worry about it, tube type wheels have set many land speed reccords.
Just be sure your tires are rated for the speed you want to go. And if they are not quite then not having a load and going faster may be OK? They are rated to go a max speed with a max load, I think it may be safe to a point to trade one for the other. See what others think about the idea first?