It is possible to pay with a money order on ebay. You just need to contact the seller, and work out the details. It's, of course, up to you, but I have personally found that having a paypal account is handy and convenient for other things too, besides ebay.
