You could try, but it might or might not work depending on whether or not it has an LDO (low drop out) regulator.
You have to have a minimum voltage difference between the input and the output that varies somewhat based on the specific design.
Try one and see what happens. Worst case it just won't work. You might try an adapter that supports USB-PD since they have to have boost converters anyway. I think they would be more likely to work than some random one.
