Well, you don't need a drive bay, just a port. Alternatively, a PCIe to M.2 adapter plus a cheap PCIe M.2 SSD would also work very well.
If those aren't viable, I guess you're stuck with USB. SanDisks generally work fine, at least for a decent while.