I bought a 2 pack of these for $90 on sale.
PoE is 100% the way to go. You can have a UPS on the circuit where your switch is, and cameras won't cut out any time you need to pop a breaker and do any electrical work.
I had some spare PoE injectors from other equipment, and I'm sure you can find some secondhand ones for cheap. Seriously, running a single low voltage wire cannot be understated.
If you need to run conduit outside I would just use some small grey PVC. Or you can find outdoor rated Cat5/6 cable with black sheathing that will resist UV, and is filled with dielectric grease.
As far as a switch in the wall, they should sell some steel or PVC boxes that will sit in between studs and mount flush. Kind of looks a circuit breaker panel. Mostly used in commercial buildings, so you might want to check an electrical supply house locally.