Yes, those are of course valid points as well. However you also need to consider that you have to spend money on other things as well: the power adapter & the SD card to at least have a bare minimum (and a case maybe if you are not a careful person with electronic stuff).
Two things that actually annoy me is that SD cards are way way slower than other storage options and are very prone to corruption, I've lost not critical data, but data that was still useful to me due to SD cards (even I believe if you purchase them from a known manufacturer). So this implies that you will likely want to have another more reliable storage option to keep critical data backed up (more spending). And the other one is the missing power button. I don't know if that has changed but all the models that I own lack of a power switch button.