Most towns will have a hotel, smaller villages a designated hostel (someone who rents rooms out), these will probably cost a couple of quid.
It's very likely you'll need to camp at least once. Especially if you break down. There's probably no accommodation between Puerto Acopa and Atalaya.
Atalaya and Ayacucho have plenty of choice.