I don't think there is a single thing, but I would say corruption in their governments for most and civil wars for others. It's certainly not a lack of resources or labor. There's also the race factor, but you said you didn't want to talk about that. Colonialism definitely plays it's part. Same with Africa.... Africa has the gold mines. If gold held such value... then how is Africa poor?