I can confirm that I experienced the same on a regular basis with CLN and a Tor-only node. Has drastically improved recently for some reason.