Default avatar
npub1y3uh...yzhd 2 years ago
Do you see a lot of imagebots in the logs perhaps? Might want to grep logs for user agents. Can block nicely with robots.txt and if bad crawlers with AWS Firewall or WAF. Could be someone trying to mirror content by scraping so look for IPs and rate limit then. Can use
GoAccess - Visual Web Log Analyzer
GoAccess is an open source real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser.
 against logs if do not already have something.
↑ Parent

Replies (4)

Default avatar
npub1y3uh...yzhd 2 years ago
Micro-zap payments per upload? Show minimum Sats for image or video with option to add more Sats when upload.
nostr.build's avatar
nostr.build nostr.build@nostr.land 2 years ago
Added the robots.txt earlier this month, yeah, trying to limit all scraping , increased compression an reduced video upload max. New load balancing arch will likely solve these problems.
Default avatar
npub1y3uh...yzhd 2 years ago
Yes, can install and run from command line. Or will generate HTML, json, or csv reports. Is very powerful with a lot of features. If logs big can tar up logs and download to run locally.
↑