I’m interested how y’all check/monitor your reverse proxy logs. I run an nginx vm that has ports 80 and 443 forwarded that exposes some of my services to the internet on different domains. I use nginx exporter for Prometheus, but I would like a better monitoring to see what connects to my services (like my Lemmy instance).
If I would be under pressure by LLM scrapers for example, I would only notice via application and hardware metrics, but I would have to figure out what’s going on.
Depending on what your log files look like, look at ‘GoAccess’.
I think you’re gonna be disappointed with existing solutions if you don’t want to sit and stare at text files. It’s big business to automate this kind of stuff, because it’s hard.
I gave it a quick try and while it’s not exactly what I had in mind, it’s pretty cool! I’ll organize my log formats a bit and check it out more in depth, thanks