Find top sites by requests over a time period:
|
1 2 |
for file in /var/www/vhosts/*/logs/access_ssl_log; do \ echo "$file: $(grep -c 'DD/MMM/YYYY:HH:MM' "$file")"; done | sort -t: -k2 -nr |
Replace “DD/MMM/YYYY:HH:MM” with desired period like “01/Aug/2024:15”.
Find and count all occurrences of “parameter” in access log:
|
1 2 3 4 |
cat access_log | awk '{ match($0, /parameter=([^& ]+)/, arr); if (arr[1] != "") print arr[1]; }' | sort | uniq -c | sort -r -n | less |
Extract a list of the top user agents from an Apache format log file and sort in descending order by number of occurrences:
|
1 |
awk -F\" '{print $6}' access_log | sort | uniq -c | sort -r -n | head -20 |
Results similar to this:
|
1 2 3 4 5 6 7 8 9 |
94786 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.75 Safari/537.36 68390 Amazon CloudFront 36131 Mozilla/5.0 (Windows NT 6.2; WOW64; rv:17.0) Gecko/20100101 Firefox/17.0 19725 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36 11865 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 11428 Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) 10056 Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) 6311 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) .... |
If you have a WordPress site that is password protected with HTTP Basic Auth, then you may encounter problems with the WordPress cron failing to run. A workaround is to install the “WP Cron HTTP Auth” from here:
After you install and activate the plugin, go to “Settings->WP Cron HTTP Auth” and enter the HTTP Basic Auth credentials.
Quick way to find the wp-admin login slug on WordPress sites with iThemes Security or Solid Security installed:
|
1 |
wp option pluck itsec-storage hide-backend slug |
If the sub-name changes then try:
|
1 |
wp option get itsec-storage | grep slug |
