Weird crawler activity?

This is the report across the last three days. Weird agent names for the top two with heavy amounts of requests. Any idea what these are? Should I be concerned? For now, I’ve added them to the crawler block setting

1 Like

They aren’t targeting you specifically because I’m seeing them too. From what I can see they’re both from the same source, originating from one of three AWS instances and have only been active for a couple of weeks.

There are many more differently named crawlers that also originate from the same three AWS instances so they’re probably up to no good, otherwise why try to hide behind so many names? I can’t find anything suggesting what they’re trying to do though.

5 Likes

Maybe collecting data to train future AI language models :smile:. Glad to know it’s not just me

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.