How do I filter bots from reporting?

Avatar

By Zeno

updated 6 months ago

Firstly, let me preface this by saying we haven't yet added "filtering" as a feature and intend to do so. This article will be updated when we do. For now, it will just cover some basic approaches to delete this annoying data.

As I said above, we don't have filtering yet that can automatically filter/remove certain visitors from your data.

Here are our overall plans with that feature:

  • Provide filtering rules as a new section, where you define global (account-level) rules based on:
    • User-agent

    • IP address/ranges

    • Referrer domain/path

    • Countries

    • ISP name

    • Funnel

    • Traffic Source

  • You will be able to create rules that are either global, or apply to specific funnels only, or to specific traffic sources only.
  • You will then be able to apply several actions:
    • Mark as filtered but let visitor continue as normal down funnel path

    • Do not log the data, but let visitor continue as normal down funnel path

    • Bounce the traffic to a specific URL and do not log the data at all

So these actions are basically soft, soft-delete, and hard-bounce.

That's for the future though! On to dealing with the now...

Dealing with bots (NOW)

Right now, the only thing you can do about annoying data is delete it entirely.

You can do this via the updates section > reset stats. The easiest way will be to know the IPs of the traffic that you want to delete.

You can then pick funnel groups, funnels and traffic sources (or just select all), then toggle on the IP filtering and enter IPs/ranges, like so:

Click Estimate and it will find matching data, which you can then delete.

How to find these IPs? For that, you can use our Raw Events section and just scan through the results. Typically you will find specific ISPs, referrers or user-agents are responsible for the junk you want to remove.

You can manually find and copy the related IPs, or export to Excel and filter to get what you want there.

For now, I would just keep a text file with the IPs/ranges so that you can copy/paste into the above form every time you want to do this, and so you can grow your filtering list over time -- an IP blacklist basically.

We do plan to add user-agent and ISP name to the above filtering options in the future, which may make these even easier, prior to our filtering module.

Sorry for the inconvenience!

Also, please note reset stat operations are slow -- once submitted they go to our database which itself manages these operations, its out of our control. So it might take 15 seconds, it might take 10 minutes -- you just need to wait and let it proceed.

If after 1 hour your data has not been removed, you can try again and see if the estimate has changed, or reach out to us for help.

Did this answer your question?