Redundancy checker

General information, announcements and questions about the EasyList subscriptions.
User avatar
fanboy
EasyList Author
EasyList Author
Posts: 12220
Joined: Wed Sep 05, 2007 8:17 pm

Post by fanboy »

monnawynter wrote:The 12-12-15 Fanboy’s Ultimate list contains 459 redundancies.
Finished (after 1227 seconds)! 459 redundant rules found!
[Adblock Plus 2.0]
! Checksum: 6ABuG+WEF7Dozj8VngKjQA
! Title: Fanboy+Easylist-Merged Ultimate List
! Version: 201512121200
! Last modified: 12 Dec 2015 12:00 UTC

Most of it is because of the omniture and doubleclick filters.
itsallinyourhead
Site Member
Site Member
Posts: 16
Joined: Wed Jan 28, 2015 2:50 am

Post by itsallinyourhead »

The redundancy checker at https://arestwo.org/famlam/redundantRuleChecker.html is old and has some flaws. But it still finds 97 redundancies in EasyPrivacy List and 32 redundancies in Easylist Noelemhide.

Is there a reason not to remove those redundancies?
User avatar
kombu
New Member
New Member
Posts: 2
Joined: Thu Sep 14, 2017 11:20 pm
Location: XMMP Texting

Post by kombu »

I wish this was baked into uBlock Origin's subscription manager for Chromium and mozilla flavors.
User avatar
fanboy
EasyList Author
EasyList Author
Posts: 12220
Joined: Wed Sep 05, 2007 8:17 pm

Post by fanboy »

the redundancy issues are mainly due to use of $generichide and $genericblock which will show dubes
peace2000
Finnish List Author
Finnish List Author
Posts: 82
Joined: Mon Oct 02, 2017 10:51 pm

Post by peace2000 »

https://abpvn.com/ruleChecker/redundantRuleChecker.html

Hi! Many probably know this tool. It's for checking lists if there are any rules that are not needed because they are dupes or are being covered by other rules.

This tool doesn't take into account the usage of generichide -switch. So it lists some rules redundant even if they are not.

Here are sample rules in the Main Easylist:

@@||bing.com^$generichide
###verticalads
bing.com###verticalads

If I put these Easylist rules to that tool, it says that bing.com###verticalads is redundant because of general ###verticalads rule. But bing.com has generichide -switch applied that prevents general rules being applied to it. So bing.com###verticalads is actually needed, it's not redundant as the tool says.
I maintain the Finnish Easylist. If you report an ad issue, tag my name so I'll get a notification.
Yuki
Contributor
Contributor
Posts: 205
Joined: Sun Dec 15, 2019 7:34 am

Post by Yuki »

@fanboy
Please consider to remove

Code: Select all

||amazonaws.com^*/i?stm=
||cloudfront.net/i?stm=
from EP as

Code: Select all

/i?stm=
covers all.

Also

Code: Select all

||xozilla.com/js/analytics.js
is not needed as there's

Code: Select all

/js/analytics.
User avatar
krystian3w
Site Member
Site Member
Posts: 24
Joined: Sun Mar 25, 2018 9:03 pm

Post by krystian3w »

ABP have genericblock, so for few sites maybe generate lack of privacy - unless how long domain= modifier only mark filter as specific.
FTP servers to download Firefox & Opera
Locked