Giter VIP home page Giter VIP logo

adaway.github.io's Introduction

AdAway

AdAway is an open source ad blocker for Android using the hosts file.

direct link https://raw.githubusercontent.com/AdAway/adaway.github.io/master/hosts.txt

Features

  • AdAway is Open Source and Free Software (GPLv3+)
  • AdAway lets you select your own sources of hosts files
  • You can add exceptions to your Whitelist if an app is not working when specific hosts are blocked *You can define extra hostnames in your own Blacklist
  • You can add your own (hostname, IP)-pairs in the Redirection List

Licenses

The content of the website is under the GPL license, meanwhile the Jekyll theme is under MIT license. For more details, check the license notes.

Website

The website was designed to be as lightweight as possible and because of this JavaScript is not necessary for it to work. The underlying technology used is Jekyll and there is no framework used. CSS is built from SCSS files and everything is contained to remove the need for 3rd party assets and unnecessary connections.

This project is maintained by AdAway.

adaway.github.io's People

Contributors

anenasa avatar anxh3l0 avatar argymeg avatar ayanagroup-official avatar bm1549 avatar dalisoft avatar dependabot[bot] avatar dylanarmstrong avatar echodev avatar francyesco avatar gabrielanca avatar githubib avatar hashworks avatar jawz101 avatar jpanmotus avatar jpbede avatar madlittlemods avatar martinml avatar mertcelen avatar mgius-ae avatar mkatsevvr avatar natanlao avatar nils-a avatar perfectslayer avatar pixelchutes avatar pmalek avatar sagebrushes avatar sirlancelot avatar socram8888 avatar spirillen avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

adaway.github.io's Issues

Backup converter issue

Website converter doesn't work. I tried Edge, Firefox, Chrome on PC and Chrome on Android. Clicking buttons does nothing.
@edit:
I figure it out: it doesn't parse empty lines, you should fix that easily.
console log:
export:152 Uncaught TypeError: Cannot read property 'length' of null
at convertToModern (export:152)
at HTMLButtonElement.onclick (export:70)
@edit2:
but still there is some bug:
white spotify.com
converts to:
{
"sources": [],
"blocked": [],
"allowed": [
{
"host": "tify.com*",
"enabled": true
}
],
"redirected": []
}

Originally posted by @vidmo91 in AdAway/AdAway#1194 (comment)

socialize.us1.gigya.com addition

Hey there! I recently noticed an app became unusable when my network level ad blocker was turned on... I traced it back all the way to this project and in particular, this commit: e025400

The app is silly for just totally breaking when that host is unavailable, however, I don't think the socialize.us1.gigya.com and socialize.eu1.gigya.com domains should be in this list. These are not ad serving domains and it looks like were added maybe a bit hastily. These domains seem to typically be used for customer engagement within an app (login, comments, ratings, loyalty). You can read more about them here: https://developers.gigya.com/display/GD/Social+Engagement+Deprecation

I think their removal from this list would make the most sense.

[workaround-available] https://appcenter.ms/ being blocked - false positive?

Describe the third party app

Describe the compabitily issue
Seems like the following two domains being blocked will break some applications hosted at https://appcenter.ms/ - which seems to be a legitimate Dev site owned by Microsoft

[hockeyapp.net]

127.0.0.1 gate.hockeyapp.net
127.0.0.1 sdk.hockeyapp.net

Workaround
If applicable, describe the whitelist domains to add to fix the issue:

After whitelisting these two, app started to work properly:

gate.hockeyapp.net
sdk.hockeyapp.net

--

Is there any particular reason to have these blocked? Please consider removing those two domains. Thank you.

False positive uservoice.org

Hi,

please remove uservoice.org. The domain does not serve ads, it is the domain for Uservoice, a company that provides "product feedback management software".

Please see these example subdomains:

https://yahoo.uservoice.com/
https://office365.uservoice.com/
https://sharepoint.uservoice.com/

X.ssl.fastly.net is blocking too many things

Hello AdAway Team!

I noticed that in this commit added two hosts that are blocking legitimate sites:

f.ssl.fastly.net#L7330
m.ssl.fastly.net#L7334

These domains are used by Fastly CDN customers who use shared SSL hosting. As a Fastly customer you are assigned a certain letter so that they can do propper SNI matching during the SSL handshake.

Some downstream consumers of this list (pfBlockerNG, pihole, NordVPN Cybersec, etc.) will end up blocking some or all of the content hosted on these sites

Because Fastly domains host multiple sites some downstream consumers of this list (pfBlockerNG, pihole, NordVPN Cybersec, etc.) will end up blocking some or all of the functionality of the sites hosted on these domains.

Some legitimate sites that I have identified that are affected:

  • bleacherreport.net
  • businessinsider.com
  • fetlife.com

There are also other sites that are listed in the SNI certificate and can be broke in multiple ways, depending on how the sites implement Fastly/DNS:

  • 500px.com
  • digitalocean.com
  • projects.fivethirtyeight.com
  • ruby-lang.org
  • rubytogether.org

I suspect these domains were added because there are also other ad domains being hosted here as well (such as adroll)

Can we please remove those two lines so that legitimate sites are not blocked?

There are 110 SNI names handled on the f and m domains; however it is worse than that due to wildcards:

$ for x in {f,m}; do openssl s_client -connect ${x}.ssl.fastly.net:443 < <( echo "Q\r" ) 2>/dev/null | openssl x509 -noout -text 2>/dev/null  | grep 'DNS:' | tr ',' '\n' | sed 's/.*DNS://g' ; done | sort | uniq | wc -l
     110

Hope blockade

@jawz101
Hi,
Can these several ask you to block?
ad.ettoday.net
imp.appledaily.com
video-api.yql.yahoo.com
udc.yahoo.com

Whitelist domain request - Tapas.io

Describe the third party app

  • Name: Tapas

Describe the compabitily issue
App reports no internet connectivity, domains listed below are being blocked by PiHole.

Workaround
Whitelist the following domains:

api.tapas.io
da.tapas.io
ping.tapas.io

Unblock api.ipify.org

Hi

Was it really necessary to add this:

127.0.0.1 api.ipify.org

to the list?

This broke, among other things, an internal monitoring tool and a dynamic DNS updater.
(also the block is even incomplete since you guys missed api6.ipify.org)

All they do is provide your public IP address back to you via a free API that anyone can use without signing up or any other restrictions. Nothing is logged either. :/

False positive for Help Scout

Hi everyone, I’m and Android app developer who wants to integrate helpdesk software to improve customer support. Today I discovered that AdAway blocks Help Scout’s Beacon API. It lets users access our knowledge base and ask us for help. However, this site doesn’t serve ads. Could this be a false positive?

The following domains are currently blacklisted by AdAway:

# [helpscout.net]
127.0.0.1 beacon-v2.helpscout.net
127.0.0.1 beaconapi.helpscout.net

I also found an article from Help Scout about this, might be interesting for you:
https://docs.helpscout.com/article/911-beacon-ad-blockers

Note: I’m not working for Help Scout, I’m just one of their customers.
Wish you a nice weekend and stay safe 😊

Remove Cloudflare

Hi @PerfectSlayer,

Can we please remove Cloudflare from AdAway? GitHub now provides SSL for custom domains so we don't need it anymore. There's also countless privacy issues related to using Cloudflare so I believe this is necessary.

Thanks!

Remove GrooveHQ from the list

Hi, my name is Marcin and I'm the Head of Engineering at GrooveHQ.

It's been brought to our attention that a number of groovehq domains were included in the list, which I think might have happened by mistake. Groove is a customer support tool and we have nothing to do with ads.

The lines in question:

# [groovehq.com]
127.0.0.1 assets.groovehq.com
127.0.0.1 c.groovehq.com
127.0.0.1 graphql.groovehq.com
127.0.0.1 i.groovehq.com

Slack channel

Hi all contributors,

I am opening a Slack channel to easily communicate about the next versions of AdAway project: the app, the hosts file, translations and the website.
I would like to invite the @AnXh3L0 @jawz101 and @smed79

Could you send me an email to perfect slayer @ adaway . org (without space) so I could invite you to the channel?

Regards

Addition to the new update

0.0.0.0 adclick.g.doublecklick.net
0.0.0.0 adeventtracker.spotify.com
0.0.0.0 ads-fa.spotify.com
0.0.0.0 analytics.spotify.com
0.0.0.0 audio2.spotify.com
0.0.0.0 audio-ec.spotify.com
0.0.0.0 content.bitsontherun.com
0.0.0.0 crashdump.spotify.com
0.0.0.0 d2gi7ultltnc2u.cloudfront.net
0.0.0.0 d3rt1990lpmkn.cloudfront.net
0.0.0.0 desktop.spotify.com
0.0.0.0 gtssl2-ocsp.geotrust.com
0.0.0.0 heads-ec.spotify.com
0.0.0.0 log.spotify.com
0.0.0.0 omaze.com
0.0.0.0 open.spotify.com
0.0.0.0 prod.spotify.map.fastlylb.net
0.0.0.0 redirector.gvt1.com
0.0.0.0 sto3.spotify.com
0.0.0.0 upgrade.spotify.com
0.0.0.0 v.jwpcdn.com
0.0.0.0 weblb-wg.gslb.spotify.com

Remove bugsnag

Bugsnag is a useful exception monitoring tool for developers and has nothing to do with ads, so I don't see what it's on this list. I'm not related to the company in any way other than I use & love their product. If there's some ethical stance about what they're doing that I'm missing, then I'd suggest removing app.bugsnag.com at a minimum, which is just the url of their web app that I log into to see tracked exceptions. However, I think all of their domains should be removed from the list.

[workaround-available] CNBC seems to require api.queryly.com

CNBC Website Symbol Lookup
Website: CNBC

Description
The domain api.queryly.com is blocked which stops results populating the 'Search Quotes' field.
That domain is not used for searching, but when it is blocked, the search no longer works.

Steps to Duplicate
Go to website and enter a symbol in the 'Search Quotes' field on CNBC (in the upper right) and it will fail.

Workaround
If applicable, describe the whitelist domains to add to fix the issue:
api.queryly.com

Remove intercom.io

Intercom.io is a useful live chat support platform. This is perhaps a bit more of a gray area than my previous request regarding Bugsnag, as one could argue that some of Intercom's behavior falls under trackers, but it definitely isn't ad-related, so I think it would help to clarify exactly what type of domains this list hopes to capture (with a product called AdAway I would expect it to just be Ad companies, but I could be wrong).

Mobile apps don't work because API is being blocked

Hi,

Immobilienscou24 mobile apps stop working because our apis are being blocked. I've created a pull request to remove domains from blacklist.

We get more and more angry users because app just can't load content.

These domains are absolutely crucial for applications to work:

  • api.finanzen.immobilienscout24.de
  • api.mobile.immobilienscout24.de
  • api.recommendation.immobilienscout24.de

Could you please remove them from blacklist?

find way to scan list with VirusTotal for mobile file relations

example:

https://www.virustotal.com/gui/domain/api2.batmobi.net/relations

scroll down to Communicating Files and Files Referring sections and it indicates that Android applications refer to and/or communicate with this api2.batmobi.net entry. It would be nice to run the list through to check each entry and see if each occurs in mobile applications.

I don't know if there is an easy way to do this. VirusTotal does have an api but I don't know if it can pull out these details. I've looked at web scraping utilities but either the results screen is designed a certain way where I can't figure out how to do it... and I'm just taking guesses on how to get a scraping app to work :/

Any help is appreciated!

FP: pusher.com

pusher.com is used by travis-ci.(com|net) to call logs and current status

Only stats.pusher.com should be blocked for statistic tracking of users.

image

Logger output
+53 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_send?t=1579062757722&n=20
+53 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_send?t=1579062757722&n=20
+28 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_send?t=1579062732855&n=19
+28 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_send?t=1579062732855&n=19
+28 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_send?t=1579062732850&n=18
+28 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_send?t=1579062732850&n=18
+28 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_send?t=1579062732685&n=17
+28 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_send?t=1579062732685&n=17
+26 travis-ci.com 3 xhr https://sockjs.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_streaming?protocol=7&client=js&version=5.0.2&t=1579062730862&n=16
+26 travis-ci.com 3 xhr https://sockjs.pusher.com/pusher/app/59236bc0716a551eab40/84/1bp7c4n6/xhr_streaming?protocol=7&client=js&version=5.0.2&t=1579062730862&n=16
+0 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/314/cbt3ga1j/xhr_send?t=1579062704900&n=15
+0 travis-ci.com 3 xhr https://sock126-mt1.pusher.com/pusher/app/59236bc0716a551eab40/314/cbt3ga1j/xhr_send?t=1579062704900&n=15

original posted here https://github.com/jawz101/MobileAdTrackers/issues/30

Remove from list

I believe the following should be removed from the block list. These links cause state government pages to not function that are end users to pay things like vehicle registration.

# [mobilgov.com]
127.0.0.1 3100-app.mobilgov.com
127.0.0.1 3300-app.mobilgov.com
127.0.0.1 5900-app.mobilgov.com
127.0.0.1 8443-app.mobilgov.com

gjtech.net is still linked to in the metadata, which it probably shouldn't be

The lines:

# 2013-03-29 Integrated some hosts from
#            http://adblock.gjtech.net/?format=hostfile

...are still present in the new AdAway list, despite how gjtech.net has for several years now been a parked domain with no actual lists and a not insignificant chance (Maybe as much as 20%) of being redirected to malware, and is probably not a link that laymen end-users should want to casually check out. I therefore hereby request that the text be replaced with # 2013-03-29 Integrated some hosts from GJtech.

The rest of the metadata in the list's top could also need a bit of updating to whatever you (jawz101) and the AdAway programmer team would want to have. In particular I personally presume that it could be worth it to encourage end-users to report list-only issues to https://github.com/AdAway/adaway.github.io/issues.

I would also like to thank the AdAway team in general for finally removing the gjtech.net link from https://github.com/AdAway/AdAway/wiki/HostsSources, even if it was done perhaps several years late.

Deprecated Markdown engine

Hello @AnXh3L0

When I merged a PR on project, I received a mail from Github about deprecated 'redcarpet' Markdown engine. Does it ring a bell to you? Is there any action to do?

You are currently using the 'redcarpet' Markdown engine, which is no longer supported by GitHub Pages and may cease working at any time. To ensure your site continues to build, remove the 'markdown' setting in your site's '_config.yml' file and confirm your site renders as expected. For more information, see https://help.github.com/en/articles/updating-your-markdown-processor-to-kramdown.

For information on troubleshooting Jekyll see:
https://help.github.com/articles/troubleshooting-jekyll-builds

Thanks!

Remove schneidercorp.com

Please remove this entire section from the hosts file:

# [schneidercorp.com]
0.0.0.0 beacon.schneidercorp.com
0.0.0.0 beaconbeta.schneidercorp.com

These websites are not ads or tracking, they are "interactive public access portals" that allow access to local government property information and maps.

use-application-dns.net should not be sinkholed

https://support.mozilla.org/en-US/kb/canary-domain-use-application-dnsnet

Firefox will attempt to resolve this domain using the DNS server(s) configured in the operating system of the device, and examine the result. The result will be considered negative if:

  • A response code other than NOERROR is returned, such as NXDOMAIN (non-existent domain) or SERVFAIL
  • A NOERROR response code is returned, but contains neither A nor AAAA records

The result will be considered positive if:

  • The query completes with NOERROR and contains A or AAAA records (or both)

A negative result will be a signal to disable application DNS, i.e. DoH.

By adding use-application-dns.net as an A record, this blocklist (as well as others) is signalling that DoH should be enabled which is an issue for DNS based adblockers that often use this list such as Pi-hole.

Thanks :)

mobile.impacttestonline.com - Why is it blocked?

Just a quick question, we subscribe to a host list that aggregates from your list and it works great, but recently is has blocked login to impacttestonline, which is valid. The url in question is called when a user logs into the online portal for ImPACT, which is used by health care professionals to assist with diagnosing concussions and brain injuries.
I've whitelisted it on my piholes, but wanted to drop a note that it probably shouldn't be blocked.

Blocking of "ns.exitgames.com" breaks games that use the Photon multiplayer platform

My router has ad-blocking software which blocks ads at a network level, and one of the hosts files it uses is the AdAway one.
It recently added the domain "ns.exitgames.com", which is used by the Photon multiplayer platform. Blocking that domain breaks any multiplayer games which use that provider.
I noticed it on Distrust, a PC game (and it worked last week, so the change must have been recent), but it sounds like the provider also provides multiplayer to Android games as well.

Our map and APIs are being blocked

Hello,

We offer maps & geocoding (address) APIs to over 50k developers and do not have anything but Google Analytics & Intercom (chat) on our website. We woke up today to find our map tile servers and our US API endpoint listed on your list.

Could you please help us remove this?

us1.locationiq.com
maps.locationiq.com

Thanks,

False Positive: a bug reporting tool

I noticed that our API api.instabug.com is blocked. Instabug is used for reporting bugs or crashes from inside mobile apps.

  • It isn't used to serve any ads
  • User consent is taken before sending the bug report

api.particle.io is being blocked

Hi there!

api.particle.io is part of your blocklist and causing major headaches at our support department.
Could you please assist in removing our API? We are a legitimate IoT company operating out of San Francisco.

https://www.particle.io for reference.

Kind regards,
Chris

please remove the panopticlick EFF tracker protection domains unless they're actual trackers

I don't see the point of simply blocking these domains by hardcoding them in a list.
trackersimulator.org
eviltracker.net
do-not-tracker.org

If their purpose is to test certain fingerprinting techniques, why prevent them from doing that? You're effectively breaking the test of techniques that thousands of actual tracking companies use by blocking these 3 innocuous domains.

I can't find the right words to explain that.

I liken this to cell phone companies overclocking your phone when running benchmark apps. It helps your brand but we're actually trying to test something specific.

Domain reports

Hello again @jawz101 (sorry to bother you so many times lately...)

I can read from the help page bundled in the app that we recommend to report any new found domain to the hosts-file.net forum.

It does not block ads in application XYZ!

Some hostnames may be missing in the provided hosts files from the Hosts Sources or the application has bundled the images to provide ads without accessing the internet.

You can log DNS requests (Menu->Log DNS Requests) from AdAway to find out which additional hostnames have to be blocked.

Add the suspicious hostnames to your own Blacklist by long pressing the entries in the Log and report these hostnames when you have verified them in the Forum Hosts Inbox of hosts-file.net.

As it is closed, would you like users report adware domain on this GitHub or do you have any other place in mind? Another solution could be to simply remove the report part for the help page.

What would you prefer?

potential additions

launches.appsflyer.com
inapps.appsflyer.com
cdp.cloud.unity3d.com
config.uca.cloud.unity3d.com
www.geoplugin.net
metric-android-am.road404.com
outcome-ssp.supersonicads.com
www.leanplum.com
www.google-analytics.com
freegeoip.com
ads.sessiongames.com
1cef.playfabapi.com
cx.atdmt.com
api.leanplum.com
app.adjust.com
stats.unity3d.com
ssl.google-analytics.com
reports.crashlytics.com

update: this one merged

Host whitelist for cdn.anypoint.mulesoft.com

Describe the third party app

  • Name: Pi-Hole using AdAway lists

Describe the compabitily issue
Mulesoft just updated their website and the URL of cdn.anypoint.mulesoft.com has been added to the hosts list. This breaks their site and the ability to manage and administer business applications if using this list with a browser based ad blocker using AdAway.

This also gets ingested into the StevenBlack list which is very popular in the Pi-Hole community.

Workaround
If applicable, describe the whitelist domains to add to fix the issue:

  • cdn.anypoint.mulesoft.com manually added to the whitelist in PiHole.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.