Giter VIP home page Giter VIP logo

useragentlists's Introduction

User-Agent Lists

Sometimes you need change the User-Agent string used when making alot of requests to the same server(s) often.

  • Research Purposes ONLY

That can be a hard thing to do if you only know a handful of user agents.

Not to mention building your own comprehensive list of user agent strings takes time.

In the spirit of the rfc.bib project, this project aims to make a comprehensive set of User-Agent string lists available for all to use.

Usage

Download a list today free of charge

OR

Generate the lists yourself (Requires python 3.5)

  • [sudo] pip install -r requirements.txt
  • python useragents.py --all

For more options execute python useragents.py --help

List Info

Origins

The User-Agent lists made available by this repo come from

Flavors

All list provided by this repo come in two flavors namely csv and json.

Both flavors can be found in a directory of same name and both flavors share the same "keys".

Keys

ua_org_allagents.(csv|json)

  • description: The name of the browser/bot/etc using the User-Agent string
  • ua: The User-Agent string

techpatterns_com_useragentswitcher.(csv|json)

  • kind: Is the userof the User-Agent string a browser, mobile, spider
  • description: Name version (os) for the user of the User-Agent string
  • ua: The User-Agent string

[browser].(csv|json)

  • ua: The User-Agent string
  • version: The version of the browser using the User-Agent string
  • commonality: How common is this User-Agent string

User-Agents Included By Each List

ua_org_allagents.(csv|json) provides 2460 User-Agent strings comprised of

  • Web Crawlers / Robots
  • Browsers (Older)
  • Tools (Curl, etc)
  • Scanners

techpatterns_com_useragentswitcher.(csv|json) provides 830 User-Agent strings comprised of

  • Browsers - Windows
  • Browsers - Mac
  • Browsers - Linux, Browsers - Unix
  • Mobile Devices
  • Spiders
  • Miscellaneous

[browser].(csv|json) provides 1501 User-Agent strings specific to a browser

  • chrome
  • firefox
  • safari
  • opera
  • internet-explorer
  • android

License

MIT

useragentlists's People

Contributors

n0tan3rd avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.