Modules to do

• DNS
• Domains
• Downloads
• Redirects
• SSL_utilities
• Youtube

Currently using sws domains kieranwood.ca -d prints:

{'creation_date': datetime.datetime(2018, 11, 6, 5, 9, 47),
 'expiration_date': datetime.datetime(2022, 11, 6, 5, 9, 47),
 'last_updated': datetime.datetime(2020, 11, 7, 14, 52, 12),
 'name': 'kieranwood.ca',
 'name_servers': {'sharon.ns.cloudflare.com', 'kevin.ns.cloudflare.com'},
 'registrant_cc': 'redacted for privacy',
 'registrar': 'Go Daddy Domains Canada, Inc'}

The datetime objects in 'creation_date', 'expiration_date', 'last_updated' should be converted to human-readable formats.

TODO

• When printing the response in the CLI convert the datetime objects to a human-readable format
• Update User docs example with new print format

• Review old section wording since much of it is awkward
• Add docs for new commands
  • Loadtest
  • Framework
• Move installation instructions up

Definitions

• SSL
• Domain
• FQDN
• Framework
• Registrar
• Metadata

Requirements

• Download class
  • url
  • size
  • download() with progress bar option
  • extension
  • download path

Implement a loadtesting command to loadtest a framework

Requirements

• Use Locust
• Provide URL
• Passthrough the loadtesting FE

Tasks

• See if it's possible to inject into PATH variable for whois instead of registry modification

Used to get domain info

Functionality

• Expiry
• Registered to
• Contact info
• If available
• If other TLD's are available

• domains
• Redirects
• ssl_utilities
• Youtube

• Update index wording, since some of it is awkward due to refactoring
• Add docs for new commands
  • Loadtest
  • Framework
• Cleanup Contribution guide
• Add API cookbook

Look into replacing nox with github actions pipeline

Checks if a site is a popular framework

Requirements

• Pass in url that goes through set of checks to see if site is using known frameworks
• Need to have Heirarchy for UI frameworks (bulma, jquery, react, bootstrap etc.), proxy systems (Nginx, apache etc.), backend frameworks (Wordpress, Drupal, squarespace, wix, django etc.)
• On query return an ordered list with the likelyhoods of each being present

So something like this:

sws frameworks kieranwood.ca

would print

Framework analysis for https://kieranwood.ca

Backend
======
1. Django (x/10 checks)

UI
=======
1. Bootstrap
2. JQuery

Proxy
====
1. NGINX

The purpose of this module is to provide easy ways to validate strings are in the correct format for use.

TODO

• Create a validation class that can take in a regex string, and has 2 methods: __repr__(), validate()
• Add in the instances found in the Validation instances section

Validation class

import re
from dataclasses import dataclass

@dataclass
class Validator:
    validation_string:str

    def validate(self, value:str, as_bool:bool=False) -> :
        compiled_expression = re.compile(self.validation_string)
        if not as_bool:
            return compiled_expression.match(value) # Return full match groups
        else:
            return bool(compiled_expression.match(value))

    def __repr__(self) ->str:
        return self.validation_string

Validation instances

• Valid email checker https://www.regextester.com/19
• Valid hostname regex https://www.regextester.com/23
• Add IP validation to dns module https://github.com/richardpenman/whois/blob/master/whois/__init__.py#L27-L28
• Phone number validation for Tel Links (note this is only for 6-7 digit numbers) https://www.regextester.com/17
• Look at international phone number validation (has some false positives) https://www.regextester.com/1978
• Finds HTML/XML tags https://www.regextester.com/27540