Qscripts

Quick scripts for productivity, data fetches, and tedious tasks.

Current Scripts

72it.py

An attempt to follow a strict adherence to PEP 8 that cuts every single line in a file into a length of 72 characters. Ignores words, punctuation, or anything that would actually be useful.

TODO:

• Cut lines over full words and recognize the syntax of at least python.

addDoc.py

Looks over a file, pulls out functions and asks the user what they would like to write for documentation. This script runs under the assumption (the lofty assumption) that the user has read and understood the file s/he/it is adding documentation to. Does not support decorators or classes.

TODO:

• Add support for decorators and classes.
• Add a config file for custom definition of function documentation

cat.py

A short script to print out the contents of a file because I didn't feel like downloading the much better GNU cat. This version of cat is so good though, that it doesn't even use pretty print or anything. It just spits lines at you.

TODO:

• Download GNU cat

check_site.py

Querying a site for a specific status code. Not sure why I needed a full fledged module for this, but here it is.

TODO:

• Add option to pass timeout length
• Time the amount of time until the status code disappears
  • Give statistics on the timing

dance.py

Makes some fun little ASCII terminal dancers because everyone needs a pick me up once in a while.

TODO:

• Make prettier dancers
• Get the slow hip roll in. They are a bit spastic right now

music.py

Requires VLC. Looks for new posts on 2 subreddits and then shoves them into VLC which sorts out whether they can actually stream them or not. Keeps a log of which urls were used in the case that you want to look up something you just heard, and for minimal memeory in the long term.

TODO:

• Do some preprocessing so that VLC doesn't have to deal with trying to figure out if it should play music from an article
• Add some configuration options to when the script does the querying

sw.py

Kindly asks for some site statistics from similarweb.com for a specific site. Equivalent to visiting the webpage. Please don't abuse this.

TODO:

• Add a User-Agent (Probably Mozilla)

white2trans.py

Transform all of the white pixels in an image to transparent (Change the alpha values to 0) in a png. Far better results for larger images. Also uses the magic of PIL

TODO:

• Evaluate the accuracy with a negative of the image compared to the new image.

gheadlines.py

Grab the top 5 results from a google search of a {site} for a {topic} in the past year. Returns only live urls, not the google cached results.

TODO:

• Expand on what the user can display and maybe take in a generic query

link_get.py

Go to a certain amount of links and then retrieve all the links on the page. Also optionally returns a simple regex query for the links scraped.

TODO:

• Search for links recursively with a depth parameter
• Search for all links in the page instead of those under html 'a'

site_dscrp.py

Grab a site's description as listed in the "description" or "og:description" tags.

TODO

• Update to a consistent User-Agent and maybe implement some speedups

href_finder.py

Crawl a site for a specific link and other functionality. Has a mandatory robots.txt read for purposes of "being nice"

Usage:

python href_finder.py [-t] [-g get-element] [-gm tag] [-s schema] [-o Output-File] url find [-i ignore, ..]

• -t is for testing purposes. It only runs through one webpage and then breaks. Should be renamed to debug or something in the future.
• -g get-element retrieves an element from every gathered webpage AFTER these pages are scraped.
• -gm tag writes the string contents of the specified tag on url to the output file. Might be able to use with -g but this is a bug.
• -s schema if you know what the urls should look like then use this to specify the url schemas they must be
• -o Output-File the file that the results should be output to.
• -i ignore, .. ignore a certain pattern that you know should not be in the url (i.e. .css or .jpg)
• url the base url with which to search
• find the string/url to find

TODO

• Include the ability to specify the appearance of an arbitrary regex (valid) pattern within the sub-pages
• Include the ability to look for an arbitrary (valid) tag instead of href
• Add comments
• Update documentation
• Refactor into class structure

gping.py

Ping an IPv4 or IPv6 address continuously with a nice graphical bar to tell you how you are doing!

Currently only available for Windows (basically a mask for ping -t ip) and with Ctrl-C to break out.

Usage:

>python gping.py [[Normal ping options]] ip

Examples:

>python gping.py 8.8.8.8

>python gping.py 127.0.0.1 -l 256

TODO

• Make available for *nix systems
• Have the option to set the token for displayed bar
• Display help on -h or no ip entry
• Have the option to collapse the bar into a small section so as not to clog up the rest of the terminal
  • x% of total terminal lines

Classes

Helper classes that make data easier to handle in some of the scripts. Yay Object-Oriented programming!

Etc.

If you have any questions, comments, concerns, clarifications, or need advice on what resin you should use in your carbon fiber hull email mailto:[email protected]