Python utils for DataHack.
~ dhutil mail confirm_stat
Emails stas on DataHack 2019 registration:
432 total users in the system.
415 users got a confirmation email.Install dhutil with:
pip install dhutildhutil uses configuration files located at a folder named .datahack in your home folder (i.e. ~/.datahack). Create this folder and populate it with the desired files.
To enable MongoDB access, put a mongodb_credentials.json file in the ~/.datahack folder with the following properties:
{
"host": "ds162883.mlab.com",
"port": "26552",
"usr": "some_user",
"pwd": "pAsswOrd",
"authSource": "db_name",
"srv": true,
"db": "test"
}These are example values; you need to use the database-specific host and port supplied by mlab, a username and password of a user created inside that mlab database (not the username and password used to log into mlab!), and the name of that database as the authSource parameter.
To enable email access, put an email_credentials.json file in the ~/.datahack folder with the following properties:
{
"host": "smtp.zoho.com",
"port": "587",
"usr": "zoho_username",
"pwd": "wOwPassWord"
}These are example values; host and port are correct (for the ZohoMail SMTP server), but you need to put the username and password of the ZohoMail account you want to use to send emails, or put in the details of another SMTP server.
To enable mail access, put an mailchimp_credentials.json file in the ~/.datahack folder with the following properties:
{
"username": "mchimp_uname",
"secret_key": "o8347583489t03894tr29",
"registrants_list_id": "9uy24hw9fue",
"accepted_list_id": "208dj2dj2"
}These are example values; use the desired username and issue an API key for that user. Also take the actual ids of the registrants and accepted MailChimp lists.
To enable Google Drive access, follow the instructions here to create a service account with Google Drive access, and create a json key file for it.
Place this file in the ~/.datahack folder, and rename it to google_drive_service_account_key.json.
Don't forget to follow all the above instructions, including sharing your spreadsheet with an email you have in your json_key['client_email'] (Otherwise you’ll get a SpreadsheetNotFound exception when trying to open it).
Additionally, create google_drive_cfg.json file at the ~/.datahack folder, and populate it with the key of the users spreadsheet, and the name of the specific worksheet within it in which users are listed:
{
"users_spreadsheet_key": "08924ufo8u2ndfuqihdo7g23dfh",
"users_worksheet_name": "Users"
}When you install dhutil a command (of the corresponding name) giving access to its CLI is installed on your system. Type dhutil in terminal to get a list of the available sub-commands:
~ dhutil
Usage: dhutil [OPTIONS] COMMAND [ARGS]...
A command-line interface for dhutil.
Options:
--help Show this message and exit.
Commands:
mail Email related commands.
mailchimp MailChimp related commands.
mongo MongoDB related commands.Some MOngoDB-related utilities. Type dhutil mongo in terminal to get a list of the available MOngoDB-related commands:
~ dhutil mongo
Usage: dhutil mongo [OPTIONS] COMMAND [ARGS]...
MongoDB related commands.
Options:
--help Show this message and exit.
Commands:
user_stats Print user stats.Prints statistics on users in the database.
Some email-related utilities. Type dhutil mail in terminal to get a list of the available email-related commands:
~ dhutil mail
Usage: dhutil mail [OPTIONS] COMMAND [ARGS]...
Email related commands.
Options:
--help Show this message and exit.
Commands:
confirm_send Send confirmation emails.
confirm_stat Status of confirmation emails.The dhutil mail confirm_stat terminal command will print to termintal how many users got confirmation emails (not acceptance emails):
~ dhutil mail confirm_stat
Emails stas on DataHack 2017 registration:
432 total users in the system.
415 users got a confirmation email.The dhutil mail confirm_send terminal command will first print to terminal confirmation emails stats, and then will send confirmation emails (not acceptance emails) to any registered user who has not gotten one yet, and will mark them as such. Emails are sent with 50 recipents per-email (so not to use up the daily email quota), which are all BCCed so they can't see who else is CCed:
~ dhutil mail confirm_send
Emails stas on DataHack 2017 registration:
250 total users in the system.
247 users got a confirmation email.
Sending confirmation emails to all non-confirmed users.
Sending a confirmation email to the following addresses:
['[email protected]', '[email protected]', '[email protected]']
Email sent successfully
Users marked as confirmed on MongoDB
==========
1 confirmation emails were sent to 3 users.Lists all the mailing lists on the connected account.
Sync the MailChimp registrants list with the registration system's DB, adding any missing user. Prints a progress bar while doing so.
Sync Google Drive acceptance status to MongoDB.
Package author and current maintainer is Shay Palachy ([email protected]); You are more than welcome to approach him for help. Contributions are very welcomed.
Clone:
git clone [email protected]:DataHackIL/dhutil.gitInstall in development mode with test dependencies:
cd dhutil
pip install -e ".[test]"To run the tests (none at the moment), use
python -m pytest --cov=dhutilThis project is documented using the numpy docstring conventions, which were chosen as they are perhaps the most widely-spread conventions that are both supported by common tools such as Sphinx and result in human-readable docstrings (in my personal opinion, of course). When documenting code you add to this project, please follow these conventions.
Created by Shay Palachy ([email protected]).