Awesome-ETL List

07 Oct 2015

Finally decided to put all the interesting ETL software I find into a list: https://github.com/pawl/awesome-etl

Python Idioms

24 Sep 2015

Here’s a great page describing Python idioms: https://david.goodger.org/projects/pycon/2007/idiomatic/handout.html

This gist of a Raymond Hettinger talk is also great: https://gist.github.com/JeffPaine/6213790

Best "Command Line" Beginners Guide

19 Sep 2015

Learn Enough Command Line

It’s a short guide, but I think it covers everything a beginner needs to know.

Current State Of Workflow Engines / Frameworks

15 Sep 2015

This is a great article about the current state of workflow engines (and frameworks?): http://stackstorm.com/2015/04/10/the-return-of-workflows/

Taskflow looks especially interesting. The article is unfortunately missing Airbnb’s Airflow: https://github.com/airbnb/airflow

Installing Postgres 9.5 On OSX

02 Aug 2015

Edit 12/25/2020: I’d recommend using: https://postgresapp.com/

Ended up being surprisingly easy:

brew uninstall postgresql brew install postgresql-9.5 brew link -f postgresql-9.5 mv /usr/local/var/postgres /usr/local/var/postgres.old initdb -D /usr/local/var/postgres # restore old database? # pg_upgrade -b /usr/local/Cellar/postgresql/9.0.4/bin -B /usr/local/Cellar/postgresql/9.1.2/bin -d /usr/local/var/postgres.old -D /usr/local/var/postgres # start postgres pg_ctl -D /usr/local/var/postgres -l logfile start

New Macbook Pro Setup

26 Jul 2015

I’m finally switching to a Macbook Pro as my personal computer after a few months of using one at work. Local development on OSX is a lot easier and bug-free than on a Windows computer.

I started a gist with what I did for setup:

Important tips: * to open applications quickly, command + space and type the application name * mac doesn't have an address bar in finder, you need to use command + shift + g to type a directory path * mac doesn't have "snap window to screen" like windows does, you need to install moom for this * activity monitor = task manager * brew install = apt get install (you'll need to install brew) * use command + tilde to switch between windows for the same application Setup: * Upgrade MacOS to newest through the app store if you haven't already * Install chrome (https://www.google.com/chrome/browser/desktop/) * Install chrome plugins (adblock, etc) * Install brew * /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" * Install iterm2 (https://www.iterm2.com/) * Fix alt + left/right arrow in iterm: http://apple.stackexchange.com/a/136931 * `brew install git` * [github ssh setup](https://docs.github.com/en/authentication/connecting-to-github-with-ssh/generating-a-new-ssh-key-and-adding-it-to-the-ssh-agent#adding-your-ssh-key-to-the-ssh-agent) * Install xcode and agree to terms of service (it's required by some things) * Install sublime text * Install sublime package manager and plugins * command + shift + p then "install plugin manager" * install plugin sidebarenhancements * restore sublime text settings from other computer * Security hardening (especially turn off bluetooth): http://docs.hardentheworld.org/OS/OSX_10.11_El_Capitan/index.html * Open dock settings and check "Automatically hide and show dock" * Open trackpad settings and enable "Tap to Click" * Open keyboard settings and set "key repeat" to "Fast" and "delay until repeat" to "Short" * install docker * install vlc

In Order to Configure TCP/IP, You Must Install and Enable a Network Adapter Card

12 Jul 2015

If you get this error message, you need to disable and uninstall your network adapter. Once you’ve done that, you can reinstall the driver to fix it.

Cygwin - Python Compiled Without SSL Support

11 Jul 2015

Download error on https://pypi.python.org/simple/pip/: unknown url type:
https – Some packages may not be found!

ImportError: cannot import name HTTPSHandler

I was trying to install pip in cygwin when this happened. Searches say openssl-devel needed to be installed, but it already was. Apparently python was compiled without ssl support.

My solution was to install cygwin-x86 instead of the 64x one.

md5sum: standard input: no properly formatted MD5 checksum lines found

11 Jul 2015

If you see this error when you’re using apt-cyg, it means you need to update apt-cyg.

You need to run the following commands:

lynx -source rawgit.com/transcode-open/apt-cyg/master/apt-cyg > apt-cyg
install apt-cyg /bin

Create and edit records in a modal - Flask-Admin

05 Jul 2015

By default Flask-Admin sends you to a separate page to create or edit a record. I added options to do it in a modal on top of the list instead.

class UserView(ModelView):
    create_modal = True
    edit_modal = True

Set those and the New and Edit buttons open the form in a popup, submit through the normal flow, and drop you back on the list. Edit came first (#919), then create (#925). Getting the create modal right meant fixing a few things: missing CSS/JS when a submit came back with validation errors, the Bootstrap 3 backdrop showing through, and translations for the modal header.

I also added a read-only details view and moved the modal markup into its own templates so the create, edit, and details modals could share it (#942), and wired the same modals into FileAdmin (#933).

Older Newer