Software developer and data engineer
Skills
Data Engineering:
- Python
- SQL
- Airflow
- DBT
- Scala
- Sqoop
- Spark/Spark Streaming
Web Development
- Python
- Ruby/Rails
- Golang
- Javascript - React, ES6
Experience
Sprout Social
Senior Data Engineer
Sprout Social – Chicago, IL – 2022 - Present
- Set up testing and linting for python code to run in CI
ActiveCampaign
Senior Data Engineer
ActiveCampaign – Chicago, IL – 2020 - 2022
- Led redesign of Airflow ETL code to make code re-use easier - leading to faster incorporation of new data sources - and to move from a manual deploy process to an automated one on kubernetes
- Moved bulk data load from hundreds of thousands of MySQL databases to a streaming process so business processes previously using data hours to days out of date to data updated every 5 minutes
- Introduced tests to vital legacy code, enabling confident changes
Built In
Senior Data Engineer
Built In – Chicago, IL – 2019 - 2020
- Introduced dbt to ETL system to transform streamed website page views and clicks into actionable and attributable information
- Wrote dockerized scripts to run and serve machine learning models, optimizing for constant memory use regardless of data size
- Instrumented javascript, golang, and php code for data collection
Marketing Attribution
Data Engineer
Marketing Attribution – Evanston, IL – 2019
- Designed code to handle large datasets in Python, ideally without holding all data in memory
- Built web services to serve results of model runs or perform optimizations on data
Reverb.com
Software Engineer
Reverb.com – Chicago, IL – 2015 - 2019
Data Engineering Team – 2017 - 2019
- Revamped ETL pipeline using Scala code to run Sqoop to transfer and transform data from main database to tables in Redshift
- Performed ETL on event logs stored in JSON or parquet to be transformed and uploaded to S3 to be queried via Redshift Spectrum
- Built data pipeline to serve personalized recommendations
- Built web services using Flask or Sinatra to serve machine learning models and other data via HTTP or GRPC
- Built React components to serve results of machine learning models to users
Core Team – 2015 - 2017
- Full-stack development with Ruby on Rails and React
- Full text search using Elasticsearch
Blueye Creative
Junior Developer
Blueye Creative – Chicago, IL – 2014 - 2015
- Full-stack development with Ruby on Rails
- Connecting with APIs like Google Analytics, Traxo, and Open Weather Map
- Front-end development with Angular for highly interactive sites
- Javascript, JQuery, HTML, CSS, and some PHP for Wordpress sites
Dev Bootcamp
Web Developer in training
Dev Bootcamp – Chicago, IL – 2014
- Focusing on full-stack development with Ruby on Rails, 9-week intensive course
Kaplan Test Prep
Medical Programs Manager
Kaplan Test Prep – Chicago, IL – 2012 - 2014
- Managing department of 50+ employees
- Developed system to evaluate the effectiveness of Kaplan’s course to predict performance on the USMLE exam
- Working with MD faculty and staff to update practice test content
- Running regular marketing events to bring in new leads and build relationships with current students
Designated School Official
Kaplan Test Prep – Chicago, IL – 2010 - 2012
- Maintained SEVIS (Student and Exchange Visitor Information System) records for students on student visas
Education
Indiana University
2007 - 2009
Bloomington, IN - Master of Music, Bass Performance
Northwestern University
2003 - 2007
Evanston, IL - Bachelor of Music, Bass Performance