Hire Samuel B. - Forward Deployed Engineer

* Optimized and maintained data ingestion pipelines: * created cleaning functions for provider (and in-house) data scrapes using pyspark on AWS EMR * optimized merging of many data sources to create a unified dataset (python, SQL) on snowflake * worked with data science team to integrate machine learning models to augment the data (compensation predictions, location mapping, gender/ethnicity predictions, etc.) * built automated quality checks and manually reviewed data before promoting to live (for website backend and other transformation/delivery pipeline inputs) * Worked on highly parallelized Go pipelines: * built new features (added customizable inputs, optimized to cut out unnecessary compute, integrate custom appends to pipeline output) * debugged pipeline issues when they arise * Designed and built data orchestration layer to optimize deliveries on a small team: * Designed and built python library for client facing team to script fully customizable data deliveries * Designed and implemented data orchestration system to automatically read all deliveries and optimize them, so that all data is delivered using as few resources (storage and compute) as possible * Implemented caching so future data deliveries would not have not run in full (or not at all if final result was already available) * Company Universe Project: * worked with data science team to design and build Revelio's proprietary company universe * designed and implemented models to merge company identifier data from different company sources to create Revelio Company IDs (RCIDs) * created a company mapper python package to probabilistically map a client's list of companies with identifiers to the RCID universe

* Fixed web app. Debugged HTML, JavaScript (AngularJS), PHP code. Rewrote data calls to google sheets API in PHP. * Reviewed database and made suggestions to further optimize data storage and retrieval.