XD

Hire Xu D. - Forward Deployed Engineer

Forward Deployed Engineer

13+ years
seattle, washington, united states
Starburst

About xu

I design high-scale data architectures that help Fortune 500 companies turn their distributed data into competitive advantage — specifically at the intersection of operational databases, analytical lakehouse patterns, and AI/ML enablement. As a Data Platform Architect at Starburst Data, I serve as the primary technical advisor for strategic enterprise accounts, diagnosing complex architectural bottlenecks across distributed compute engines and cloud storage layers. My work spans the full lifecycle: designing hybrid data patterns that prevent costly anti-patterns, engineering cost-optimization strategies that reduce compute waste, leading severity-1 war rooms for mission-critical systems, and building high-performance access layers that accelerate AI/ML pipelines by removing data movement bottlenecks. Before Starburst, I architected Spark-backed ML pipelines at Tamr. My PhD research in Industrial Engineering focused on information diffusion across large-scale graph networks on distributed systems. What I do best: I translate complex distributed systems challenges into clear architectural guidance that drives measurable business outcomes — whether that means cutting cloud spend, preventing outages, or unblocking an AI initiative that's stalled on data access. Core domains: Distributed SQL (Trino/Presto, Athena) · NoSQL & Key-Value Stores (Cassandra, DynamoDB) · Lakehouse Architecture (Iceberg, Snowflake) · AI/ML Pipeline Enablement · Cloud Infrastructure (AWS, Azure) · Cost Optimization & Capacity Planning

Key Skills

algorithmsamazon web servicesapache sparkbig data analyticsbusiness intelligencedashboarddata analysisdata miningdata sciencedeep learningextractgithadoophigher educationload+22 more

Experience

Forward Deployed Engineer

Current

Starburst

Serve as the primary technical advisor for Fortune 500 accounts on distributed data architecture strategy, working at the intersection of Trino query engine optimization and cloud-native storage (S3, Iceberg). Promoted twice. Architected hybrid data patterns and cost-optimization strategies that reduced customer compute waste across auto-scaling clusters Own severity-1 incident resolution for strategic accounts ($9M ARR), leading cross-functional war rooms with Engineering and Support Designed high-performance federated access layers enabling AI/ML teams to query raw operational data directly for context engineering — eliminating data movement bottlenecks Built and led a customer support engineering team, establishing escalation frameworks and mentoring junior engineers on distributed systems troubleshooting Was also Customer Support Team Lead and Sr. Solution Engineer before taking the current role

Dataops Engineer

Tamr

* Designed and implemented solutions to enterprise-level data unification problems at scale using in-house ML algorithms and third-party tools. * Consulted on best practices of materializing and/or categorizing entities (contacts, customers, suppliers, parts, registrations, etc.) to global and domestic enterprise customers. * Productionized a real-time notification module to monitor Spark jobs using RESTful APIs and Slack Web Client. * Delivered time-constrained POV projects leading to customer success. * Prototyped add-on applications to software that expands analytical functionalities.

Data Science Fellow

Insight Data Science

* Built a data product called APRODUCE, a web application that uses machine learning to help online Peer-To-Peer (P2P) lenders to predict and track the revenue on their lending investment. * Ingested 2.5 million historical loan data with 140 features from lendingclub.com loan data repository. * Used logistic regression (scikit-learn) to classify loans that will default or not, resulting in a good balance with precision and recall metrics. * Used XGBOOST to obtain accurate predictions (1.6% MAE) on annualized percentage returns of any recommended (healthy) loans. * Deployed a web-based dashboard using Dash by Plotly and AWS Elasticbeanstalks. Provided easy-to-use interfaces and batch recommendations for both prospective and current loan investors

Education

University Of Miami

Doctor Of Philosophy

Wuhan University Of Technology

Masters

Wuhan University Of Technology

Bachelor Of Science

Interested in connecting with xu?

Sign up for NinjaHire to send a connection request.

Common Questions

What is xu's expertise?

xu specializes in Forward Deployed Engineer, with expertise in algorithms, amazon web services, apache spark, big data analytics, business intelligence.

Where is xu located?

xu is based in seattle, washington, united states.

How much experience does xu have?

xu has 13+ years of professional experience.

How can I contact xu?

You can connect with xu through NinjaHire by signing up for a free account.

Looking for a different Forward Deployed Engineer?

Describe exactly who you need and NinjaHire will source them for you.

Type a role to try NinjaHire for free