Responsibilities
- Develop and refine data pipelines using PySpark, Delta Lake, SQL, and cloud-based data engineering platforms.
- Enhance the dependability, monitoring, logging, error recovery, and restart capabilities of data workflows.
- Evaluate current notebooks, SQL scripts, data models, and workflow orchestrations for performance and long-term maintainability.
- Advise on optimal use of Azure Synapse, Spark, Delta Lake, data lake storage, and associated cloud services.
- Detect architectural shortcomings, technical debt, and risks related to system modernization.
- Support the creation of data quality validations, reconciliation methods, and verification frameworks.
- Contribute to the development of canonical identifiers, master data strategies, and entity resolution logic.
- Assist in implementing data cataloging, lineage tracking, metadata standards, and governance protocols.
- Collaborate with business teams to define needs for reporting, analytics, and data products.
- Help design scalable data models compatible with BI tools like ThoughtSpot, Power BI, or equivalent platforms.
- Coach members of the data team and advance the team’s overall engineering standards.
- Offer insights on potential oversights in security, efficiency, cost management, orchestration, testing, and long-term sustainability.
Benefits
- Medical coverage options include Blue Shield PPO, HDHP with HSA, and Kaiser HMO for California employees.
- Dental insurance provided through MetLife.
- Vision insurance coverage via VSP.
- Optional supplemental benefit plans available.
- Healthcare savings accounts with employer contributions.
- Flexible spending accounts for healthcare and dependent care.
- Flexible work arrangements to support work-life balance.
- Substantial employer contributions to 401(k) plans.
- Exempt employees qualify for flexible paid time off.
- Non-exempt employees receive 15 days of paid time off per year for the first three years.
- 11 paid company holidays annually.
- Opportunity to join the Equity Purchase Program, excluding contract, intern, and part-time roles.
- Potential for career advancement within the organization.
Work Arrangement
Hybrid
Team
Addison
Other
- This is a full-time exempt position.
- Benefits are offered to full-time employees working over 30 hours per week.
- The company is an E-Verify participant.