Responsibilities
- Build and maintain enterprise data platform capabilities on Databricks Lakehouse and Microsoft Fabric
- Implement medallion architecture patterns (bronze, silver, gold) for data organization and quality progression
- Configure and manage Delta Lake for ACID transactions, time travel, and reliable data storage
- Support Unity Catalog implementation for data discovery, lineage, and governance
- Contribute to OneLake integration and platform capabilities within Microsoft Fabric
- Configure and manage platform components including compute clusters, storage, and security
- Implement platform features that support batch and streaming workloads
- Contribute to building data platform capabilities as products that enable self-service for business users
- Develop reusable templates, patterns, and accelerators that reduce time-to-value for data consumers
- Support the creation of data products with clear documentation, quality metrics, and usage guidance
- Assist in building intuitive interfaces and experiences that enable non-technical users to access and work with data
- Contribute to platform adoption by ensuring capabilities are discoverable, well-documented, and easy to consume
- Support feedback loops to capture user needs and continuously improve platform offerings
- Help track platform usage metrics, adoption rates, and user satisfaction to inform product decisions
- Contribute to onboarding materials, tutorials, and self-service guides for data platform consumers
- Develop reusable platform templates and Infrastructure as Code (IaC) patterns for common use cases
- Create blueprints for workspace configuration, cluster setup, storage organization, and security controls
- Build standardized patterns for platform provisioning, access management, and cost allocation
- Contribute to a pattern library that guides LOB teams in leveraging platform capabilities
- Document best practices and reference architectures for platform adoption
- Develop starter kits and accelerators that reduce time-to-value for teams onboarding to the platform
- Monitor and optimize Spark cluster performance, resource utilization, and workload execution
- Implement cost optimization strategies for compute and storage across Databricks and Fabric
- Support CI/CD for platform capabilities and infrastructure as code
- Contribute to platform reliability, availability, and performance monitoring
- Troubleshoot and resolve platform issues across the technology stack
- Ensure platform security, access controls, and compliance with enterprise standards
- Manage platform upgrades, patches, and configuration changes
- Partner with data architects and engineers to align platform development with architectural standards
- Collaborate with business analysts and data scientists to understand platform requirements
- Work with cross-functional teams to operationalize platform capabilities and scale solutions
- Contribute to technical documentation, runbooks, and knowledge sharing
- Support the adoption of enterprise data platform tools and best practices across teams
- Participate in code reviews and follow engineering best practices
- Support data platform delivery with contractor and consultant teams under guidance from senior team members
- Contribute to knowledge-sharing sessions and workshops to build platform capability awareness across LOB teams
- Document best practices, lessons learned, and technical standards for platform development
- Stay current with industry trends in data platforms, lakehouse architectures, and cloud data services
- Share insights and learnings with the broader team to foster continuous improvement
- Assist in evaluating emerging data platform technologies, frameworks, and tools
- Identify opportunities to enhance platform performance, reliability, and cost efficiency
- Contribute to the evolution of best practices and standards for data platforms
- Propose automation opportunities to reduce manual effort and improve consistency
- Other duties as assigned
Requirements
- Master’s degree with 5 years of experience or a bachelor’s degree with a minimum of 7 years of relevant experience, or equivalent combination of education and experience.
Benefits
- comprehensive benefits, including a retirement plan; medical, life and disability insurance; and paid leave, including parental leave, as well as reasonable accommodations for individuals with disabilities.
Team
Structure: The ITS Data Office is the central entity within the World Bank Group’s Information and Technology Solutions (ITS) department responsible for enabling data, AI, information, and knowledge capabilities across the institution. It comprises four Units focused on platforms & tools, product & service delivery, enablement and governance. The office plays a pivotal role in advancing the Bank’s digital transformation, supporting business domains with trusted data, information and AI capabilities, and fostering a culture of responsible innovation.
Additional Information
- English
- 4 years 0 months
