Role Overview
We are seeking a Senior Data Engineer with AI/GenAI expertise to join the Data Platform (Foundry) team. This role will focus on building and optimizing enterprise-scale data pipelines while also enabling metadata-driven, AI-driven use cases, including copilots, LLM integrations, and intelligent data workflows using Databricks, Azure, ADF, Azure SQL, Astronomer/Airflow or Control M Detailed Description: - Design, build, and maintain data pipelines using Databricks, Spark, ADF, Advanced SQL/Python, and Azure services - Develop and optimize bronze → silver → gold transformations - Schedule and orchestrate via ADF, Airflow, Control M. Airflow experience would be a huge plus - Enable AI/GenAI use cases across the platform, including: - Copilot integrations - LLM-based workflows - Intelligent data enrichment pipelines - Work with Databricks GenAI capabilities . - Integrate external AI platforms (e.g., Anthropic, Azure OpenAI) into enterprise data workflows - Ensure data reliability, performance, and operational stability - Troubleshoot and resolve production issues with strong SLAs - Support ingestion using tools such as: - Fivetran / ADF / Auto Loader - Implement data quality, monitoring, and reconciliation frameworks - Ability to read/write...
Unlock Official ATS Application Link
Sign in with Google or Email in 1 tap to access the direct Wesco career portal requisition and full role requirements.
Or open standard login page
