Job Description We are seeking a Staff or Principal Data Engineer to join a highly technical data engineering team focused on modernizing and scaling enterprise marketing and customer data platforms. This role is heavily hands-on and will involve designing, building, and optimizing cloud-based data solutions that support customer analytics, marketing, and e-commerce initiatives. The ideal candidate has deep experience with Azure Databricks, enterprise data warehousing, and large-scale data engineering, along with a background supporting marketing, customer, or e-commerce data environments. This position requires strong technical independence, architecture-level thinking, and the ability to mentor peers without direct people management responsibilities. Design, develop, and maintain large-scale data pipelines using Azure Databricks and cloud-native technologies.
Build and optimize data engineering solutions supporting marketing, customer, and e-commerce analytics.
Modernize legacy data platforms and contribute to data warehouse transformation initiatives.
Work with data from multiple enterprise systems, including SQL Server and other operational platforms.
Analyze, refactor, and migrate existing ETL processes into modern cloud-based architectures.
Lead technical design discussions and provide guidance to a small team of engineers.
Troubleshoot complex data processing issues and drive resolution independently.
Collaborate with stakeholders to understand business requirements and translate them into scalable technical solutions.
Ensure high-quality, reliable, and performant data products that support analytics and reporting. Skills and Requirements 10+ years of progressive data engineering experience or equivalent technical expertise.
Strong hands-on experience with Azure Databricks.
Advanced SQL development and performance tuning experience.
Experience building cloud-based data warehousing solutions.
Robust coding and data pipeline development experience.
Experience working with marketing, customer data, CDP, CRM, loyalty, digital, or e-commerce datasets.
Proven ability to work independently and drive technical solutions with minimal oversight.
Experience serving as a technical lead, mentor, or senior contributor on engineering teams. Azure Databricks
SQL Server
Cloud Data Warehousing
Data Engineering & ETL
Marketing Data Platforms
Customer Data Management
IBM DataStage (Plus)
Azure Ecosystem
IBM DataStage experience.
Hospitality, travel, retail, or e-commerce industry experience.
Experience modernizing legacy ETL environments.
Azure data platform services beyond Databricks.
Customer identity, segmentation, personalization, or marketing analytics experience.
Experience supporting enterprise-scale marketing data ecosystems. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to
[email protected].
📌 Principal/Staff Data Engineer - Databricks - INTL INDIA (Hyderabad)
🏢 Insight Global
📍 Hyderabad