13 Sep
|
Computomic
|
Karnataka
13 Sep
Computomic
Karnataka
Job DescriptionWe're Hiring: Senior Data Engineers (Immediate to 30 days) NLocation: Whitefield, Bangalore NPlatform Specialization: Databricks NProject Scope: Complex DWH & Migration initiatives across the full data engineering lifecycle NAre you passionate about building scalable data pipelines, optimizing performance, and solving real-world data challenges? We're looking for hands-on Data Engineers who thrive in fast-paced environments and bring deep expertise in SQL, Python, Spark, Databricks, and cloud-native data platforms. NSenior Data Engineers (4–8 years): Nn Build and optimize robust data pipelines for ingestion, transformation, and analytics N Work across structured and semi-structured data sources, ensuring performance and reliability N Collaborate with cross-functional teams to deliver scalable solutions on Databricks N Solid coding skills inSQL, Python, and Spark are a must N Experience in data validations, reconciliation, and quality checks across ingestion and transformation stages NnMust-Have Technical Skills: Nn Advanced SQL (window functions, CTEs, performance tuning)
N Python (data manipulation, modular design, error handling) N Advanced Apache Spark Programming N Databricks (Notebooks, Delta Lake, Job Orchestration, Unity Catalog, Delta Live Tables, DB Asset Bundles, Lakehouse Architecture, Workspace Management, Cluster Configuration, MLflow Integration, and Role-Based Access Control) N CI/CD pipelines, version control (Git), and testing frameworks N Experience with cloud platforms (Azure, AWS, or GCP) NnSoftware Engineering Fundamentals: Nn Clean code practices and modular design N Agile delivery and sprint planning N Debugging, logging, andexception handling N Code reviews and mentoring junior engineers N Understanding of systemdesign and scalability NnBonus Skills: Nn Exposure to data modeling (dimensional, star/snowflake schemas) N Familiarity with data governance, lineage, and cataloging tools N Prior experience in large-scale data migration projects and validation frameworks N
📌 Senior Data Engineer (Karnataka)
🏢 Computomic
📍 Karnataka