02 Sep
|
Inferyx
|
Pimpri-Chinchwad
02 Sep
Inferyx
Pimpri-Chinchwad
About Inferyx We are a global analytics company, with a mission to empower enterprises to build scalable androbust artificial intelligence & machine learning based applications and solutions. We are a team ofdata engineers and data scientists helping businesses with actionable intelligence and data-drivendecisions. The Inferyx platform is an end to end data and analytics platform that lets you disrupt andaccelerate with data. Job Title: Lead Data Engineer Experience: 8+ Years Location: Pune Employment Type: Full time Job Description: We are looking for a Lead Data Engineer who is responsible for the design and development ofscalable data pipelines and integrations to support continual increases in data volume andcomplexity. Work with analytics and business teams to understand their needs, create pipelines,improve data models that feed BI and visualization tools. Key Responsibilities:1. Data Pipeline Development Design, develop, and maintain scalable batch and streaming data pipelines using Apache Spark(Py Spark/Scala) and Databricks.
Build end-to-end ETL/ELT workflows for ingesting,transforming, and validating data from diverse source systems while ensuring data accuracy,reliability, and performance.2. Data Modeling & Analytics Enablement Design and maintain efficient data models, schemas, and curated datasets that support businessanalytics, reporting, and visualization tools. Optimize data structures for performance, scalability,and cost across lakehouse and data warehouse platforms.3. Data Integration Integrate data from multiple internal and external sources, including relational databases, APIs,flat files, and streaming sources. Ensure seamless and reliable data movement across cloudplatforms, data lakes, and analytics systems.4. Performance Optimization Identify and resolve performance bottlenecks in Spark jobs, Databricks workloads, and datastorage layers. Tune Spark configurations, optimize queries, and improve pipeline efficiency tosupport large-scale data p
📌 Lead Data Engineer (Pimpri-Chinchwad)
🏢 Inferyx
📍 Pimpri-Chinchwad