Job Type: Full-time
About InferyxWe are a global analytics company, with a mission to empower enterprises to build scalable androbust artificial intelligence & machine learning based applications and solutions. We are a team ofdata engineers and data scientists helping businesses with actionable intelligence and data-drivendecisions. The Inferyx platform is an end to end data and analytics platform that lets you disrupt andaccelerate with data.Job Title: Lead Data EngineerExperience: 8+ YearsLocation: PuneEmployment Type: Full-timeJob Description:We are looking for a Lead Data Engineer who is responsible for the design and development ofscalable data pipelines and integrations to support continual increases in data volume andcomplexity. Work with analytics and business teams to understand their needs, create pipelines,improve data models that feed BI and visualization tools.Key Responsibilities:1. Data Pipeline DevelopmentDesign, develop, and maintain scalable batch and streaming data pipelines using Apache Spark(PySpark/Scala) and Databricks. Build end-to-end ETL/ELT workflows for ingesting,transforming, and validating data from diverse source systems while ensuring data accuracy,reliability, and performance.2. Data Modeling & Analytics EnablementDesign and maintain efficient data models, schemas, and curated datasets that support businessanalytics, reporting, and visualization tools. Optimize data structures for performance, scalability,and cost across lakehouse and data warehouse platforms.3. Data IntegrationIntegrate data from multiple internal and external sources, including relational databases, APIs,flat files, and streaming sources. Ensure seamless and reliable data movement across cloudplatforms, data lakes, and analytics systems.4. Performance OptimizationIdentify and resolve performance bottlenecks in Spark jobs, Databricks workloads, and datastorage layers. Tune Spark configurations, optimize queries, and improve pipeline efficiency tosupport large-scale data processing.5.
Data Quality & GovernanceImplement data quality checks, validation rules, and governance standards to ensure trustworthydata. Monitor data quality metrics and proactively address data issues in collaboration withstakeholders.6. Collaboration & Stakeholder EngagementWork closely with data analysts, data scientists, and business teams to understand requirementsand deliver data solutions aligned with business objectives. Partner with platform and cloudteams to ensure architectural consistency and best practices.7. Documentation & Best PracticesDocument data pipelines, data models, and technical designs. Follow best practices for softwaredevelopment, version control, CI/CD, and deployment in distributed data environments.8. Continuous ImprovementStay current with emerging data engineering technologies, Spark and Databricks enhancements,and cloud data platform innovations. Drive automation and process improvements to increasereliability, scalability, and developer productivity.Required Skills and Qualifications:- Bachelor's degree in Computer Science, Engineering, or related field.- 8+ years of experience in data engineering or related roles.- Proficiency in programming languages such as Python, Java, or Scala.- Strong SQL skills and experience with relational databases (e.G., MySQL, PostgreSQL).- Experience with data warehousing concepts and technologies (e.G., Snowflake, Redshift).- Familiarity with big data processing frameworks (e.G., Apache Spark, Hadoop).- Hands-on experience with ETL tools and data integration platforms.- Knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform.- Understanding of data modeling principles and data warehousing design patterns.- Excellent problem-solving skills and attention to detail.- Robust communication and collaboration skills, with the ability to work effectively in a teamenvironment.How many years of experience you have? (Total years of experience 8+ mandatory):Expected CTC and current CTC:What is your notice period ? Are you an immediate joiner?: Are you willing to relocate Pune?: Interested Candidates kindly share your resume at
[email protected]
📌 Lead Data Engineer (India)
🏢 Inferyx
📍 India