- 5-9 years experience in Data Engineering with strong PySpark, Python, SQL, and Apache Spark optimization skills
- Design, develop, and optimize scalable PySpark data pipelines; develop ETL/ELT processes; troubleshoot and optimize Spark jobs; collaborate with stakeholders in Agile environment
We @ Altimetrik are Hiring PySpark Developer! Are you an experienced PySpark looking for your next chance?
Altimetrik is a digital business transformation company helping organizations build and scale modern digital solutions through data, cloud, engineering, and product innovation.
Role: PySpark Developer
Experience: 5-9 Years
Location: Pune / Bangalore / Chennai
Employment: Full-time
Key Responsibilities
- Design, develop, and optimize scalable data pipelines using PySpark.
- Work with Python, SQL, Spark, and distributed data processing frameworks.
- Develop ETL/ELT pipelines for large-scale structured and unstructured datasets.
- Perform data transformation, cleansing, validation, and aggregation using PySpark.
- Work with cloud-based data platforms and data warehouses.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Troubleshoot data pipeline issues and perform root-cause analysis.
- Collaborate with Data Engineers, Architects, Analysts,
and business stakeholders.
- Implement data quality checks and follow best practices for data engineering.
- Work in an Agile development environment.
Required Skills
- 69 years of experience in Data Engineering.
- Strong hands-on experience with PySpark and Python.
- Strong SQL skills and experience working with large datasets.
- Good understanding of Apache Spark architecture and optimization.
- Experience in developing and maintaining ETL/ELT pipelines.
- Experience with cloud platforms such as AWS / Azure / GCP.
- Good understanding of data warehousing and data lake concepts.
- Experience with Git and CI/CD practices.
- Strong analytical and problem-solving skills.
Good to Have
- Experience with Databricks.
- Knowledge of Delta Lake.
- Experience with Airflow or other workflow orchestration tools.
- Experience with Kafka or other streaming technologies.
- Exposure to cloud data services and modern data architecture.
Interested candidates can share their updated resume with us. Please mention “PySpark – 5 to 9 Years” in the subject line.