Role: Bigdata Engineer

Exp: 4.5yrs-12yrs (4.5yr-6.5yrs - 19lpa), (7-9yrs - 26lpa), 10+yrs - 33LPA

Loc: Chennai/Bangalore

JD;

Develop scalable data pipelines using Python, PySpark, and Scala Build and optimize Spark applications Collaborate with architects, analysts, and business teams Perform code reviews and unit testing.
Design, develop, and maintain scalable data processing applications using Python, Scala, and PySpark.
Build and optimize ETL/ELT data pipelines for large scale data processing.
Develop batch and real time data solutions using Apache Spark and related big data technologies.
Analyze business requirements and translate them into technical solutions.
Perform data transformation, cleansing, validation, and quality checks.
Optimize Spark jobs for performance, scalability, and resource utilization.
Integrate data from multiple sources including databases, cloud platforms, and APIs.
Collaborate with data engineers, analysts, architects, and business stakeholders.




Troubleshoot production issues and ensure system reliability and performance.
Follow coding standards, perform code reviews, and implement best practices.

Required Skills
Robust programming experience in Python and Scala.
Hands on expertise with Apache Spark (PySpark).
Experience in developing and maintaining ETL workflows.
Solid understanding of distributed computing and big data concepts.
Experience with SQL and relational databases.
Knowledge of data structures, algorithms, and object oriented programming.
Familiarity with version control tools such as Git.
Experience with cloud platforms such as Azure, AWS, or GCP is an added advantage.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Bigdata Engineer Tamil Nadu
🏢 PSRTEK
📍 Tamil Nadu