? WE ARE HIRING | BIG DATA ENGINEERS

SAN Engineering Solutions is expanding its Big Data Engineering team and looking for talented professionals with strong expertise in Python, Spark, PySpark, SQL, and Big Data platforms.

✨ Explore an exciting opportunity to work on large-scale data migration projects involving Apache Iceberg!

? Job Details

- Role: Big Data Engineer
- Experience: 4–15 Years
- Locations: Chennai – Sholinganallur | Bangalore – RMZ Ecoworld

? Experience-Wise Hiring

? 4–7 Years – 10 Positions

? 7–10 Years – 10 Positions

? 10–15 Years – 10 Positions

? Mandatory Skills

- Python
- Apache Spark
- PySpark
- SQL
- Unix Shell Scripting
- Big Data Platforms

⭐ Good to Have Skills

- Apache Airflow
- Data Warehousing
- Data Modelling
- Apache Iceberg Development

? Key Responsibilities

✔️ Design and develop scalable PySpark-based data migration pipelines from source systems to Apache Iceberg.

✔️ Perform data extraction, transformation, cleansing, standardization, and loading.





✔️ Develop complex SQL queries and perform query tuning and performance optimization.

✔️ Analyze Spark execution plans and optimize jobs using partitioning, caching, and productive transformations.

✔️ Perform data profiling, validation, and reconciliation to ensure data quality and integrity.

✔️ Troubleshoot PySpark jobs, production issues, and performance bottlenecks.

✔️ Monitor Azure DevOps (ADO) pipelines and manage code changes using Git, pull requests, and code reviews.

✔️ Conduct RCA, support deployments, SIT, UAT, hypercare, and production support.

✔️ Collaborate with cross-functional teams to ensure successful project delivery.

#WeAreHiring #BigDataEngineer #BigData #DataEngineering #Python #PySpark #ApacheSpark #SQL #ApacheIceberg #Airflow #DataMigration #DataWarehousing #DataModelling #AzureDevOps #ChennaiHiring #BangaloreHiring #ITJobs #TechHiring #HiringNow

📌 Big Data Developer (Bengaluru)
🏢 SAN Engineering Solutions
📍 Bengaluru