12 Aug
|
Calitii
|
Bengaluru
Job Summary
Synechron is seeking a PySpark Data Engineer with 7+ years of overall experience and at least 5+ years of commercial experience in data-driven roles. The role will design, develop, test, deploy, and support scalable data pipelines, data marts, and data warehousing solutions using Python, PySpark, SQL, and related data technologies.The position will contribute to business objectives by delivering reliable data solutions, improving data quality and accessibility, supporting analytics and reporting, and ensuring effective data processing across the full software development lifecycle.
Required
Software Requirements
7+ years of overall professional experience in data engineering, software development, or related technology roles.
5+ years of commercial experience in a data-driven role.
Hands-on experience building data marts and ETL pipelines.
Strong expertise in Python and PySpark for ETL scripting.
Experience writing clean, maintainable, robust, and testable Python code.
Hands-on experience with Spark, PySpark, Hadoop, MapReduce, Hive, and Pandas.
Strong knowledge of SQL and Oracle query development.
Experience working with SQL and NoSQL database management systems.
Experience across the end-to-end software development lifecycle, including:
Build and development.
User acceptance testing.
UAT defect resolution.
Production deployment.
Post-production support.
Experience debugging PySpark code and investigating data processing issues.
Solid understanding of data warehousing and data pipeline production practices.
Ability to process structured, semi-structured, and unstructured data.
Familiarity with Git, CI/CD processes, data testing, and validation.
Experience with data analysis, data cleansing, data linking, imputation, and feature engineering.
Familiarity with workflow orchestration and scheduling tools.
Experience collaborating with multiple technical and business teams.
Preferred
Experience with Apache Airflow, Oozie, and Jenkins pipelines.
Experie
📌 PySpark Data Engineer – Python, ETL (Bengaluru)
🏢 Calitii
📍 Bengaluru