Role Overview: We are seeking a skilled Python Developer with expertise in data engineering and a strong background in the insurance domain along with 4+ years of relevant experience. The ideal candidate will excel in developing scalable data pipelines, handling large datasets, and automating workflows using Apache Airflow.
Key Responsibilities:
- Build and maintain ETL pipelines with Python and Apache Airflow.
- Read, clean, and save data in various formats (CSV, JSON, Parquet).
- Handle large datasets efficiently with Pandas, NumPy, and optimized joins.
- Perform data cleaning, transformation, and string manipulation.
- Ensure data integrity and quality through validation checks.
Required Skills:
- Strong proficiency in Python, Pandas, NumPy.
- Experience with Airflow and large-scale data processing.
- Expertise in data integration, data cleaning, and string handling.
- Knowledge of various data formats and data storage solutions.
- Prior experience in the insurance domain is a plus.
Experience & Education:
- Bachelor’s degree in Engineering/IT, or a related field - MCA
- 4+ years of relevant experience as Python Developer with expertise in data engineering and a robust background in the insurance domain.
- The ideal candidate will excel in developing scalable data pipelines, handling large datasets, and automating workflows using Apache Airflow.