Role Overview: We are seeking a skilled Python Developer with expertise in data engineering and a robust background in the insurance domain along with 4+ years of relevant experience. The ideal candidate will excel in developing scalable data pipelines, handling large datasets, and automating workflows using Apache Airflow.
Key Responsibilities:
Build and maintain ETL pipelines with Python and Apache Airflow.
Read, clean, and save data in various formats (CSV, JSON, Parquet).
Handle large datasets efficiently with Pandas, NumPy, and optimized joins.
Perform data cleaning, transformation, and string manipulation.
Ensure data integrity and quality through validation checks.
Required Skills:
Robust proficiency in Python, Pandas, NumPy.
Experience with Airflow and large-scale data processing.
Expertise in data integration, data cleaning, and string handling.
Knowledge of various data formats and data storage solutions.
Prior experience in the insurance domain is a plus.
Experience & Education:
Bachelor’s degree in Engineering/IT, or a related field - MCA
4+ years of relevant experience as Python Developer with expertise in data engineering and a robust background in the insurance domain.
The ideal candidate will excel in developing scalable data pipelines, handling large datasets, and automating workflows using Apache Airflow.