Requirements

- Ensuring and validating data quality developing and maintaining end to end data pipelines and insight products.
- We are looking for someone with robust data lake fundamentals, AWS, spark, python, airflow etc. hands-on experience in all layers of data Integration and analytics.

RESPONSIBILITIES :

- Sr Data Engineer will understand the business need and design the data pipelines, translate data into business insights, data cleansing and ETL.
- Experience in Databricks, GitHub Actions.
- Understand CI/CD, Aerospike
- Gather requirements from vested teams to build features.
- Self-motivated individual will use their love of user interfaces to balance design and function, and thrive in a fast-paced environment, knowledge in Angular / Play Framework is a plus.
- Understand the priorities and ensures the deliverables stick to the timeline and complete projects on time
- Be a team player who works effortlessly with people

Requirements :





- 3 to 7 years of development experience at an Enterprise level in the following tools and languages :

o Spark Scala o python o Mysql o Apache Parquet / any columnar formats

- Desired Pluses o Java o Play framework / Angular o Tableau o Advertising Tech Industry experience o AWS Services, Hadoop architecture and EMR management o Linux
- Strong experience with digital media.
- Strong experience with relational databases like MySQL. NoSQL databases experience is a plus.
- Strong background with data modeling, data access, and data storage techniques
- Experience with design, development, and implementation of highly scalable, high-volume software systems and components, source of truth systems for different business areas.
- Bachelor's degree in Computer Science or related field or equivalent combination of industry related professional experience and education

📌 Senior Data Engineer - Big Data/Python/AWS (India)
🏢 UPAMP Business Solutions
📍 India