We are looking for a Data Engineer with strong experience in PySpark and AWS to build and optimize scalable data pipelines and data processing solutions.
Required Skills:
- Strong experience in PySpark and Python
- Hands-on experience with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.)
- Valuable knowledge of SQL and data warehousing concepts
- Experience in designing and developing ETL/ELT pipelines
- Understanding of data modeling and performance optimization
Good to Have:
- Experience with Databricks
- Exposure to CI/CD and Agile methodologies