17 Oct
|
Mactores Cognition
|
India
17 Oct
Mactores Cognition
India
Job highlights
Prior experience in working on AWS EMR,Apache Airflow . Certifications - AWS Certified Big Data Specialty Cloudera or Hortonworks Certified Big Data Engineer . Understanding of DataOps Engineering .
4 to 7 years of experience in Apache Spark
What you will do?
Write effective code in the chosen technology for the project - For example - Spark, Apache Beam.
Explore recent technologies and learn recent techniques to solve business problems creatively.
Collaborate with many teams - engineering and business, to build better data products and services.
Deliver the projects along with the team collaboratively and manage updates to customers on time.
What are we looking for?
4 to 7 years of experience in Apache Spark.
2+ years of experience in writing ETL jobs using pySpark, and SparkSQL
2+ years of experience in SQL queries and stored procedures
Have a deep understanding of all the Dataframe API with all the transformation functions supported by Spark 2.7+
You are preferred if you have
Prior experience in working on AWS EMR, Apache Airflow
Certifications - AWS Certified Big Data Specialty Cloudera or Hortonworks Certified Big Data Engineer
Understanding of DataOps Engineering
📌 Data Engineer Senior Mumbai (India)
🏢 Mactores Cognition
📍 India