Sr. Data Engineer – Big Data
- Experience: 6-8 Years- Location: Bengaluru, KA
Key Skills
- Big Data Technologies- Hadoop, HDFS, Hive- Spark / Spark SQL- SQL- Real-Time and Batch Data Processing
Required Skills and Experience
- Extensive experience with Apache Kafka, Apache Flink, and other streaming technologies.- Strong expertise in Hadoop ecosystem tools such as Hive, Iceberg, and Spark SQL.- Good understanding of Apache Airflow for orchestrating complex data workflows and pipelines.- Proven experience designing and implementing automated data pipelines and materialized views.- Proficiency in Python, Unix/Linux, or similar technologies.- Strong SQL skills, including experience with Oracle, SQL Server,
or similar databases.- Experience with graph databases such as Neo4j or JanusGraph and graph query languages.- Experience with monitoring and CI/CD tools such as Prometheus, Grafana, Jenkins, and GitHub Actions.- Solid engineering fundamentals, including data structures, algorithms, testing (JUnit/pytest), Git, and clean coding practices.- Experience with cloud-native technologies, including Docker and Kubernetes (deployment, networking, scaling, and troubleshooting).- 6+ years of relevant professional experience.- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
📌 Sr. Data Engineer (Mumbai)
🏢 AMISEQ
📍 Mumbai