02 Oct
|
Damco Solutions
|
Noida
02 Oct
Damco Solutions
Noida
Job description
Job Summary: Looking for a skilled Data Engineer proficient in Python, Scala, or Java, with solid experience in Hadoop, Spark, SQL, and various data platforms. The role involves optimizing data application performance and working in rapid/agile development environments
Key Responsibilities
- Review and understand business requirements and ensure development tasks are completed within timelines with minimal defects.
- Partner with software development teams to implement best practices and optimize data application performance.
- Collaborate across the company and interact with customers to understand and translate business challenges into innovative solutions.
- Research new Big Data technologies and assess their maturity and alignment with business/technology strategy.
- Work in a rapid and agile development process to increase speed to market while maintaining appropriate controls.
Mandatory Qualifications & Skills
- BE/B.Tech/MCA
- At least 4+ years of experience in Data Engineering technology stack and programming languages.
- Python / Scala / Java
- Hadoop, HDFS, MapReduce
- Spark SQL, DataFrames, RDDs
- SQL
- Hive / Snowflake / SQL Server / BigQuery
- Elastic Search
Preferred Skills
Experience in 3 or more of the following:
- Spark Streaming
- Spark ML
- Kafka / Flume
- Apache NiFi
- Apache Airflow / Oozie
- Cloud-based Data Platforms
- NoSQL databases: HBase / Cassandra / Neo4j / MongoDB
📌 Data Engineer (Noida)
🏢 Damco Solutions
📍 Noida