08 Aug
|
ShimentoX Technologies
|
Bengaluru
08 Aug
ShimentoX Technologies
Bengaluru
Data Engineer | 4+ Years | Bangalore / Hyderabad
Location: Bangalore / Hyderabad
Experience: 4+ Years
About the Role
We are looking for a skilled Data Engineer to design, develop, and maintain scalable data pipelines while building automated solutions that streamline business processes. The ideal candidate should have solid expertise in big data technologies, Python, SQL, and cloud-scale data processing.
Key Responsibilities
Design, build, and maintain scalable ETL/data pipelines.
Develop and optimize data processing using Spark, PySpark, Hive, and Presto.
Write efficient SQL queries and Python scripts for data processing and automation.
Build, deploy, debug, and optimize data pipelines.
Implement data quality checks to identify duplicates, null values, and data drift.
Collaborate with cross-functional teams to gather requirements and deliver automation solutions.
Maintain dashboards and business-critical reporting metrics.
Monitor pipeline performance and continuously improve reliability and efficiency.
Work with upstream and downstream teams to ensure seamless data flow.
Follow best practices for software development, testing, version control, and documentation.
Required Skills
Python
SQL
Apache Spark / PySpark
Apache Hive
Apache Airflow
Presto
ETL & Data Pipeline Development
Data Quality & Validation
Git & Jira
Distributed Data Processing
Preferred Skills
Kafka
Tableau
Grafana
Google Dash Studio
Experience with large-scale distributed systems
Qualifications
Bachelor's degree in Computer Science or a related field.
4+ years of experience in Data Engineering.
Solid problem-solving, analytical, and communication skills.
If you're passionate about building scalable data solutions and working with up-to-date data engineering technologies, we'd love to hear from you.
Interested candidates can share their updated resume with their current CTC, expected CTC, notice period, and current location.
📌 Data Engineer Bengaluru
🏢 ShimentoX Technologies
📍 Bengaluru