- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using modern data engineering tools and frameworks.
- Build and manage data storage solutions using cloud-based platforms such as AWS, Google Cloud, or Azure, with a focus on cost-efficiency and performance.
- Optimize data processing workflows for speed, reliability, and scalability across batch and real-time processing systems.
- Collaborate with cross-functional teams to gather requirements and translate business needs into technical data solutions.
- Implement data governance, quality checks, and monitoring systems to ensure data accuracy and integrity.
- Work with streaming technologies (e.g., Apache Kafka, Apache Flink) to support real-time data ingestion and processing.
- Ensure data security, compliance, and privacy standards are maintained across all data systems.
- Document system architectures, data models, and operational procedures for knowledge sharing and onboarding.

Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.




- 2–5 years of hands-on experience in data engineering with a strong focus on data pipeline development and data infrastructure.
- Proficiency in programming languages such as Python, SQL, and Scala.
- Experience with big data technologies including Apache Spark, Hadoop, and distributed data processing frameworks.
- Strong knowledge of cloud platforms (AWS, GCP, or Azure) and experience with services like S3, Redshift, BigQuery, or Data Lake solutions.
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes.
- Experience with workflow orchestration tools like Apache Airflow or Prefect.
- Understanding of data modeling, schema design, and database optimization for both relational and NoSQL databases.
- Excellent problem-solving skills, attention to detail, and ability to work in agile environments.
- Robust communication skills and ability to collaborate effectively across technica

📌 Require a Data Engineer in Hyderabad
🏢 TestHiring
📍 Hyderabad