01 Nov
|
HNM Systems
|
Hyderabad
01 Nov
HNM Systems
Hyderabad
We are looking for Big Data Engineer's to help design, build, and scale production-grade data platforms on AWS. This is a highly hands-on engineering role for someone who can lead technical decisions while remaining deeply involved in development, architecture, code reviews, and production delivery. What Youll Do
- Design and build scalable ETL and data pipelines using Python, Spark, AWS Glue, and Amazon EMR.
- Develop large-scale S3 data lakes and lakehouse architectures supporting batch and CDC ingestion.
- Build solutions using Step Functions, Athena, Redshift/Spectrum, Lambda, SQS, SNS, Kinesis, and MSK.
- Lead technical design, architecture, and code reviews while partnering closely with engineering teams.
- Drive production readiness across reliability, observability, data quality, performance, and cost optimization.
- Optimize distributed data workloads operating at multi-terabyte scale. What We’re Looking For
- Expert-level Python and robust SQL.
- Deep hands-on experience with Apache Spark/PySpark, including Spark internals and performance tuning.
- Strong AWS experience, particularly Glue, EMR, S3, and Step Functions.
- Experience with Parquet, ORC, Avro, Iceberg, Hudi, and Delta Lake.
- Strong understanding of dimensional modeling, lakehouse, and medallion architectures.
- Experience with Terraform, AWS CDK, CloudFormation, CI/CD, Git, and Docker.
- Proven ability to deliver and support complex, production-grade data solutions. Preferred
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- AWS certifications.
- Experience leading architecture decisions and mentoring engineering teams.
📌 Big Data Engineer (Hyderabad)
🏢 HNM Systems
📍 Hyderabad