13 Nov
|
People Prime Worldwide
|
Secunderabad
13 Nov
People Prime Worldwide
Secunderabad
Experience: 4 - 9 years Max Experience: 9 Role Overview We are seeking an experienced Senior Data Engineer to join our team on a contract basis. You will be responsible for designing, building, and optimizing scalable data pipelines and cloud data infrastructure to support enterprise analytics, product features, and AI/ML workloads. As a senior contractor, you will hit the ground running to deliver high-impact data solutions, enforce engineering standards, and collaborate closely with cross-functional stakeholders.
Key Responsibilities Pipeline Architecture &
• Development. Design, build, and maintain robust batch and real-time ETL/ELT data pipelines to ingest, transform, and process large-scale datasets. Data Modeling &
• Warehousing. Architect dimensional data models (star/snowflake schemas) and optimize cloud data warehouses and data lakes for analytical and operational use. Performance &
• Cost Optimization. Tune complex SQL queries, storage formats, and compute clusters to maximize throughput and reduce cloud infrastructure costs. Data Quality &
• Observability. Implement automated testing, validation rules, monitoring, alerting, and data lineage frameworks to ensure high data reliability and integrity. Security &
• Governance. Enforce data governance policies, access controls, and compliance standards across all data assets. Cross-Functional Collaboration. Partner with data scientists,
analysts, product managers, and backend engineers to translate business requirements into technical specifications and production-ready data products. Documentation &
• Handover. Maintain comprehensive architectural documentation, runbooks, and code standards to ensure seamless knowledge transfer to internal teams.
Required Qualifications &
Skills Experience. 5+ years of hands-on experience in data engineering, with a proven track record of delivering production data pipelines at scale. Programming &
• Querying. Advanced proficiency in SQL (window functions, complex joins, query tuning) and Python (or Scala) for data processing and automation. Big Data &
• Processing Frameworks. Robust experience with distributed processing engines such as Apache Spark / PySpark, and streaming technologies like Apache Kafka or Kinesis. Cloud &
• Data Platforms. Hands-on expertise in at least one major cloud ecosystem (AWS, Azure, or GCP) and modern data platforms such as Snowflake, Databricks, BigQuery, or Redshift. Orchestration &
• DevOps.
Experience with workflow orchestration tools (e.g., Apache Airflow, dbt, Azure Data Factory) and CI/CD practices using Git. Data Formats & Modeling. Deep understanding of dimensional modeling and columnar storage formats (Parquet, Iceberg, Delta Lake)
📌 Contract Position-Senior Data Engineer (Secunderabad)
🏢 People Prime Worldwide
📍 Secunderabad