13 Nov
|
People Prime Worldwide Private
|
Secunderabad
13 Nov
People Prime Worldwide Private
Secunderabad
Experience: 5 - 9 years Max Experience: 9 We are seeking an experienced Senior Data Engineer on a contract basis to design, build, and optimize scalable data pipelines and cloud data infrastructure. You will hit the ground running to support critical [analytics / AI / migration] initiatives, ensuring high data reliability, performance, and governance across our platform. As a senior contractor, you will operate with high autonomy, make pragmatic architectural decisions, and collaborate closely with cross-functional engineering and product stakeholders.
Key Responsibilities • Pipeline Architecture &
- Development. Design, build, and maintain robust batch and real-time ETL/ELT data pipelines to ingest and transform large-scale datasets.
- Data Modeling &
- Warehousing. Architect effective dimensional data models (star/snowflake schemas) and optimize cloud data warehouses for analytics and downstream applications.
- Performance &
- Cost Optimization. Troubleshoot bottlenecks, tune complex queries, and optimize compute and storage costs across data platforms.
- Data Quality &
- Observability. Implement automated testing, data validation rules, monitoring, alerting, and lineage tracking to ensure data accuracy and integrity.
- Security &
- Governance. Enforce data security best practices, access controls, and compliance standards across all data assets.
- Technical Leadership &
- Documentation. Establish engineering standards (CI/CD, code reviews), maintain clear technical documentation, and provide architectural guidance to team members.
Required Qualifications • Experience. 6 years of hands-on experience in data engineering, with at least 3 years building production-grade pipelines at scale.
- Programming &
- SQL. Advanced proficiency in Python (for data processing and automation) and complex SQL (window functions, query optimization, incremental loads).
- Big Data &
- Distributed Processing. Strong experience with big data frameworks such as Apache Spark / PySpark.
- Cloud &
- Data Platforms. Hands-on expertise with at least one major cloud ecosystem (AWS, Azure, or GCP) and modern data platforms (e.g., Snowflake, Databricks, BigQuery, or Redshift).
- Orchestration &
- Transformation. Proven experience with workflow orchestration tools (Apache Airflow, Dagster, or Prefect) and transformation frameworks (dbt).
- DevOps &
- CI/CD. Familiarity with Git workflows, Docker, and automated deployment pipelines for data infrastructure.
- Contract Readiness. Strong communication skills, high ownership, and the ability to deliver milestones independently with minimal ramp-up time.
📌 Contract Position-Senior Data Engineer (Secunderabad)
🏢 People Prime Worldwide Private
📍 Secunderabad