Build and maintain scalable batch and streaming data pipelines.
Develop distributed data processing using Spark, Apache Beam, or Flink.
Orchestrate workflows using Apache Airflow.
Develop data transformations using Python, SQL, and dbt.
Work with GCP or other major cloud platforms.
Ensure data quality, performance, and pipeline reliability.
Collaborate with Analytics and Platform Engineering teams.
Mandatory Skills
Strong Python & SQL
Apache Airflow
Spark / Apache Beam / Flink dbt
Cloud experience, preferably GCP
Streaming: Kafka / Pub/Sub
Hands-on experience with AI-assisted coding tools such as GitHub Copilot, Cursor, Gemini Code Assist, etc.
Positive to Have: AI-driven data/ML pipelines, data quality/governance, BI/analytics experience.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Engineer (Chennai)
🏢 Willware Technologies
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.