17 Nov
|
Ideas2it Technologies
|
Chennai
17 Nov
Ideas2it Technologies
Chennai
What you'll actually do as a Data Engineer with us.
- Design and build robust data pipelines and architectures on AWS or Azure
- Develop and optimize ETL processes that handle large-scale structured and unstructured data from multiple sources
- Work with distributed processing tools like PySpark and Pandas to move and transform data at scale
- Use cloud services hands-on: Glue, Lakeformation, EMR for AWS Datafactory, Synapse, Datalake, Fabric on Azure
- Model and warehouse data that feeds BI tools and supports real analytical decisions
- Write clean Python or Scala to automate, integrate, and build
- Collaborate with analytics and business teams to translate data needs into infrastructure that works
- Contribute to tech stack decisions: your opinion on architecture matters here, not just your execution.
Must-haves:
- Strong SQL and hands-on experience with relational databases: MySQL, PostgreSQL, or SQL Server
- Strong hands-on experience with Cloud data warehouses: AWS Redshift, Snowflake, Azure Synapse Analytics
- Experience in at least one cloud workplace: AWS or Azure
- Proven experience building large-scale data pipelines and ETL processes
- Proficiency with distributed data processing: PySpark, Pandas, Polars
- Fluency in Python and/or Scala
- Experience with cloud data services (Glue, Lakeformation, EMR for AWS Datafactory, Synapse, Datalake, Fabric on Azure)
- Ability to handle messy, large-scale data from internal and third-party sources and make it usable
Nice-to-haves:
- Experience with data visualization tools: Power BI or Tableau
- Familiarity with orchestration and workflow management tools
- Familiarity with Data quality, testing and observability tools
- Familiarity with Docker and Kubernetes
What that looks like day-to-day:
- Autonomy to contribute to architecture and tech stack choices, not just implement them
- Access to technical PoCs if there's a technology you want to explore
- Internal Shark Tanks and Hackathons if you want to take an idea further
- A culture that weights capability over tenure
📌 Senior Data Engineer (Chennai)
🏢 Ideas2it Technologies
📍 Chennai