17 Nov
|
Codeboard Technology
|
Chennai
17 Nov
Codeboard Technology
Chennai
Role & responsibilities
- 56 years of experience in Python development or data engineering.
- Develop and maintain Python-based applications, scripts, and data processing solutions.
- Build, implement, and optimize data pipelines using Azure Databricks and PySpark.
- Work with Azure cloud services to ingest, process, transform, and store structured and unstructured data.
- Develop ETL/ELT workflows for large-scale data processing.
- Write complex SQL queries and perform data validation and transformation.
- Work with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and other relevant Azure services.
- Implement data processing workflows using Apache Spark and Delta Lake.
- Optimize Python code, Spark jobs, and Databricks notebooks for performance and scalability.
- Troubleshoot data pipeline failures and resolve performance-related issues.
- Collaborate with data engineers, architects, and business stakeholders to deliver reliable data solutions.
- Follow coding standards, version control practices, and data security requirements.
📌 Senior Software Engineer (Chennai)
🏢 Codeboard Technology
📍 Chennai