06 Oct
|
VDart Software Services
|
India
06 Oct
VDart Software Services
India
Job Description: Data Engineer (SQL +Python + DBT + Airflow + Snowflake ) 5+ Years
Role: Data Engineer
Experience: 5+ Years
Location: Bengaluru/Gurgaon
Job Summary
We are looking for an experienced Data Engineer with strong expertise in SQL, DBT, Apache Airflow, and Python to design, develop, and maintain scalable data pipelines and transformation frameworks. The ideal candidate will have hands-on experience in building modern data platforms, workflow orchestration, ETL/ELT development, and cloud-based data warehousing solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python, DBT, and Apache Airflow.
- Build and manage Airflow DAGs for workflow orchestration, scheduling, monitoring, and dependency management.
- Develop reusable and optimized DBT models, snapshots, tests, and macros for data transformation.
- Implement data quality checks, validation frameworks, and reconciliation processes across data pipelines.
- Develop and optimize Python scripts for data ingestion, transformation, automation, and exception handling.
- Work with structured and semi-structured data formats such as JSON, CSV, and Parquet.
- Integrate data from multiple sources into enterprise data warehouses and analytics platforms.
- Monitor, troubleshoot, and resolve data pipeline failures and performance bottlenecks.
- Collaborate with Data Architects, Analysts, and Business stakeholders to understand and deliver data requirements.
- Ensure adherence to best practices around coding standards, version control, testing, and deployment.
- Participate in production support, incident resolution, and root cause analysis activities.
Mandatory Skills
- 5+ years of experience in Data Engineering.
- Strong hands-on experience with DBT (Data Build Tool).
- Robust experience with Apache Airflow including DAG development, scheduling, monitoring, and workflow orchestration.
- Proficiency in Python for ETL development, automation, and data processing.
- Strong SQL skills with experience in writing complex queries and performance tuning.
- Experience developing and supporting enterprise-scale ETL/ELT pipelines.
- Experience with Snowflake, Redshift, Big Query, or other cloud data warehouses
- Knowledge of data modeling concepts including Star Schema and Dimensional Modeling.
- Experience with Git-based version control systems.
Preferred Skills
- Experience with AWS services such as S3, Glue, Lambda, or EMR.
- Exposure to CI/CD pipelines and Dev Ops practices.
- Experience working in Agile/Scrum environments.
- Familiarity with data quality, governance, and observability frameworks.
Nice to Have
- Snowflake Streams, Tasks, Snowpipe.
- DBT Cloud.
- PySpark or Spark.
- Terraform or Infrastructure as Code.
- Monitoring and alerting tools.
Qualification
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
VDart: Digital Consulting & Staffing Solutions
VDart is a leading digital consulting and staffing company founded in 2007 and headquartered in Alpharetta, Georgia. VDart is one of the top staffing companies in USA & also provides technology solutions, supporting businesses in their digital transformation journey. Digital consulting services, Digital consulting agency
Core Services:
- Digital consulting and transformation solutions
- Comprehensive staffing services (contract, temporary, permanent placements)
- Talent management and workforce solutions
- Technology implementation services
Key Industries: VDart primarily serves industries such as automotive and mobility, banking and finance, healthcare and life sciences, and energy and utilities. VDart - Products, Competitors, Financials, Employees, Headquarters Locations
Notable Partnership: VDart Digital has been a consistently strong supplier for Toyota since 2017 Digital Transformation Consulting & Strategy Services | VDart Digital, demonstrating their capability in large-scale digital transformation projects.
With over 17 years of experience, VDart combines staffing expertise with technology solutions to help organizations modernize their operations and build skilled workforce capabilities across multiple sectors.
📌 Data Engineer (SQL +Python + DBT + Airflow + Snowflake ) (India)
🏢 VDart Software Services
📍 India