06 Nov
|
Value Lane Consulting Private
|
Bengaluru
06 Nov
Value Lane Consulting Private
Bengaluru
Required Qualifications :- Minimum 7 years of professional experience in data engineering, data integration, ETL/ELT development, or related areas.- Strong hands-on experience with Databricks, including Apache Spark, PySpark, SQL, Delta Lake, and job orchestration.- Robust proficiency in Python, PySpark, and advanced SQL.- Experience building production-grade data pipelines using medallion architecture.- Good working knowledge of AWS, particularly Amazon S3, IAM, and cloud-based data integration and processing.- Experience integrating data from enterprise databases and SaaS applications, with working knowledge of PostgreSQL, Couchbase, Salesforce, and Oracle NetSuite.- Understanding of JDBC, REST APIs, CDC, incremental ingestion,
and batch processing.- Experience working with structured, semi-structured, and JSON-based data.- Strong knowledge of data modeling, data transformation, and data quality frameworks.- Experience with Databricks Unity Catalog and data governance fundamentals.- Experience with Git, CI/CD, automated testing, and production deployment practices.- Robust troubleshooting, performance tuning, and problem-tuning capabilities.- Ability to independently design, develop, test, and deploy enterprise data pipelines. (ref:hirist.tech)
📌 Senior Data Engineer - Databricks (Bengaluru)
🏢 Value Lane Consulting Private
📍 Bengaluru