Experience in python programming with hands-on experience in data processing related libraries.
Experience in working with Apache Spark (pyspark, spark-sql).
Hands on with AWS databricks platform.
Experience with Apache airflow.
Experience in data visualisation tools.
In-depth knowledge of big data ecosystem ( hadoop, hive, sqoop, mongodb, cassandra )
Experience in cloud technology like Azure, GCP, AWS

Responsibilities:
Managing master data, including creation, updates, and deletion.
Provide quality assurance of imported data, working with quality assurance analyst if necessary.
Commissioning and decommissioning of data sets.
Managing and designing the reporting setting, including data sources, security, and metadata.
Processing confidential data and information according to guidelines. Helping develop reports and analysis.
Supporting the data warehouse in identifying and revising reporting requirements.




Supporting initiatives for data integrity and normalization.
Assessing tests, implementing new or upgraded software and assisting with strategic decisions on recent systems.
Generating reports from single or multiple systems.
Troubleshooting the reporting database setting and reports.
Evaluating changes and updates to source production systems.
Training end users on new reports and dashboards.
Providing technical expertise on data storage structures, data mining, and data cleansing.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Data Engineer Karnataka
🏢 47Billion
📍 Karnataka