Data Engineer

Experience: Minimum 3 Years

At least 3+ years of development work experience in Hadoop programming (HDFS) using Spark/Scala/Java with Hive-based Data warehouse projects. And, with good Shell Scripting experience.

Able to Understand the requirements and design solutions and guide the team to ingest the data into the Bigdata platform using Spark with HIVE.

Should be able to design the SQL scripts and very good in writing complex SQL Scripts to process the data with SCD handling exposure.

Hands-on experience in data analysis and debugging the issues in SQL

Responsible for meeting the quality, and scope as per the project plans must be able to meet the stringent timelines.

Flexible to work as per the regional timing

Must have good technical experience and should be able to handle multiple modules in parallel on a need basis and bring the task to closure on time.

Should have supported the estimation process for Hadoop-based projects.

Excellent communication and documentation skills

Very good at team playing and flexibility to work with Offshore team in different time zones based on project needs.

Willingness to do Certification in Databricks Certified Developer: Apache Spark 3. X