Senior Data Engineer

Job Description

Senior Data Engineer 

Contract duration - 3 month

TheDataTeam is looking for a Senior Data Engineer to join and contribute to the

engineering consulting services of the company. 

The Senior Data Engineer role is primarily responsible for building out entire engineering artifacts (code and documentation) for clients delivered on top of the Hadoop ecosystem.

The Responsibilities Of the Senior Data Engineer Are

• Requirements gathering and assessment, understand existing Ruby scripts
• Breakdown complexity and translate requirements to specification artifacts and story
• boards to build towards, using a test-driven approach
• Implement the pipelines using execution frameworks including but not limited to
• MapReduce, Spark, Hive, using Python for application design.
• Mentoring juniors in a dynamic team setting
• Manage stakeholders with proactive communication upholding TheDataTeam

brand and values

A Candidate Must Have The Following Skills:

• Strong problem-solving ability
• Excellent software design and implementation ability
• Exposure and commitment to agile methodologies
• Detail oriented with willingness to proactively own software tasks as well
• as management tasks, and see them to completion with minimal guidance
• Minimum 4 years of experience
•   Experience in Cloud environment (GCP/AWS/Azure) preferably AWS
• Should have experience in full life-cycle of one big data application
• Strong understanding of various storage formats (ORC/Parquet/Avro)
• Should be well versed with at least one Database
• (Mysql/Oracle/MongoDB/Postgres) preferable Postgres
• Bachelor’s in Computer Science, and preferably, a Master’s as well
• Should have good code review and debugging skills