Cloud Engineer

Job Description

Cloud Data Engineer (AWS Expert):

• Minimum of 6 or more years working as Data Engineer on Advanced Analytics and Data Provisioning projects.
• Demonstrable technical experience in BIG data analytics
• Business Requirements Analysis and technical design
• Communication with key business users, Data Scientists, IT Tech leads.
• Hands on experience with BIG data processing, clean, transform and prepare data.
• Hands on experience working with Data Lakes (Hadoop, AWS S3, Azure ADLS)
• Expertise on joining datasets and creation of de-normalized views
• Experience with Data Preparation and Features Engineering as part of Machine Learning or Advance Analytics project
• Understanding of Cloud Solutions and Architecture
• Experience using Code/Version management tools.
• Some basic knowledge on Supply chain, Operations and Manufacturing process domain

Desired Skills & Knowledge:

• Deep knowledge on AWS Data Services
• Experienced writing AWS Glue, Spark code for data processing and preparation
• Experienced working with Glue Endpoints. Step functions, Lambda
• Experienced in SageMaker notebooks using Python and PySpark to create features and write to S3 & AuroraDB
• Experienced in IoT Analytics using AWS Kinesis data streams or Kafka streaming
• Automate with CI/CD pipelines by Modularizing / generalizing with variables
• Experienced working in any of the popular ETL tools
• Experienced or Working knowledge of Talend
• Working knowledge of Snowflake
• Working knowledge of Hadoop toolset like HDFS, Hive, Impala
• Working knowledge of Linux Shell Scripting.