Big Data Engineer

Job Description

The Data Engineering team is one of the core technology teams of Lumiq.ai and is responsible for creating all the data-driven products and platforms scalable across any amount of data, users, and processing. The team also interacts with our customers to create technical architectures and deliver the products and solutions they need.

If you are someone who is always contemplating new and unusual ways of how to solve data problems, how technologies can interact, and how various tools, technologies & concepts can help a customer drive business value, then Lumiq is the place of opportunities you are looking for.

Eligibility

Experience

At least 2 years of experience as a data engineer or in a similar role

Technical expertise with data models, segmentation techniques, data systems and pipelines

Some experience in handling customer interactions would be a plus

Must-Have Skills

Amazon Web Services (AWS) - EMR, Glue, S3, RDS, EC2, Lambda, SQS, SES

Apache Spark

Python

Scala

PostgreSQL

Git

Linux

What We Are Looking For… 

Enthusiast should be your middle name. You know what’s new in Big Data technologies and how things are moving

Apache is your toolbox and you have been a contributor to open source projects or have discussed the problems with the community on several occasions

You use cloud for more than just provisioning a Virtual Machine

Vim is friendly to you and you know how to exit Nano

You check logs before screaming about an error

You are a solid engineer who writes modular code and commits in GIT

You are a doer who doesn’t say “no” without first understanding

You understand the value of documentation of your work

You are familiar with Machine Learning Ecosystem and how you can help your fellow Data Scientists to explore data and create production-ready ML pipelines

Good-to-have Skills

Apache NiFi

Apache Kafka

Apache Hive

Docker

Amazon Certification

Airflow