Azure Data Bricks

Job Description

Experience: 6 to 8 Years

Location: Chennai, Bangalore, HYD, Mumbai, Pune and Gurgaon.

Notice: Immediate to 10 days

Budget: 16-18LPA

JD for Azure Data Bricks:

on-premises Hadoop workloads Migration to the Databricks. Currently we are using scala /python”

• Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Databricks and Apache Spark
• Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).
• Microsoft Azure Big Data Architecture certification (preferred)
• Delivering and presenting proofs of concept to of key technology components to project stakeholders.
• Developing scalable and re-usable frameworks for ingesting of data sets
• Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
• Working with event based / streaming technologies to ingest and process data
• Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
• Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
• Strong knowledge of Data Management principles
• Experience using geospatial frameworks on Apache Spark and associated design and development patterns
• Hands on experience designing and delivering solutions using the Azure Data Analytics platform including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics