Data Engineer

Job Description

• Working comprehensively with SSIS, Azure Cloud technologies and Python with multiple data source systems on regular basis.
• Create and maintain optimal data pipelines in - On Premise SQL Server Infrastructure and Azure Cloud Environments
• Responsible for expanding and optimizing data and data pipeline architecture as well as optimizing data flow and collection for cross functional utilization.
• Design, develop and deploy high volume ETL pipelines to manage complex and near-real time data collection
• Expertise working with SQL Server 2005/2008 R2/2012 tools Such as Management Studio, Query Analyzer, SQL Profiler, SQL Agent, SSIS and SSRS.
• Develop complex queries using sub queries and multiple joins.
• Working comprehensively with SSIS, Azure Cloud technologies and Python with multiple data source systems on regular basis.
• Create and maintain optimal data pipelines in - On Premise SQL Server Infrastructure and Azure Cloud Environments
• Responsible for expanding and optimizing data and data pipeline architecture as well as optimizing data flow and collection for cross functional utilization.
• Design, develop and deploy high volume ETL pipelines to manage complex and near-real time data collection
• Expertise working with SQL Server 2005/2008 R2/2012 tools Such as Management Studio, Query Analyzer, SQL Profiler, SQL Agent, SSIS and SSRS.
• Develop complex queries using sub queries and multiple joins.
• Designing, implementing custom REST-ful APIs for usage in integrations with cloud/web-based 3rd party applications
• Resp0nsible for consuming 3rd party web-based APIs and integration end points (REST-ful, SFTP file transfer, etc.)
• Work with the data management team and project leads to assist with data related technical issues and support infrastructure needs