avatar

Jatin Verma

  • Data Engineer

Exp : 4 yrs

India Chandigarh, Chandigarh

Email : ja*****

Contact : 91 91*****

Share this profile via
SKILLS :
1 sql
2 Spark
3 Python
4 Linux
5 Hive
6 Azure Cloud Platform
7 beam
Profile Summary :

Data Engineer with 3.5+ years of experience on working with Big Data. I am eager and curious to learn new technologies while working on the existing skills. I have experience in building multiple complex data pipelines using a variety of frameworks and tools.

Work Experience :
  • Associate, Data Engineering L2
    Publicis sapient

    location_on Bangalore, India

    date_range 2022 - Till Date

    Roles and Responsibilities : Developed a robust data ingestion solution using Apache Beam and GCP Dataflow, achieving efficient PDF data processing from GCS. The pipeline utilizes unstructerd.io for data parsing and chunking, Vertex AI models for embedding chunked data, and integrates seamlessly with PostgreSQL (pgvector extension) for optimized storage. Worked on data redaction tools to empower seamless operations while ensuring sensitive data protection across diverse use cases. Developed and deployed a data labeling tool in GKE using Helm charts and Terraform scripts. Enhanced its functionality and security measures to empower use case teams in labeling data and training their machine learning models for automation. Collaborated with the data profiling team to develop a Python- based data profiling tool that helps in data analysis

  • Trainee Data Engineer
    Futurense Technologies

    location_on Bangalore, India

    date_range 2022 - 2022

    Roles and Responsibilities : Developed and maintained data pipelines using Big Data technologies, leveraging PySpark for integration with various big data tools. Automated workflows through shell scripting, enhancing efficiency and scalability.

  • DevOps Engineer
    Code-Brew labs

    location_on Chandigarh, Chandigarh, India

    date_range 2021 - 2021

    Roles and Responsibilities : Managed website and API development environments on AWS, ensuring optimal performance with domain mapping and secure communication setups. Leveraged Docker containers for efficient deployments and automated provisioning using AWS CLI and scripting for seamless delivery.

  • Support Engineer
    Tris-IT Solutions

    location_on Chandigarh, Chandigarh, India

    date_range 2020 - 2021

    Roles and Responsibilities : Automated and maintained a daily ETL pipeline using shell scripting and cron jobs. This pipeline extracts, transforms, and filters data from files, ensuring efficient data processing.

Spoken Languages :
English
Hindi