Narin Meher

Over 5 years of experience in leading Big Data technologies, I excel as a skilled Data Engineer. My proficiency lies in designing and implementing data-driven solutions using various data processing tools like Hadoop ecosystem, Apache Spark, StreamSets and GCP. My adeptness extends to leveraging these tools for crafting both batch and streaming ETL pipelines. I am a computer engineering expert with a Postgraduate Diploma in Big Data Analytics from CDAC (India).

1. Engineer, CV Parser in ERPNext, bigspark ltd
  - Integrated a machine learning script into ERPNext for CV parsing and skills extraction.
  - Deployed an ML model to AWS SageMaker to automate CV parsing, utilizing endpoints and Lambda functions.

2. Data Engineer, SARs Data Automation, NatWest Group, bigspark ltd
  - Developed a customizable, fault-tolerant JDBC framework using StreamSets, Snowflake, and AWS S3, reducing coding time for systems.
  - Orchestrated, scheduled, and monitored complex workflows using AutoSys and Apache Airflow.
  - Proficient in data modeling within Snowflake for tailored report creation.

3. Data Engineer, Merchant Portal, TSYS - A Global Payment Company
  - Resolved production defects and enhanced requirements.
  - Designed and executed end-to-end ETL pipelines on Google Cloud Platform, utilizing Dataflow (Java SDK), PubSub, and BigQuery for batch and streaming data processing.
  - Successfully migrated on-premise ETL pipelines to Google Cloud Platform, reducing on-premise costs by 70%.

4. Big Data Developer, HDP based Consolidation ETL Tool, IBM, Alphonso Global Solutions
  - Developed a reusable Python framework for data warehouse to datalake migration, reducing report generation time by 50%.
  - Orchestrated ETL pipelines for various schedules using Pyspark for data processing and storage in Hive tables or files.
  - Extracted data from diverse sources and applied transformation logic using Pyspark.

5. Big Data Developer, Online and Offline Subscriber De-duplication, IBM, Alphonso Global Solutions
  - Built high-performance, distributed pipelines for data loading and processing using Spark (Scala), Spark Streaming, Hive, HBase, Kafka, and Redis, reducing data processing time by 50%.
  - Developed shell scripts for SQL data extraction and ingestion into HDFS.
  - Automated daily and monthly data loading jobs with Oozie workflows, reducing manual effort.

PGD in Big Data Analytics - Centre for Development of Advanced Computing, CDAC, Pune -

February -18

Bachelor of Engineering in Computer Science - NBN Sinhgad School of Engineering, Pune - June - 17