Summary
Overview
Work History
Education
Skills
Accomplishments
Certification
Timeline
Generic

PUSHPENDRA SINGH SODA

Papakura,Auckland

Summary

Data Engineer with 8 years of experience specializing in data warehousing, ETL development, and big data technologies. Proficient in SQL, Python, and cloud platforms like Azure and AWS. Implemented Data Vault methodologies, managed SQL Server and Oracle databases, and utilized Snowflake for data optimization. Experienced in creating data visualizations with Power BI, engaging stakeholders, and driving Agile project delivery.

Overview

9
9
years of professional experience
1
1
Certification

Work History

Data Engineer

Tower Limited
Auckland CBD, Auckland
07.2024 - Current
  • Designed and optimized ETL pipelines using Talend: Developed data integration workflows for analytics, finance, claims, and marketing teams, storing data in Snowflake, Azure Blob, and Excel.
  • Worked with Data Vault 2.0 modeling: Created hubs, satellites, links, and version tables, ensuring scalability and flexibility in the data architecture.
  • Developed stored procedures in PyCharm: Performed complex data transformations and processing tasks in Stored Procedures, resulting in improved data accuracy and system performance.
  • Jira for sprint management and Git for version control: Managed feature branches, tracked issues, and handled code versioning. Utilized Unix commands for automation and efficient system operations.

Senior Developer

HCL TECH
Bangalore, India
01.2022 - 04.2024
  • Data Integration and Optimization: Developed and optimized Azure Data Factory pipelines to load data from on-premises databases into Azure Databricks and Snowflake for further processing. Implemented PySpark and SQL transformations in Databricks, resulting in a 40% reduction in data transfer time and a 20% improvement in data processing efficiency.
  • Created insightful dashboards and reports with Power BI: Communicated key findings and trends to stakeholders, driving a notable increase in report utilization by business units.
  • Production Support: Provided developer and production support on a rostered after-hours basis, ensuring timely resolution of issues and maintaining system uptime.
  • Developed Unix shell scripts: Created and developed Unix shell scripts for scheduling and automating ETL workflows, ensuring smooth execution, timely processing, and minimizing errors in day-to-day operations.

Data Engineer

Axis Bank
Bangalore, India
09.2019 - 01.2022
  • Collaborated with cross-functional teams: Developed data pipelines using PySpark which were 25% more efficient than older pipelines.
  • Kafka Integration and Data Streaming: Integrated Kafka for real-time data streaming, consuming data from Kafka topics and processing them using PySpark.
  • Deployed code in CI/CD pipelines: Utilized Jenkins and SVN to streamline the deployment process and ensure continuous integration and continuous deployment (CI/CD).
  • Orchestrated pipelines:Managed and scheduled pipelines through Airflow, Cron, etc., ensuring reliable and efficient workflow execution.

Programmer Analyst

Cognizant
Bangalore, India
02.2016 - 09.2019
  • Utilized Informatica Power Center and Informatica Developer (IDQ): Developed end-to-end data extraction and transformation processes for AML (Anti-money laundering) and IFD (Internal fraud detection) intelligent systems using ETL tool Informatica.
  • Employed different source systems: Integrated DB2, Oracle, flat files, mainframe, and big data as sources and targets for ETL pipelines, ensuring comprehensive data integration.
  • Developed scripts: Created and maintained UNIX shell scripts for pre/post session operations and various day-to-day operations, ensuring smooth workflow execution and automation.

Education

Bachelor of Technology -

Rajasthan Technical University
India
06-2015

Senior Secondary School Certificate -

G.R Global Academy
India
05-2010

Skills

  • Programming Languages: SQL, Python, SAS
  • Big Data Tools: Spark, Sqoop, Kafka, Hbase
  • ETL Tools: Informatica, PySpark, DBT, Databricks, Azure Data Factory,Talend
  • Scripting: Unix
  • Cloud Platforms: Azure, AWS
  • Databases: DB2, Oracle, Hive, SQL Server, Snowflake
  • Data Analytics: Power BI, Excel, Google BigQuery
  • Containers: Docker, Kubernetes
  • Project Management and Development: Agile, Jira, Confluence
  • CI/CD: Azure DevOps, Jenkins
  • Pipeline Management: Airflow, Autosys, Cron
  • Version Control : GIT, SVN, BitBucket
  • Data Masking and Encryption
  • Data Formats: JSON, AVRO, Parquet, ORC, Mainframe

Accomplishments

  • Certificate of Recognition in appreciation of excellent performance in HCLTech- Emirates NBD relationship.
  • BIU STAR Award, 2021, Axis Bank: Awarded with BIU STAR Award for TD Realtime Trigger.
  • BIU CROSS FUNCTIONAL Award, 2020, Axis Bank: Awarded with BIU CROSS FUNCTIONAL Award for RBI Moratorium Project.
  • Wizard Award, 2018, Cognizant: Wizard Award at BFS level.

Certification

  • Microsoft Certified: Azure Fundamentals
  • Atlassian Agile Project Management Professional

Timeline

Data Engineer

Tower Limited
07.2024 - Current

Senior Developer

HCL TECH
01.2022 - 04.2024

Data Engineer

Axis Bank
09.2019 - 01.2022

Programmer Analyst

Cognizant
02.2016 - 09.2019

Bachelor of Technology -

Rajasthan Technical University

Senior Secondary School Certificate -

G.R Global Academy

Similar Profiles

  • Suman Chandra Das

    Suman Chandra DasSuman Chandra Das

    Program Manager Project-H.O, Circle Quality Head at TOWER VISION INDIA PVT. LTD.Program Manager Project-H.O, Circle Quality Head at TOWER VISION INDIA PVT. LTD.

    View Profile
  • Ciara Ambrose

    Ciara AmbroseCiara Ambrose

    Tower Trading Limited at Tower Trading LimitedTower Trading Limited at Tower Trading Limited

    View Profile
  • SANDEEP MALIK

    SANDEEP MALIKSANDEEP MALIK

    Project Coordinator at ATC Telecom Tower Corporation Private LimitedProject Coordinator at ATC Telecom Tower Corporation Private Limited

    View Profile
PUSHPENDRA SINGH SODA