Ravi Shankar
Kumeū,New Zealand
Summary
Seasoned Data Engineer with a proven track record at Spark, where I spearheaded a cloud migration journey, saving $1.5 million annually. Expert in Data Engineering and Team Management, I excel in architecting cloud data solutions and leading high-impact projects. Achieved a 50% reduction in query times, demonstrating strong analytical and leadership skills.
Overview
15
15
years of professional experience
Work History
Chapter Lead / Senior Data Engineer
Spark
Auckland, New Zealand
12.2018 - Current
- Designed and implemented cloud data architecture, applying standards across different Spark initiatives in the data engineering domain.
- Implemented a cloud migration strategy, resulting in cost savings of $1.5 million annually.
- Collaborated with stakeholders, SMEs, BAs, and Microsoft for cloud migration solution design, and oversaw the migration of approximately 100 TB of data to the cloud solution in Snowflake.
- Played a crucial role in defining the roadmap and strategy for our Data Engineering Chapter for the next three years.
- Instrumental in architecting and publishing the cloud data platform roadmap and templates, and leading the data modeling (cloud data warehouse) team.
- As part of chapter lead responsibilities, I worked on setting up the data engineering standards at the chapter level, which aligned with the wider chapter areas.
- Strategized the cloud migration journey, emphasizing data lineage and business impact.
Lead Consultant
Infosys
, New Zealand
05.2015 - 12.2018
- Company Overview: Contract with Spark NZ.
- Worked as a Senior Consultant with Spark to help migrate and re-engineer the old legacy system into new platforms, and establish the Information Architecture standards of the new EDW.
- Designed and developed the information, data models, and data design with best practices and governance.
- Built data marts and integrated them well into the design of our EDW architecture from scratch.
- Worked with solution architects to translate the high-level data roadmap components into detailed solution data marts.
- Optimized database performance, reducing query times by 50% by implementing advanced indexing techniques.
- Enhanced business process automation by 60% by developing and deploying intelligent ETL pipelines in DataStage.
Consultant
Deloitte
India
12.2013 - 04.2015
- Worked as a Data Modeller/Developer to design and implement data mart, publish ETL design and lead downstream development and training teams in AIG (Insurance)
- Worked closely with business/stakeholders on various requirements/initiatives to incorporate/integrate multi-discrete systems data with the enterprise data warehouse
- Built and designed Data Lake components for QBE to ingest data from various source systems to the Data Lake – Hive and MongoDB and had to do a lot of data profiling to make sure we got clean data ingested into the system
- Collaboration with UI/UX teams (non-BI for application integration
Associate Consultant
Capgemini India
Pune, India
04.2010 - 11.2013
- Company Overview: HSBC Pune
- Worked as a BI Developer with the HSBC India Risk MI team
- Built an automated platform to acquire, integrate, analyze and report risk management intelligence across all business units and lines of business
- Risk MI received feeds from various systems periodically and loaded them into Risk MI Data Mart
- Processed Basel, Credit Risk, and Finance data and enhanced business process automation by developing and deploying intelligent ETL pipelines
- HSBC Pune
Education
Bachelor of Computer Engineering -
Pune University
Pune01.2009
Skills
- Agile Development Practices
- Data-Driven Insights
- Cloud Migration
- Data Pipeline Development
- Db2
- DBT
- Microsoft Azure
- Snowflake
- Product Development for Data Solutions
- Team Leadership
Accomplishments
MicroSoft Certified- Azure Data Associate Expert
Passions
- Playing Cricket
- Badminton
Timeline
Chapter Lead / Senior Data Engineer
Spark
12.2018 - Current
Lead Consultant
Infosys
05.2015 - 12.2018
Consultant
Deloitte
12.2013 - 04.2015
Associate Consultant
Capgemini India
04.2010 - 11.2013
Bachelor of Computer Engineering -
Pune University
Similar Profiles
Evorjia WoodardEvorjia Woodard
Delivery Driver at SparkDelivery Driver at Spark
Nicole RodriguezNicole Rodriguez
Delivery Driver at SparkDelivery Driver at Spark
Taylor MillsTaylor Mills
Independent Contractor at SparkIndependent Contractor at Spark