Sudhanshu Kumar Pandey
Dubai,United Arab Emirates
Summary
Results-driven professional with expertise in advanced data engineering and analytics, leveraging tools and technologies such as Spark, Python, Scala, Hive, Kafka, Databricks, and Azure DevOps to deliver scalable solutions. Demonstrates strong leadership in technical projects, system design, data modelling, and governance while fostering team collaboration and mentoring talent. Adept at stakeholder communication and nurturing interpersonal relationships to drive project success. Committed to advancing innovative data strategies that align with organisational goals.
Overview
11
11
years of professional experience
4
4
years of post-secondary education
1
1
Certification
Work history
Senior Data Engineer
Emirates Airline
Dubai, United Arab Emirates
03.2022 - 07.2025
- Develop and Deploy the complex solutions, Work closely with PDE and Architect for right architecture patterns and design. Conduct required source system analysis, data profiling, source-to-target mapping activities and data modelling (both logical and physical) to ensure delivery on business needs.
- Mentor and Guide junior engineers in best practices and software development processes.
- Led strategic initiatives involving complex datasets resulting in efficient resource allocation.
- Established best practices in line with company's data governance policies.
- Deployed software solutions in highly available, scalable & distributed environments.
- Collaborated with customers and other stakeholders to ensure customer satisfaction with product delivery.
- Collaborate with members of the cross-functional team to identify areas of inefficiency and propose solutions.
Lead Consultant Specialist
HSBC Limited
Pune
06.2021 - 02.2022
- Designing a robust system to handle terabyte/Petabyte of workloads.
- Coordinating with onsite and offshore teams (multiple locations) and ensuring proper project execution in compliance with the SLAs and CMM processes.
- Directing process audits, root cause analysis to improve productivity and quality.
- Drafting and executing risk management plans to always ensure operational excellence.
- Establishing and presenting deployable solution based on client requirement to the customer.
- Reviewing and analysing the effectiveness and efficiency of existing systems and developing strategies for improving or further leveraging these systems.
Senior Data Engineer
Synechron Technologies
Pune, India
06.2019 - 06.2021
- Reviewing and analysing the effectiveness and efficiency of existing systems and developing strategies for improving or further leveraging these systems.
- Client: UBS
- Established best practices in line with company's data governance policies.
- Migrated legacy systems to cloud platforms, resulting in increased scalability and reliability.
Senior Data Engineer
Zensar Technologies
Pune, India
04.2018 - 11.2019
- Client: CISCO (US)
- Domain: Electronics and Manufacturing
- Frameworks: Hadoop, Apache Spark, Confluent Kafka, Sqoop, ADF, Azure Blob storage, Azure Databricks
Software Engineer
HCL Technologies
Kolkata, India
03.2014 - 04.2018
- Organization: HCL (T-Mobile) - Bigdata Hadoop Developer
- Client: T-Mobile (US)
- Domain: Telecom
- Database: Oracle, Teradata, Multiple Sources
- Environment: Bigdata: Hadoop Ecosystem (Java, Pig, Hive, Hbase, Map Reduce, Oozie, UNIX)
Education
B.Tech (First) - Electronics & Telecom
Biju Patnaik University of Technology
India 06.2009 - 08.2013
Skills
- Tools and Technologies - Spark, Python, Scala, Hive, Kafka, Sqoop, Databricks, ADF, Synapse, ADLSGen2, Event Grid, Fabrics, MongoDB, Cassendra, HBase, Elastic Search, Azure Git DevOps, Jenkins, Oozie, Airflow
- Soft Skills - Team Player, mentor, nurturing talent, Good Interpersonal Skills
- Data modelling
- System design
- Data governance
- Leadership in technical projects
- Mentoring aptitude
- Communication with stakeholders
Websites
Certification
- AZ-900, Microsoft (A) February 2021 - February 2021
- MS Fabrics, Microsoft (A) November 2024 - November 2024
Affiliations
- Travelling
Accomplishments
Received Multiple Najm from business/stakeholders and Internal Department for outstanding delivery and solutions.
linkedin.com/in/sudhanshu-pandey-5ba22514b
Languages
English - Native Speaker
Fluent
Hindi - Native Speaker
Fluent
GIT
https://github.com/sudhkpandey/sudhanshu-Spark
Timeline
Senior Data Engineer
Emirates Airline
03.2022 - 07.2025
Lead Consultant Specialist
HSBC Limited
06.2021 - 02.2022
Senior Data Engineer
Synechron Technologies
06.2019 - 06.2021
Senior Data Engineer
Zensar Technologies
04.2018 - 11.2019
Software Engineer
HCL Technologies
03.2014 - 04.2018
B.Tech (First) - Electronics & Telecom
Biju Patnaik University of Technology
06.2009 - 08.2013
Similar Profiles
KENNETH OPOKU BOATENGKENNETH OPOKU BOATENG
Customer Service Cum Aviation Security at EMIRATES AIRLINE (TGSS) - Emirates Group SecurityCustomer Service Cum Aviation Security at EMIRATES AIRLINE (TGSS) - Emirates Group Security
Eduardo Jr RoncoEduardo Jr Ronco
Facilities Officer at Emirates Group, Emirates AirlineFacilities Officer at Emirates Group, Emirates Airline
Abdulrahman Jama Haji AliAbdulrahman Jama Haji Ali
Crew Scheduling and Planning Officer at Emirates AirlineCrew Scheduling and Planning Officer at Emirates Airline
Marwan AbdelhamidMarwan Abdelhamid
Senior Cabin Crew Member at emirates airlineSenior Cabin Crew Member at emirates airline
SHAHEEN TOLESHAHEEN TOLE
Quality Control & Compliance Officer at Dubai Islamic BankQuality Control & Compliance Officer at Dubai Islamic Bank