Thorough Developer offering 6 years of experience with specialties in producing detailed specifications and writing program codes. Proficiency in Data Engineering and Data Analysis. Organized, innovative and experienced in all stages of development.
Overview
6
6
years of professional experience
4
4
years of post-secondary education
3
3
Certifications
Work History
Developer
Emirates Technology Solution
Dubai
10.2021 - Current
Responsible for gathering, addressing and implementing technical and design requirements.
Refactor existing applications to optimize its performance through setting the appropriate architecture and integrating the best practices and standards.
Own the technical implementation of the projects ensuring the projects is on track, deadlines are met, and progress/bottlenecks is communicated to management.
Used Airflow , Pandas and Pyspark framework to create data flows and transformations.
Automated the data validation of 30,000 reports by using requests and selenium framework and deployed the services using Docker and kubernetes.
Designed and implemented the Big Data Quality Gates from scratch using open source dashboarding tool - Plotly Dash with minimal refresh time and real time incident reporting. The dashboard provides an indepth support to the operations team to monitor the big data ecosystem.
Performed data modelling using aggregated tables in hive to perform mall footfall analysis into 40 malls in United Arab Emirates and provided daily data to the data warehousing team for the mall footfall reporting using Pyspark and Hive.
Created a framework to automate the validation of data migration from HDP to CDP cluster. Reducing the error rate from 35% to 6% using python and pyspark.
Documented and distributed handbooks for the entire big data services, workflows and additional features delivered to the business after the release using Bitbucket.
Senior Backend Engineer
Noodle.ai
Bangalore
07.2021 - 09.2021
Developed and delivered new features on the risk prediction dashboard by adding several layers of granularity on the API level.
Created RESI API using Flask and documented them using Swagger.
Optimized the API performance by replacing backend database from Postgresql to Druid.
Associate Data Scientist
UnitedHealthCare
Bangalore
01.2019 - 07.2021
Worked with stakeholders to develop quarterly roadmaps based on impact, effort and test coordinations.
Utilized advanced querying, visualization and analytics tools to analyze and process complex data sets using MySQL and Tableau.
Minimised the errors by 79% in the dataflow by developing a framework using Plotly Dash , Pandas and Python that provided a comprehensive view about the data discrepancies from source to target Streams.
Developed a dashboard using machine learning algorithms that increased the revenue of UnitedHealthCare by predicting member disenrollments from various insurance plans in the Medicare and Medicaid line of business using Machine Learning libraries such as scikit learn.
Automated the SSRS Report migration from 2012 server to 2016 server by using Kafka and Selenium, bringing down the total release time from 60 planned days to 5 days.
Wrote frameworks using Pyspark to perform RAW Files loading from source to Hive tables and scheduled them using oozie.
Software Engineer
Trianz
Bangalore
09.2016 - 01.2019
Reviewed project specifications and designed technology solutions that exceeded performance expectations.
Worked with software development and testing team members to design and develop robust solutions to meet client requirements for functionality, scalability and performance.
Worked with Netapp Team and developed a data integrity project using Django to provide the view of overall health of autosupports (ASUP).
Developed a spark microservice using Kafka and Pyspark to requeue autosupports back to the spark microservices in case of failures.
Developed daily reports that alarmed the developers and stakeholders about data discrepancies and kafka message losses as well as overall health of big data cluster.
Education
Bachelor of Computer Science And Engineering - Computer Science
Annamalai University
Chidambaram, India
07.2012 - 08.2016
Skills
Data Analysis
undefined
Accomplishments
BASIS Innovation Award for SSRS Report Migration of more than 2500 reports in 1 week.
10000 smile points by Etisalat for exceeding performance expectations and delivering projects with 0 errors and closely aligned to customer expectations.
Additional Information
Visa Status : Residency Visa
Certification
Databricks Lakehouse Fundamentals
Interests
Piano
Competitive Programming
Reading technical and psychological blogs
Timeline
Databricks Lakehouse Fundamentals
10-2022
Learning Kubernetes
09-2022
Data Ingestion with Python
09-2022
Developer
Emirates Technology Solution
10.2021 - Current
Senior Backend Engineer
Noodle.ai
07.2021 - 09.2021
Associate Data Scientist
UnitedHealthCare
01.2019 - 07.2021
Software Engineer
Trianz
09.2016 - 01.2019
Bachelor of Computer Science And Engineering - Computer Science
Annamalai University
07.2012 - 08.2016
Similar Profiles
Abigail PidoAbigail Pido
Operations Supervisor at Creative Technology Emirates LLCOperations Supervisor at Creative Technology Emirates LLC