Summary
Overview
Work History
Education
Skills
Certification
Accomplishments
Roles And Responsibilities
Visa
Personal Information
Languages
Timeline
Work Availability
Software
Hi, I’m

Mohammad Ashfaque

Data Architect
Dubai,UAE
Mohammad Ashfaque

Summary

A seasoned Data architect and Data Analytics practitioner with 11 years of experience in the field of Big-data solutions designing, Data governance, Data warehousing, Business Intelligence, AI and IoT implementations.

Overview

11
years of professional experience
4
Certification
5
Languages

Work History

Dubai Electricity And Water Authority (DEWA)

Modern Data Lakehouse Architect
08.2021 - 12.2023

Job overview

  • Collaboration with diverse team to comprehensively understand their data challenges, covering areas like Data Quality, Governance, Analytics, Data Architecture, Data Lakes, DWH, and MDM
  • Conducting in-depth requirement gathering meeting with client stakeholders from both business and Data analytics departments to assess the current data landscape
  • Development of innovative solutions to address data-related issues, enhancing data utilization as a competitive advantage
  • Identification of key pain points and proposed data strategies that unlocked the power of data for clients, improving decision-making and insights
  • Design and implement effective big data solutions and models to store and retrieve organization data using Cloudera Data platform (CDP)
  • Lead implementation of the solutions from establishing project requirements and goals to solution 'go-live'
  • Implementing Master Data Management strategy to ensure data standardization, quality, and governance, and provide single source of truth.
  • Supported data stewards in defining and documenting data definitions, business rules, and data quality requirements

Clairvoyant USA

Senior Big Data and Cloud Engineer
03.2017 - 08.2021

Job overview

  • Configuring and managing 3000 of nodes secure Hadoop cluster in prod environment
  • Migrated Hadoop cluster from on-perm to public cloud
  • Worked on CDH cluster up-gradation and expansion
  • Identified current inefficiencies and recommended changing functionality or behaviors to eliminate concerns
  • Performed security testing using results to identify and fix vulnerable areas
  • CDH, HDP and HDF cluster configuration and up-gradation
  • Configuration of Kerberos in Hadoop cluster and role-based security on databases using sentry
  • Experience in configuration of data encryption on HDFS
  • TLS/SSL configuration on Hadoop Cluster
  • Evaluation of existing Hadoop cluster as per Cloudera standard and cluster certification
  • Hadoop eco-system layout designing, file system designing
  • Setting up new Hadoop users, AD/LDAP/Kerberos Authentication models
  • Large Hadoop cluster resource optimization and tuning
  • Hadoop architecture and configuring various components such as HDFS, YARN, MapReduce (MR1 & MR2), Tez, Sqoop, Flume, Pig, Hive, Zookeeper, Oozie, Ranger, Knox, Sentry, Kafka, Storm, Hbase
  • Configuring Hadoop cluster for security at Enterprise level using MIT & AD Kerberos for authentication, HDFS ACL's, Sentry & Ranger for authorization, Knox for client gateway request, SSL/TLS implementation for Securing HTTP traffic
  • AD user synced with Linux servers using SSSD, Centrify and Okta
  • Troubleshot and resolved cluster-related issues, collaborating with development teams to ensure smooth data processing
  • Performed regular performance tuning and optimization, including memory and resource management, to improve cluster efficiency.

Saama Technology

Big Data Consultant
08.2016 - 03.2017

Job overview

  • Managed and maintained Hadoop clusters comprising multiple nodes, ensuring high availability, performance, and scalability
  • Installed, configured, and upgraded Hadoop ecosystem components including HDFS, YARN, Hive, HBase, and Spark
  • Installation, configuration, supporting and managing Hadoop Ecosystems (Hive, Impala, Zookeeper, Oozie, Hue etc)
  • Configuration of highly available Hadoop cluster
  • Performed regular performance tuning and optimization, including memory and resource management, to improve cluster efficiency
  • Monitored cluster health using tools like Ambari, Cloudera Manager, or Hortonworks Data Platform (HDP) Dashboard.

Locuz Pvt Ltd

Big Data Engineer
03.2015 - 07.2016

Job overview

  • Implementation and support (post implementation) of the enterprise Hadoop environment
  • Integration of BI and Development tool with Hadoop eco-system components Hive, Impala
  • Monitoring and managing cluster resources memory and storage
  • Enable automatic alert and notification to monitor Hadoop eco-system
  • Enable automatic log rotation policies
  • Implemented automatic failover zookeeper and zookeeper failover controller
  • Importing and exporting data using Apache Sqoop from HDFS to Relational Database System
  • Administer Kerberos Security on Hadoop, create key tab files, principal and set appropriate permissions for the principals per requirements
  • Importing/Exporting the data using Sqoop from HDFS to Relational Database systems
  • Automated Monitoring of Hadoop ecosystem and Infrastructure using Cloudera Manager, Zabbix, Grafana and Nagios.

Probity IT Solutions

Associate Hadoop Admin
01.2013 - 03.2015

Job overview

  • Setup Linux server and file system design on physical server
  • Troubleshooting installation & configuration issues
  • Configuration Hadoop Dev cluster and replicating prod issues
  • Monitoring Hadoop cluster job performances and capacity planning
  • User management and resource monitoring of cluster
  • Apache Hadoop and Ecosystem installation, configuration and troubleshooting
  • User Creation and Sync AD with Linux servers
  • Hadoop Job monitoring and Cluster health check and generate reports
  • User and group service Management (Creation, Deletion and modification)
  • Set-up POC clusters and performing smoke test.

Education

Savitribai Phule Pune University

Master in Computer Science
05.2013

Skills

  • Big Data Frameworks Cloudera CDP, KUDU, Hbase, CFM,CSA,CML(Machine learning), Kafka, Airflow,Hive,Impala, Azure Synapse and Stream Analytics, ADLS
  • Cloud Platform Microsoft Azure and Amazon Web Services (AWS)
  • BI Tool Power BI, Tableau
  • Data Polices and Compliances HIPPA, GDPR, PCI DSS and Dubai Data Compliance
  • Programming Languages Python, SQL , Java , Shell Scripting
  • Monitoring and management tools Cloudera Manager, JIRA, Confluence, Nagios, Terraform, Kubernetes, Azure log monitor and Sentinel
  • Operating system Linux, Windows, MacOS
  • Skills Cloud Architecture Designing, Data Integration ETL, Data Security, Data Governance, Metadata Management MDM, Team Management, Project Management
  • Data Warehousing Architecture
  • Large dataset management
  • Data migration

Certification

  • Certified Cloudera Administrator
  • Microsoft certified Architecting Microsoft Azure Solutions
  • Microsoft certified Azure Security Engineer Associates
  • MongoDB certified Engineer

Accomplishments

  • Successfully designed and deployed a scalable, secure big data solutions, resulting in a 50% improvement in data processing speed and a 30% reduction in operational costs using Cloudera's Big-data solution.
  • Led a cross-functional team in implementing data governance and data quality best practices, resulting in improved data accuracy and compliance.
  • Published and presented Data-lake solution in international conference ITIKD 2023 Bahrain https://ieeexplore.ieee.org/document/10099717
  • Presented DEWA's Bigdata/IoT based solutions in GITEX and WETEX Dubai
  • Trained professional in Big Data technology
  • IoT graduate from SoftwareAG

Roles And Responsibilities

  • Assisted in the development and implementation of data governance policies, standards, and procedures.
  • Conducted data quality assessments and root cause analysis to identify data issues and recommend corrective actions.
  • Data strategy planning and discussions
  • Evaluation of existing data architecture design
  • Data integration and ingestion
  • Data modeling and preparation of business glossary
  • Designing and implementing Data Governance and Compliance
  • Solutions presentation and brain storming
  • Collaborated closely with the DEWA's technology team to develop and implement innovative data solutions for clients, staying at the forefront of data technologies.
  • End-to-End Solution Design, leaded the architectural designing of enterprise-level applications, encompassing both high-level (HLD) and low-level design (LLD), ensuring scalability, reliability, security and performance.
  • Demonstrated an in-depth understanding of clients' strategic enterprise data needs, leading to more efficient data management practices.
  • Instituted and facilitated governance of business and technical metadata, as well as data quality routines and frameworks, ensuring data accuracy and consistency.
  • Developed and implemented an enterprise-wide Data Governance Strategy encompassing data policies and standards, data stewardship, data classification, security, retention, and disposition, master & reference data management, and metadata management.
  • Maintained data governance documentation, including data dictionaries, data lineage diagrams, and metadata repositories.

Visa

UAE Golden Visa

Personal Information

  • Nationality: Indian
  • Marital Status: Married

Languages

English
Bilingual or Proficient (C2)
Hindi
Bilingual or Proficient (C2)
Urdu
Bilingual or Proficient (C2)
Arabic
Beginner (A1)

Timeline

Modern Data Lakehouse Architect

Dubai Electricity And Water Authority (DEWA)
08.2021 - 12.2023

Senior Big Data and Cloud Engineer

Clairvoyant USA
03.2017 - 08.2021

Big Data Consultant

Saama Technology
08.2016 - 03.2017

Big Data Engineer

Locuz Pvt Ltd
03.2015 - 07.2016

Associate Hadoop Admin

Probity IT Solutions
01.2013 - 03.2015

Savitribai Phule Pune University

Master in Computer Science
  • Certified Cloudera Administrator
  • Microsoft certified Architecting Microsoft Azure Solutions
  • Microsoft certified Azure Security Engineer Associates
  • MongoDB certified Engineer
Availability
See my work availability
Not Available
Available
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse

Software

Data Architect

Hadoop

Spark

Cloud Architect

Mohammad AshfaqueData Architect