Summary
Overview
Work History
Education
Skills
Personal Information
Languages
Timeline
Generic

Muhammad Awais Agha

Riyadh

Summary

Results-driven data engineer and solution architect with a strong foundation in system design, automation, and enterprise data solutions. Experienced in designing scalable and efficient architectures to address complex business challenges while aligning with organizational goals. Proficient in Python programming, distributed systems, and data engineering technologies, with a proven track record of building high-performance data pipelines and architectures. Takes a proactive and collaborative approach to delivering enterprise-grade solutions, ensuring continuous integration and optimized data workflows. Recognized for quick adaptability, leadership skills, and a commitment to continuous learning, driving transformation in dynamic, fast-paced environments to ensure the success of innovative architectural projects.

Overview

9
9
years of professional experience

Work History

DATA ENGINEER

Huawei
04.2022 - Current
  • Designed and implemented a distributed, multi-system architecture for centralized live-stream API log collection, enabling seamless data flow and real-time analytics
  • Developed scalable log-streaming pipelines using Kafka, integrating with enterprise systems to monitor API performance, identify bottlenecks, and enhance operational decision-making
  • Integrated Apache Kafka with ClickHouse, leveraging real-time OLAP analytics to deliver actionable insights into system performance and usage patterns
  • Deployed and optimized Grafana dashboards, creating comprehensive monitoring solutions for distributed API utilization and system health
  • Delivered high-performance, scalable solutions for real-time API tracking, reducing downtime and supporting robust business continuity strategies
  • Designed and optimized a data processing pipeline, achieving a 96% reduction in processing time (from 6 hours to 13 minutes) by leveraging advanced multiprocessing techniques and resolving resource bottlenecks
  • Implemented iterative performance enhancements to improve system scalability, responsiveness, and overall throughput
  • Developed and deployed a backend API to enable real-time KPI monitoring, streamlining field operations and enhancing customer service quality
  • Delivered real-time network KPI insights, facilitating faster and more informed decision-making across organizational functions
  • Drove measurable operational efficiencies, aligning technical solutions with business goals to enhance end-user experience
  • Architected and implemented a unified Zabbix-based monitoring platform, delivering scalable and high-performance monitoring across diverse infrastructure tiers
  • Optimized data collection and aggregation using advanced strategies (e.g., SNMP, hierarchical models) to enhance system scalability and ensure data accuracy
  • Collaborated with 7 cross-domain stakeholders to customize and align the monitoring solution with enterprise-wide objectives, ensuring tailored observability for varying infrastructure needs
  • Developed a real-time network traffic monitoring solution, enabling automated load balancing, proactive anomaly detection, and improved network performance
  • Enhanced operational reliability through real-time insights, supporting business continuity and reducing system downtime
  • Led cross-functional collaboration with 5 teams to design and implement a robust, scalable data pipeline system, streamlining data handling and analytics across the enterprise
  • Architected a fault-tolerant data pipeline tailored for multi-vendor, multi-domain environments, ensuring seamless data collection, transformation, and visualization
  • Integrated data from 5 vendors across 7 domains, enabling comprehensive analytics and real-time insights to support critical network operations
  • Developed Grafana dashboards for actionable and intuitive data visualization, enhancing stakeholder decision-making with real-time monitoring capabilities
  • Delivered an enterprise-wide data solution, boosting operational efficiency and supporting proactive network management strategies
  • Designed and implemented data integration and workflow automation systems using Apache NiFi and Apache Airflow, enhancing operational efficiency in government reporting and compliance processes
  • Architected end-to-end solutions that streamlined data workflows, optimized processes, and ensured alignment with enterprise reporting standards, driving operational excellence
  • Developed and delivered a comprehensive Radio Access Network (RAN) solution, integrating network KPI data from service providers, utilizing PySpark for distributed computing and Apache Airflow for efficient data orchestration
  • Engineered and implemented an enterprise-grade data warehouse on ClickHouse, optimized for OLAP workflows, enabling advanced business analysis and supporting strategic, data-driven decision-making
  • Boosted data management scalability, ensuring high-performance processing and analytics across the enterprise

LEAD AUTOMATION ENGINEER

Huawei
12.2020 - 04.2022
  • Designed and architected a highly integrated system using a Flask-based web application, reducing customer care response times by 95% (from 3+ hours to minutes), driving significant operational efficiency
  • Led a team of 5 developers to successfully integrate 6 disparate systems (web, APIs, and SSH tools), enhancing system functionality and streamlining operations
  • Spearheaded the integration of 50+ use cases into the web application, enabling rapid and efficient resolution of customer complaints and improving customer service outcomes
  • Collaborated with cross-functional teams to ensure seamless system delivery, meeting project milestones and ensuring the successful deployment of critical tools and processes
  • Optimized system performance, significantly enhancing operational capabilities and customer satisfaction
  • Designed and optimized an advanced anomaly detection system by enhancing a research-based Spike and Drop Detection Algorithm, significantly reducing noise and improving accuracy in network traffic analysis
  • Architected predefined actions and escalation workflows for anomaly detection, ensuring proactive and timely responses to critical network issues, minimizing downtime
  • Customized and fine-tuned algorithmic solutions to address real-world challenges, resulting in a more reliable, scalable system for detecting traffic anomalies and enhancing network performance
  • Improved operational efficiency through automated anomaly detection, supporting faster decision-making and reducing manual intervention
  • Directed codebase management for client-facing web tools and automation scripts across multiple environments, ensuring seamless integration and adherence to enterprise standards
  • Implemented systematic version control and continuous integration (CI) pipelines using GIT, ensuring code stability, reliability, and streamlined development processes
  • Championed comprehensive testing frameworks and best practices, consistently delivering high-quality, resilient solutions tailored to meet diverse client requirements
  • Enhanced code quality through rigorous testing and CI/CD practices, reducing deployment risks and increasing development efficiency

FREELANCER

Private
07.2019 - 11.2020
  • Developed a model for monitoring a person's vigilance by detecting and assessing the state of their eyes (open or closed), specifically for applications such as identifying drowsy drivers and enhancing road safety
  • Applied advanced computer vision techniques to detect eye states, ensuring high accuracy and real-time performance for critical safety applications
  • Conducted trend analysis on news and journalistic articles using the Apriori algorithm for data mining, uncovering key insights into news trends and patterns
  • Analyzed data collected from August 2017 to September 2017, generating actionable results across multiple dimensions, improving content analysis and decision-making
  • Enhanced data-driven decision-making by identifying trends in news content, contributing to more informed strategies and insights

WEB DEVELOPER

Horver Tech
08.2016 - 09.2018
  • Performed Web Scraping and Other scripting tasks for client projects
  • Perform various tasks to process the raw data in a certain data structure to accomplish data visualizations for a better understanding of the client

Education

Bachelor of Science - Software Engineering

Mehran University of Engineering And Technology
Jamshoro
05.2014

CS50

Howard University

Business Analyst Intern -

Convergent Business Technologies
08.2020

Skills

  • Python
  • JavaScript
  • Git
  • PySpark
  • API Integration
  • SQL/NoSQL
  • Apache NIFI
  • Apache Airflow
  • Apache Kafka
  • Dashboards Development
  • System Design
  • OLAP/OLTP
  • ETL development
  • Data warehousing
  • Data modeling
  • Data pipeline design

Personal Information

Gender: Male

Languages

Urdu
Native language
English
Proficient
C2
Arabic
Elementary
A2

Timeline

DATA ENGINEER

Huawei
04.2022 - Current

LEAD AUTOMATION ENGINEER

Huawei
12.2020 - 04.2022

FREELANCER

Private
07.2019 - 11.2020

WEB DEVELOPER

Horver Tech
08.2016 - 09.2018

Business Analyst Intern -

Convergent Business Technologies

Bachelor of Science - Software Engineering

Mehran University of Engineering And Technology

CS50

Howard University
Muhammad Awais Agha