Summary
Overview
Work History
Education
Skills
Websites
Certification
Languages
Personal Information
Timeline
Generic

Ahmed Nagy

Riyadh

Summary

Experienced data engineer, who has been involved in almost all parts of DWH and data lakes. Passionate about learning new technologies and methodologies for creating data pipelines and always interested in exploring new tools.

Overview

9
9
years of professional experience
1
1
Certification

Work History

Senior Data Engineer

Nomo Fintech
London
11.2022 - 11.2023
  • Ingested data from the currency cloud website using Python, and put the data in a suitable form in the s3 data-lake
  • Reduce the cost of developing to 10% by automating the process to convert from noSQL(dynamodb) to SQL(Athena) without any human intervention
  • Optimize long-running lambda jobs by converting it to 'Spark' Glue jobs
  • Visualize the data using Quick-sight and Mode-analytics
  • Python AWS Terraform Pyspark
  • SQL
  • Pandas/AWS Wangler Git/Gitlab

Analytics Developer

Hyve
Cairo
07.2019 - 08.2021
  • As an Analytics developer, I was assigned to two projects to build a DWH.
  • Helping BYTI to track their business using powerBI dashboards, without any interventions
  • This was happening daily mid-night ingesting delta data and, cleaning and designing tabular cubes using Azure cloud.
  • Designing and implementing PowerBi dashboards for IDSC to help decision makers make some decisions on factors like (inflation, education, GDP, health, ...)by using some Excel sheets, This was developed by on-premises Microsoft tools.
  • Optimize PowerBi dashboards running on Teradata DWH fact table 70 GBS from 12 minutes to some seconds using (partitioning, indexes, and views)
  • SQL
  • Databases (Sql Server ,Oracle)
  • Integration (SSIS,Azure Data Factory) SSAS Tabular Cubes
  • PowerBI , PowerBi Report Builder DWH (Synabse Analytics ,Teradata)
  • NIFI

Senior Big Data Engineer

RackSpace
Cairo
09.2021 - 11.2022
  • I was one of the data team who helped Sheetz migrate from Teradata DWH to AWS Redshift.
  • Building all processing pipelines for dimensions data using AWS Glue (Pyspark).
  • Restore the metadata for pipelines in DynamoDB, and orchestrate pipelines using lambda functions (Python) and step functions.
  • Python SQL AWS Pyspark

Senior Big Data Modeler

Ejada Systems (Banking)
Riyadh
12.2023 - Current
  • Working in a transforming transactional system to a Cloudera Data Lake.
  • Creating data modeling schema and the transformations, and guide ETL Team to perform jobs efficiently.
  • Write SQL code for ETL pipelines and Hive, and perform ETL jobs Using Informatica.
  • Automate the infomatica and spark ETL jobs using Airflow.
  • Airflow Apache Ranger&Atlas Data Modelling
  • Informatica BDM
  • Learn how to deal with big data (ingestion, storing, processing) using Cloudera

Intern Big Data Science

National telecommunication Institute
09.2018 - 12.2018

BI Developer

IT-Fusion House
Cairo
11.2018 - 06.2019
  • As a BI Developer, I helped them manage their Insurance companies through effective PowerBi dashboards
  • Helped them to define the most used medicines their active ingredients and their cost in a visual manner

Technical Support Engineer

Tedata
Cairo
11.2016 - 03.2018
  • Talk clients through a series of actions, email or chat, until they've solved a technical issue.
  • Researching, diagnosing, troubleshooting, and identifying solutions to resolve system issues.
  • Properly escalate unresolved issues to appropriate internal teams (Enterprise Engineers).

Education

B.Sc - undefined

Ain-Shams university
01.2016

Intern - undefined

National telecommunication Institute
12.2018

Skills

  • Python
  • Spark
  • ETL (SSIS, Data Factory, AWS Glue)
  • SQL (SQL Server, postgres, AWS Athena)
  • NOSQL (AWS DynamoDB)
  • DWH (Teradata, Redshift, Synapse Analytics)
  • AWS (S3, Lambda, Glue, Kinesis, IAM, CloudFormation, SNS, Athena, Step Functions)
  • DataOps (Git, Gitlab, Terraform)
  • Visualization (PowerBI, quick-sight, Mode Analytics)
  • Active listening & Strategic Decisions
  • Time management
  • Leadership & Teamwork
  • Positivity
  • Cloudera CDP

Certification

  • Cloudera CDP Data Analyst
  • BI Developer

Languages

Arabic
English

Personal Information

Title: Lead Data Engineer / Modeler

Timeline

Senior Big Data Modeler

Ejada Systems (Banking)
12.2023 - Current

Senior Data Engineer

Nomo Fintech
11.2022 - 11.2023

Senior Big Data Engineer

RackSpace
09.2021 - 11.2022

Analytics Developer

Hyve
07.2019 - 08.2021

BI Developer

IT-Fusion House
11.2018 - 06.2019

Intern Big Data Science

National telecommunication Institute
09.2018 - 12.2018

Technical Support Engineer

Tedata
11.2016 - 03.2018

B.Sc - undefined

Ain-Shams university

Intern - undefined

National telecommunication Institute

Similar Profiles

CREATE PROFILE
Ahmed Nagy