Maryam Al Mansour
Riyadh
Summary
Experienced Data Engineer with 6+ years of architecting and implementing ETL pipelines. Seeking an opportunity as a Data Engineer to leverage my experience with cloud computing platforms such as Hadoop, Spark, Hive, Kafka, RDBMS, and other big data technologies, towards creating streamlined workflows to deliver reliable and scalable data pipeline which provides solutions for complex datasets.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Data Engineer
Saudi Authority for Data and Artificial Intelligence(NCAI)
2021.09 - Current
- Architected and built robust streamed big data pipelines integrating Apache Kafka, processing it using Spark, and Store in HDFS, Hive, and object storage.
- Performed API data extraction ingesting via scraping, preprocessed it and stored it into unstructured database MongoDB
- Deployed high-scale vector database Milvus on Kubernetes.
- Implemented Transformation Layer to ingest petabyte of data from object storage and store it in distributed databases(Hive) and object storage.
- Managed and Automated data workflows using Airflow.
Data Engineer Consultant
Al Nakheel
2021.10 - 2022.04
- Built an Ingestion Layer to connect data from various sources such as SFTP, RDBMS, and API to Data Lake for reporting usage
- Implemented an application’s business logic for an e-commerce Website called Dragon Mart Mall using T-SQL Stored Procedures (SPs), to retrieve data from an SFTP and re-create the tables in SQL Azure DB to insert or update it.
- Implemented Powershell script to automatically send Tableau Reports, using Tabcmd package to fetch data from Tableau API and email it to stakeholders using Windows Task Scheduler.
- Proactively monitored cloud services & pipelines run status using Azure Data Factory to prevent failures from escalating.
- Constructed a Digital Marketing ETL pipeline that migrates data from Google Analytics to Data Warehouse in BigQuery using Stitch Data.
Data Engineer Consultant
Compass Real Estate
2018.01 - 2020.02
- Utilize a data framework to develop and maintain an ELT data pipeline that processes Real-time ingestion in batches from Rets MD API, load it to MongoDB for further analysis, and convert it later on to match business goals.
- Query raw data using MongoDB to perform a transformation to the data, such as converting date formats, editing text strings, or joining rows and columns.
- Work closely with Data Analysts to construct data transformation by extensively cleansing the Raw data via scripts using SQL and Python.
- Performed Migration to move data from temporary (MongoDB) holds raw data to target DB (PostgreSQL) holds normalized, transformed data.
- Navigate Airflow to run multiple DAGS in staging and production.
- Create an AWS cloud testing (EC2) development environment as a replica of production to test the migrated data with the deployed services.
- Maintain best practices of using Linux command lines creating and modifying scripts to perform tasks across all environments.
Education
Master of Science in Software Engineering -
Stevens Institute of Technology
New Jersey, USA05.2018
Bachelor of Software Engineering -
Dar Al Uloom University
Riyadh, Saudi Arabia02.2014
Skills
TECHNICAL SKILLS
Big Data: Hadoop Ecosystem, Hive, HDFS, Spark Kafka.
Databases: Redis, MYSQL, MongoDB, PostgreSQL, Milvus.
Orchestration: Airflow, Datadog
Containerization: Docker, Kubernetes
Programming Languages: Python, HTML, CSS
SOFT SKILLS
Team work Communication Skills
Leadership Presentation Skills
Certification
- Devops Bootcamp - Saudi Digital Academy
- Data Engineering Nanodegree - Udacity
Languages
Arabic, English
Native language
Timeline
Data Engineer Consultant
Al Nakheel
2021.10 - 2022.04
Data Engineer
Saudi Authority for Data and Artificial Intelligence(NCAI)
2021.09 - Current
Data Engineer Consultant
Compass Real Estate
2018.01 - 2020.02
Master of Science in Software Engineering -
Stevens Institute of Technology
Bachelor of Software Engineering -
Dar Al Uloom University
- Devops Bootcamp - Saudi Digital Academy
- Data Engineering Nanodegree - Udacity
Similar Profiles
HANAN ALASADYHANAN ALASADY
Software Engineer - IOS at Saudi Authority for Data & Artificial IntelligenceSoftware Engineer - IOS at Saudi Authority for Data & Artificial Intelligence
Marwa Wali-KhansMarwa Wali-Khans
Technology Researcher at Saudi Authority for Data and Artificial Intelligence (SDAIA)Technology Researcher at Saudi Authority for Data and Artificial Intelligence (SDAIA)
Sahar AlghamdiSahar Alghamdi
Demand Specialist/Technical Project Manager at Saudi Data and Artificial Intelligence Authority (SDAIA)Demand Specialist/Technical Project Manager at Saudi Data and Artificial Intelligence Authority (SDAIA)