PORTFOLIO

Deep Reinforcement Learning for Network Resource Management

View on Github Open on IEEE Xplore Open on IEEE Xplore

Designed an actor-critic DRL framework to assign mobile users to edge servers based on their traffic and network conditions. The objective is to minimize energy consumption given a delay threshold and with queue stability constraints. The actor module is based on a CNN (using Tensorflow), and the critic module is backed by Lyapunov optimization. The method reduces the energy to a 3% gap compared to an exhaustive search. The research was partly presented at IEEE ICC 2022 (won the IEEE ComSoc Travel Grant) and published in IEEE/ACM Transactions on Networking.


SpaceX Falcon 9 First Stage Landing Prediction

View on Github open Project Report

Collected SpaceX Falcon 9 launch data via web scraping (on Wikipedia) and making a request to the SpaceX API. Data wrangling, exploratory data analysis, and feature engineering were performed using SQL and Pandas. Used Plotly to build an interactive dashboard and Folium for launch sites locations analysis. Several machine learning models (SVM, Classification Trees, and Logistic Regression) were fine-tuned for successful landing prediction with an accuracy of 83%.


IBM Data Science Professional Certificate

View on Github

In this 10-course program, I practiced data science tools and skills with various real-world data sets in the IBM Cloud, including relational databases, SQL, Python, data visualization, data analysis, predictive modeling, and machine learning algorithms.


DeepLearning.AI Deep Learning Specialization

In this 5-course program, I built Convolutional Neural Networks, Recurrent Neural Networks, LSTMs, Transformers using Tensorflow to tackle various applications, such as object detection, speech recognition, music synthesis, and machine translation.