My Journey

Hello, I am

Shoukath Ali

AI/Data/Software — building reliable Data, BI, ML and scalable systems

Who am I?

Data Engineer Professional & AI Enthusiast

A passionate Data Engineer with expertise in Big Data, Databricks, GenAI and Machine Learning, driven to solve complex business challenges through data-driven solutions.

  • Specialized in ML, Data Science, and GenAI applications
  • Experience in end-to-end data solutions and AI implementations
  • Cloud-native development with Azure, AWS and GCP
Fun Facts
  • Originally from the City of Destiny
  • Nature enthusiast exploring campus wilderness
  • Adventure seeker who loves natural swimming
  • Cyborg, since 2015

Personal Info

Shoukath Ali
Data Engineer & AI Engineer
Phone: +1 (930) 444-0530
Location: United States of America 🇺🇸
Availability: Full-time
Global Experience: 4+ Years

My Expertise

Data Engineering
  • Cloud Architecture
  • Big Data Pipeline Development
  • Data Modelling
Data Science & Analytics
  • 2+ Years AI/ML Project Experience
  • Statistical Analysis
  • Data Analytics
Software Engineering
  • Full-Stack Data Engineering
  • AI Systems
  • Big Data Certified

My Experiences

Education

2023 - 2025

Master of Science in Data Science

Indiana University Bloomington


2017 - 2021

Bachelors in Computer Science and Engineering

National Institute of Technology, Patna


Activities

Hobbies
Hiking Swimming Blogging AI Products
Clubs
Data Science Art of Living ACM - SCIMOD GCP Developer Club Residential Life Member

Skills

Programming Languages
Python C++ R PySpark
Database Mgmt & Data Formats
PostgreSQL MySQL Snowflake MongoDB Neo4j Avro JSON Delta Live Tables (Databricks)
SQL Parquet Delta
Software Development
Flask FastAPI GitHub GitHub Actions Microservices (Istio) Jira
Cloud & Data Engineering
AWS Google Cloud Azure Docker Apache Airflow Databricks
AI / ML
OpenAI LangChain Pinecone Qdrant PyTorch TensorFlow fastai
LLM Prompt Engineering RAG FAISS

~4

Overall Experience

30+

Projects Finished

20+

Accomplishments

4k+

Network == Networth

My Badges

Microsoft Cloud Fundamentals
Microsoft Cloud Data Fundamentals
IBM Data Science
Machine Learning Professional
Link
Oracle GenAI Professional
SAS BI

My Portfolio

Seed Classification using SparkML
Seed Classification using SparkML

Developed a robust data pipeline using PySpark and Pandas to process and analyze a 2,500-row sunflower seed dataset, enabling high-quality classification through advanced feature engineering and statistical analysis.

End-to-End Retail Analytics
End-to-End Retail Analytics

Developed a scalable analytics solution using Datalakes, PySpark, Spark SQL, and PowerBI that boosted the analytics workflow by 30%.

Boston Housing Analytics
Boston Housing Analytics

Performed regression analysis to evaluate the impact of proximity to employment centers on housing values, revealing a statistically significant positive relationship with an impact coefficient of 1.0916 (p-value < 0.05).

Lending Club Analytics
Lending Club Analytics

Developed a scalable data solution using HDFS, PySpark, Spark SQL, and Spark UI that reduced risk analysis time by 40%, improving operational efficiency and reducing costs by 30%.

Vehicle Data Architecture and Implementation
Vehicle Data Architecture and Implementation

Led end-to-end development of a data-driven platform using SQL and ER diagrams, achieving 100% deployment success. Demonstrated the ability to translate business requirements into effective technical solutions.

Reddit Data Analytics
Reddit Data Analytics

Analyzed Reddit posts and comments using a hybrid model combining statistical topic modeling (Latent Dirichlet Allocation) with LLMs (Bert, MiniLM, GPT) to improve contextual semantic analysis by 30%.

Home Credit Default Risk (HCDR)
Home Credit Default Risk (HCDR)

Conducted comprehensive data analysis and predictive modeling using Python, including data wrangling, feature engineering, and machine learning models (XGBoost, SVM) for credit risk assessment.

SpaceX Failure Analysis
SpaceX Failure Analysis

Performed end-to-end data analysis and predictive modeling with a focus on achieving an accuracy of 87% using a Decision Tree model. Included feature engineering and interactive visualizations.

MNIST Handwritten Digit Recognition
MNIST Handwritten Digit Recognition

Developed a neural network model for handwritten digit recognition using the MNIST dataset, focusing on understanding neural networks and tensors.

Customer Churn Data Visualization
Customer Churn Data Visualization

Created an enterprise-wide data visualization report using PowerBI, applying advanced data modeling techniques to provide actionable insights into customer churn trends.

Covid Visualization Live Dashboard
Covid Visualization Live Dashboard

Created an interactive geospatial visualization dashboard for COVID-19 data, including live web scraping, statistical measures!

Portfolio
Portfolio

Built a personal web portfolio using HTML, CSS, Bootstrap, and JavaScript, with GitHub as the hosting platform. Future plans include transitioning to React and integrating blockchain technology.

Health Care System based on Blockchain Technology
Health Care System based on Blockchain Technology

Designed a blockchain-based EHR system for secure patient data access and prescription management. Implemented smart contracts and IoT integrations.

Download free bootstrap 4 admin dashboard, free boootstrap 4 templates
Blockchain-based FireForest Prediction (Dapp)

Led a team to develop a prediction system for forest fires using machine learning and blockchain technology. Implemented smart contracts and an API for frontend-backend communication.

Latest Blogs

LLM — Large Language Models
LLM — Large Language Models

By: Admin 234 5

Why Large? not Small? First, let’s define the Language Model

Language Model is a text probabilistic model that gives probability to each word available in its Vocabulary. Here, the model calculates the probability of a word filling a blank in a given sentence.

Read more
Apache Spark — Data Engineering
Apache Spark — Data Engineering

By: Admin 456 264

Overview of how data and compute resources are distributed across clusters, with optimization.

Read more
Prompt Engineering

Prompting - Prompt Engineering

By: Admin 431 312

Convincing LLM, how to generate outputs. ( Brainwash LLM models 😉 )

Read more

Send a message

Get in touch

Phone :
+1 (930) 444-0530
Location :
United States Of America 🇺🇸