50× Performance Optimization | Azure · Databricks · PySpark | Kaggle Master
Whether you're a startup or enterprise — let's talk data.
Need a pipeline built from scratch, an existing system optimised, or expert data consulting? Let's talk.
Send Me a MessageAirflow-orchestrated Spark pipeline for large-scale financial file processing. Hadoop HDFS storage, Sqoop RDBMS transfer, and live REST API for front-end BI dashboards. Full Docker containerisation.
Complete migration of legacy SQL workloads to PySpark on PolarDB. Broadcast joins, custom partitioning, and caching strategies delivered 50× query speedup and 35% compute cost reduction.
ADF + Databricks telemetry pipeline for Blue Cross Blue Shield processing 10M+ records/batch. Azure Synapse Analytics with near-real-time Power BI dashboards for 50+ business users.
Snowflake-powered serverless task pipeline using AWS Lambda for event-driven real-time validation with automated MoEngage downstream delivery. Cloud-agnostic across Azure and AWS.
Image recognition & OCR system trained on 500k augmented images. YOLOv8 + OpenCV + Pytesseract achieving 85% detection accuracy at under 280ms inference per frame in production.
End-to-end ETL for US-based investment firm — ADF flows integrating 5+ financial sources with governance-compliant pipeline stack, Synapse Analytics, and live Power BI investment analytics.
Real-time streaming pipeline integrating Azure cloud services with Apache Kafka for event-driven data ingestion and processing at scale.
View RepoContainerised end-to-end pipeline — Spark ingestion, Airflow orchestration, Hadoop HDFS storage, Sqoop transfer, and REST API integration.
View RepoCollection of practical data engineering implementations covering PySpark, Delta Lake, Apache Airflow, and cloud integrations.
View RepoPortfolio website — HTML, CSS, JavaScript showcasing data engineering projects, skills and experience.
View RepoFYP: NLP-based auto-grading using semantic similarity for question classification and subjective answer evaluation. MIT License.
View RepoNeural network for heart disease prediction — data cleaning, feature engineering, training, evaluation and deployment pipeline.
View RepoAwarded Q1 & Q2 2023 at Techlogix for delivering the 50× pipeline optimisation and measurable infrastructure cost reduction at scale in production.
Data Engineer Associate — scored 95% on first attempt. Expertise in Lakehouse architecture, Delta Lake, Unity Catalog, and production pipelines. Valid through Jun 2026.
Datasets Legacy Master (Rank 1,914/9,003) · Notebooks Expert (7,839/60,750) · 2 Gold + 4 Silver + 7 total medals earned globally.
Full merit-based scholarship from Punjab Educational Endowment Fund for all 4 years at UET Lahore, 2018–2022.
Awarded by the Prime Minister Laptop Scheme for academic distinction, 2015–2018.
Top 5% of global data engineering contributors on LinkedIn. 20K+ followers. Regular posts on Spark, Databricks, Azure, and data architecture.
Arslan is one of the most reliable and skilled Data Engineers I've collaborated with. He has strong command of data pipelines, ETL/ELT processes, and cloud technologies, and consistently delivers high-quality solutions even under tight deadlines. What sets him apart is his ability to troubleshoot complex issues calmly and provide clear, actionable insights. Any organisation would be lucky to have him — highly recommended!
Arslan is an exceptionally intelligent individual. He consistently shares valuable insights and offers clear, practical advice. His deep understanding of various subjects and ability to communicate complex concepts in an accessible manner make him an invaluable resource. His passion and dedication are truly inspiring.
A team player, always willing to support others and share his knowledge. He consistently delivers measurable performance and cost improvements. Any organisation would be lucky to have Arslan on their team.
Whether you need a pipeline built, a system optimised, a dashboard delivered, or expert data consulting — I'm available for full-time roles, part-time engagements, and freelance projects worldwide.
📍 Based in Lahore, Pakistan · Available for remote work worldwide
Typically responds within 24 hours