Real-Time Fraud Detection
Source
Kafka→
Spark Structured Streaming→
Random Forest→
Postgres + HDFS
An end-to-end pipeline that simulates live transaction traffic and scores it in-flight. Predictions split two ways: Postgres for a low-latency Streamlit dashboard, HDFS as a data lake for batch analytics and retraining.
Spatial Selection Bias in Broadband Data
MSc thesis
Ookla + RURA data→
Observation model→
Cross-fit calibration→
Corrected estimates
Compares Ookla's self-selected speed tests against RURA's full subscriber census, then models the probability a location enters the crowdsourced sample to correct for it. Thirty quarters of measurements, terrain, and technology mix pulled from 28 regulator PDFs feed an out-of-fold calibration step.