Smart-City Streaming Data Analytics Platform

A real-time analytics platform for the IoT sensor streams of a smart city that runs on a student laptop CPU. Readings from 71 sensors (traffic, air quality, noise, parking, energy, water, weather) flow through a Kafka-compatible log broker into a Spark-style micro-batch stream processor with watermarks, tumbling and sliding windows, de-duplication and a dead-letter queue. Streaming anomaly detectors and complex-event rules turn the windows into sensor alerts and city incidents, written exactly-once to MongoDB and a Parquet data lake.

Category: Big Data / Stream Processing / Internet of Things / NoSQL Databases / Smart Cities / Anomaly Detection

CSE Project 35 from ProTechSC Academy, with graphical abstract, video demonstration and project guidance.