Real-Time Weather Data Pipeline (Cloud Architecture):
- Architected a serverless ETL pipeline to ingest and process real-time meteorological data from the OpenWeather API using AWS Lambda and EventBridge.
- Developed a dual-storage strategy using DynamoDB for low-latency state management and S3 as a scalable data lake for raw JSON payloads.
- Automated data warehouse ingestion by implementing Snowpipe, reducing data latency from hours to seconds for downstream analytics in Snowflake.
- Designed a scalable schema in Snowflake to support complex analytical queries, ensuring 99.9% pipeline uptime through robust error handling.
Tech Stack: AWS, Python, Lambda, EventBridge, DynamoDB, S3, Snowflake, Snowpipe.
Real-Time News Sentiment Analytics Platform:
- Engineered an event-driven ingestion engine to scrape and process global news feeds every 5 minutes, utilizing Python for NLP-based sentiment scoring.
- Optimized data storage by decoupling raw unstructured data (S3) from processed relational data (PostgreSQL/RDS), improving query performance by 40%.
- Containerized a Streamlit visualization dashboard using Docker and deployed it to AWS ECS Fargate for automated scaling and high availability.
- Enabled stakeholders to monitor real-time market sentiment trends through interactive time-series visualizations and automated reporting.
Tech Stack: AWS Lambda, EventBridge, RDS, PostgreSQL, S3, Docker, ECS, ECR, Streamlit, Python
Financial Analytics Dashboard (Freelance):
- Developed a custom Financial Intelligence Dashboard using Python and Streamlit to automate the consolidation of fragmented cash flow data.
- Reduced monthly reporting time by 80% by replacing manual Excel workflows with automated Pandas data transformation scripts.
- Implemented dynamic filtering and automated OpenPyXL exports, providing leadership with real-time visibility into burn rates and revenue trends.
- Built a modular data validation layer to ensure 100% accuracy in year-over-year financial comparisons.
Tech Stack: Streamlit, Python, Pandas, Matplotlib, OpenPyXL, Excel Automation