Introduction
Built a smart, end-to-end dashboard that lets users analyze public sentiment in real time using a chatbot-style interface. The system fetches data from social platforms, processes it in the backend and allows users to ask questions, see charts and download insights - all in English or Arabic
Objective
- Enable non-technical stakeholders to interact with sentiment data through a simple, intuitive interface.
- Provide real-time insights into public sentiment, keyword trends, and audience feedback.
- Support English & Arabic for a broader audience reach.
- Combine visual analytics with chat-based interaction to enhance user experience.
Methodology
Data Ingestion & Storage
- Scraped posts, mentions, hashtags and comments from multiple social media platforms using Python libraries, APIs and external tools .
- Stored and organized data in a PostgreSQL database with structured tables (platforms, content, hashtags, timestamps).
- Set up automated scheduling for periodic updates and live data availability.
Data Cleaning & Preprocessing
- Removed noise (links, emojis, stopwords) using regex and nltk
- Normalized text for sentiment consistency using lowercasing, tokenization, and lemmatization.
- Ensured data quality by filtering nulls and duplicating content.
Sentiment Analysis
- Applied a trained model for three-class sentiment classification: Positive, Negative, Neutral.
- Processed the text data in batch jobs to keep the interface fast and responsive.
- Stored sentiment scores and tags in the database for query-based access.
Frontend & Chat Interface
- Built the interface in Streamlit, mimicking a chat experience where users can ask questions
- Users can filter data by date, hashtag, topic and can request charts, visuals etc.
- PDF Export: Users can export chats, dashboards, and sentiment summaries with one click.
Multilingual Query Handling
- English queries are answered directly using LLaMA 2.
- Arabic queries are also answered using LLaMA 2, then translated using mBERT into Arabic.
- The system detects input language and returns context-aware answers in the same language.
Result
- Successfully delivered a multilingual, intelligent prototype that secured the project.
- The tool enabled non-technical teams to explore public perception visually and conversationally.
Summary
- Tools Python & SQL
Mockup Dashboard is coming soon....