Back to ProjectsAutomation
Pakistan Stock Exchange Scraper
Automation to fetch data from PSX despite anti-scraping measures. Research into workarounds and a reliable data pipeline. Python, Selenium, strong research and problem-solving.
Languages
Python
Skills & Tech
PythonSeleniumWeb ScrapingData Pipeline
Overview
Automation to fetch data from Pakistan Stock Exchange (PSX) despite anti-scraping measures. Required research into workarounds and a resilient data pipeline. Python with Selenium — strong emphasis on research and problem-solving.
What I Built
- PSX data extraction — stock prices, volumes, indices
- Anti-scraping workarounds — headless browsing, rate limiting, session handling
- Reliable pipeline — retries, error recovery, logging
- Data storage — persistent historical dataset
- Research & iteration — documented approaches and fallbacks
Tech Stack
- Language: Python
- Scraping: Selenium
- Storage: SQLite, PostgreSQL, or CSV
- Scheduling: cron or similar
Outcome
A working PSX data pipeline that bypasses common anti-scraping defenses. Reliable enough for daily automated runs.