CyberScraper 2077 Web Scraping

CyberScraper 2077 is not just another web scraping tool – it’s a glimpse into the future of data extraction. Born from the neon-lit streets of a cyberpunk world, this AI-powered scraper uses OpenAI to slice through the web’s defenses, extracting the data you need with unparalleled precision and style.

Whether you’re a corpo data analyst, a street-smart netrunner, or just someone looking to pull information from the digital realm, CyberScraper 2077 has got you covered.

Installation

# Clone the repository
git clone https://github.com/itsOwen/CyberScraper-2077.git
cd CyberScraper-2077

# Create and activate a virtual environment
virtualenv venv
source venv/bin/activate  # Optional

# Install required packages
pip install -r requirements.txt

# Install Playwright
playwright install

# Set OpenAI API key (Linux/Mac)
export OPENAI_API_KEY="your-api-key-here"

Usage

# Start the Streamlit app
streamlit run main.py

Open your browser and navigate to http://localhost:8501.
Enter the URL of the site you want to scrape or ask a question about the data you need.
Ask the chatbot to extract the data in any format, select the data to export, or extract everything from the webpage.
Watch as CyberScraper 2077 extracts data quickly and efficiently!