Skip to content

JJ1LFC/keiojp-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

keiojp-scraper

Scrape, take a screenshot or update diff of news, and post it to Slack.

*This repository does not have any relationship with keio.jp portal site.

requirement/setup

  • python3
  • venv
  • some packages (see requirements.txt)
  • google chrome
  • config.ini

To make config.ini, refer to the config.ini.example.

to install venv packages

python3 -m venv keiojp-scraper
source keiojp-scraper/venv/activate.fish
pip install -r requirements.txt

to get google chrome

curl https://dl.google.com/linux/linux_signing_key.pub | sudo apt-key add -
echo 'deb [arch=amd64] http://dl.google.com/linux/chrome/deb/ stable main' | sudo tee /etc/apt/sources.list.d/google-chrome.list
sudo apt update
sudo apt install google-chrome-beta

text mode

When text mode is enabled (default by config.ini.example), text diff of news is posted instead of the screenshot.

To disable text mode, set textmode in [global] of config.ini to false.

run

Use screen or something to keep session.

source keiojp-scraper/venv/activate.fish
python3 ./scrape.py

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages