digiato

A crawler that contains news from digiato website.

How To Use

install the requirements
in models.py import the name below

from playhouse.db_url import connect
create your database connect to your database like the example below

database = connect('mysql://USERNAME:[email protected]:3306/digiato')
run $ main.py find_and_store_links
run $ main.py read_links

Now you got all your news in seprated categories in your database:)

Name		Name	Last commit message	Last commit date
Latest commit History 28 Commits
.gitignore		.gitignore
README.md		README.md
config.py		config.py
crawler.py		crawler.py
main.py		main.py
models.py		models.py
parser.py		parser.py
requirements.txt		requirements.txt