Revize af7609b5
Přidáno uživatelem Tomáš Ballák před více než 3 roky(ů)
modules/crawler/DatasetCrawler/OBSAZENIMISTNOSTI_crawler.py | ||
---|---|---|
1 | 1 |
from Utilities import folder_processor |
2 | 2 |
from Utilities.Crawler import basic_crawler_functions |
3 |
from shared_types import ConfigType |
|
3 | 4 |
|
4 | 5 |
# Path to crawled data |
5 | 6 |
CRAWLED_DATA_PATH = "CrawledData/" |
6 | 7 |
|
7 | 8 |
|
8 |
def crawl(config): |
|
9 |
def crawl(config: ConfigType):
|
|
9 | 10 |
""" |
10 | 11 |
Implement crawl method that downloads new data to path_for_files |
11 | 12 |
For keeping the project structure |
Také k dispozici: Unified diff
Re #8193 - refactoring crawler