DatasetProcessing » Historie » Verze 2
Petr Hlaváč, 2020-05-06 10:11
1 | 1 | Petr Hlaváč | h1. DatasetProcessing |
---|---|---|---|
2 | |||
3 | Složka obsahuje implementace processoru pro jednotlivé datasety. Processory jsou dynamicky importovány je tedy proto nutné dodržet pojemnování *"dataset-name"Processor.py*. |
||
4 | |||
5 | Je velmi žádoucí aby crawler pro stažení souboru používal funkci *CSVutils.export_data_to_csv(filename, date_dict)*. |
||
6 | |||
7 | Po implementování metody je nutné změnit *Return False* na *Return True* |
||
8 | |||
9 | h2. Generovaný Processor |
||
10 | |||
11 | <pre> |
||
12 | 2 | Petr Hlaváč | from Utilities.CSV import CSVDataLine |
13 | 1 | Petr Hlaváč | |
14 | 2 | Petr Hlaváč | |
15 | 1 | Petr Hlaváč | def process_file(filename): |
16 | """ |
||
17 | 2 | Petr Hlaváč | Method that take path to crawled file and outputs date dictionary: |
18 | 1 | Petr Hlaváč | Date dictionary is a dictionary where keys are dates in format ddmmYYYYhh (0804201815) |
19 | and value is dictionary where keys devices (specified in configuration file) |
||
20 | and value is CSVDataLine.CSVDataLine with device,date and occurrence |
||
21 | |||
22 | Args: |
||
23 | filename: name of processed file |
||
24 | |||
25 | Returns: |
||
26 | 2 | Petr Hlaváč | None if not implemented |
27 | date_dict when implemented |
||
28 | 1 | Petr Hlaváč | """ |
29 | 2 | Petr Hlaváč | date_dict = dict() |
30 | |||
31 | 1 | Petr Hlaváč | #with open(filename, "r") as file: |
32 | print("You must implements process_file method first!") |
||
33 | 2 | Petr Hlaváč | return None |
34 | |||
35 | 1 | Petr Hlaváč | </pre> |