Student: SRIVASTAVA Dhruv (3035667792)
Supervisor: Dr. Heming Cui
Data Loader (also called Bulk Data Loader or Base Data Loader) for the
Server Skeleton interface https://github.com/DSri01/COMP4801_FYP_Server_Skeleton
to be used during the evaluation phase of the project to load the base data
(generated by the Base Data Generator https://github.com/DSri01/COMP4801_FYP_Base_Data_Generator)
to the System Under Test (SUT) before any experimentation begins.
Input the configuration of the base data and the Server Skeleton in the
BDL005_config_file.json configuration file.
The data loader can be executed via the following command:
python3 BDL003_main_loader.py BDL005_config_file.json
The Data Loader (also called Bulk Data Loader) is built from the files listed in the table below.
| File Name | Description |
|---|---|
| BDL000_multithreaded_object_loader.py | Contains the definition of the base python class for loading data in the files generated by the Base Data Generator |
| BDL001_vertex_loader.py | Contains definition of python classes to load vertices in the base data to the SUT |
| BDL002_edge_loader.py | Contains definition of python classes to load edges in the base data to the SUT |
| BDL003_main_loader.py | Script to initialize and execute python objects to load all base data to the SUT |
| BDL004_helper.py | Contains some helper methods for interactions with the Server Skeleton SUT |
| BDL005_config_file.json | Configuration file for the data loader |