We suggest that you use Shared Computing Cluster (SCC) for your projects. SCC provides a standardized environment and can be fully accessed and used over the web browser. SSC does not require a specific OS on your personal machine neither an SSH client. Using SCC will simplify setting up the working environments for the CS561 projects.
We have provided the SCC guide to help you get started.
TemplateZonemaps is a simple template for you, the student, to use for the simple implementation project in CS 561. Note that this is a high level template, it is not extensive, rather it is meant to help guide you on what we expect when you implement the zonemaps. You can use this as base code or start from scratch. You may require additional helper functions to satisfy the requirements of the project.
You will be asked to generate workloads of a specific size, and generate specific number of point and
range queries. An incomplete workload generator is provided as part of the API that performs the
required functionality (note that you are required to implement the range query generator for specific
selectivity). Compile the workload generator using the make
command, and execute using
./workloadgenerator --help
You will get
./workloadgenerator {OPTIONS}
Zonemap_Workload_Parser.
OPTIONS:
Workload parameters:
-N[N], --num-points=[N] The number of total elements [def:
1000000]
--UB=[UB],
--upper-bound-of-the-max-element=[UB]
The upper bound of the largest
positive element [def: 3000000]
-P[P], --num-point-queries=[P] The number of total point queries
[def: 10000] (duplicates may exist in
the input data, there might be more
than one matching records)
-R[R], --num-range-queries=[R] The number of total range queries
[def: 1000]
-s[s],
--selectivity-of-range-queries=[s]
The selectivity for each range queries
(0 <= s <= 1), [def: 0.5]
--sort sort the input workload
For example, to generate a workload of 1 Million integers in file workload.dat
, 10000 point queries in
filepoint_queries
.txt, and an empty file range_queries.txt
(you can define the format of range
queries by yourself).
./workloadgenerator
or
./workloadgenerator -N 1000000 -P 10000
The zonemaps.h
header file is a template that defines the basic components of a zone map data structure.
It is required to implement the data structure using this template in a separate file named
zonemaps.cpp
. You are free to modify certain components of the template to improve performance of the
data structure, however the core functionality should remain the same. In your implementation, it is
important to comment your code to highlight various design decisions and logic.
The main.cpp
file provides a foundational testing framework expected for this project. You are required
to generate the workloads, read the data, build the zone map, and benchmark point queries and range
queries. We have already provided a simple logic to benchmark the point query. You are required to
implement parsing the range queries from range_queries.txt
and benchmarking the range query
performance. The execution times are to be written either into a log file or displayed onto the terminal
along with other relevant details about the workload, such as: the input workload size, the number of
queries, the selectivity of range queries etc.
Compile all files using the make
command.
Once the implementation of zone maps is complete, you will be required to fill in the appropriate test
call in the main.cpp
file for the point/range queries.
If you have any questions please feel free to see Teona in office hours, or post your questions on Piazza