20-006 TT - Big Data Cybersecurity Cluster Expansion

This Request for Proposal is for the acquisition of hardware to extend an existing Hadoop cluster that will be leveraged to address critical challenges in cyber security. The University of Waterloo intends to deploy additional hardware  and software (e.g., Apache Metron, Storm, Kafka, HDFS, YARN, Spark, Hive, Zeppelin, Kibana, Grafana, MIT Kerberos, ElasticSearch, etc.) stack that is capable of scaling to accommodate the needs of big data ingestion (i.e., parsing, enriching and indexing 1TB/day of network traffic), storage, data security and privacy, advanced analytics and custom visualizations. A goal of the research is to train deep neural networks for threat intelligence, which also requires an increase to the number of GPUs (3 additional GPUs) in the cluster.