Cloud Hadoop Operations Lab

For a while I wanted to publish the research capabilities of Professor Jeremy Hajek for the Cloud and Operations research group in the Information Technology and Management Program Program at the School of Applied Technology.

Current Hardware Platform - as of 12/09/20

Current applications include:

• 5 node Hadoop 2.8.5 Research Cluster
  • 197 GB RAM and 47 processors available.
• 1 Pfsense 2.4 VPN router for access to the cluster
• 1 Instance of Cobbler 2.8.x for network based installs
• Use of Riemann for metric and event routing
• 1 instance of Grafana for visual inspection of metrics
• 2 instances of Docker running on Ubuntu 16.04 LTS

Current Hardware

• Namenode - 1.8 TB of storage, 32 GB of RAM, AMD FX 6100 Hexacore
• Datanode1 - 3.6 TB of storage, 94 GB of RAM, 2x Intel Xeon E5530 Quad Core
• Datanode2 - 2 TB of storage, 56 GB of RAM, 2x Intel Xeon E5530 Quad Core
• Datanode3 - 2 TB of storage, 32 GB of RAM, 2x Intel Xeon E5504 Quad Core
• Datanode4 - 2 TB of storage, 24 GB of RAM, AMD FX 6100 Hexacore
• Datanode5 - 2 TB of storage, 32 GB of RAM, Intel Xeon E5530 Quad Core

Software Support

• Supported Software
• MapReduce
• Spark
• SparkR
• SparkQL

Actual Image Located at the Wheaton Rice Campus - Room 242