Cloud Hadoop Operations Lab
For a while I wanted to publish the research capabilities of Professor Jeremy Hajek for the Cloud and Operations research group in the Information Technology and Management Program Program at the School of Applied Technology.
Current Hardware Platform - as of 12/09/20
Current applications include:
- 5 node Hadoop 2.8.5 Research Cluster
- 197 GB RAM and 47 processors available.
- 1 Pfsense 2.4 VPN router for access to the cluster
- 1 Instance of Cobbler 2.8.x for network based installs
- Use of Riemann for metric and event routing
- 1 instance of Grafana for visual inspection of metrics
- 2 instances of Docker running on Ubuntu 16.04 LTS
Current Hardware
- Namenode - 1.8 TB of storage, 32 GB of RAM, AMD FX 6100 Hexacore
- Datanode1 - 3.6 TB of storage, 94 GB of RAM, 2x Intel Xeon E5530 Quad Core
- Datanode2 - 2 TB of storage, 56 GB of RAM, 2x Intel Xeon E5530 Quad Core
- Datanode3 - 2 TB of storage, 32 GB of RAM, 2x Intel Xeon E5504 Quad Core
- Datanode4 - 2 TB of storage, 24 GB of RAM, AMD FX 6100 Hexacore
- Datanode5 - 2 TB of storage, 32 GB of RAM, Intel Xeon E5530 Quad Core
Software Support
- Supported Software
- MapReduce
- Spark
- SparkR
- SparkQL