By: Munira Hussain and Kevin Tubbs
The Intel Xeon Phi Coprocessor boosts and aggregates the parallel processing power of computation in a cluster. It is designed to expand on parallel programming model of Intel Xeon processors and benefit the applications that are able to scale. Similar to the processor on the systems that are cache coherent and share memory, the Intel Xeon Phi Coprocessor is SMP on a chip and connects to other devices in the system via the PCIe bus.
To install and configure Intel Xeon Phi Coprocessors, the administrator must install the Intel Manycore Platform Software Stack (MPSS) and provide initial configuration of all the coprocessors in a cluster. Installing and configuring a new piece of technology can be complex and time-consuming. This blog provides detailed steps and best practices to get started with Xeon Phi.
Note that such a solution setup has also been simplified with the Bright Cluster Manager software. The drivers and software needed for Intel Xeon Phi are integrated in the software stack for ease of deployment and provisioning.
Pre- Install Configuration:
If the Xeon Phi coprocessor is detected by the hardware (“lspci”) but is not recognized by the Intel tools, confirm that the BIOS has the following setting enabled.
Enable large BAR setting: Integrated Devices >> Memory I/O larger than 4GB in Bios Settings >> Enabled
This can also be done with Dell Deployment Tool Kit 4.2 or higher using the “syscfg” tool from the operating system.
>> /opt/dell/toolkit/bin/syscfg -- MmioAbove4Gb=enable
Setting up Host Nodes:
Install the Host nodes with Bright Cluster Manager 6.1 that includes the Intel MPSS. The host nodes refer to the nodes to which the Intel Xeon Phi are connected via PCI slots.
The main drivers and tools are bundled in rpm format in Bright Cluster Manager. These are extracted from Intel MPSS and made easy to deploy. Four main components: intel-mic-cross, intel-mic-driver, intel-mic-ofed, intel-mic-flash and intel-mic-runtime are installed on the host nodes.
The k1om packages are meant to run inside the Intel Xeon Phi. The packages deployed are libgcrypt-k1o, slurm-client-k1om, strace-k1om, munge-k1om, libgpg-error-k1om
b. Then configure the network bridge IP that is between the host node and Intel Phi for communication purpose. Bright Cluster Manager tool automatically checks IP conflicts across the Intel Xeon Phi in the cluster that are connected.
c. This tool automatically creates and assigns IP to the Intel Xeon Phi. At this stage the Intel Xeon Phi can now be recognized and managed/monitored from the Bright Cluster Manager.
Dell’s HPC offerings with the Xeon Phi are supported on the PowerEdge R720 and C8220x servers. More info:
Dell HPC Solutions: http://www.dellhpcsolutions.com/
Bright Computing: http://info.brightcomputing.com/intel-xeon-phi/
Intel Corporation: http://www.dellhpcsolutions.com/dellhpcsolutions/static/XeonPhi.html