Check out my first novel, midnight's simulacra!
X10QBi: Difference between revisions
| Line 8: | Line 8: | ||
* 10QBi-MEM1 2.0: 1600MHz DDR3 (Jordan Creek 2) | * 10QBi-MEM1 2.0: 1600MHz DDR3 (Jordan Creek 2) | ||
* 10QBi-MEM2 1.01: 1866MHz DDR4 (Jordan Creek 2) | * 10QBi-MEM2 1.01: 1866MHz DDR4 (Jordan Creek 2) | ||
The X10QBi supports ECC memory, correcting single-bit errors and detecting double-bit errors. Jordan Creek is a "Scalable Memory Buffer" capable of running in "lockstep" or "performance" mode. In Lockstep, the SMB runs at the same speed as the DIMMs, you can recover from two faults, less power is consumed, and bandwidth is diminished. Performance mode uses two DIMMs per memory channel, consumes more power (approximately 9W vs 7W), and can recover from a single fault. Each processor supports four controllers, and each controller supports 6 DIMMs. With all four sockets populated, this yields 96 DIMMs on sixteen controllers. 32GB DIMMs in all 96 slots yield 3 terabytes of RAM. Each socket is wired to two memory boards, two controllers per board, and thus all eight boards | The X10QBi supports ECC memory, correcting single-bit errors and detecting double-bit errors. Jordan Creek is a "Scalable Memory Buffer" capable of running in "lockstep" or "performance" mode. In Lockstep, the SMB runs at the same speed as the DIMMs, you can recover from two faults, less power is consumed, and bandwidth is diminished. Performance mode uses two DIMMs per memory channel, consumes more power (approximately 9W vs 7W), and can recover from a single fault. Each processor supports four controllers, and each controller supports 6 DIMMs. With all four sockets populated, this yields 96 DIMMs on sixteen controllers. 32GB DIMMs in all 96 slots yield 3 terabytes of RAM. Each socket is wired to two memory boards, two controllers per board, and thus maximum bandwidth requires all eight boards, with at least 4 DIMMs per board, in "Performance" mode. | ||
The manual claims that MEM2 boards are required to use v3/v4 Xeons, but my experience is that these newer processors work fine with MEM1, so long as you have the most recent firmware. | The manual claims that MEM2 boards are required to use v3/v4 Xeons, but my experience is that these newer processors work fine with MEM1, so long as you have the most recent firmware. | ||
Revision as of 21:14, 3 May 2023
A SuperMicro motherboard supporting four LGA2011 CPUs and eight SuperMicro memory boards. The physical board comes in at least versions 1.01, 1.2a, and 1.21. It requires a SuperMicro AOM-X10QBi-A/L I/O board to boot (the card uses a proprietary slot). This card implements BNC/IPMI, offers two 10GigE ports via an Intel controller, and supports VGA. The chipset is Intel C602J.
Contrary to some information online, it boots just fine off a single CPU in Socket 1. It requires about five minutes to reach UEFI handoff, and goes through several dozen boot codes (some of them repeated) before doing so. Similarly, you can boot off any subset of CPU sockets, so long as there's one in socket 1, and there is working memory on board 1.
Memory boards
There are 8 slots for SuperMicro memory boards, of which there are three variants (different boards cannot be mixed):
- 10QBi-MEM1 1.01: 1333MHz DDR3 (Jordan Creek 1)
- 10QBi-MEM1 2.0: 1600MHz DDR3 (Jordan Creek 2)
- 10QBi-MEM2 1.01: 1866MHz DDR4 (Jordan Creek 2)
The X10QBi supports ECC memory, correcting single-bit errors and detecting double-bit errors. Jordan Creek is a "Scalable Memory Buffer" capable of running in "lockstep" or "performance" mode. In Lockstep, the SMB runs at the same speed as the DIMMs, you can recover from two faults, less power is consumed, and bandwidth is diminished. Performance mode uses two DIMMs per memory channel, consumes more power (approximately 9W vs 7W), and can recover from a single fault. Each processor supports four controllers, and each controller supports 6 DIMMs. With all four sockets populated, this yields 96 DIMMs on sixteen controllers. 32GB DIMMs in all 96 slots yield 3 terabytes of RAM. Each socket is wired to two memory boards, two controllers per board, and thus maximum bandwidth requires all eight boards, with at least 4 DIMMs per board, in "Performance" mode.
The manual claims that MEM2 boards are required to use v3/v4 Xeons, but my experience is that these newer processors work fine with MEM1, so long as you have the most recent firmware.
Boot codes
If the machine immediately goes to state FF and doesn't leave, the CPU output ports are not being written to. You have either a bad motherboard, at least one bad processor, and/or at least one badly-seated processor.
Updating BIOS via BMC
The most recent BIOS is 3.2 from 2019-08-08, X10QBi9.808.
[schwarzgerat](0) $ ./SMCIPMITool BMCADDRESS USERNAME PASSWORD bios update BIOSFILE --reboot Option: SMBIOS preserve =============== BIOS Image info =============== Date = 08/08/2019 MB Type = X10QBi Size = 16 MB ============= BIOS ROM info ============= 0726 BIOS Date: 6/12/2018 ==================== Uploading BIOS image ==================== Progress:|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 100% Upload Time: 0 min 48 sec(s) ============= Updating BIOS ============= Progress:|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 100% Update Time: 5 min 33 sec(s) Total Elapse Time: 6 min 38 sec(s) Done [schwarzgerat](0) $
See Also
- My machine strangelet is based on the X10QBi platform
