Comments Locked

36 Comments

Back to Article

  • FunBunny2 - Thursday, January 3, 2019 - link

    "The rack is currently installed in an unheated attic and it's the middle of winter, so this setup provided a reasonable approximation of a well-cooled datacenter."

    well... I don't know where your attic is, but mine is in New England, and the temperature hasn't been above freezing for an entire day for some time. what's the standard ambient for a datacenter?
  • Ryan Smith - Thursday, January 3, 2019 - link

    It is thankfully much warmer in North Carolina.=)
  • Billy Tallis - Thursday, January 3, 2019 - link

    I"m in North Carolina, so the attic never gets anywhere close to freezing, but it was well below normal room temperature during most of this testing. Datacenters aren't necessarily chilled that low unless they're in cold climates or are adjacent to a river full of cold water, but servers in a datacenter also tend to have their fans set to run much louder than I want in my home office.

    The Intel server used for this testing is rated for continuous operation at 35ºC ambient. It's rated for short term operation at higher temperatures (40ºC for 900 hours per year, 45ºC for 90 hours per year) with some performance impact but no harm to reliability. In practice, by the time the air intake temperature gets up to 35ºC, it's painfully loud.
  • Jezzah88 - Friday, January 4, 2019 - link

    16-19 depending on size
  • drajitshnew - Thursday, January 3, 2019 - link

    It enough information available for you to at least make a pipeline post clarifies the differences between Z-Nand (Samsung) and traditional MLC/SLC flash
  • Billy Tallis - Thursday, January 3, 2019 - link

    I should have a review up of the Samsung 983 ZET Z-SSD next month. I'll include all the information we have about how Z-NAND differs from conventional planar and 3D SLC. Samsung did finally share some real numbers at ISSCC2018, and it looks like the biggest difference enabling lower latency is much smaller page sizes.
  • MrCommunistGen - Thursday, January 3, 2019 - link

    Very much looking forward to the review!
  • Greg100 - Thursday, January 3, 2019 - link

    It's a pity that we don't have consumer drives that are fast and at the same time have large enough capacity - 8TB. I would like to have a consumer U.2 drive that has 8TB capacity.

    What we have now… only 4TB Samsung and… SATA :(

    Will Intel DC P4510 8TB be compatible with Z390 motherboard, Intel Core i9-9900K and Windows 10 Pro? Connection via U.2 to M.2 cable (Intel J15713-001). Of course the M.2 port on the motherboard will be compatible with NVMe and PCI-E 3.0 x4.

    I know that compatibility should be checked on the motherboard manufacturer's website, but nobody has checked Intel DC P4510 drives and nobody will, because everyone assumes that the consumer does not need 8TB SSDs.

    Anandtech should also do tests these drives on consumer motherboards. Am I the only one who would like to use Intel DC P4510 8TB with Intel Z390, Intel Core i9-9900K and Windows 10 Pro? Is it possible? Will there be any compatibility problems?
  • Billy Tallis - Thursday, January 3, 2019 - link

    I don't currently have the necessary adapter cables to connect a U.2 drive to our consumer testbed, but I will run the M.2 983 DCT through the consumer test suite at some point. I have plenty of consumer drives to be testing this month, though.

    Generally, I don't expect enterprise TLC drives to be that great for consumer workloads, due to the lack of SLC caching. And they'll definitely lose out on power efficiency when testing them at low queue depths. There shouldn't be any compatibility issues using enterprise drives on consumer systems, though. There's no need for separate NVMe drivers or anything like that. Some enterprise NVMe drives do add a lot to boot times.
  • Greg100 - Thursday, January 3, 2019 - link

    Thank you :-) So I will try that configuration.

    Maybe Intel DC P4510 8TB will not be the boot champion or power efficiency drive at low queue depths, but having 8TB data on a single drive with fast sequential access have huge benefits for me.

    Do you think it is worth waiting for 20TB Intel QLC or 8TB+ client drives? Any rumors?
  • Greg100 - Thursday, January 3, 2019 - link

    In Europe we have got:

    Samsung SSD 860 QVO 4TB for € 579 and
    Samsung SSD 860 EVO 4TB for € 625

    So I think it’s time for something bigger and faster…
  • Greg100 - Thursday, January 3, 2019 - link

    especially, when we have many 15.36TB SAS SSDs from every major manufacturer:

    Western Digital Ultrastar DC SS530 15.36TB
    Seagate Nytro 3330 15.36TB
    Toshiba PM5-R 15.36TB
    Samsung PM1643 15.36TB

    with Samsung PM1643 even double capacity: 30.72TB

    ...but we can't use SAS SSD on consumer motherboard...

    so I count on new U.2 drives.
  • phoenix_rizzen - Friday, January 4, 2019 - link

    Well, you can use SAS drives with consumer-oriented motherboards, you just need to add an SAS HBA via one of the PCIe slots. :) An extra cost, for sure, but it's certainly doable. LSI 92xx-8i or similar aren't that expensive.
  • Greg100 - Saturday, January 5, 2019 - link

    Thank you for your advice. You're right, SAS SSDs can be connected to a consumer motherboard, but does it make any sense?

    SAS SSDs are only given as an example that there are even larger than 8TB SSDs available on the market. It's a pity that they are much more expensive for GB than Intel U.2 drives and much slower. The fastest of the above:

    Western Digital Ultrastar DC SS530
    15.36TB
    2150MB/s (Read)
    2120MB/s (Write)

    We can get instead:

    Intel DC P4510
    8TB
    3200MB/s (Read)
    3000MB/s (Write)
    £2,300.78
    (Bleepbox on UK ebay; new, in stock)

    so....
    2x more expensive per GB than Samsung SSD 860 EVO 4TB
    6x faster (sequentially) than Samsung SSD 860 EVO 4TB

    Is it worth its price?

    Is 6x faster CPU worth 2x higher price?
  • Greg100 - Saturday, January 5, 2019 - link

    If someone has to use SAS drives, they pay more for lower performance, but they don't have to rebuild the entire infrastructure.

    For the consumer who wants:

    -big
    -fast
    -cheap

    I think that Intel DC P4510 is the best option

    If someone can find
    8TB SSD 3000MB/s+ read
    cheaper than £2,300.78 let me know...
  • Billy Tallis - Thursday, January 3, 2019 - link

    I don't think we'll see 8TB consumer-oriented drives in 2019, and if we do, they'll make even less sense than Samsung's premature introduction of the 4TB 850 EVO did. Going beyond 8TB will require a new generation of controllers for the consumer market, with support for more DRAM, and that may not be economical until 2TB and 4TB drives are as affordable as 1TB drives are now.
  • Greg100 - Thursday, January 3, 2019 - link

    Thank you for your opinion and information on compatibility.

    So... if I will not see something interesting on CES... I think it is time for Intel DC P4510 8TB (data) and maybe Intel Optane 905P (boot, software)
  • Greg100 - Thursday, January 3, 2019 - link

    One more question:

    Do you know cause and solution to the issues with the 4TB Samsung drives, you describe here: https://www.anandtech.com/show/13633/the-samsung-8... ?
  • Billy Tallis - Thursday, January 3, 2019 - link

    I haven't been able to pin down the cause or fix. One of the troublesome 4TB 860s did start behaving again, but I'm not sure what part of my messing with it accomplished that and I haven't been able to replicate it with the other two. And the 4TB enterprise Samsung SATA drives (860 DCT and 883 DCT) have been trouble-free but haven't been subjected to the full consumer test suite yet.
  • Greg100 - Thursday, January 3, 2019 - link

    Thanks.

    When you will be able to pin down the cause or fix PLEASE make short article about it or include it with the future 860 DCT and 883 DCT consumer test. I think, it can be very important, especially that they are the biggest client SSDs and with last week significant price drop in Europe they are more affordable.
  • ZeDestructor - Friday, January 4, 2019 - link

    Could you do the MemBlaze drives too? I'm really curious how those behave under consumer workloads.
  • mode_13h - Thursday, January 3, 2019 - link

    At 13 ms, the Peak 4k Random Read (Latency) chart is likely showing the overhead of a pair of context switches for 3 of those drives. I'd be surprised if that result were reproducible.
  • Billy Tallis - Thursday, January 3, 2019 - link

    Those tail latencies are the result of far more than just a pair of context switches. The problem with those three drives is that they need really high queue depths to reach full throughput. Since that test used many threads each issuing one IO at a time, tail latencies get much worse once the number of threads outnumbers the number of (virtual) cores. The 64-thread latencies are reasonable, but the 99.9th and higher percentiles are many times worse for the 96+ thread iterations of the test. (The machine has 72 virtual cores.)

    The only way to max out those drive's throughput while avoiding the thrashing of too many threads is to re-write an application to use fewer threads that are issuing IO requests in batches with asynchronous APIs. That's not always an easy change to make in the real world, and for benchmarking purposes it's an extra variable that I didn't really want to dig into for this review (especially given how it complicates measuring latency).

    I'm comfortable with some of the results being less than ideal as a reflection of how the CPU can sometimes bottleneck the fastest SSDs. Optimizing the benchmarks to reduce CPU usage doesn't necessarily make them more realistic.
  • CheapSushi - Friday, January 4, 2019 - link

    Hey Billy. this is a bit of a tangent but do you think SSHDs will have any kind of resurgence? There hasn't been a refresh at all. The 2.5" SSHDs max out at about 2TB I believe with 8GB of MLC(?) NAND. Now that QLC is being pushed out and with fairly good SLC schemes, do you think SSHDs could still fill a gap in price + capacity + performance? Say, at least a modest bump to 6TB of platter with 128GB of QLC/SLC-turbo NAND? Or some kind of increase along those lines? I know most folks don't care about them anymore. But there's still something appealing to me about the combination.
  • leexgx - Friday, January 4, 2019 - link

    Sshd tend to use MLC, Only ones been interesting has been the Toshiba second gen sshds as they use some of the 8gb for write caching (from some Basic tests I have seen)
    where as seagate only caches commonly read locations
  • leexgx - Friday, January 4, 2019 - link

    Very annoying the page reloading

    Want to test second gen Toshiba but finding the right part number as they are using creptic part numbers
  • CheapSushi - Friday, January 4, 2019 - link

    Ah, I was not aware of the ones from Toshiba, thanks for the heads up. Write caching seems the way to go for such a setup. Did the WD SSHD's do the same as Seagates?
  • leexgx - Friday, January 11, 2019 - link

    I have obtained the Toshiba mq01, mq02 and there h200 sshd all 500gb to test to see if write caching works (limit testing to 500mb writing at start see how it goes from There
  • thiagotech - Friday, January 4, 2019 - link

    Can someone help me understanding which scenarios is considered as QD1 and higher? Does anyone have a guide for dummies what is queue depth? Lets suppose i'll start Windows and there is 200 files of 4k, is it a QD1 or QD64? Because i was copying a folder with a large number of tiny files and my Samsung 960 Pro reached like 70MBPS of copy speed, is really bad number...
  • Greg100 - Saturday, January 5, 2019 - link

    thiagotech,

    About queue depth during boot up a Windows check last post: https://forums.anandtech.com/threads/qd-1-workload...

    About optimization Samsung 960 Pro performance check: "The SSD Reviewers Guide to SSD Optimization 2018" on thessdreview
  • Greg100 - Saturday, January 5, 2019 - link

    I have to disagree with the last sentence of this quote about Intel SSD DC P4510:

    “The NAND and DRAM on the inner faces of the two PCBs do not get any airflow or thermal pads bridging them to the case. This lack of cooling is one of the major motivators of Intel's Ruler form factor, now standardized as EDSFF.”

    Intel's main motivation was not cooling, but charging an extra fee for the new format:

    € 5051,90 Intel SSD DC P4500 8TB, HHHL
    € 6060,90 Intel SSD DC P4500 8TB, Ruler
    (Prices: IC-S Austria)

    Proper cooling for inner faces of the two PCBs would be by using AMEC Thermasol Ultra flat Heat pipe (also known as flat aluminium cool pipe) connecting with case.

    but hey… it’s Intel, who make incredible space technology, but can not solder i7-8700K CPU!

    What the eyes don't see, the heart doesn't grieve over ;-)

    Thank you very much Billy for disassemble this SSD.

    So… I will have to use Fujipoly Ultra Extreme XR-m thermal pads with huge Fisher Elektronik passive heatsinks outside. Better would be AMEC Thermasol + Fujipoly Ultra Extreme XR-m inside, but I do not want to void of 5 year warranty.
  • Kristian Vättö - Sunday, January 6, 2019 - link

    You won't find real enterprise SSD pricing online because it's strictly B2B business with volume and numerous other factors playing a big role. One SKU may be more expensive just for the fact that the demand is low, so the distributor/reseller is not getting a volume discount. The reseller may also be marking it up due to it being new, unique and simply low volume, warranting a higher margin.
  • Greg100 - Sunday, January 6, 2019 - link

    You are right. There are many factors that influence the final price. Indeed, the ruler has its advantages: https://www.anandtech.com/show/11702/intel-introdu...
    I just wish, Intel will not neglect the cooling of U.2 2.5" drives, just because it has another format.
  • Greg100 - Sunday, January 6, 2019 - link

    And thanks Kristian, that you read comments. I hope you will remember this:

    Samsung SSD 860 EVO
    4TB
    550MB/s
    520MB/s
    625,47 € (Cloudmarkt, Germany)

    Intel DC P4510
    8TB
    3200MB/s (Read)
    3000MB/s (Write)
    2 300,78 £ (Bleepbox, UK)

    so....
    2x more expensive per GB than Samsung SSD 860 EVO 4TB
    6x faster (sequentially) than Samsung SSD 860 EVO 4TB

    Samsung has also fast U.2 7.68TB SSD, but it’s OEM-Product and no support and warranty for end customers.

    I would pay 2x price for 6x faster SSD, just like I would pay 2x price for 6x faster CPU. So, why Samsung can not make large, fast SSD availably for consumers?

    Please DO NOT LOOK at revenues of Samsung SSD 860 EVO 4TB. PC enthusiasts look for something faster, not obsolete SATA. SATA drives should be for really cheap, huge HDDs using ONLY for backup, not for SSDs.

    And please do not tell me about M.2 drives. U.2 SSDs will always have larger capacity and better thermal cooling than M.2. Always. It is so true like desktop PC will always be faster than laptop. Of course you can make really fast laptop, but you can always have 2x or 3x faster desktop PC. Not everyone need larger or faster so laptops and M.2 always be made, but when somebody, like me, looking for best of the best, large and fast U.2 SSDs are only route right now.
  • Greg100 - Sunday, January 6, 2019 - link

    Fortunately every new motherboard has M.2 port (compatible with NVMe and PCI-E 3.0 x4), so we can connect U.2 SSD via U.2 to M.2 cable (Intel J15713-001).

    I would like to have more motherboards with more number native U.2 ports, that take up much less space than M.2 ports, so we can have many U.2 SSDs mounted in cooler place in desktop PC, just like we have mounted old HDDs.
  • GCappio - Sunday, October 6, 2019 - link

    Just saw a 61.3 TBytes SSD model from Huawei in Rome, Italy during a Huawei Smart City tour, would love to see its performance - but maybe it's not a product you'll see in the USA...

Log in

Don't have an account? Sign up now