/r/storage

Photograph via snooOG

A subreddit for enterprise level IT data storage-related questions, anecdotes, troubleshooting request/tips, and other related discussions.

A subreddit for enterprise data storage-related questions, anecdotes, troubleshooting request/tips, and other related discussions.

Areas of interest for this sub include: SAN, NAS, EMC, HPC, HDS, HP/3PAR, Violin-Memory, Dell/Compellent, NetApp, IBM, Pure Storage, Nimble Storage, Cisco, Sun, Seagate, Symantec, Western Digital news, discussion, and information.


Rules:

  1. Please try to keep submissions on topic and of high quality.
  2. Submissions must relate to enterprise level IT data storage. For posts about your home NAS you might be better posting to /r/homelab or /r/datahoarder .
  3. Don't post links to your personal or corporate storage/IT-related blog. Text posts referencing your blog are okay. See Rule 1.
  4. Do not post sponsored content. This includes blogs written by vendors and/or IT review websites.
  5. Please follow proper reddiquette.
  6. Report any posts/comments that violate the above rules and a mod will investigate. Also, feel free to contact any of the mods if you wish to discuss the rules.

Related Reddits:

/r/EMC2

/r/NetApp

/r/sysadmin

/r/vmware

/r/linux

/r/hpc

/r/datahoarder

/r/zfs

/r/storage

29,241 Subscribers

2

Storage suggestions for VFX Studio

Hi everyone,

I work in a VFX studio and we are currently thinking about expanding our storage.
As of now we only have stand alone systems (a couple of QNAP and TrueNAS),
but since we're growing pretty fast -and so is the data we handle- we would like to move to a more
scalable and performant system.

Since we handle pretty big files and access them a lot, high throughput and fast r/W would be best,
so the idea is a system with at least 200TB ssd/nvme, 100G NICs that could be scaled.

I'm researching online and at the moment some of the candidates are:

・NetApp: the thing itself is nice but even if the model they presented us is full NVMe it is
bottlenecked by the hardware (HBA) and so it's kind of a waste. Plus the price is really high...

・Qumulo: I saw able to take a look on a 4 node cluster, and it's pretty nice as well.
Only thing is that every node only had 9 HDDs apparently and so the throughput was not that impressive, especially writes. Not sure about the pricing.

・Isilon. Never tried it but the pricing and maintenance fees are not attractive...

I'm sure there are other, maybe better systems, so it would be great if I could hear opinions from more experiences admins.

Also if other details are needed I'll add them here or in the comments,
I'm sure I'm forgetting something.

Thanks in advance,
cheers!

14 Comments
2024/12/04
04:05 UTC

2

iSCSI network recommendation

Hy!

My deployement will include two Aruba switches for only iSCSI communication. The servers has 2 NIC for iSCSI, the storage has 2 NIC/controller, so summary 2 servers has 4 NICs and the storage has 4 NICs.

What do you think? Can I configure only one subent for all iSCSI communication, so I plan to use the following subnet: 10.10.100.0/24, and assign to each iSCSI NICs one IP address from this subnet? It will be correct solution?

So, storage controller addresses:

A1: 10.10.100.5

A2: 10.10.100.6

B1: 10.10.100.7

B2: 10.10.100.8

Servers addresses:

Server1: NIC1 (iSCSI1): 10.10.100.1

Server1: NIC2 (iSCSI2): 10.10.100.2

Server2: NIC1 (iSCSI1): 10.10.100.3

Server1: NIC2 (iSCSI2): 10.10.100.4

The two Aruba switch will not part of the production LAN. The two servers are in Hyper-V Failover Cluster.

Thanks.

7 Comments
2024/12/03
20:06 UTC

0

How Do I Force FolderSync to Overwrite Existing Files?

I'm using FolderSync to back up app settings from Google Drive to Dropbox. Problem is, the backup file always has the same filename, so it's not detecting the file as new. I've messed with settings but can't crack it. What settings might force an overwrite?

Also, can I set it to sync instantly when a change happens instead of waiting for scheduled intervals?

0 Comments
2024/12/03
14:39 UTC

2

HPE vs IBM vs Dell

Hey,

I'm trying to understand the product differentiation between HPE's Greenlake for Block, IBM's FS series and Dell's PowerStore/PowerMax. Any suggestions? I know that HPE has something called DSCC, but not sure if it's worth it? Also, IBM doesn't sall "all-inclusive", anyone knows if the TCO in the lung run will be higher than the others?

59 Comments
2024/12/03
10:27 UTC

0

Is Backing Up Files to Multiple Cloud Services Overkill?

I back up my files to Google Drive, Dropbox, and Bitwarden. I feel like I need to use three services in case I lose access to one or if one of them shuts down.

It's driving me mad, though—constantly uploading to all three, deleting old backups, and managing everything. Does anyone else do this, or do you stick to just one cloud service? Am I overthinking it?

5 Comments
2024/12/03
08:36 UTC

1

Shared storage solutions

I'm working on a shared storage solution, and currently, we are using a Windows HA NFS server. However, we've encountered issues with failover not being smooth, so I'm exploring alternatives. Here's what I've considered so far:

  • Distributed File Systems (Ceph, GlusterFS): These don't seem ideal for our setup since we already have Pure Storage, which is centralized. Adding another layer seems unnecessary.
  • Cluster File System (GFS2): Our systems team has tried this before but found it complex to manage. When failures occur, it often impacts other servers, which is a concern.
  • TrueNAS SCALE: I have no experience with it and am unsure how it works under the hood for HA scenarios.
  • NFS Server on Kubernetes: While this is an option, it feels like adding another layer of complexity.
  • Linux HA NFS Server: our systems team has tried this before but they says windows is more easier

Are there other alternatives I should be considering? What are the best practices for setting up a reliable and smooth failover NFS solution in an environment with existing centralized storage like Pure Storage?

Any advice or shared experiences would be greatly appreciated!

30 Comments
2024/12/03
08:01 UTC

2

Large-Scale Global Cloud Storage - Recommendations?

Hi there - looking for some recommendations. We're looking to move a large amount of our storage to the cloud and would like to split it up across 2, 3 or even 4 physical locations. Looking at nearly .5 PB in total.

Due to the very active nature of the data being stored, products like AWS Glazier are not an option.

Azure, AWS and similar vendors seem to be very, very expensive at this level, so I'm looking for alternatives. Could be a single global operation, or a couple smaller regional. Really just need Linux VMs with limited compute, but access to large amounts of cheap but relatively fast storage.

Any vendor recommendations?

6 Comments
2024/12/03
01:10 UTC

0

My brand new micro sd seems broken?

So I just bought a brand new 128gb sansdisk sd card for this game that cant fit on my phone. (A32 5g, only 64gb storage.) I tested it out by putting smaller games on it and it worked fine. The issue is when I try to put my new game on it, it tells me that theres not enough space even though the SD card shows 0% storage and 119gb free. The game before the huge download is 3gb and around 20gb after. The plan was to move the game to the sd while it was small and just update it after but the card seems to not be able to handle it? I tried another game, 1.5gb, and same story. When I tried a third game,0.93gb, it worked out. Im just confused as to why my straight out the packaging and formatted on phone and computer sd card seems to have less than 1gb of storage. Please help!

9 Comments
2024/12/03
01:04 UTC

2

LUN id change

Hi , I have rocky 9.5 when I change lun id from storage array and rescan from host, I still see the old lun and respective drive. How do I refresh it with valid disk only.

2 Comments
2024/12/02
18:25 UTC

0

What does WD stand for?

0 Comments
2024/12/02
17:58 UTC

0

Want a certificate about storage and backup that includes AI and data science.

Hello guys, Iam interested in both storage, backup and AI, data science, iam looking for a certificate that combines them really good.

Iam searching for a professional certificate that talks about automation backup jobs, etc...

Automation, Machine Learning, these kinds of topics.

Thank you guys so much.

0 Comments
2024/12/02
13:05 UTC

1

Can SFF-8088 cables be single lane?

I have an HP 430063-001 SAS SFF-8088 to SFF-8088 cable. When using this to attach to a SuperMicro 836TQ Backplane just the first lane on the SFF-8087 discovers the drive. Moving the same drive to the other slots results in it being not detected/no spin up. I’ve tried this is all 4 ports of an LSI 9201-16e across 4 different SFF-8088 to SFF-8087 cabling.

The cable is listed as a “4M SFF-8088 to SFF-8088 - Connects to HP StorageWorks 1U SAS Rack Mount Kit”. I know this is usually used for a SAS Tape Drive.

Could this cable only be carrying 1 lane thus the results?

Is there something I’m missing related to the 836TQ? I’ve checked and reseated everything.

I do have a CableCreations SFF-8088 cable on order.

Thoughts?

3 Comments
2024/12/02
03:44 UTC

0

Best Solution for Storage For Remote Work

I need to set up some form of storage solution for remote staff to be able to copy over larger files from me easily. What would be the best solution for quickly sharing files like that. Would something like Filezilla be good, or is there a better method. While setting up something like a NAS could be good long-term, I would ideally need it to be something where the files can be automatically accessed by the remote user the second I plug in an external drive up. I want to avoid having to first copy files from the external drive to a drive actually accessible to the other person.

10 Comments
2024/12/01
17:26 UTC

0

These still worth it?

Just wondering what's people opinion is regarding getting Intel DC 4510 U.2 for desktops nowadays ? They have crazy write cycles. I can get 1TB one brand new (new old stock I think) for USD89; 2TB 139.

Thinking of using this and tinkering with PCIe Oculink adapter to hook this up and forget about it forever. LOL.

Also these oculink card with self bifurcation (my motherboard, Asus X99 WS does not have bios support for bifurcation) is cheaper than non-oculink.

3 Comments
2024/11/30
22:43 UTC

0

I have a huge 72TB raspberry pi 5 storage server - with a public dashboard for stats!

8 Comments
2024/11/29
20:52 UTC

1

Secondary SAN Issues

Anyone have a good starting point to check why a secondary SAN isn't taking over when the Primary is turned off? Management is through Dell Unisphere.

5 Comments
2024/11/26
23:37 UTC

1

Dell EMC storage expansion

A company I am working with said that a few years ago they accidentally purchased an extra Unity 300 EMC and it has just been sitting in the box for years because they had no use for it. Does anyone know if it is capable of being set up as a simple disk shelf expansion with their existing unity just by connecting it with SAS cables or is the only way they can add the additional storage to set it up in standalone mode?

6 Comments
2024/11/25
18:11 UTC

0

adding new drive. did i do it right?

so i added this Seagate 2TB to my storage pool with the Samsung ssd 1TB. it doesn't show up in file explorer is it just a part of my Z drive now?? or did i not to it properly. it also started optimizing by its self transferring the files to the new drive but i cannot see the file locations. i have already formatted it.

https://preview.redd.it/3obyg83bgs2e1.png?width=1027&format=png&auto=webp&s=dc4105c1cbaea7c1c3667cb099a204725b4eb043

0 Comments
2024/11/24
05:48 UTC

4

SAN storage demo

TLDR: I was asked to create a 15-minute practical demo/presentation about SAN/NAS enterprise storage. I need help coming up with something interesting for the general (upper/middle management type) public.

For the demo, I can use a few storage arrays with HDD disks (Old Dell StorageCenter/PowerVault/NetApps). (Really fun NVMe storage is under heavy load in production usage, so I will not touch it). I can also have Linux/ESX/Windows servers.

Does anybody have any ideas on what to show before the audience goes to sleep?

13 Comments
2024/11/23
15:44 UTC

3

Architecture Whiteboarding

Dear All,

I’m looking to refresh my storage knowledge after a decade of focusing on virtualization and HCI. With customers shifting back to external storage, I’d appreciate guidance from anyone experienced in comparing and architecting solutions across vendors like Pure, Dell, HPE, NetApp, and IBM.

Your insights would be invaluable in helping me get back up to speed.

Thanks in advance!

5 Comments
2024/11/23
02:52 UTC

2

Saw my first HPE Closed-loop liquid cooling option in person on a Alletra 4110 Storage Server at the HPE CIC in Houston. I gotta say it was pretty friggin' cool (pun intended)! It was also the 20x EDSFF model so the cabling and backplane was quite busy with the liquid cooling also tossed in there!

0 Comments
2024/11/22
23:00 UTC

0

Google Photo Storage

I was paying for the 2tb option of Google photos storage but I decided to cancel today and it brought me to 15gb so I have till the 21st of December to bring it down to 15gb or everything I have on there will be deleted. I know stupid question but how would I be able to do that it's mostly movies I've downloaded from links so how would be the easiest way of transferring them? Buy a 2tb harddrive and just download them on there? Thanks.

1 Comment
2024/11/21
22:02 UTC

17

Pure vs EMC Powerstore

Hello everyone

We have shortlisted Pure and Powerstore to replace our aging scv3020 Compellent arrays.

Powerstore 500T vs either an X or C series from pure. I’ve sat through a month of sales and SE calls, read white paper and watched numerous training videos. I think I want to go to pure but wanted to see what the community thinks. Would anyone who owns one of these be so kind as to share your experience please? I want to see what the real world says vs the sales and marketing jargon.

Are you getting 4:1 or more dedupe? Great IOPS? Issues with support or upgrades? Integration into vSphere 8.x ?

Thank you

52 Comments
2024/11/21
18:37 UTC

5

Guidance Required for HPE Alletra MP and 3-Site DR Setup

Hi,

I am seeking guidance on the following:

We plan to use HPE Alletra MP for Block and set up a 3-Site Disaster Recovery (DR) architecture with the following replication setup:

  1. Site A to Site B and Site C
  2. Site B to Site C
  3. Site C to Sites A and B

Our NDR (Near DR) is Site B, located approximately 100 km from Site A. Site C is in a geographically remote location, potentially in another country or in the cloud.

Could you please clarify:

  1. Can this setup be achieved with HPE Alletra MP?
  2. What are the best practices for implementing such a 3-Site DR architecture?
  3. Can L2 or L3 connectivity be used for replication between Site A and Site B?
  4. Is an FCIP router required for this setup?
  5. Are there any reference architectures or similar use cases recently implemented?

Additionally, Site B and Site C will host a minimal number of systems. Any reference points or insights on HPE Peer Motion for this architecture would be greatly appreciated.

Thank you in advance for your assistance!

8 Comments
2024/11/21
12:49 UTC

1

sfp failure rates ME4024

I’ve got a couple ME4024 SANs which we’ve had for a couple years and are directly connected to 4 node clusters of ESXi hosts. Lately I’m replacing a SFP on the SAN weekly after doing all the tests to confirm the issue is on the SFP on the SAN. The SFPs that came with the SANs are FTLF8529P4BCV-D2.

The issue typically starts with a drop here and there, some CRC errors, then bam! The path is down and no amount of port resets or reseating gets it back up.

Anyone know if this is a known problem with these SFPs? I have dozens of other HP and Pure SANs in the environment and hardware issues are very very rare.

1 Comment
2024/11/21
02:24 UTC

3

Storage hp 2062 power indicator is orange

Hi, I have bought hp 2062 after I power it on yesterday, it turns on but power indicator is orange, is it normal or one of the powers is faulty?

1 Comment
2024/11/19
05:34 UTC

Back To Top