/r/homelab
Welcome to your friendly /r/homelab, where techies and sysadmin from everywhere are welcome to share their labs, projects, builds, etc.
Labporn Diagrams Tutorials News
Please see the full rules page for details on the rules, but the jist of it is:
Don't be an asshole.
Post about your homelab, discussion of your homelab, questions you may have, or general discussion about transition your skill from the homelab to the workplace.
No memes or potato images.
We love detailed homelab builds, especially network diagrams!
Report any posts that you feel should be brought to our attention.
Please flair your posts when posting.
Please no shitposting or blogspam.
No Referral Linking.
Keep piracy discussion off of this subreddit.
All sales posts and online offers should be posted in /r/homelabsales.
Before posting please read the wiki, there is always content being added and it could save you a lot of time and hassle.
Feel like helping out your fellow labber? Contribute to the wiki! It's a great help for everybody, just remember to keep the formatting please.
/r/sysadmin - Our original home. Splintered off from this sub-reddit.
/r/networking - Enterprise networking.
/r/datacenter - Talk of anything to do with the datacenter here
/r/PowerShell - Learn Powershell!
/r/linux4noobs - Newbie friendly place to learn Linux! All experience levels. Try to be specific with your questions if possible.
/r/linux - All flavors of Linux discussion & news - not for the faint of heart!
/r/linuxadmin - For Linux Sysadmins
/r/buildapcsales - For sales on building a PC
/r/hardwareswap - Used hardware, swap hardware. Might be able to find things useful for a lab.
/r/pfsense - for all things pfsense ('nix firewall)
/r/HomeNetworking - Simpler networking advice.
/r/HomeAutomation - Automate your life.
/r/homelab
I bought a X9 Supermicro board from eBay. Upon entering BIOS, it shows as wrong model (however on the actual physical motherboard it clearly is the correct model corresponding to the model i bought). First, everything seemed to work anyway. But after more testing, it turns out there is not the same PCIe slot layout on my board as in the current bios, so the settings are wrong and some PCIe slots doesn't work and/or can not be changed with bifurcation properly (bios has wrong settings).
Can I just flash the correct bios from Supermicro´s website with a bootable DOS usb stick as usual, or is there risk of bricking the board? Or, is there a preferred approach of flashing the correct bios when the current bios is of wrong model?
PS. The price was really good, so I'd rather get it working than return it to the seller. Thanks!
I have a spare gtx 970. Any ideas for a reason to put it in my system? I would like to:
Is the gtx 970 too old? Too low vram? Any other uses for this card? What do you use gpus for?
Hey all.
I'm new to building labs. I'm wanting to get a server for plex and a variety of games.
The best way I can think of doing this is to run an OS that's designed to run VM's. From there I could run a VM for UNraid(For plex).
I can also run an OS for the video games I want to host.
Is that a good way to go about things? any recommendations etc?
Thanks
I'm in the process of setting up an LXC jump host on my network using ProxmoxVE so I can access some of my VMs remotely through SSH. My current setup is
/etc/ssh/sshd_config
that looks like this:
Include /etc/ssh/sshd_config.d/*.conf
Port 22425
LogLevel VERBOSE
PermitRootLogin no
PubkeyAuthentication yes
AuthorizedKeysFile .ssh/authorized_keys
HostbasedAuthentication no
IgnoreRhosts yes
PasswordAuthentication no
PermitEmptyPasswords no
KbdInteractiveAuthentication no
UsePAM yes
AllowAgentForwarding yes
GatewayPorts yes
X11Forwarding no
PrintMotd no
AcceptEnv LANG LC_*
Subsystem sftp /usr/lib/openssh/sftp-server
AllowUsers sshUser
If I run systemctl status ssh
I get
root@Jump-Host:/home/sshUser# systemctl status ssh
* ssh.service - OpenBSD Secure Shell server
Loaded: loaded (/lib/systemd/system/ssh.service; enabled; vendor preset: enabled)
Active: active (running) since Sat 2024-04-27 00:38:52 UTC; 2s ago
Docs: man:sshd(8)
man:sshd_config(5)
Process: 393 ExecStartPre=/usr/sbin/sshd -t (code=exited, status=0/SUCCESS)
Main PID: 394 (sshd)
Tasks: 1 (limit: 77096)
Memory: 1.7M
CPU: 62ms
CGroup: /system.slice/ssh.service
`-394 "sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups"
Apr 27 00:38:52 Jump-Host systemd[1]: Starting OpenBSD Secure Shell server...
Apr 27 00:38:52 Jump-Host sshd[394]: Server listening on port 22425.
Apr 27 00:38:52 Jump-Host sshd[394]: Server listening on :: port 22425.
Apr 27 00:38:52 Jump-Host systemd[1]: Started OpenBSD Secure Shell server.0.0.0.0
and with this setup I can access the host locally with ssh -i ~/.ssh/homelab-keyfile
sshUser@10.0.1.253
-p 22425
, but if I try and use ssh -i ~/.ssh/homelab-keyfile sshUser@publicIP -p 22425
from a remote host, the connection times out entirely.
The part I can't figure out is that if I change the SSH server to listen on port 22 instead, and then change the pfSense port forward rule to redirect packets from WAN port 22/tcp to the SSH server on the same port, I can connect to the jump host both locally and remotely. I've also verified that the firewall isn't active with ufw status
(it returns Status: inactive
)
I can't for the life of my figure out why the remote SSH works on port 22 but not on port 22425. I know moving it to another port isn't really security, but I want to avoid the amount of connections that hammer my SSH port if possible. Any ideas on what to look for here?
I’m assuming most people are using TrueNAS - I’m preparing to plan out what to use, and have pretty much landed on SCALE, but wanted to see if I’m missing anything. I’ll be running 128 threads with 256GB of RAM and around 6TB of NVME U.2 drives and then 4x 12TB NAS drives. I’ll have two clusters (3 nodes each) accessing this as I’m demoing XCP-NG along side my existing ProxMox environment.
I've installed AGH on my M1 Mac Mini since I don't use it at all and decided to put it to some good use. Everything is set up and I have access to the web interface. I've access my NetGear CAX80 router settings online and I've changed my DNS settings to the 192.168.127 address that AGH said I should use.
One thing I've noticed is that the 192.168.127 address is the same address as my Mac Mini so I am guessing its using that as the DNS server since the Mac Mini has to stay on in order to have AGH work. My router IP address is 192.168.1.1 but for some reason that IP address shows up on every mobile device I have as its DNS address even though I've manually changed it on my router. I have restarted my router a couple of times as well and have had this set up for a couple of weeks now.
Does anyone know why my devices are not connecting to the correct 192.168.127 address but instead are connecting to the 192.168.1.1 address of my router? If I manually change the DNS server address on my iPhone it would automatically start working and blocking ads but I want this to be set up as a network-wide and rather avoid doing this manually for every device. DHCP server option is turned on and my Mac Mini address has been entered there. I just don't know how to make the DHCP server push out the correct 192.168.127 address instead of its own 192.168.1.1 address.
TIA!
So i managed to snag a AS4610-54P switch for $100 that I'm gonna try out in my homelab.
But i have no idea what kind of OS to run on it.
It comes with ONIE installer so i can install an OS on it, but i don't know anything about switch OS. I don't mind having to learn how to use CLI for everything, but it would be a big plus if there was an OS with a webui.
What kind of OS would be best to use? I don't mind paying for one as long as it's not over $100.
TLDR; Is there a specific way to confirm that the HBA controller can handle the disk size I want to use?
The long way; I recently started looking into expanding into the 100+ TB storage range and I find myself at a loss to confidently purchase the hardware. A disk array seems like a good fit for my application, in particular a NetApp DS4243 or similar array. I've read many times that a LSI 9201-16E HBA controller will be able to recognize drives over 2 TB and I'm almost willing to accept that. What's bugging me is that no one explains why the HBA controller can handle the larger disk sizes. So what is the best way to be sure that the HBA controller works with the hardware we want to deploy?
This might be a long shot because it is such a unique setup but…
I’ve got an IPv6 only VLAN for my homelab that I use for testing various software and hardware to see if they are fully functional in an IPv6 only environment. That segment has a DHCPv6 server, DNS, and I have a central PXE/HTTP/TFTP boot server for installing an OS or booting to a utility ISO that is reachable from any VLAN.
I’ve got a Dell R440 and a Dell R430 from the scrap heap at work. The R440 booted up using UEFI HTTP without any issues. The R430 says it supports PXE over IPv6, but it gets lost at boot.
It gets an address from the DHCPv6 server but it seems to be either ignoring the RA from the router or something else weird. It never tries to connect via tftp to get the boot image - instead it just pumps out neighbor requests like it has no default route. Wireshark shows it gets everything from DHCP like it should and the RA appears correct.
So has anyone else booted an R430 or similar generation Dell using PXE over IPv6 ?
Virtual clients on the R440, which is running RHEL8 and acting as a KVM host for testing, boot with either PXE or UEFI HTTP without issues so this feels like something specific to the Dell hardware.
The R430 has the Broadcom 1G ports, the R440 has a newer chipset IIRC.
Like I said, it’s a long shot to ask for help here for something this specific but I hope I’m not the only IPv6 tinkerer here.
I’ve got a pretty beefy Gen9 HPE server with 30TB of storage. I had high aspirations of a fun homelab but work and kids take up most of my time so it’s transformed in to a Plex Server and a host for Homebridge.
I’ve been on TrueNAS (FreeNAS) for 6 years or so but I’ve found that their support for jails/plugins has been lacking in the past couple years so keeping Plex and Homebridge up to date has been more of a task than it should be.
It should be said that I’m still on TrueNAS core and from my research, moving to TrueNAS scale may fix some of my issues but could lead to others.
Do I just stick with what I know? Do I look at something like Proxmox for VM’s for Plex and Homebridge?
Appreciate any insight.
Hi all, I'm just getting into setting up my homelab, so sorry if I'm making rookie mistakes.
What I'm trying to achieve, is to self host some services.
I've chosen to run Rancher via Docker (Compose). (is this my first mistake?)
In Rancher, I've created two deployments: one for Nginx (Proxy Manager), one for Heimdall.
Rancher (and its web ui) run via Docker on the host, Nginx runs in a pod using Rancher, and any other services (at the moment just Heimdall) run on Rancher and should be accessed through Nginx.
I want to be able to access every service on port 443, but route them depending on the subdomain I use.
I have almost been able to make it work, but I'm failing to be able to access the Rancher web ui and the other services at the same time.
I've tried two situations:
1. Rancher with network_mode host
Almost everything works great, and I don't have to declare every single port in the compose file and restart the Docker container.
Problem is, I want the Nginx to listen on port 443 (and this works), but the Rancher web ui also runs on 443 and I can't find a way to change this. Therefore, I'm able to access every service through Nginx, but I can't access Rancher web ui because it's hidden by Nginx (when I scale down the Nginx pod to 0, I'm immediately able to access the Rancher web ui).
2. Rancher with default network_mode (bridge)
The idea here is to not run the Rancher container with host network, so I can use port forwarding to run the Rancher web ui on a different port (so I can keep nginx on 443).
So in the compose file, I forwarded 443 to 8443 (Rancher), and 8444 to 443 (Nginx). In Rancher, I forwarded the Nginx pod from 443 to 8444.
Now, I can access Rancher (through Nginx), and I can hit the Nginx reverse proxy, but the proxy is unable to access the other services running through Rancher. When trying to access in the browser, I get a 502 bad gateway error. When I bash into the container and try to curl to the service, I indeed get a connection refused.
Question
How can I achieve what I'm trying to do? Am I missing something easy? Should I just run Rancher and its web ui on bare metal?
Thanks in advance!
I am currently hypothesising a home network architecture and would like to have two routers in my home network. (1) My ISP Router where all my devices are connected for myself and my housemates, (2) My Server Firewall/Router running Sophos XG Home.
I would like this configuration as my Home Server is not always on, and this allows all my devices to always be connected to the internet. It also allows me to configure my Homelab network with more control over DNS, VLAN, etc. Additionally, I move to different locations often, and this allows a simple plug and play for my server to work as the ISP network is simply seen as WAN and doesn't affect IP Adresses, etc in the server network.
However, I haven't tested it, but I believe I will have an issue to easily RDP or SSH to my Server VMs from my ISP Network due to the NAT. I will also have an issue to get my IOT Devices to connect to the server network and to home assistant.
I understand the current options (1) I may be able to allow connections on Sophos XG from WAN (ISP Router) to allow connections from my IOT Devices, and I may be able to port forward my Servers to the WAN (ISP Router) so I can SSH/RDP.. however this may get complex as I add more VMs, etc as I will need to configure a lot of port forwarding on different ports. (2) I may be able to VPN into my server network, but this won't fix the issues around IOT Devices being able to have connectivity from my ISP Network. It also can be combersome to setup VPN on all devices, and would prefer not to have to do this.
What options/considerations do I have to make a seamless expierence? Would be great to have a solutions which I can plug/play my server into any network, and have it running, and with connectivity to my IOT Devices on an ISP Router, and ability to SSH/RDP from ISP Network.
Trigger warning: I am using pfsense with udm but only cause I already owned the udm se and yes this is working 100% and am aware of the double Nat concern. For those who are like me and curious I got this to work by doing the following:
1 Ethernet is going straight to the modem (UCI) 2.5gb to 10gb transceiver on SFP+ pfsense (WAN) Transceiver actually is compatible to switch between 1/2.5/10gb. Think it has 5 support too but unsure.
1 SFP+ 10gb(LAN) from pfsense to udm se 10gb SFP+ WAN port
With these two mostly everything works. The only thing that doesn’t work is that pfsense is unable to see any device in my udm as handles all my vlans. This is where the next part was crucial to me.
1 10gb Ethernet from Pfsense to 1 10gb port on my UniFi xg24 with UniFi assigning the ip to pfsense. So in pfsense I set the port to dhcp and that allows it to receive an ip from UniFi. This allows pfsense to communicate to all my devices in UniFi. But note I also had to set static routes in pfsense for each vlan to point that port. Can give more detail if anyone wants to know.
Other than that wish I could make it work off one port but this was the easiest way to go about it for me.
Otherwise, took me about a year to get this project completed and I know it’s a bit overkill for home but I just wanted it and happy to share. Open to any suggestions to improve on it tho and yes I know my cable management is shit.
List of equipment
1x UniFi PDU pro
1x NEW Supermicro SYS-5019D-FN8TP 1U Xeon D-2146NT SoC 4x10G QAT 32GB ECC 240GB SSD
1 x UniFi UDM SE 1x UniFi aggregation pro
1x UniFi enterprise 24 poe
1x UniFi enterprise xg24
1x NVR pro
5x UniFi cameras
1x synology rs1221rp+ nas
1x cyberpower 900w backup battery. Gives me about 30 mins to shutdown (tested)
2x minisforum um790 with 96gb of ram and 512 os Proxmox drive and 2tb nvme
1x minisforum ms01 with 96gb of ram and 512 os proxmox drive and 2tb nvme
1x dell emc 24u rack.
All,
I was looking into r7XX series and decided that the wattage for my usage is too high. The setup would be no more than just a fun playground in the house. This will mostly be relevant to docker container and exploration of on-premise data gateways and fun small side projects. This is not for video sharing or streaming like plex/jelly.
Bang for the buck where do you think are the most viable options? I don't mind upgrading just looking for good bones. I was looking at stackign 35W 1L PC from HP Elite Mini
Thanks,
Hi guys
I have just picked up a HP proliant ml350 G9. From what i can see it has a single 8 bay for sas drives and controller. But when trying to install truenas to the ssd in the bay it says no drives available, I did do some googleing and many people say you cant boot from a sas drive unless you do some tweaking. Would anyone on here know if this is possible?
Also I am unable to plug the ssd directly into MB and use sata controller as there is no sata power plug.
Thanks
Hey everyone. I hope this is the best place to get some advice for my issue. If not, I'll remove it.
So basically I'm wanting to do a diy media server, but I don't have the funds to go all in right now. I just have a $400 best buy gc. I'm wanting to maximize storage, but I'd like to be able to expand in the future. Currently, it would just be for home use.
Would 2 WD120EFBX (12tb internal) and some sort of cheap dock work?
https://www.newegg.com/wavlink-wl-st334u-dock/p/0VN-0069-00001 (something like this maybe?)
I like the idea of two hhds so one can be back up in case the other fails. The other option would just be like a 20tb external. That might be the way to go until I can invest in a proper nas server.
Just need some help thinking this through. If anyone knows of better deals or products, I'm all ears. If it matters, I'm mostly ripping my TV series collection to it, but at some point will be doing full on 4k blurays. Thanks in advance!
Does this config work?
For all of those BGP hobbyists out there….
Which VPS providers provide a port for an internet exchange peering.
So far I’m familiar with Tritan and iFog, what are some others?
I am looking for a cheap low-power NAS. The main goals would be to store VM backups and some movies and TV shows as well as important files.
I was thinking the EliteDesk may be a good option since I could fit two 3.5 drives in it as well as a boot drive. I can get one for around $70 and that feels like a good deal. Pair it with some 18 TB drives and I should be good to go for under $500
Does anyone have feedback on this setup or are using something like it?
Hi, as my old pfsense broke I need a new mini-pc to run it.
Will run pfsense(maybe opnsense) with pfblocker and probably suricata, telegraf
(If you don't know Galaxus is the like Swiss Amazon, as Amazon wasn't interested in sellling here at all. )
Tought of something like this:
https://www.galaxus.ch/en/s1/product/shuttle-barebone-slim-dl30n16gbintel-n100-intel-n100-barebones-43305853
or
-------
Or the DIY Build
A refurbished Lenovo Thinkcentre M720q Tiny with 4x 2.5 G NIC
https://www.galaxus.ch/en/s1/product/t1a-m720q-intel-core-i3-8100t-8-gb-ssd-256-gb-refurbished-pc-42554633
And either this, or:
https://www.galaxus.ch/en/s1/product/exsys-gmbh-4-port-pcie-network-card-25-gigabit-pci-e-x4-network-cards-23355452
Thank you for any suggestions!!
Hey everyone,
I'm in the process of setting up my home network in our new house and could really use your insights and expertise, especially considering practicality and aesthetics.
For my current setup, I've been using the NavePoint 18U - 600mm Depth rack enclosure, primarily because I'm running a custom 2U OpenSense firewall, a 3U Unraid NAS, a DS220+ Synology NAS, and a Unifi 1U NVR, all of which require a bit more space. I've already mapped out my network runs on the house floor plan, distinguishing between PCs, streaming boxes (in red lines), and security cameras (in blue lines).
Here's the challenge: the closet won't fit the rack, so I'm considering leaving the door open if I place it there. However, I want to ensure it meets both practical needs and aesthetic standards, particularly as my wife and I will be sharing the office space.
Considering these factors, I'm seeking advice on:
Thank you for your help!
I have this intel nuc laying around, and I've been getting into the idea of running a server at home. I have a plan to start with having an ad-blocker, a NAS system, a home assistant client and host a website maybe. how do I run all those services and do i need more than one computer?
I am looking to add a KVM switch to my home work set up. I have tried a few but not having any luck as the monitors are not receiving a signal when going through the KVM.
Current set up PC with 2 DP ports 2 monitors with HDMI ports DP to HDMI cables from PC to monitors All works fine
When I add the KVM switch connect monitors and the Main computer 1 the monitors do not work
Any ideas???
Thanks
Hi
I want to buy a used server for my new homelab
It's main purpose will be for nas only Though there will be ~10 drives and 10G also
So I was thinking to go for a 5600 and 64gb ram in diy route(new) and get a rackmount case
What used server could potentially fit my needs?
I want prefferably DDR4 server
And about 1000USD ~84K INR
I am building a NAS/Proxmox server.
My thoughts are to install Proxmox, with GPU passthrough to a Hackintosh and Plex VM.
But I also need it to be my NAS, I think to run TrueNAS (is there anything better, I comming from Synology) in a vm also.
I will use it for storage for two other Proxmos host, Docker and general storage.
I think to passthrough storage to it. But will it work fine?, can I add some SSD for RW cache?.
Will the preferments be good? or do I need do it in a other way?
I recently moved my network over from the Xfinity XB8 gateway/modem/AP to OPNsense, a random DOCSIS 3.1 modem I had laying around, and a Unifi 6 Pro & 7 Pro. After some hiccups I got every single device working great, with the exception of my roommate's Pixel 7. He is pretty consistently slowing down to a crawl/dropping to where he needs to swap over to cellular. He had no issues with the Xfinity equipment.
Everyone else in the house has newer-gen iPhones and no connectivity issues, my girlfriend's 2020 Macbook Pro works totally fine, and before I upgraded my roommate to Ethernet, the Wifi card in his PC (kept in his room) worked perfectly. His position relative to the APs do not seem to affect the speed/latency much if at all since it's always pretty all over the place (~5-800Mbps down, ~7-80ms latency, these are Ookla numbers). I have one for each floor, laying flat on a high shelf with the 7 Pro upstairs between the 3 bedrooms.
I've been saying Wifi is inherently high latency (compared to wired speeds) and spotty, and that his phone probably just sucks but I still want it to work for him especially since it was fine before I moved everything over.
I've tried messing with the APs in the console (DFS on/off, optimizing frequencies, TX power high/normal, locking the Pixel to the 7 Pro), moving the APs, making sure there's only 1 DHCP lease for the phone and it's dynamic, and resetting the network on the Pixel. The only things unusual about my network is that there's no IPv6 and my OPNsense is in Proxmox.
Thank you for any ideas you may share, and best wishes.
Intel Server System R1208WFTYS
Or
HPE ProLiant Gen 9 ML350 Tower Server
Which would you rather? I think the intel server is like 3 years newer as well.
Hi,
i3-N305 , 8GB RAM and 256GB ROM 270usd
is there any better cpu alternative for up to 280usd?
i have my own 2tb storage to replace and 16gb ram with 1.35V( not 1.2V)
want to host wordpress websites mainly and nextcloud and maybe some game servers
Hey all, hoping to get some advice, maybe suggestions or people who've tried already what i'm planning to try. Before I buy, hoping to get some confirmation i'm on the right track.
I've got a home server (Unraid) that's mainly for Plex, and secondary for home automation apps (HomeAssistant, HomeBridge), and general storage (immich, NAS). It's currently a Dell R740XD running 12x8TB HDDs in ZFS-3 for storage, and 2 SSDs for parity/apps. It's got 192GB DDR4 ECC, and dual silver 4114 Xeons. I run most things in docker, but had a ton of playback issues in Plex depending on what device was trying to play. I got a P2000 GPU to try and offload, but the errors continued. I ended up making a windows VM and running Plex inside of that and it's ran well (no playback errors) since then but seems to hit max CPU when playing 2 HEVC files.
From what I can find, my guess is that the playback issues initially were due to quicksync and file formats. The server is also power hungry (150-300w, average around 240w) and can be loud in general, so I was considering a rebuild custom server.
My plan;
HDDs: 6-7 20TB HDDs. Less drives, less power. Possibly ZFS1 format to get more space while keeping some redundancy. Also have 2x2TB SSDs for cache unused. Is there a better way or format?
MB: ASUS Pro WS W680-ACE IPMI. I've grown to like iDRAC and this seems like the closest I can get to most of the functionality
CPU: Either an i9 14900KS, or an i7 14700K. Do I need the extra power? Should I go lower, or would it be helpful for the NAS and home automation side?
RAM: Nemix 2x48GB DDR5 ECC ,might add more later if needed.
I use to be better at this, but i've had a lot of failures so open to criticism. Please tell me if i'm under or overthinking anything. Would you do the storage different? Is the CPU too much or too little? Whatever drives I dont use I figured i'd make into a backup server or even a second pool that powers down when not in use. Is that over the top?
I appreciate any and all input. Thanks