Hi is anyone using Databricks or thinking of using it? Please let me know your experience.

Hello , Someone has some resources about how to troubleshoot and improve slow responses times for applications hosted on Amazon ECS?

I'm planning on making a mobile phone app and need to pick a cloud provider to handle the backend but I'm having problems deciding between the three.

I'd like use cloud functions via REST API, hosted PostgreSQL, storage and authentication.

How do you decide between the three? They seem to offer similar services so picking one over the others is tricky for someone like me who doesn't have much experience.

What are your must-have online resources, utility, tools, and repos for cloud engineers?

Hello, Just wanted to know whether getting Cloud certifications and Linux certifications are enough for going into DevOps? Or do I need to get a CCNA certification as well ? My background is from CS and CE, I do know the basics of networking. Thanks for reading.

Curious to know how your startup or company manages AWS costs. Do you stick with AWS’s native tools like Cost Explorer, or use third-party solutions? Any tips, tools, or strategies that have worked well for keeping costs down?

How many times like do you check your costs?(Monthly weekly daily )

Soo, I'm working on a VDP & while doing recon I found a request that was been made to some Microsoft service, later I found that the site is hosted on Azure, so it makes sense that the request was related to the cloud instance... Is it that easy to find the cloud IP ?? Cause before also I had found an AWS instance IP with the same method ?? What are your thoughts ?

Hey everyone! I'm a backend developer working on a NestJS and Angular app, using Socket.IO for WebSocket connections. The app is already deployed and running over HTTPS, but WebSocket connections are failing with mixed-content blocking errors in the browser console. I’m using wss:// on the frontend, but it still fails.

I’ve configured CORS and is set to allow requests from the frontend. The WebSocket URL is set to wss://, but the connection gets blocked.

Could anyone suggest what I might be missing on the backend? Also, any deployment-level fixes for WebSocket support ?

Thanks in advance for your help!

A question to spark discussion on serverless computing, especially for heavy or large-scale applications. How is the scalability and cost-effectiveness?

Does anyone know about any decentralized data storage solution? I just found AITECH Solidus through its Social Hub launched by DAOlabs, and I feel we might need to look at it. Is there any discussion around a decentralized data storage facility right here?

I recently did an exploration of the various cloud-native technologies and architectures. I put the uncovered information in a series of PDFs that I'm sharing below 👇 with you:

Feel free to explore all of them and don't forget to let me know your comments:

AI/LLM

Harness Proprietary Data with Foundational Models and RAG https://mveteanu.me/pdf/rag.pdf

A visual presentation of Leading AI Studios https://mveteanu.me/pdf/ai_studios.pdf

A Tour of Azure AI Services https://mveteanu.me/pdf/azure_ai.pdf

OWASP Top 10 for LLMs https://mveteanu.me/pdf/llm_security.pdf

Cloud

Core Services Across Azure, AWS, and GCP https://mveteanu.me/pdf/cloud_core.pdf

Select the right cloud-based DB for your project https://mveteanu.me/pdf/cloud_db.pdf

21 Tips for Designing Web APIs https://mveteanu.me/pdf/webapis.pdf

Leadership

25 Challenges Every R&D Leader Faces https://mveteanu.me/pdf/rd_challenges.pdf

Physical Product Design

Power Presenter: An OBS and PowerPoint clicker https://mveteanu.me/pdf/power_presenter.pdf

Stay Active: An AI solution for controlling TV time https://mveteanu.me/pdf/stay_active.pdf

Coral Micro: A dedicated coding computer https://mveteanu.me/pdf/coral_micro.pdf

Cloud architecture

SaaS vs IaaS vs PaaS https://mveteanu.me/pdf/saas_iaas_paas.pdf

Exploring Multi-Tenant Architectures https://mveteanu.me/pdf/multitenant_architectures.pdf

Pitfalls of Microservices https://mveteanu.me/pdf/pitfalls_microservices.pdf

Docker Tips https://mveteanu.me/pdf/docker_tips.pdf

Industry quotes

Key Quotes Driving the Software Revolution https://mveteanu.me/pdf/quotes.pdf

If you activate something paid in your free account(ex: R2 or Cache) even if you deactivate the service in the next hour, with just one single read access to the infrequent R2 instance you are going to be billed +$9!

But wait, things can get worse. Their billing email normally comes in the last day of the month. So if if you can't deactivate the service on that day and deactivates in the next day, you are going to be billed another $9 dollars.

Their customer support is the worse compared to any other cloud provider.
It's extremely slow, mostly boilerplate text and they won't offer refunds for uses that are a clear mistake which basically any other cloud provider would offer for such cases if not repeated mistakes.

Can’t delete the project Can’t delete credit card info

Can someone help me to troubleshoot this nightmare

Does it make any difference for the end-user whether they run their HPC on VMs vs Bare Metal Servers? I want to train a ML model on a GPU Cloud Provider, and whenever I look at other providers than AWS,Azure,GCP (Sagemaker etc.) the smaller ones (Datacrunch for example) offer GPU clusters run on bare metal servers instead of VMs. Any info on advantages/disadvantages?

I know that bare metal allows you more direct control etc. but is this actually a notable change to the better or worse?

https://www.infoq.com/articles/cell-based-architecture-adoption-guidelines/

Everything fails all the time, and cell-based architecture can be a good way to accept those failures, isolate them, and keep the overall system running reliably. However, this architecture can be complex to design and implement. This article explores the best practices, problems, and adoption guidelines organizations can use to succeed.

I am planning to host vulnerable virtual machines in a virtualized environment for my students to engage in cybersecurity exercises.

My objective is to establish a private network accessible via VPN, where students can interact with and attack these machines as part of their coursework.

I am exploring the best approach to implement this setup.

Any guidance on how to begin or recommendations for resources would be greatly appreciated.

During this live session, we’ll dive into DigitalOcean Kubernetes (DOKS) Networking and cover topics, including:

VPC-Native Clusters: Learn how to seamlessly integrate DOKS clusters with your existing network using native VPC routing.

VPC Peering: Discover how to enable smooth communication between cluster resources across regions and VPCs.

Global Load Balancer (GLB): Explore strategies to distribute traffic across clusters globally for better scalability and reduced latency.

Internal Load Balancer (ILB): Understand how to enhance security and performance with internal load balancing within your private network.

Join our upcoming LIVE Office Hours Q&A: Kubernetes Networking event, where you'll have the opportunity to learn about the new Kubernetes Networking features, and get your questions answered by our experts!

Event Details:

📅 Date: November 21, 2024

🕒 Time: 10:00 AM EST / 4pm CEST

🔗 Register Here: LIVE Office Hours Q&A Registration

Read the blog post to learn more about the new features including load balancing and VPC peering.

Hi everyone. I'm wondering where everyone stores their projects in order to show case them on your linkedin profile. Github?

Hi everyone,

I manage a high-volume data warehouse in BigQuery, and controlling costs has become increasingly challenging. I recently noticed monthly spend climbing significantly due to inefficient query patterns, costly joins, and frequent data pulls across our team. I’ve tried using INFORMATION_SCHEMA.JOBS for tracking, but I’m exploring more streamlined ways to identify and optimize costly queries or receive alerts when certain thresholds are hit.

For those with similar issues:

• What’s worked well for you?
• Have you built custom tools, applied query optimizations, or set up specific monitoring dashboards?
• Any real-world experiences would be greatly appreciated!

Tired of managing Non-Human Identities (NHIs) like access keys, client IDs/secrets, and service account keys for cross-cloud connectivity? This project eliminates the need for them, making your multi-cloud environment more secure and easier to manage.

With these end-to-end Terraform templates, you can set up secure, cross-cloud connections seamlessly between:

• AWS ↔ Azure
• AWS ↔ GCP
• Azure ↔ GCP

The project also includes demo videos showing how the setup is done end-to-end with just one click.

Check it out on GitHub: https://github.com/clutchsecurity/federator

Please give it a star and share if you like it!

Hey Reddit crew, I need your opinion:

I never paid Azure egress fees myself. I guess the websites I run are too small to go over 100Gb of downstream in a month.

I thought it should be the general case (websites that don't go over the free limits). Nevertheless, I often hear complaints about egress fees, such as that they make budgets too unpredictable; or specific cases like https://basecamp.com/cloud-exit

Does it apply to large companies/popular websites only? Or do they bother startups and small companies as well?

Hey,

is there any cloud service that hosts a VM for me to install a Windows 7?
Don't need a lot CPU or RAM and I only need it for 2-3 weeks.

Reason: a friend only has a corporate owned laptop using win 11, he can't install software himself, so also no local VM.
I need him to use an old software that only runs on win 7 and my idea was to prepare a cloud-based/web-hosted VM for that purpose.

Hello all, I'm asking this due to feeling a bit stuck on my current path in I.T. currently. I'm currently in a support role and I learn/ build small things on the side ( not anything special maybe like a microservice / calculator for a game I play ), thought I'm transitioning into Cloud.

I started with GCP and im currently learning the cloud CLI though I know it is the most niche of the three and eventually will compare and contrast the others, though im wondering what all encompasses cloud roles.

What do I need to REALLY make sure for certain I know fairly decent enough before heading into a role like

Cloud Support Cloud engineer etc

terraform? Just knowledge of the services? Do I HAVE to know code proficiently? scripting?

I know it is not as simple as click ops so id actually love get feedback on what EXACT skills to learn ~

If you are currently working as one, could you go into detail about your workflow...since nobody seems to in this field.

I have like ~$200k+ in cloud credits on one provider but my company is shutting down due to founder issues. Any fun ideas to do with them? Pretty burnt out so probably won't start a new one for a bit. They expire in like 11 months and don't want them to go to waste

Sorry if this is the wrong sub, but I’m just curious which is better for my video game.

I’m developing an open world game, like GTA V, and thus want to use dedicated servers for players to connect to. I’m not sure if Google is worth as most of my workflow is thrifty them, or Microsoft has they own their own game studio, Xbox games studios, finally as a last resort, I don’t want to use Amazon, but are they good for this?

Hi,

What tools would I need to develop my own personal Cloud to Cloud Transfer Service/app online especially for transfer of files between Googledrive, Onedrive, or Dropbox? I plan to buy a webhosting and a domain of my own.

Further, will I need any periodic subscription of any kind apart from webhosting and a domain registration?

Thanks and regards,

The Vast.ai marketplace is really impressive--some really dirt-cheap prices, seemingly much cheaper than AWS in many cases. https://cloud.vast.ai/create/.

*But* I can't seem to find the equivalent type of marketplaces for high-end *CPU* clusters. Does anyone know of a CPU equivalent to vast.ai?

I can of course rent CPU clusters on AWS. But I'm looking for these kinds of markets, which may be cheaper.

Use case: I'm creating an enormous amount of "synthetic data" for code that is not easily ported to GPUs. I would ideally be running servers constantly. No idle time on the project. This is why price point is even more important than usual for my use case.

Thanks! Love this sub

Please explain to me as if I am a child, or a golden retriever.

I have had a paid Google account for business, mostly for cloud storage of all my files, for a number of years and am now retired. I am thinking of switching to save a bit of money. Any help or insights would be greatly appreciated.

Hi everyone! 👋

We are developing a new Terraform visualization tool, and we'd love to hear your thoughts. The tool aims to solve several pain points that many of us face when managing infrastructure using Terraform. Your feedback would be super valuable to refine the idea and see if it’s something you'd actually find useful!

Here’s what it does:

Pain points it solves:

• No easy way to visualize infrastructure: It generates a real-time graph of your Terraform resources, showing relationships and dependencies.
• Cloud cost visibility: It provides detailed cost breakdowns (monthly/yearly) for each component and the whole environment.
• Outdated resources: It detects and alerts for outdated Terraform modules and providers.
• Sync with version control: Integrates with VCS (like GitHub) and updates the visualization and cost estimates automatically after each commit, ensuring your view is always up-to-date.
• Design and generate Terraform code: You can create a desired infrastructure visually using drag-and-drop and generate Terraform code from it, making it easier to build and deploy your cloud resources.

What’s in it for you?

• Simplified infrastructure management: Get a clear view of even the most complex cloud setups.
• Optimize costs: Know exactly where your money is going and avoid surprises in cloud bills.
• Boost productivity: Spend less time troubleshooting and designing infrastructure manually.
• Security and performance: Stay ahead by keeping Terraform modules and providers up-to-date.

How would you use it?

• For Individuals: Freelancers or small DevOps teams can use it for better cost control, quick visualizations, and easy infrastructure planning.
• For Enterprises: Larger companies can manage multi-cloud environments, integrate it with CI/CD pipelines, and keep infrastructure continuously optimized and secure.

What do you think?

Would a tool like this be helpful to you? What features would you love to see? Do you see any blockers that would prevent you from using it? We'd love to hear your thoughts, feedback, and suggestions!

Thank you in advance for taking the time to share your thoughts! Your feedback will help shape the direction of this tool and determine whether it can provide real value to the community. 😊