I need to store 10gb+ of PDFs, along with their plain text and metadata, as well as some 1.5M vectors for a semantic retrieval system. The DB will almost only handle reads.

At first I went with Supabase, as they offer all that in a fully manages fashion, but given the size of the DB, I can't go with th free plan, and 25$/m seems overkill, especially since I will not be using auth or realtime functionalities, which are where Supabase shines.

So I took the cheap, dirty path with a $5/m Contabo VM where I'm self hosting a postgresql + pgvector. Problem is I'm not sure how reliable this infrastructure is, and the latency is not great since I'm in South America, and the closest Contabo servers are in NA.

Now, I don't need a super fast service, but I was wondering if there are better (affordable) options for my requirements, which basically boil down to low CPU, low memory, but (somewhat) bigger storage and reliability.

Thanks

[ Removed by Reddit in response to a copyright notice. ]

Learn how to keep tokens more secure by using the Backend for Frontend (BFF) architectural pattern.

Read more…

Hi, I'm currently designing a platform using native PHP and got some back-end architecture questions that intriguing me. My application involves multiple different companies with sensitive data, so each company has their own database where their sensitive data is stored ("company" refers to people under contract, paying good monthly service fees, so each company having a database is scalable). These companies have users, all of which are authenticated through AWS Cognito. My application is mostly structured by endpoint files, core files, and a dashboard page. The dashboard page is loaded by users, and the client side requests data via endpoints, and endpoints sends back data using the useful core files.

The question is: Let's say I have a core class that handles updating company information. Security wise, I would never want a user that doesn't have access to a company, update that company information. So do I

A. make the core class accept ANY company as a parameter, and update the company info accordingly. This forces the endpoint that's using the core class to validate it themself.

B. make the core class re-validate that the user has access to the company, so even if the endpoint tries to update the information of a company the user doesn't have access to it fails.

I'm curious on whether I should be treating the thread that handles the user request as only having the access the user has on the lowest level, or if only the higher level operations (the endpoint) should handle restricting it's own access.

I am looking for a project showing a/some examples of a headless CMS. Meaning there's a backend/CMS client and a separate front end client that can be deployed separately.

BUT there's a twist! I'm interested in a CMS that supports on page editing, so that the backend/CMS client must hold a "copy" of the front end client to enable this behaviour.

I've found plenty that holds a CMS client and a frontend client, but none where this overlap stated above occured. I'm thinking something with git submodules that indcludes the frontend repo in the CMS repo. But I'm at a loss.

Any insight or resources would be appreciated! Thank you.

Hey, I'm trying to figure out all of the pros and cons of Websockets and have a short <5 min survey on it. When I've got enough responses to draw some conclusions I'll share my results in here for everyone. :)

https://docs.google.com/forms/d/e/1FAIpQLSeWjGwwHFEjW0buKaY-4kthaxmR3n__a9gWbCilDFaQNLiqlQ/viewform

We have a domain on GoDaddy and planning on routing the traffic to it through Route 53 and later will be creating subdomains using Route 53 too. So I wanted to know what are the pros and cons and also the security concerns for both scenarios of using GoDaddy for only the domain and Route 53 for subdomains and vice versa.

I wrote this tutorial to deploy an Express server to AWS in a few minutes. The code works locally and doesn't need conform to any serverless API!

https://docs.anycloudapp.com/documentation/tutorials/aws-node

Dexcom is expanding its growing reputation as one of the technology leaders in diabetes management and patient satisfaction. With fiscal year 2019 revenue of $1.5 billion, Dexcom is scaling and now employs over 5,000 people worldwide. Our goal is to lead in the development of the emerging digital health space and the software that drives this modern world. At Dexcom, you will get to make a direct impact at fast-paced environment with other industry experts and leading-edge technologies.

Our cloud-based data management and computing is one of the key business priorities for Dexcom. With constantly growing and over 300M transactions per day and having over 7PB of data compressed and stored, providing a 24x7 solution with 5 9s reliability is not just a goal but a day to day reality.

If you want to be part of this amazing mission, check out the open positions below and apply today! 

Senior Staff Cloud Data Platform Systems Engineer

https://careers.dexcom.com/careers/job?domain=dexcom.com&pid=1249864

Director of Cloud and DevOps

https://careers.dexcom.com/careers/job?domain=dexcom.com&pid=1264683

More about us:

For People with Diabetes, Finally, Dexcom Makes Fingersticks a Thing of the Past https://www.youtube.com/watch?v=A1NU5ivC5Og

Dexcom - Learn More About Us https://www.youtube.com/watch?v=5wzlN1RMIbY&feature=youtu.be

Why Live and Work in San Diego https://sandiegolifechanging.org/work/#growth

Hi everyone,

I am a student of Computer Engineering and looking for resources on how to get started in creating a cloud based SaaS product, with functionality such as:

1. Monitoring the users inbox such as gmail, outlook (I imagine web based tools would be unable to interface with email clients installed on an operating system but could interface with web based email clients).
2. Performing an action when a certain email is received. (Such as creating a Google drive folder)
3. Automatically send text of email based on certain triggers.
4. Interface with APIs such as Amazon MWS API

I know most of this can be done on Python on my laptop but how do I approach this for cloud based? I have read that Python can be used in conjunction with MongoDB as a documented oriented database, but really struggling to find anything to get me started.

Any help would be greatly appreciated!