One of my current projects involves needing to crawl and scrape Data from a user provided website, usually a directory, or subdomain. We need to store the information for RAG.

I would like to know what your favorite tool is for doing projects like this and why? We are currently having some success with Firecrawl but there are a lot of other tools out there, and want to choose wisely. If you’ve used Firecrawl and like/don’t like it, I’d love to know why.

Requirements are that the tool be open source and cloud-hosted. Thanks!

Even with 3 screens I often find that I need more space to open new windows and I'm wondering if anybody has experience with programming using AR/VR virtual screens.

Some years ago as a fun project I made a way to put a whole multi-page website into a single URL. It doesn't require a server, loads instantly, can be accessed offline (if bookmarked) and cannot be tracked or blocked.

It was during a period of pricy obsession for me :-). But I never really shared it anywhere until now.

Main issue is that is is based on data:url and most browsers don't allow it in anchors. So it has to be copied and pasted into an address bar, which is a pretty big handicap. I wonder if there is a way around it? Maybe open the window in JS or at least copy it into a buffer to simplify access?

New runtimes started supporting typescript out of the box! Will browsers natively support typescript in the future?

Hello everyone, I have been working on my own cookbook for a while now and shared it with my friends. Turns out they liked it very much and want to post their recipes, so we can all share it with each other. Does this app exist? Or i am planning to build it on my own with React and Springboot/Express+Node.js. I am not sure about the tech stack, but how and where do i start with? do i need look out for any laws as such or build a basic UI like FB?

I come from a mainly OOP education and when I started working I started with Angular and I loved it (OOP with typescript, the way it forces a structure some like java, the splitting of responsibilities, etc.). I'm one of those programmers that believes in well-writen and well-structured code and the tools you use should guide you towards that kind of development. So when I came across react I said "what kind of mess is this?" where the paradigm is totally flipped (a main mess of code AND THEN elements with responsibilities that you call in that great main mess). But my greatest surprise were that react IS THE MOST POPULAR FRON-END FRAMEWORK. And I mean, HOW?? Why is chaos over order? I mean I can understand that when you know nothing about front-end framework you choose the easiest straighforward option but why is also picked by professionals?

PD: I know that react is more a library than a framework but let's keep it simple just for the discussion.

I'm here to find someone that explains to me and convence me that react is the best front-end framework out there (because if it wasn't, it wouldn't be at the top of every list and UI library installation guide).

My main opinion (and points to argue):

1. React is designed to be straighforward = It's going to be selected as first instance by a novice. If I'm a veteran dev and I know that there're more complete frameworks (like angular), why should I bother with a framework that I must do everything from scratch?
2. A use case that I see logical to choose react is that you need to build your own UI framework, because I think that react, at the end, is designed for the developers to build their own UI frameworks easly, so they don't repeat themselves, but how many custom UI frameworks are out there? I know that you're going to say that we'll never know because those are private stuff, but when you land a job, you end up using an already mature, ready to use UI framework (like Materials or Semantic). So the argument blows away too.

I need to understand why is react so popular. I don't see it logical in any way from a good practices first development.

There are so many skills, tricks, languages, frameworks, paradigms, principles, specialties, etc how do you know where to go next. It's hard enough knowing which direction to choose let alone knowing the steps in-between. Does anyone else struggle with this? What helps you know what skills to focus on next?

I have a career fair coming up and I wanted to make something where I can just easily show to recruiters. Just going to a site and saying “I made this little game” and showing them and talking about it.

I need help on how to get started however. I have zero experience with web dev but do have some experience with Java (it’s fairly basic though)

I would like a tutorial or just any series of things I should do to have a website on the internet that anyone can go to to play the game.

Please tell me what I need for each step. What HTML, JavaScript and CSS would be used for. And how or if any frameworks are necessary.

I basically have a week to put this together so a detailed tutorial would be best but I’ll take any direction at this point.

And please give me detailed steps on how to actually put this on the internet.

Thank you.

Hi,

Thanks for taking the time to read this...

We are a small agency specializing in creating content for our clients...

We are running into a problem with the management side of things: Getting content distributed to all stakeholders, getting approval from key stakeholders, sharing links etc...

We have used Monday.com and Frame.io to hack together a solution, but it's not really elegant.

I'm wondering if there's a cloud based server/storage that also acts like a content management solution and project management software?

I'd like to display a custom modal that warns the user when they are about to reload or close a tab.

My optimal solution would be a model in the UI framework of my choice that blends in with the rest of the page and can show a countdown timer that tells the user how long they have to make a decision before the unsaved information is lost.

The second best option would be to use the built-in browser alert and at least put in a custom message that tells the user what information can't be saved and why it is that way.

After extensive research I came to the conclusion, that none of the above is possible.

Intercepting the unload event is possible by listening to the beforeunload event. But there seems to be no way to do anything else than letting the browser display the default alert with some useless default message.

--> https://developer.mozilla.org/en-US/docs/Web/API/Window/beforeunload_event

--> https://stackoverflow.com/a/38880926/10043870

WHAT IS THIS SHIT?

I understand that there is potential to abuse such features. But this is too rigid. If I can't even tell the user what is going on, the message just adds to the confusion.

I tried to show a snackbar message in combination with the built-in modal, but as soon as I put something else into the event listener, it will not intercept the unloading anymore.

Does anyone have any idea how to get better UX than the default alert with the very very bad default message?

Arrr, I be sick o the new cowboys on the Stack Overflow seas! They reckon every soul be lazy and don’t spend time preparin’ their blasted questions. I don’t even know if they be knowin’ what they’re doin’! I’m out—they can keep their scurvy free lunch. Ubuntu Forums, Python treasures, and ChatGPT be yer true mates, aye!

https://www.ahmadcodes.dev/

I read and then re-read their documentation several times, and I still cannot wrap my head around how/why it is different (more secure or better user experience) than the token implementation? What's actually different?

I just want to thank everyone in this forum who has given me advice. I have been back and forth about leaving my job over the last year after my boss has died. I have been with the company for 15 years and I know without a doubt it is time for me to go now. I made a resume and started applying for new jobs.

I do a lot of CMS development and I am also heavily into marketing and SEO. I actually called a company whom I have partnered with in the past and he said he had a job opening coming up in the next few months that he'd like to hire me for. It is a company whom I have always wanted to work for as well. It is actually a CMS development firm, but they also do tons of ecommerce, application development and one off development as well not related to CMS' for large companies. It is a huge opportunity for me to grow as a developer. They also just acquired a marketing company. He was willing to pay me about 40K more than my current job as well.

I didnt really know my worth until I did this. I know my current boss is going to try to counter, but I have zero desire to be there anymore, once my boss died I knew it was time to go.

My question is now how do I approach my current boss? I cant really think of a good way to go about this. Ive been there so long I know me leaving is going to really hurt them as a company and i don't mean this arrogantly, but the company may actually fail if I leave. With my new boss only being there 7 to 8 months he is trying to change everything and heavily relying on me to do things. My counterpart left after my boss died so they won't have any inhouse developers when I leave. It kind of makes me sad to do this, because I was the 1st employee at this company when it started and I basically built the company with my boss to where it is today, but I realized that was the only thing keeping me there and my own fear of the unknown, not because I liked my job.

I have a nextjs react app hosted with the free version of Vercel. I can see how many visitors the site has in Vercel, but I would like to track some other basic analytics if possible. For example, how many people click a certain button each day. It doesn’t really seem worth it to have a db just to store basic stuff like this and it will not have that many users. Is there any free and easy solutions to this?

Greetings,

Main Question: I want to use Twilio as part of my application but it seems prior to using it I need to register a phone number. As part of the registration you need to submit:

1. llc info
2. link to a website
3. link to opt in form
4. And a number of other requirements.

Is the above data needed for simply working on a prototype of a project? There must be an easier way to use the twilio api when you are still developing a product.

Thoughts?

https://www.pulsar.gg/products/x2-crazylight-gaming-mouse?variant=46176229687550

This is what im looking at. If you could scroll down youll see theres some cool animations where the mouse is rotating and even further down theres another one where the mouse changes from black to white and its all based on scrolling.

Would really appreciate it if someone could point me to a youtube tutorial thats good for this. Ive learned a good amount of Angular and am switching to React right now, where i have a little bit of knowledge from before i learned angular so even if its a whole course where you make a website with other functionalities that would be fine. Thank you!

I’m planning to build a web application by myself, and I’m trying to decide which stack or framework to learn. I have some basic programming knowledge, but I’m looking for something that balances ease of learning with scalability and performance.

I’ve heard a lot about MERN (MongoDB, Express, React, Node.js) and Laravel (PHP), but I’m not sure which one would be the best fit for me.

The application will include: • User authentication • CRUD operations • A responsive and interactive frontend • Some level of scalability for future use

Should I go with MERN, Laravel, or something entirely different like Django, Ruby on Rails, or ASP.NET? Any advice, insights, or resources for learning would be greatly appreciated!

Thanks in advance!

I stopped doing web development many years back because everyone started to do online ordering, and as a HTML PHP coded, I didn't know the best way to notify customers of their orders.

Many years later, I am curious how developers will accomplish this feat?

I would've emailed an order because I simply didn't know how to provide for such a service so that the restaurant would be notified.

The reason I am asking is because I keep finding local restaurants that I am trying to order from who don't have a website, and instead have a Facebook page that just shows three week old news about them being open that day or not. No menu. No way for me to order.

I will likely just go in and order and walk away happy, but I think today that their customers should at the very minimum be able to see a menu that they themselves can easily maintain.

But, how does one, if I even wanted to, help these restaurants get more current with the times? I can create a menu and database which they themselves could maintain.... But what is the preferred method if they wanted online ordering?

They may or may not have a POS system set up to allow online ordering to be easily integrated.

This is more for me to understand than for me to try to help others. It's just more a piece of the puzzle that I don't understand and would like to.

Hello everyone,

I’m currently working on my undergraduate thesis, focusing on web security awareness and practices among developers. To gather insights, I’ve created a short survey that covers key topics such as security risks, common threats, and the security practices developers use in their daily work.

The survey is quick (only 16 questions) and should take about 5-10 minutes to complete. Your input would be incredibly valuable for my research, and all responses are completely anonymous.

Link to the survey

Thank you so much for your time and support! If you have any questions or feedback, feel free to leave a comment or send me a message. Your participation is greatly appreciated!

Hey r/webdev! Built a simple tool to clean up recipe sites using TailwindCSS and a brutalist design approach. It extracts just the recipe content, removing SEO and popups and presents it in a clean, ad-free interface.

Recipe Explorer

I have tested with a half a dozen recipes sites, pinterest, instagram, and reddit so far, and it seems to work on everything, although it takes an extra few seconds to bypass cloudflare.

Features:

• No account needed
• Mobile-responsive brutalist design
• Multiple cooking timers
• Save recipes locally
• Clean and minimal UI

Backend does the heavy lifting (Python with some ML), but wanted to share the frontend approach. Built with vanilla JS and TailwindCSS for that neo-brutalist look.

Would love feedback on the design/UX!

https://preview.redd.it/mp2v881267ee1.png?width=1202&format=png&auto=webp&s=7486d255cd33de917f4c787c751094081e9b41ee

hello, first off im a total noob when it comes to hosting so execuse me for that. I used to use epik for hosting my website before but now another domain i needed was cheaper on godaddy so i went with that and its driving me nuts! it's trying to create me ai generated landing pages and stuff i already have my website ready on my vps and i added the dns i don't want it to do anything on its own, i managed to get the site up with no redirection to stupid landing pages and stuff but the problem is when my site appears on a search engine (im talking about those information you see on the search engine before opening up the site idk what they are called), it has a random logo and a random description im trying to get rid off, can any of you help me with that?
There are some instructions on the godaddy documentations but they make me create a website with their services i dont want that, as i said my site is already done.

For context Im currently making a admin dashboard for my job.

It has a sidenav to the left and a main page that that takes the rest of the width of the page.

In the side nav there’s a add new user page that has a form with 6 input fields.

How would you design this? Currently I just put the form at the center of the page which looks really awful.

I want to take existing forum software and install it. Does this exist? Similar to how you can install WordPress with the push of a button, I want to make a forum like this.

What else is involved in being a forum owner/moderator?

I would also like to eventually explore forum access based on subscription, the way some forums do. Do these tools exist?

Hi guys, just looking to get some opinions.

Basically I've received my first web-app project, a small web-app application for an office/small business (to store customer details, and records of their previous payments, but not a payment gateway) etc. I'm not really that strong in web development, as I've not really had any experience so I'm still worried I might not be able to deliver the project, but I have made small apps like this before on a personal level, which is why I'm considering taking it on.

I'm considering giving them a quote between £2.5k to 3k, and around 2 months time-frame. Hosting / domain costs separate, as well as maintenance separate. Is this reasonable, and what should I keep an out for?

When I was in school, I used to enjoy coding. But that's about 13 year ago. I haven't been close to programming for a decade. But for past 12 months I am learning Java and Spring Boot. I have also completed 3 projects. But I am confused, I have applied maybe 50 jobs and almost all of them are junior level. Yet I haven't been call for an interview once. I don't understand what's wrong. I have even got my cv reviewed by few senior Java devs. They assured my cv is just fine. what could be wrong? the only conclusion I can come up with is my age. Does it really matter in dev jobs?