Mintplex Labs Inc reposted this
Today, AnythingLLM Desktop launched 1.8.3, and there is one BIG feature - Authenticated Web Scraping! The internet that any AI model can "see" is limited to the public internet, which is great for general information that is public and not personalized. However, one big hurdle for AI Agents is the elusive personalized data. This is why you see every big provider trying to jump into launching web browsers like Perplexity's Comet, or OpenAI's rumored browser - they all want that private data. We don't believe you should give that up, and it should be fully local and on-device. Think of your LinkedIn notifications or DMs. A highly specific dataset that contains a ton of nuanced information and data. Data that any AI tool you know today cannot access on a whim. The only possible alternatives are paid API keys, writing a ton of custom code, or paying some third party to do it for you. You can see this content in your browser - why can't your AI? Now with AnythingLLM Desktop 1.8.3, that is no longer a problem. I made a quick video where I get my local LLM to scrape my LinkedIn Notifications just to show the possibilities. Expand that concept to intranets, sites without APIs or behind a VPN, and other authenticated, paywalled, or private sites, and you can see how this is game-changing for AI Agents. Download AnythingLLM Desktop 1.8.3 at https://lnkd.in/guuQiPej Watch the tutorial video: https://lnkd.in/gVm-TY3e