Skip Navigation
User banner
Dr Pen

Tech society posts and shares from Dr Pen, Digital Media & Humanities academic based in Malta, from London. Late bloomer, a bit pithy.

Previously of home.social

\#UserExperience #UGC \#DataSociety #DigitalSociety #SmartCities \#webdev #Fediverse #activitypub

World Citizen

Posts 0
Comments 8
Is there a simple way to severly impede webscraping and LLM data collection of my website?
  • @Dkarma well exactly. I don't expect most of them to but if bot paths are tracked in search console (no idea if they are) I might be able to see them

  • Is there a simple way to severly impede webscraping and LLM data collection of my website?
  • @Maroon fwiw I just added a robots txt with a lot of Gen AI user agents disallowed. Ive added this to Google search console to see if I have any way of checking if the AI companies honour robots txt. I used the following link to get the robots.txt template: https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/

  • Finally seriously looking at [#Obsidian](https://pkm.social/tags/Obsidian) Sync.
  • @kurau @ellane @obsidianmd I use Syncthing successfully, syncing mac, pc and android phone. I run 2 vaults, sync everything to the pc and sync main vualt with mac and a separate small vault with the phone. You do get some workspace json or similar conflicts (this happens in any sync situation imo, I used to get it with Evernote notes quite often) but if you resolve those by selecting the one you want via date or time or device etc, it works very well.

  • EU unveils ‘revolutionary’ laws to curb big tech firms’ power
  • @NocturnalMorning @war it's likely that the EU have enough power, acting for in excess of 500m ppl, to stand up to big tech. The UK also have subscribed to data privacy and rights as part of their adoption of GDPR principles, though prob with some caveats. Creating territorial legislation will shake up how big tech works in the globally. I think this is why Meta have stated their intention of being decentralised. They have to, if they want to continue to operate within EU/UK territories.

  • How does Amazon/Audible know my country with VPN and private browsing on?
  • @newpuritan Its the same account, I just sign in to different Amazon regional sites.

  • How does Amazon/Audible know my country with VPN and private browsing on?
  • @Pika no probs! Sometimes the products arent available for whatever reason in a region.

  • How does Amazon/Audible know my country with VPN and private browsing on?
  • @Pika Id have to log into the new region from he start, go find the same product, then order. I dont think it would work if I change region half way through a purchase.

  • How does Amazon/Audible know my country with VPN and private browsing on?
  • @Pika @supercheesecake dont wanna butt in but in case this is relevant: I use at least 3 Amazon regional accounts here in Europe: UK, Germany and Italy (I live in another EU country). I sign in with the same username/password. Currency of products changes for UK from EUR to GBP, and often different ranges of products can show up. I have multiple addresses listed for delivery and just select the one I want.