Blog

If you find this interesting I’d love to chat – find me on Twitter @natebosscher

  • Military-grade bot detection: How to bypass the Server Bot Check
    How to bypass the Server Bot Check The first check request is where the server checks if your worth sending the base html page to. This doesn’t contain any useful data like prices, this is just “should I even bother responding”. Since we’re a new client at this point (no session history), there’s a limited […]
  • Military-grade bot detection: How to bypass Interaction Checks
    How to bypass Interaction Checks It’s not enough just to check that the browser properties are all in order. Good bot detection scripts also monitor human interaction to check for authenticity. When you or I move a mouse on the screen, we follow a predictable and human-like behaviour. Bots do not. Bots move in a […]
  • Military-grade bot detection: How to avoid bot detection Client Checks
    How to avoid bot detection Client Checks This section is all about the wonderful extensibility of javascript and the browser.Client checks happen with a javascript library before any sensitive information is shown. Lot’s of metrics from browser performance, screen size and graphics rendering are all compiled into a nice little package and sent off to […]
  • How to Juggle Priorities Successfully
    This is something I’ve struggled with. I hope this will help you become a valued person in your community/workplace. Juggling priorities is all about setting and managing expectations.  Expectations that are met or exceeded are a success and will make you a valuable person. Expectations that are not met are a mark against you. So it’s important […]
  • How I bypassed military-grade bot detection software on popular ecommerce sites
    Back in 2022, I started a company called Product Sonar that aimed to scrape ecommerce prices from popular websites in the hardware store industry. Sound pretty simple right? Pull up Screaming Frog or Scraping Bee and you’re off to the races right? Wrong. These sites have the likes of Akamai and CHEQ, with a lot […]