Monday, 31 October 2016

Webscraper from PeacockMedia - usage

[updated 3 Apr 2017 with the release of v2]

I've had one or two questions about using WebScraper. There's a short demo video here  but if, like me, you prefer to cast your eye over some text and images rather than sit through a video, then here you go:

1. Type your website address (or starting url for the scan). Like Integrity / Scrutiny (Webscraper uses the same engine) the crawl will be limited to any 'directory' implied in the url.

2. Hit Next. The way that version 2.0 works is that you configure your output file, and the app crawls your site, collecting the data as it goes. This makes version 2 much more efficient than previous versions (it can scan bigger sites) but it does mean that if you want to change the configuration of your output file, you'll need to re-scan.

3. Hit Next, and you'll be able to either begin the scan, or generate a preview. The preview button will perform a very short scan and present your output as a quickview. If all looks well, you can press Go, or if you need to make changes, you can head back to the Output file configuration with the breadcrumb widget at the top of the window.

4. When the scan is complete, the export dialog will open. This is the only time that your output file will be saved. The Save Project option from the File Menu will only save your setup, not the scan data.

A common scenario is that the data you want isn't defined by a unique class or id. In these cases a regular expression can be used, there's a detailed tutorial here.

Sunday, 30 October 2016

A sneak peek at some of the new features of Scrutiny v7

Scrutiny v7 is still very much in progress and being shaped, but here's a sneak preview, in case you'd like to feed back or make suggestions.

I demonstrate in the video:

 - document based (multiple windows open at once)
 - organise your websites into folders
 - simpler navigation
 - full autosave (view data for any site you've scanned previously)

[update] Version 7 is now well-established and has proved very popular. It's available here, and details about the very reasonable upgrade are also on the page.


Friday, 28 October 2016

Scrutiny for Mac - affiliate scheme

My licensing and payment provider is Paddle. They now have an affiliate system up and running, with affiliates earning from the sales they generate.
It seems simple, you register as an affiliate, you'll get notified of any special offers and the all-important link by email. You post that link on a review / blog / article and earn money when people click through and purchase.

You get 20% commission on the sale, and a monthly payout by Paypal or bank transfer.

I'm still getting my head around the best way to use this, but if you'd like to jump on board early (and maybe help shape the way this works out) then here's the registration form.