Verisk Analytics is looking for a Product Consultantβ¦
", "datePosted": "2026-05-20T09:14:32.000Z", "validThrough": "2026-06-30T09:14:32.000Z", "employmentType": "CONTRACTOR", "industry": "Insurance, Insurance-Information Technology", "directApply": true, "jobLocationType": "TELECOMMUTE", "applicantLocationRequirements": ["United Kingdom"], // ββ Employer ββ "employer": { "name": "Verisk Analytics", "url": "https://www.cwjobs.co.uk/jobs/verisk-analytics?cmpId=%E2%80%A6", "logoUrl": "https://www.cwjobs.co.uk/CompanyLogos/%E2%80%A6verisk.png" }, // ββ Location ββ "location": { "text": "London, GB", "locality": "London", "region": "London", "postalCode": null, "country": "GB", "lat": 51.50735, "lng": -0.12776 }, // ββ Salary (often DAY rates for contractors, ANNUAL for permanent) ββ "salary": { "rawText": "Β£650 - Β£700 per day", "min": 650, "max": 700, "currency": "GBP", "period": "day" }, // ββ Apply flow ββ "applyUrl": "https://www.cwjobs.co.uk/job/product-consultant-ii-insurance/verisk-analytics-job107380088", "applyType": "internal", "scrapedAt": "2026-05-21T20:25:31.012Z" } ``` ### Apply flow β what `applyUrl` and `applyType` mean | `directApply` | `applyType` | `applyUrl` | Meaning | |---|---|---|---| | `true` | `"internal"` | **= `jobUrl`** | CWjobs hosts a one-click apply form on the job page itself. | | `false` | `"external"` | `null` | External recruiter ATS (e.g. Greenhouse, Workday, the company's own careers portal). Open `jobUrl` in a browser and click *Apply* to be redirected. | | missing | `"unknown"` | `null` | JSON-LD didn't surface the flag. Treat the same as `"external"`. | **Practical rule of thumb:** β 60β70 % of CWjobs listings are `directApply: true`. ### Notes & limitations - **Day-rates are common for contractor roles.** UK tech contracting is rate-per-day (Β£500βΒ£900/day typical for senior software engineering contracts). The structured `salary.period: "day"` field captures that β use it to separate contractor day-rates from permanent annual salaries in analysis. - **`employmentType` fill is higher than average** (β 80%) because UK tech has clearer permanent-vs-contract distinctions. - **`jobLocationType: "TELECOMMUTE"` is common** for tech roles (remote / hybrid working is mainstream in IT). - **Apify Residential GB is mandatory** for the per-job detail fetch. - **No radius-based filter.** Use a tighter `where=` location instead. - **No maximum-salary filter.** Only minimum (`?salary=N`). - **CWjobs editorial mix is broader than pure software.** Their definition of "tech" includes IT operations, industrial automation, analytics, insurance-tech, and adjacent engineering. Expect some "Instrument Control Automation Technician" or "Product Consultant" alongside the pure software roles. ### FAQ **Which CWjobs URLs work?** Two types: **listing URLs** (`/jobs/javascript`, `/jobs/devops/in-london`, `/jobs/in-remote`, `/jobs/{company-slug}-jobs`) which auto-paginate, and **direct detail URLs** (`/job/{title-slug}/{org-slug}-job{id}`) which scrape one row each. **Why is my salary Β£650 instead of Β£65,000?** Tech contractor jobs are paid by day. The `salary.period` field is the source of truth: `"day"` = daily rate (contractor), `"annum"` = annual salary (permanent), `"hour"` = hourly (uncommon in tech, more usual in support roles). The `min`/`max` numbers are in the unit indicated by `period`. For a clean salary analysis, group by `period` first. **Are remote / hybrid jobs included?** Yes. UK tech is heavily remote-friendly. Use `?jobType=workFromHome` to filter to remote-only roles, or check the `jobLocationType === "TELECOMMUTE"` field on each row. **What does each dataset-item charge cover?** One tech job row with all 14 JSON-LD fields plus the structured salary band (with `period` correctly identifying day-rate vs annual) and structured location (lat/lng). `maxItems` is per-listing-URL. ### Support - **Bugs / feature requests** β open an issue on the GitHub repo - **Custom exports / tailored fields** β drop a note via the Apify Store contact form - **Other actors** β see my [Apify Store profile](https://apify.com/memo23) *** ### π€ For AI Agents & LLM Apps Compact reference for AI agents calling this actor via the [Apify MCP server](https://mcp.apify.com) or the Apify API (actor: `memo23/cwjobs-scraper`). **Purpose:** Extract UK tech / IT job postings from CWjobs.co.uk β one flat row per job from `JobPosting` JSON-LD plus a structured salary band (annual or contractor day-rate), lat/lng, and a populated `applyUrl` for direct-apply roles. **Minimal input:** ```json { "startUrls": ["https://www.cwjobs.co.uk/jobs/in-london"], "maxItems": 25, "maxConcurrency": 4, "maxRequestRetries": 6, "enrichEmails": false, "qualifyByPayment": false, "proxy": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "GB" } } ``` **Output:** one row per job β rowType, sourceSearchUrl, jobId, jobUrl, sourceSite, title, description, datePosted, validThrough, employmentType, industry, directApply, jobLocationType, applicantLocationRequirements, employer {name, url, logoUrl}, location {text, locality, region, postalCode, country, lat, lng}, salary {rawText, min, max, currency, period}, applyUrl, applyType, scrapedAt. **Behaviors an agent should know:** - `startUrls` mixes listing URLs (auto-paginate) and direct detail URLs (one row each). Query filters honored server-side: `?postedWithin=1|3|7|14`, `?companytypes=1|2`, `?salary={int}`, `?jobType=permanent|contract|temporary|partTime|workFromHome`. - `maxItems` is **per listing URL**; default `1000`. Free-tier users are capped at 100 total rows. - `salary.period` distinguishes contractor day-rates (`"day"`) from permanent annual pay (`"annum"`) β group by it before analysis. - Apify Residential GB is required for the per-job detail fetch; keep `maxConcurrency` at 3β5. - `enrichEmails` (opt-in) adds employer contact-email fields, billed per email found (never for misses); `qualifyByPayment` requires it and adds payment-stack fields at no extra charge. - Each job row is one paid dataset item (pay-per-result); see the Pricing tab on the actor page. *** ### β οΈ Disclaimer This Actor is an independent tool and is **not affiliated with, endorsed by, or sponsored by** CWjobs.co.uk or any of its parent / sister companies. All trademarks mentioned are the property of their respective owners. The scraper extracts only **publicly visible** tech job postings from CWjobs.co.uk β no login, no CAPTCHA solving, no credential forgery. The actor uses a conservative concurrency cap (default 4 parallel requests) to avoid burdening CWjobs's infrastructure. Users are responsible for: - Complying with CWjobs.co.uk's Terms of Service - Following UK GDPR + your jurisdiction's data-protection laws when storing or processing scraped postings - Not contacting candidates listed by employers in scraped postings - Not republishing scraped data in a way that competes commercially with CWjobs *** ### SEO Keywords cwjobs scraper, cwjobs.co.uk scraper, scrape cwjobs, uk tech jobs scraper, it jobs scraper uk, software engineer jobs scraper, javascript jobs scraper, devops jobs scraper, data engineer jobs scraper, cybersecurity jobs scraper, uk tech salary data, contractor day rate data uk, uk it recruitment data, tech recruitment scraper, uk tech market intelligence, uk it salary benchmark, software contractor rates uk, remote tech jobs scraper, london tech jobs, manchester tech jobs, edinburgh tech jobs, uk it employer data, b2b sales prospecting tech # Actor input Schema ## `startUrls` (type: `array`): Mix of listing URLs (e.g. `https://www.cwjobs.co.uk/jobs/in-london`, `https://www.cwjobs.co.uk/jobs/javascript-developer/in-london`) and direct job-detail URLs. Filters supported in the query string: `?postedWithin=1|3|7|14`, `?companytypes=1|2`, `?salary={int}`, `?jobType=permanent|contract|temporary|partTime|workFromHome`. Listings auto-paginate; details emit one row each. Result set is scoped server-side to the IT/tech vertical β exactly what cwjobs.co.uk's web search shows. Both plain URL strings and the request-list object form (`{"url": "https://.../"}`) are accepted. ## `enrichEmails` (type: `boolean`): If enabled, tries to find a contact email for each employer by discovering the company's website (Clearbit) and reading its contact/about pages. Adds contactEmail + contactWebsite columns plus a detailed emailEnrichment object. Best-effort, billed per contact email found; only charged when an email is returned, never for misses. ## `qualifyByPayment` (type: `boolean`): Requires "Enrich with contact emails". Scans each business's website β reusing the pages already fetched for email discovery, so no extra cost or time β for payment processors and e-commerce platforms (Stripe, Shopify, PayPal, Paddle, Lemon Squeezy, WooCommerce, Square, Chargebee and more). Adds takesPayments (is this a real paying business?), paymentProcessors (which stack), stripeLiveKey (the public key if exposed) and paymentConfidence. Turn raw contacts into monetization-qualified leads. No extra charge β included with each enriched company. ## `maxItems` (type: `integer`): Maximum job rows emitted **per listing URL**. Pass 3 listings with `maxItems: 100` β up to 300 total rows (100 each). Direct detail URLs always emit 1 row each. Each row is one paid dataset item. Default 1000. Free-tier users are additionally capped at 100 total rows. ## `maxConcurrency` (type: `integer`): Parallel HTTP requests for detail-page fetches. Concurrency 3-5 is the sweet spot via Apify Residential GB. ## `maxRequestRetries` (type: `integer`): Per-URL retry budget on network errors, proxy CONNECT failures, HTTP/2 stream resets, and transient 4xx responses. Each retry rotates the proxy session. Default 6. ## `proxy` (type: `object`): Leave empty: paying users are routed through our own residential pool automatically. On a free plan the run uses your own Apify Proxy β set a Residential GB configuration here if your plan includes it, since CWJobs job pages are Akamai-protected. ## Actor input object example ```json { "startUrls": [ "https://www.cwjobs.co.uk/jobs/in-london" ], "enrichEmails": false, "qualifyByPayment": false, "maxItems": 1000, "maxConcurrency": 4, "maxRequestRetries": 6, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "GB" } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '