# Wiley.com Scraper (`lexis-solutions/wiley-scraper`) Actor Scrape book and journal data from Wiley.com—including titles, authors, abstracts, ISBNs, publication dates, and links. Ideal for research aggregation, catalog building, and market analysis. Fast, structured, and customizable extraction. - **URL**: https://apify.com/lexis-solutions/wiley-scraper.md - **Developed by:** [Lexis Solutions](https://apify.com/lexis-solutions) (community) - **Categories:** Automation, Lead generation, Other - **Stats:** 9 total users, 0 monthly users, 100.0% runs succeeded, 1 bookmarks - **User rating**: No ratings yet ## Pricing $29.00/month + usage To use this Actor, you pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage, which gets cheaper the higher Apify subscription plan you have. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#rental-actors ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** — the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Wiley Scraper ![banner](https://i.ibb.co/DPBR1gXt/wiley-cover.png) 👋 Welcome to the Wiley Scraper! This actor extracts book and publication data from Wiley.com. With this actor, you can easily gather data about academic books, textbooks, research publications, authors, pricing, and more from this leading academic publisher. ### Introduction The Wiley Scraper is a web scraping tool that extracts publication data from wiley.com. It is useful for academic research, bibliometrics, competitive analysis, and anyone interested in analyzing academic publications and textbooks. ### Use Cases - **Academic Research**: Collect book metadata, authors, and publication details for literature reviews. - **Bibliometrics**: Analyze academic publications, authors, and publishing trends. - **Dataset Building**: Aggregate book metadata (ISBN, pages, publish dates) for research databases. - **Price Monitoring**: Track pricing and availability of academic textbooks and publications. ### Input 📥 To use this actor, provide the following input fields: - **startUrls** (array, optional): Direct URLs to scrape. Can include search pages or book detail pages. - **query** (string, optional): Search term or keyword for books and publications. - **maxItems** (integer, required): Maximum number of books to extract. Example: `50` - **page** (integer, optional): Starting page number. Default: `1` - **sortBy** (string, optional): Sort order for results. Options: `relevance`, `authorAtoZ`, `titleAtoZ`, `publishedNewToOld`, `publishedOldToNew`, `priceLowToHigh`, `priceHighToLow` - **proxyConfiguration** (object, optional): Apify proxy configuration. Default: `{ "useApifyProxy": true }` Note: - You must provide at least one of `startUrls` or `query`. Example input: ```json { "query": "machine learning", "maxItems": 50, "sortBy": "relevance", "page": 1, "proxyConfiguration": { "useApifyProxy": true } } ``` ### Output 📤 The output is a dataset of book objects with the following fields: ```json { "title": "Charmed Knits: Projects for Fans of Harry Potter", "url": "https://www.wiley.com/en-ie/Charmed+Knits%3A+Projects+for+Fans+of+Harry+Potter-p-9780470067314", "authors": ["Alison Hansel"], "authorUrls": [ "https://www.wiley.com/en-ie/search?filters[author]=Alison%20Hansel&pq=++" ], "productOptions": [ { "type": "Paperback", "price": "" } ], "isbn": "978-0-470-06731-4", "image": "https://media.wiley.com/product_data/coverImage300/14/04700673/0470067314.jpg", "numberOfPages": "176", "publishDate": "May 2007", "description": "Sit and Knit a Spell

You'll soon be knitting enchanting things you didn't know were within your powers. Charmed Knits offers dozens of patterns for items that evoke the mystique of Harry Potter - a Wizard Robe, an Invisibility Shawl, a Quidditch Sweater, Ron's Ragg Raglan, a Clock Blanket, Harry Christmas Ornaments, and more. Easy-to-follow patterns, color photos of the finished projects, and illustrations of special stitch patterns and design elements make it easy for all knitters - from beginners to those at Mrs. Weasley's level - to work knitting magic. Charmed Knits whisks you away on a wonderful journey. Along the way, you can pick patterns inspired by the Weasleys, stock up at Diagon Alley, show your house colors, conjure up gifts, or create pieces to help you feel at home in the magical world of Harry Potter.

", "aboutTheAuthor": "Alison Hansel is an avid Harry Potter fan and a popular knitting blogger whose daily missives can be read on the blue blog at alison.knitsmiths.us. The online go-to gal for Harry Potter tribute knitting, she has published patterns in the popular online knitting magazines MagKnits and Knitty.", "permission": "", "tableOfContents": "" } ``` ### How many books can the Wiley Scraper extract? The scraper paginates through book listings and will extract up to the number specified in `maxItems`. If you want all available books, set a high value for `maxItems`. ### Why use the Wiley Scraper? - ⚡️ **Fast**: Quickly gather academic book data for your needs. - 🤙 **Easy to use**: No coding required—just input your search criteria and run. - ☑️ **Well-Maintained**: Maintained by the Lexis Solutions team for reliability and updates. - 🎯 **Flexible**: Support for multiple input methods (URLs, search queries, sorting options). - 🔍 **Comprehensive**: Extracts detailed metadata including authors, pricing, and table of contents. ### FAQ 💬 - **Can I use this scraper to download full texts?** - No, this scraper extracts metadata and page-visible information only. - **What if the website changes?** - If Wiley changes its website structure, the scraper may need to be updated. Please report issues or request updates as needed. ### Need to scrape other academic or publishing data sources? Explore related actors on Apify: - [Barnes & Noble Scraper](https://apify.com/lexis-solutions/barnesandnoble-scraper) - Books and publications - [Companies House UK Scraper](https://apify.com/lexis-solutions/companies-house-uk-scraper) - UK company registry data - [Kununu](https://apify.com/lexis-solutions/kununu-scraper) - Employer reviews (labor market research) - [Jobs.ch](https://apify.com/lexis-solutions/jobs-ch-scraper) - Swiss job listings - [InfoJobs](https://apify.com/lexis-solutions/infojobs-net-scraper) - Job listings - [JobsDB](https://apify.com/lexis-solutions/jobsdb) - Asia job listings - [Jobs.cz](https://apify.com/lexis-solutions/jobs-cz-scraper) - Czech job listings *** 👀 Need help or want a custom solution? Lexis Solutions is a certified Apify Partner. We can help you with custom data extraction projects. Contact us via [Email](mailto:scraping@lexis.solutions) or [LinkedIn](https://www.linkedin.com/company/lexis-solutions) # Actor input Schema ## `startUrls` (type: `array`): URLs to start with. ## `maxItems` (type: `integer`): Maximum number of items that will be extracted. ## `proxyConfiguration` (type: `object`): Your proxy configuration from Apify ## `query` (type: `string`): Query ## `page` (type: `integer`): Page ## `sortBy` (type: `string`): Sort ## Actor input object example ```json { "startUrls": [ { "url": "https://www.wiley.com/en-ie/search?term=golf" } ], "maxItems": 10, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.wiley.com/en-ie/search?term=golf" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("lexis-solutions/wiley-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.wiley.com/en-ie/search?term=golf" }] } # Run the Actor and wait for it to finish run = client.actor("lexis-solutions/wiley-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.wiley.com/en-ie/search?term=golf" } ] }' | apify call lexis-solutions/wiley-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,lexis-solutions/wiley-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/cNaH3xMdIMu0OkVGc/builds/tlXqnZWBGknZI9mXN/openapi.json