C# Web Scraping Library 4.0.4.2

The web-scraper for C# allows .Net developers to create logical that extract content from web applications and turn it into JSON, spreadsheets, C# objects or even SQL using simple C# and Linq code.

Iron WebScraper is a web scraping library for the .Net 4.5 and Core platform which allows developers to use clean, simple logic to reverse any web resource back into C# objects or SQL. It can extract pages using set-by-step (if-this-then-that) workflows, effortlessly scraping and parsing html, javascript, xml, RSS, pdfs and office documents on the internet or local intranets back into useful structured data.

This leaves the developer with clean, efficient web-scraping applications which are easy to understand and debug.

The C# Web Scraping Library is extremely polite, ensuring that no domain or IP address has too many concurrent requests. It intelligently throttles both client and server side looking for excessive CPU usage and slowing to an appropriate pace. In addition, it can obey robots.txt directives including bot specific crawl rates and limitation. The exact urls and content types to be strapped can be set using logical workflows and regex/wildcard rules.

Screen-scraping is made easier with identity control, automatically managing threads, rate limits, urls, duplicates, retries, proxies, headers and cookies into a an army of virtual browser which can mimic human behavior and even client buttons, fill in forms or log in behind security walls. This is useful for migrating legacy systems, populating enterprise search facilities and for statistical competitive analysis

Full documentation, support and downloadable DLLS for the C# Web Scraper are available from http://ironsoftware.com/csharp/webscraper/ , in addition to links to a .Net 4.5+ Nuget package with full Azure and Mono compatibility.

Keywords: Web Scraping, Screen Scraping, Data mining, web scraper, .Net, Library, Component

Click to enlarge

Author:

The Iron Web Scraper Development Team     Other programs by The Iron Web Scraper Development Team

Downloads:

760

Size:

1001K

Cost:

$299.00 US

Users Rating:

    Reviews (0)     Write review

Feedback:

Report broken download     Report spyware [?]

License:

Shareware [?]

Operating Systems:

Release Status:

new (2017-02-28)

Recent Changes:

'IronWebScraper' is a new Web Scraping Library for the C# / .Net programming platform.

Release features include:
- Read structured content from websites for population of databases, search indexes & applications.
- Submission to Nuget.org : https://www.nuget.org/packages/IronWebScraper/

Supported Languages:

English, Arabic, Chinese, ChineseSimplified, ChineseTraditional, Dutch, French, German, Japanese, Spanish, Swedish

Additional Requirements:

Windows C# Development Environment such as Visual Studio Community 2015 or newer.

dotConnect for PostgreSQL
A data provider for PostgreSQL built over ADO.NET architecture.

Smtp.NET
ASP.NET email component with HTML formatting mail merge and message queuing

Active Sound Recorder
ActiveX control for sound recording, sound analysis and CD ripping

Mail Expert, All Ultimate Mail Component
Professional Mail Suite for .NET

AntiDuplicate
SDK for creation of protected software dongles from USB flash drives.

FlexCell Grid Control for .NET 4.0
FlexCell is an easy to use .NET grid control.

SFTPBlackbox .NET
Add support for SFTP (secure FTP) to your .NET (VB.NET or C#) application

CatchaPage
Direct Marketing. From web page to database in one click (UniCode version)

SmartCodeDeveloper
Add professional quality barcodes to .NET applications and Reporting Services.

Manco.Chart for .NET
.NET chart control is used to create attractive 3D and 2D charts.

TeeChart Pro ActiveX
dotConnect for SQLite
BasicVideo VC++
VideoLab VC++
Miraplacid Publisher SDK
dotConnect for MySQL
GeoDLL
AlphaControls 2019
BCGSuite for MFC
Mgosoft PDF To IMAGE SDK

AlphaControls Lite Edition (2762 dl.)
AlphaControls 2019 (2095 dl.)
SimpleLPR (2079 dl.)
WSQ image library (for fingerprints) (1948 dl.)
DAC for MySQL (1903 dl.)
Client/Server Comm Lib for Delphi (1770 dl.)
10Tec iGrid Control (1761 dl.)
Alvas.Audio (1651 dl.)
GeoDLL (1634 dl.)
dbExpress driver for MySQL (1470 dl.)