SeekStorm is a Crawler as a Service.
A high-performance, focused crawler turns any website into JSON docs with structured data
You want to add site search to any website, extract data from the internet for data science,
make the web searchable for competition & trademark monitoring, threat alerts, or information intelligence?
You need a web scraper to monitor official gazettes and for web scraping public listings?
Don't worry about scalability and performance, we do all the heavy lifting for you.
High-performance crawling and indexing - thousand documents per second
Url filter
Focused crawling reduces crawling cost, index size and query latency
Definable user agent
For mobile and desktop content and for blocking circumvention
Polite Crawler
Definable politeness time between page fetches per domain
Multi-threaded
Definable number of concurrent page fetches per domain
Definable timeout
Optimize the trade-off between performance and reliability
Definable recrawl time
Definable recrawl/revisit time: Discover new content as it appears
Boilerplate removal
Key text extraction: extract pure content & discard navigation & ads
Structured data
Extraction e.g. author & date from schema.org and Open Graph protocol
Auxilary data fields
Auxiliary fields may be added to each crawled document before indexing
RESTful API with CORS
Powerful, yet concise APIallows to rapidly implement search into you products
Language Independent
Supports any UTF-8 text, including Latin, Cyrillic, Arabic and CJK-languages
Blog
Twitter
LinkedIn