dexi.io web scraper is the tool used by global leaders. We have facilitated intelligent web scraping solutions for FMCG’s, Hedge funds, Banks, Retailers and many more industries where decisions are driven by facts and data rather than a gut feeling.
Harvest your data with our precision scraper, trawl data with our Crawler, refine and enrich your data with our intelligent Pipes robot and finally connect directly with our API and secure web hocks.
With the most advanced web scraper on the market from dexi.io you can extract data from any website. Point and click on any object to build and expand even the most complex automation tasks.
The preview area shows you the page you are currently scraping and its current state within your robot. Dexi offers a simple timeline interface to help you build and visualize your robot workflow.
Context sensitive short cuts are shown when you make a selection in the preview area, giving you instant access to triggers and actions to drive your project forward.
Extend what you can do with dexi using our growing list of addons. Through addons more features are available in the Extractor and Pipes - and can integrate to a growing list of data stores and endpoints like PostgreSQL, MySQL, Amazon S3 and more.
Expect a lot of new, cool addons to be added in the time to come!
We have completely revamped and reorganised the functionality you can use in robots and run configurations (integrations).
In the new Addons section you can get an overview of all available addons, filter them by category and quickly add them to your account.
Fully featured visual programming with advanced, web interaction, login credentials, payment processing, RPA and much more. Combine the power of hundreds or even thousands of robots to orchestrate your intelligent data solution with Pipes intelligent master robot.
No credit card required. No setup fees. No obligation
With our market leading Web Scraper (Extractor robot) you can extract data from any website. The (Web Scraper) supports a full browser environment allowing you to automate and extract data from any website that you can visit in a normal modern browser. It is fully HTML5-compliant and boasts the same feature set of a desktop Web browser. It handles HTML, CSS, Javascript, downloads, Web sockets, log-ins, and much more.
The ultimate web scraping platform Quick introduction to Web Scraping (Extractor Robot) Written by Morten Garbøl Franck
Via Pipes robots it is possible to define a completely custom robot execution flow performing arbitrarily complex data processing and transformation logic. For example, a Pipes robot could execute an Extractor robot, loop over its results, call an external web service for a specific field in each result, do some custom formatting of the web service result and save the “enriched” results in a data set - and many other things.
How can I create a Pipes project? Introduction and guide to setting up your first Pipes Robot Written by Henrik Hofmeister
The key configuration defines how the system matches rows, ie. determines duplicates. A data set key can thus be seen as primary key in SQL terminology. For each field of the data type of the data set, the user selects the fields he/she wants to be part of the key and for each key field define both comparison method and weight (a value from 1-10 indicating how important the value of this field is relative to the values of the other fields).
How do I use Data Sets for deduplication? A quick introduction to introduction to deduplication Written by Morten Garbøl Franck
Trusted by 40,000+ companies... and growing
Sign Up now and try the leading webscraping tool available
By continuously monitoring the web, you can proactively manage your channels, competition and brand perception – rather than reacting when it’s too late.
Easy creation of content aggregators gather material from various sources for their Web sites or gather and distribute content to suit your team or user needs.
Imagine having access to real time insights on company and competitor product pricing/ compliance. Automate, streamline and scale your solution.
Collecting and synthesizing detailed background information can be hugely time-consuming, particularly if your processes aren’t automated.
Tap into the web’s vast store of financial information, market trends and industry topics to pinpoint the companies you need to know or do business with.
Your success depends on accurate competitive product and pricing intelligence – decision-grade information that you can act on to maintain and grow your market position.
The Extractor supports a full browser environment allowing you to automate and scrape data from any website that you can access with a browser.
Huge cloud capacity is built into our solution. And you can easily scale your setup by simply adding more scraping capacity to your account.
Add features to your Extractor and Pipes - and integrate to data stores and endpoints like PostgreSQL, MySQL, Amazon S3 and many more.
Pipes is powered by a full-blown ETL and data transformation engine that allowes you to apply just about any post-processing on the data that you need.
Connecting your data to where you need it easy with our many out of the box integrations options - we and are adding more all the time.
With dexi.io data processing features you can transform, manipulate, aggregate and combine data - our aim is to provide you with a polished ready-to-use data stream for whatever purpose.
When a robots fails (for example because the data-source being captured was altered) dexi.io provides the tools you need to quickly asses why and fix the issue to allow the robot to continue.
The built-in audit-function let’s you automatically de-duplicate your data before sending it to your own systems.
Professional and dedicated support
We’re committed to providing the best customer service in the industry. Our dedicated support team is ready to handle any of your concerns, providing a single point of contact for all inquiries, requests for service, and other technical assistance. Our online support is open Monday - Friday 8.00am - 5.30pm (GMT). But you can always visit our Knowledge and find answers to all of your questions.
Sign up to a free trial or book a product demo to learn how we can access your data.
Instant FREE trial!
No credit card required. No setup fees. No obligation
Already have an account? Log in
For technical enquiries visit the knowledge base or contact our support