Skip to main content

Editing your details extractor

With the details extractor we created, we might want to go back in and add hidden values or clean up other values within Import.io before getting our data output.

You can click Edit to get back to the Edit view of an extractor. After adding more columns, you can add find values that might be originally by turning off the styling of a page. To this, go to the Extractor Settings options, then disable CSS. The styling can be turned back on by re-enabling CSS.

Train with additional URLs will reveal a screen that allows you to add one or more pages to edit such as https://www.yelp.com/biz/flywheel-coffee-roasters-san-francisco?osq=Coffee+%26+Tea, to check the training of your extractor and improve it if needed. Once you add a second page, you can switch between the two pages to re-select data points if needed. The extractor will now use both pages to understand which data point you are selecting.

Besides adding data columns, you can edit existing data columns as well. Clicking the drop-down arrow next to a column name will reveal the column setting menu and you can find more editing options right side of the page under the column settings.

From the column settings, you can use Set regular expression to match and filter out a string. For example, try selecting all of the text under "Amenities and More". Then go to Regular expression and set Regular expression for column to Offers Delivery and Regex to replace with to True. Apply, then go to Default Value and set Default value for column to False. This will match the string that contains Offers Delivery and then output the True or False value in the data column. We can then use Duplicate column and change the Regular expression for column to (Offers Takeout) to create a separate column for Takeout option.

Before saving the extractor, you can drag and drop the data columns to rearrange the order and go back to the Data view to check the output. Once you are done, click Save and run or Save only.

Now with the details extractor finished, you will want to move on to creating a listings extractor.