#import.io

[hasanzanbak]

"Yapay zeka destekli web veri analizi sunan Import.io, 15,5 milyon dolar yatırım aldı" http://www.hasanzanbak.com/index.php/2018/12/24/yapay-zeka-destekli-web-veri-analizi-sunan-import-io-155-milyon-dolar-yatirim-aldi/

[octoparse-blog]

Web scraping software, also know as data extraction tool, is the software to collect the data from the website. In this post, I put the web scraping tool Octoparse head to head with import.io to see how the two tools compare. Here is everything you need to know when deciding which web scraping tool better suits you.

Octoparse vs. Import.io comparison: which is best for web scraping?

[datajournalismlinks]

In this post, I will explain how to extract data from websites using Import.io. This source allows the user to download data as spreadsheets, raw JSON or directly into the system via their API.

[thebridgejp]

データ抽出プラットフォームの「import.io」が1300万ドルを調達

データ抽出プラットフォームの「import.io」がシリーズAラウンドで1300万ドルを調達した。「import.io」を使うと、ユーザーは既存のウェブサイトからデータを抽出したり、APIを保存することができる。今回の調達ラウンドは、英国のImperial Innovationsが主導したもので、Wellington Partners、Oxford Capitalなども参加している。これまで同社が調達した額は、合計で1750万ドルになる。

同社の公式ブログで今月前半に発表された内容によれば、昨年2015年の1年間だけで、import.ioのユーザーが作成したAPIの数は100万以上、データが抽出されたウェブサイトは55億に上るという。今回調達した資金を元に「より優れたデータ抽出テクノロジーを開発し、アナリティクスやビジュアライゼーション面でのパートナーとのエコシステムを広げていきたい」…

View On WordPress

[online-marketeer]

[HowTo] Web scraping; niet alleen voor growth hackers

[HowTo] Web scraping; niet alleen voor growth hackers

Web scraping is hot en niet alleen voor startups of growth hackers. Handige (online) marketeers gebruiken het om sites te analyseren, marktonderzoek te doen of leads te verzamelen.

Wat is web scraping?

Web scraping is de extractie van informatie uit websites of applicaties van derden. Met speciale scripts of tools wordt ongestructureerde data van een website omgezet naar een gestructureerde…

View On WordPress

[silkapp]

Silk + Import.io: Instantly Transform Web Pages into Data Visualizations

Recognize the page in the image below? Of course you do. This is the Apple Watch page from Apple.com. It’s a beautiful page. But it is not just that. Underneath lies a table of data that looks a lot like a spreadsheet. Each table row contains information on a watch model. Each table column contains information on a specific aspect of the watches, such as price, product descriptions, or a link to an image.

What if you want to use that data trapped in the Apple carousel to build your own gallery or a chart, or a sortable table of Apple Watch data? Thanks to Silk and Import.io's new partnership now you can... in only a few seconds. All you need to do is paste the URL into the “Extract data from Website” box in your Silk dashboard. You don’t need to know any code. There is no plug-in. It just works.

Sounds too good to be true? Then check out the video below to see the new Silk-Import.io seamless data extraction tool in action on a live Apple Watch product detail page.

And, just like you saw in the video, here is all the watch data in Silk gallery. You can click through to see all the data on the Silk datacards. You can even build your own visualizations - charts, galleries, groups or mosaics from the data. Or you can try it yourself. It literally takes a minute. (If you are not a Silk user, you can sign up for free and extract data from the Apple Watch page or millions of other pages, too).

OK, we hope this blew your mind. Now, we’ll answer some obvious questions.

So how does this really work? Magic, quite literally. Silk has integrated with Import.io’s Magic API. Magic is the data extraction engine that looks at the contents of a Web page and automatically identifies structured data. When a Silk user pastes a URL into the “Extract from Website” box on their Dashboard, Silk sends that URL over to Magic. Magic extracts the structured data from the page and converts it into a table format. Magic then sends the table back to Silk. Silk imports the table data and converts that data into a Silk site.

Cool, Apple Watch. What other pages can I use this on? This isn’t a one-trick wonder. Want to convert the CB Insights Unicorn Tracker into a live database and analytics platforms for unicorns? Cut, paste, visualize, analyze. How about San Francisco real estate listings on Zillow? In fact, there are millions of pages on the Internet that are either entirely well structured in a table format or have portions that are well structured.

How about pagination? The Silk-Import.io integration supports limited pagination. Basically, we’ll look for pagination from Magic and automatically import the first 5 pages of data. We anticipate this should handle most the data extraction requests. If users demand deeper pagination, we expect adding that shouldn’t be difficult.

Will this work on all Web pages? Unfortunately, no. The Silk + Import.io Magic data extraction process only works on Web pages that have a clean, recognizable table structure. This could be a table hidden in a carousel (like the example above), a table lurking behind a map, or a table that is disguised as an image grid. But without clean structure, the extraction doesn’t work. Also, Web pages that are heavy on JavaScript or are dynamically served will probably not work. Still, this leaves millions of Web pages that will work very well and allow for clean data extraction. For ideas on more of Web sites that import fairly cleanly into Silk, check out our Extract URLs gallery (published as a Silk, naturally).

Want to try it yourself?

Sign up for Silk.

Paste a URL into the “Extract from Website” box in your dashboard.

The data from that URL is now in Silk! Publish the visualizations on your Silk home page or on your blog.

Turn a Web Page into Dataviz Right Now!

[jrlittle]

All the best big data tools and how to use them

There are thousands of Big Data tools out there. All of them promising to save you time, money and help you uncover never-before-seen business insights. And while all that may be true, navigating this world of possible tools can be tricky when there are so many options. Which one is right for your skill set? Which one is right for your project? To save you some time and help you pick the right tool the first time, we’ve compiled a list of a few of our favorite data tools in the areas of extraction, storage, cleaning, mining, visualizing, analyzing and integrating.

[sourcecon]

3 Resources to Help You Scrape the Web for Candidate Data

Scraping the web is a favorite pastime of many sourcers. In fact, a recent SourceCon Denver session about web scraping was one of the most popular sessions of the conference. If you’re new to web scraping, here are a few resources from the SourceCon archives to help you get started.  http://dlvr.it/7Yl3kC