Announcing better crawling, a new API detail page and help center

We’ve just rolled out a few changes that will make your experience with kimono (even) better – inspired by your feedback!

Powerful enhancements to crawling: We’ve simplified how you get data at scale with two new crawl strategies:

  • URL generation lets you quickly create a list of URLs to crawl from a domain, based on a single source URL (e.g., different product pages on amazon).
  • Pagination + crawling lets you crawl more deeply into a website, by paginating through each URL within your crawl list to get the complete set of data.

Redesigned API detail page: The new detail page takes you straight to the data retrieved by your API and enhances it with relevant meta data (e.g., source URL). Other tabs allow you to control your API settings, access other outputs (e.g., email alerts, WordPress, Google Sheets), see code samples for calling your API and comment in the discussion forum.

New help center: To help you get up and running quickly, we’ve launched a brand new help center. This is the comprehensive, searchable guide to all things kimono. In it you will find answers to every aspect of how to use kimono and anything else your heart desires.

We’ve also baked in a lot of other enhancements into this release. We hope you enjoy discovering them and please let us know how you like the new kimono!

Guest Post: The Semantic Web is dead – long live the Semantic Web!

Contributed by Dirk Stähler, author of “Tracking Information on Today’s Internet”.

The Semantic Web, the World Wide Web Consortium’s 2001 proposal to standardize the web to a consistent and structured format, has failed to gain traction in any significant way more than ten years later. However, by empowering individuals with new tools to structure, process and create from niche web content, we can achieve the vision of the Semantic Web with a different approach.

Continue reading

Guest Post: Looking beyond the star rating – sentiment analysis for restaurant reviews

Contributed by Dillon Robinson. See his website here.

The timing was perfect. I’d just had bad food at a supposedly delicious restaurant, when my brother began to rant about this neat new thing he had recently discovered called “kimono”. He had used kimono to build a web app to grab the restaurant’s UrbanSpoon rating and make fun of the (mediocre) score. It was a small and amusing test of what kimono could do. At the moment I was browsing the restaurant’s Yelp page, and that got me thinking — could I use kimono to pull data from Yelp in a similar way?

Continue reading

Guest Post: Fantasy Football Command Center: How I Manage, Balance My Scores of Fantasy Squads

Contributed by Ryan Lessard and originally posted at RotoViz. Follow Ryan on twitter @ryanlessard and read more of Ryan’s Fantasy Football pro-tips here.

I don’t know about you, but I’m feeling the pain after drafting a few too many teams this year.

I’ve noticed that I’m not the only one playing in more leagues than ever before. My friends all seem to be playing in three-plus leagues this season and a quick search on reveals that there are three times as many MFL 10/25/50s than last year. Despite the success of a handful of systems, I doubt many people playing in three-plus leagues do so exclusively via one outlet, so I wanted to share how I’m managing my teams across several systems.

Continue reading

Guest Post: How to hack Burning Man with APIs and text messages

Post contributed by Manuel – follow him on twitter @maebert and check out his personal blog here

Different people have different ideas about their perfect vacation. Some day-dream of relaxing on white beaches and palm trees. Others seek the thrill of snowboarding down the rockies. And then there are those who really just want to run through the desert half-naked, entangled in EL wire and exploding things to toss anvils 100ft into the air.

That’s me. And the probably only place on earth you can do this is the Burning Man festival. Problem is, I completely failed to get a ticket in time this year, and in between a lot of travelling I woke up with the sudden realisation that there were only five days left to find a ticket. The ePlaya forum had plenty of people offering tickets at face-value, however the demand this year was so high that the average time until a ticket got sold was less than four minutes. I was still stuck in Edinburgh, UK; and there was no possible way I could monitor that page all day round to call dibs on the next ticket offered.

Continue reading

Are biotech, parents and bitcoin the next big things? A data-driven look at Y Combinator investment trends


Y Combinator’s investments over the past decade have led to a portfolio of companies valued at north of $30bn, speaking to the incubator’s ability to identify high-value ideas and industries on the rise. On demo day for the Summer 2014 batch last Tuesday, we were struck by the mix of problems that these companies are looking to solve and how different it looks from a decade ago (remember when daily deals were a thing?) As a bellwether for industries on the rise (and maybe a clue as to where we should invest our rainy day funds…) we decided to get some data and take a closer look at where (and why) YC is investing now.

Continue reading