Visualize a year of bike rides with Kimono and CartoDB

Tutorial: Map your own location data

Data is more accessible, tangible and interesting when you can visualize and interact with the figures on a page. That’s why we love teaming up with our friends over at CartoDB! Kimono is a smart web scraper that let’s you turn data on a website into an API – a structured feed of updating data. CartoDB let’s you take that data set and create beautiful interactive maps. In this post, we will use kimono to get over a year’s worth of bike trip data from New York City’s citibike bike sharing program. We’ll then use cartoDB to plot our friend Andrew’s movements on a map. A big thanks to Andrew for riding his bike a lot and sharing his data with us!

Continue reading

Guest blog: Sentiment analysis on web scraped data with kimono and MonkeyLearn

Contributed by Raúl Garreta, co-founder of MonkeyLearn

New tools have enabled businesses of all sizes to understand how their customers are reacting to them – do customers like the location, hate the menu, would they come back? This increased volume of data is incredibly valuable but larger than any mere mortal can assess, understand and turn into action. Several technologies have emerged to help businesses unlock the meaning behind this data.

Continue reading

Announcing better crawling, a new API detail page and help center

We’ve just rolled out a few changes that will make your experience with kimono (even) better – inspired by your feedback!

Powerful enhancements to crawling: We’ve simplified how you get data at scale with two new crawl strategies:

  • URL generation lets you quickly create a list of URLs to crawl from a domain, based on a single source URL (e.g., different product pages on amazon).
  • Pagination + crawling lets you crawl more deeply into a website, by paginating through each URL within your crawl list to get the complete set of data.

Redesigned API detail page: The new detail page takes you straight to the data retrieved by your API and enhances it with relevant meta data (e.g., source URL). Other tabs allow you to control your API settings, access other outputs (e.g., email alerts, WordPress, Google Sheets), see code samples for calling your API and comment in the discussion forum.

New help center: To help you get up and running quickly, we’ve launched a brand new help center. This is the comprehensive, searchable guide to all things kimono. In it you will find answers to every aspect of how to use kimono and anything else your heart desires.

We’ve also baked in a lot of other enhancements into this release. We hope you enjoy discovering them and please let us know how you like the new kimono!

Guest Post: The Semantic Web is dead – long live the Semantic Web!

Contributed by Dirk Stähler, author of “Tracking Information on Today’s Internet”.

The Semantic Web, the World Wide Web Consortium’s 2001 proposal to standardize the web to a consistent and structured format, has failed to gain traction in any significant way more than ten years later. However, by empowering individuals with new tools to structure, process and create from niche web content, we can achieve the vision of the Semantic Web with a different approach.

Continue reading

Guest Post: Looking beyond the star rating – sentiment analysis for restaurant reviews

Contributed by Dillon Robinson. See his website here.

The timing was perfect. I’d just had bad food at a supposedly delicious restaurant, when my brother began to rant about this neat new thing he had recently discovered called “kimono”. He had used kimono to build a web app to grab the restaurant’s UrbanSpoon rating and make fun of the (mediocre) score. It was a small and amusing test of what kimono could do. At the moment I was browsing the restaurant’s Yelp page, and that got me thinking — could I use kimono to pull data from Yelp in a similar way?

Continue reading

Guest Post: Fantasy Football Command Center: How I Manage, Balance My Scores of Fantasy Squads

Contributed by Ryan Lessard and originally posted at RotoViz. Follow Ryan on twitter @ryanlessard and read more of Ryan’s Fantasy Football pro-tips here.

I don’t know about you, but I’m feeling the pain after drafting a few too many teams this year.

I’ve noticed that I’m not the only one playing in more leagues than ever before. My friends all seem to be playing in three-plus leagues this season and a quick search on www.myfantasyleague.com reveals that there are three times as many MFL 10/25/50s than last year. Despite the success of a handful of systems, I doubt many people playing in three-plus leagues do so exclusively via one outlet, so I wanted to share how I’m managing my teams across several systems.

Continue reading

Guest Post: How to hack Burning Man with APIs and text messages

Post contributed by Manuel – follow him on twitter @maebert and check out his personal blog here

Different people have different ideas about their perfect vacation. Some day-dream of relaxing on white beaches and palm trees. Others seek the thrill of snowboarding down the rockies. And then there are those who really just want to run through the desert half-naked, entangled in EL wire and exploding things to toss anvils 100ft into the air.

That’s me. And the probably only place on earth you can do this is the Burning Man festival. Problem is, I completely failed to get a ticket in time this year, and in between a lot of travelling I woke up with the sudden realisation that there were only five days left to find a ticket. The ePlaya forum had plenty of people offering tickets at face-value, however the demand this year was so high that the average time until a ticket got sold was less than four minutes. I was still stuck in Edinburgh, UK; and there was no possible way I could monitor that page all day round to call dibs on the next ticket offered.

Continue reading