For the past year, I've had a daily goal of writing for 15 minutes. On the surface, it doesn't seem like very much. I spend far more than 15 minutes a day on Twitter, and far more than 15 minutes a day just getting recalibrated after a workout. The idea originally came to me when I was in college. I was working as a research assistant and the professor I worked for wrote something every day for 15 minutes.
Read MoreIt's a Thursday night and I'm on a plane flying from SFO to SLC, painstaking making a list of things I need to accomplish after attending a conference. In this process, I look over other lists I've created in the past month and realize I need to centralize my lists and come up with a better system to follow up and track goals I've created.
Read MoreFor the past few years, I’ve been an ardent believer in the promise of distributed in-memory data processing. The first time I took a Hive job, re-wrote it in Spark and saw it returned 10 times faster I was a believer
Read MoreThis post is a combination of notes I’ve taken on the subject over the last year. It’s about tools that make the trade more comfortable, some that make it more uncomfortable and stuff that the jury is still out on. I had a lot of fun writing this piece and while there isn’t any code it’s still technical.
Read MoreLike Spark, Flink is fairly overwhelming to get started with. This is mostly because of installations and run-time configurations. After a bunch of searching around and I was able to put together a decent starter SBT config for Flink. I used Intellij to work with Flink because of it’s complex API, the type hinting and other niceties come in pretty handy.
Read More
