Happy July, everyone!
I’m making progress, but I’ve been mostly heads-down with client work the last few weeks.
The biggest change is that I’m moving from database-driven querying to search-engine-driven querying. I set up the alpha version using Postgres and hstore, and ran some tests to see where it would fall over. It turns out that it falls over at smaller load levels than I’d like.
I’m glad I ran that set of experiments when it was just me and a couple of folks playing with it, instead of in front of the whole world.
So, I’m implementing a version using Amazon CloudSearch for some of the heavy indexing lifting. Depending on how things work out, I should be able to see if this will carry me through by the middle of August. Then, I can fire everything up again and see where the new constraint in the system will live.
It’s also giving me a good chance to go back and refactor a few of the pieces that I didn’t get right the first time. I need to tear everything down anyway, I might as well fix the other stuff while I have the tools out.
I’m hoping for beta one at some point between now and eventually. It’s not quite turning into Project Xanadu, but I worry that we’re trending that way.
Quick update: the alpha is close to the point where it will be available for thrill-seekers to test drive. Please ping me if you want an invite.
I’m making good progress on this (increasingly) large project.
The production environment is sketched and spiked, using Amazon Web Services. I think I’ve solved the SSL issues with a combination of CloudFlare and elastic load balancer.
The crawler is up and running — I’d even say reasonably solid. It’s well-behaved, working with robots.txt files and following all the crawler best practices. Once it’s running on the AWS servers, I’ll get a better idea for how many sites just block traffic from the Amazon IPs on general principles. I have a feeling that I’ll be paying for other people’s sins.
The personalization math is done and the code is prototyped. As I’m using it, I’m tweaking the coefficients for the gestures to balance how much they can influence the profiles.
The front end is not egregiously ugly! No one would ever claim that I’m a designer, but I’m going to have that alpha in front of people to get feedback, and then bring in a real design person/team/agency for the beta version.
March is going to be an insane month in pretty much every corner of my life, but I’m still hoping to have an alpha version that I (and maybe you!) can use in the beginning of April.
I’m still working diligently towards my rock-solid deadline of “Launch this thing at some point in the indeterminate future.”
I finished the gesture engine this week. Now that that’s solid, I’m spending most of my time over the next month working on the profile balancer and its complement, the homepage builder.
I’m looking at these like a chef composing a recipe: how can I balance the flavors just right? I’m working to strike the balance among recency, relevance (how it maps to your interest profile), and reputation (how important the page is on the worldwide Internet).
My AWS infrastructure is set up, and I’m running parts of the application on it right now. Making progress.
I should be able to get into alpha Real. Soon. Now. (I’m shooting for by Opening Day, but we’ll see…)
Thanks for staying tuned.
It's always fun to get a peek into other professionals' working lives. Here is the Epicurean Dealmaker on why junior bankers lives are as they are.
[T]his massively inefficient workflow arises organically out of the nature of the work we do. Typically, a junior banker will roll into work relatively late because she was at work until midnight, one, or two o’clock the previous night finishing the corrections or first draft of a presentation or model which a senior banker dumped on her desk before he went home and demanded be put on his chair overnight for when he arrived in the morning. It will often take several hours, if not all day, for the senior banker to review the changes and give them back (for why, see infra), so the junior banker will fill her morning with odds and ends of other projects or deals she is working on plus the inevitable conference calls with clients and internal meetings on live and prospective deals.
I am, in fact, still alive — not that you'd know it from my writing here. I've been heads-down on the next version of my news engine, which is scheduled to launch at some point Real. Soon. Now.
My "linky goodness" posts that used to live here are now mostly going through my account on Twitter. You can follow them (in nicely consolidated form) here on TweetDeputy. It's a quick way to keep up with what I'm finding interesting on the web.
The children go back to school tomorrow, and the transition from Dad-mode to launch-mode begins.
After I took a week or two off to adjust to an abrupt transition, this has been an insanely productive summer. (Obviously not the “writing the blog” front, though.) I’m in the middle of rewriting Serendeputy, my personal news application, from the ground up, and I’m pretty excited by the direction it’s taken. A lot has changed since I wrote the first version in 2008-2009, and it’s been so much fun to be able to update it to match the world we’re in now.
It’s currently in private “pre-alpha”
i.e., running on my laptop. I should have a thrill-seeker version available for early testing by the end of September. If you’re interested in playing with it, please drop me a line.
Tech notes for those who are interested in that sort of stuff:
- It’s still a Rails (4.0) front end, but that’s almost entirely a thin wrapper over a series of services.
- I’m playing with Clojure for the personalization engine. I’ve written the original logic in Ruby to make sure it works; I’m going to see if I can port it over to Clojure to get a performance and memory boost.
- I’m pretty much all in on AWS. Serendeputy currently runs on a few Rackspace (formerly Slicehost) servers; the new version is entirely AWS-based.
- I’m about to fire up RubyMotion to write the iOS client. I’d really rather have a native client, and I’m hoping that my using a Ruby-based environment can make that happen. If it works, then I should be able to contract out an Android version. If not, then I’ll fall back to the mobile-optimized site through the browser.
My whole team was laid off at the end of last week. So, I have lots of unexpected free time on my hands! If you know anyone who can benefit from my skills, please send them along. Here’s my LinkedIn profile.
In the meantime, I’m going to work on building the next version of Serendeputy (potentially with a shorter name) and getting up to speed on a couple of new technologies. It’s as good a time as any to write the iOS front-end.
We just launched a new product called Care Assure.
The idea is that we can provide an friendly, objective assessment of your senior to let you both know how she’s doing. I think this will be useful, because an expert can spot potential issues before they become real problems.
Please check it out and let me know if you think it would be useful. (Or, buy it if you need it now!).
It’s times like these when I’m excited to be living in the future.
I learned algebra in seventh grade, from Mrs. Doyle if I remember correctly. That seemed appropriate; even while not starting until the seventh grade, I was probably among the first 20% of Holliston’s class of ’90 to learn algebra. It was hard, but I figured it out, eventually moving on to geometry, trig and calculus.
Sadie is in first grade.
I got her the Dragon Box game for the iPad after hearing about it from Leo Laporte on one of his podcasts.
We played it together in the beginning, but eventually she just started playing it by herself, eventually making it all the way through and beating the game.
In the beginning, it was matching various pictures. By the end, it was factoring out common elements and solving for x as you can see in this picture.
I’m proud of her, because I think this is actually pretty impressive for a first grader. (humble brag).
I’m more interested in what other forms of self-directed learning are now possible for her. If you have any suggestions for similar types of experiences, please email them to me or send them along on Twitter.
I can only imagine what college will be like for her in 11 years.
Yes, I realize I’ve been a little light on the posting ’round these parts lately. (And don’t even talk to me about the state of 39 Essays. That’s turning into the project of a decade, not a year.)
Anyway, part of the reason I’ve been dark is because we’ve been working towards another launch, one that went out the door this morning.
Potentially most interesting in this release is that we’re incorporating expert senior-living advice from some of the top experts in Massachusetts (and eventually around the country). And no, I’m not just rewriting Abuzz.
Well, for the first time since 2000, I do not have season tickets to the Red Sox.
Over the past couple of years, we’ve been lucky to get to five of our games over the course of a season. I blame the children.
Last year’s team was unlovable. I hope this year’s team is more charming, and I look forward to summer nights on the porch with the radio going.
Maybe this is the year.
I’ve been doing a lot of reading to get up to speed in my role at Compass Aging.
By far the best book I’ve read is A Bittersweet Season by Jane Gross, the original editor of the New York Times’ New Old Age blog. It combines a memoir of her time caring for her mother with a journalistic review of the industry and the challenges elders and their children must endure.
If you are older than 30 or have loved ones north of 60, you should read this book. You’ll thank me later.
We had a little over two feet of snow here in Concord during the great Blizzard of 2013. At least it happened at the beginning of the weekend.
Six hours of shoveling yesterday, in which I got almost the entire driveway done. Probably another six hours today to do the end of the driveway (where the plows dump all the snow from the busy street we’re on), the mailbox across the street so the mailman can get to it, my mother-in-law’s car, the path to the oil tank and the path to the front door. Oy.
At least I got a couple of good pictures out of it. Here’s what it looked like when I opened the garage door to get started.
Sadie and Lucy liked going out in the snow. Lucy made sure to enforce the “If I go out and play in the snow, then I get hot chocolate” rules.
With any luck, I’ll be done shoveling by dinnertime tonight, just in time to get ready to go to work tomorrow.
I just sent out the check to First Root Farm, our CSA here in Concord. I’m looking forward to the fresh vegetables all summer! If you haven’t thought about a CSA before, you should check out Practically Green’s action on how to join a CSA.
I’m still trying to stay pretty green. If you haven’t seen it, you should check out my essay on how going green is not that hard from early last year.
Happy new year!
I started a few weeks ago as the VP of Product and Technology at a startup called Compass Aging. And today, we just pushed live the first public beta of the product!
We’re building a tool that will help adult children of aging parents take control of all the challenges and opportunities that come along with that stage of life. The vision is big, and this first public beta represents about 20% of the functionality. (So, yes, things are likely to be pretty dark in these parts over the next few months…)
What’s most interesting in this first version:
- The Care Plan tool. What we’ve done here is to build out the first version of a tool that takes the concerns you have for your loved one and builds a plan customized to those concerns, with additional information and suggestions on how to take control.
- The Care Safe. This might be my favorite piece. We’ve built out the first version of a centralized place where you (and your siblings and other concerned folks) can keep track of everything that’s happening with your parents, including to-dos, notes, important documents, etc. Just keeping everyone on the same page and bought in to the plan is going to be a major win for folks.
- Housing Search. Choosing a senior-living option is one of the most important (and expensive) decisions you’re going to have to make. We want to be best in the world at helping you make that decision.
We’ve started in Newton, Needham and Wellesley. As we figure out what information is most useful for the consumers, we’re going to build this out nationwide. The IA geek in me is very excited about this project.
Check it out and let me know what you think!
p.s., Big visions require great teams. I’m hiring for about a dozen positions right now. Check them out here: Jobs at Compass Aging.
So, it’s been a little dark around these parts lately. Sorry ’bout that.
I’m in launch mode.
I’ll be back up for air in early January.
So, this is really interesting. First Root Farm, our CSA here in Concord, is doing a Kickstarter project to buy a fancy new tractor.
This is the first time I’ve seen Kickstarter used in the world outside of media and technology products. Outstanding data point.
Here’s their Kickstarter video:
While lost in Walden Woods this afternoon, I discovered a neat feature in the new Maps application in iOS6. If you keep pressing the button in the lower left, it will turn on a view where it will show you your field of vision overlaying the map.
I am obviously quite the woodsman. I made it out of a couple-acre forest with only my wits. And a GPS-enabled phone with a compass built in. And pluck — don’t forget pluck.
I haven’t forsaken you. I’ve been juggling three big projects, and the personal blog has taken a hit.
(Also taking a hit: 39 Essays, which may have expanded from a one-year project to a 10-year project at the rate I’m going).
In the meantime, TweetDeputy is archiving the links I’m tweeting, so you can sorta keep up with what’s catching my eye there.