Servers are the new Apps

My career has, until recently, been devoted to building applications. What this used to mean is programs that you ran on your computer do get stuff done. Photoshop. Microsoft Word. TurboTax. Excel. Most applications have been document-centric--you open and save documents, usually on your local hard drive.

All that has changed. Even Microsoft is starting to build the venerable Microsoft Office suite as a service instead of an old-style application.

What does that mean?

It means, fundamentally, that you should quit thinking in terms of documents and start thinking in terms of transactions. When you create a blog entry for your weblog, you're not "editing a document", you're posting a transaction to a database. The old way of doing this was to open your existing "web page" as a document in a "web page editor" like FrontPage or Dreamweaver, "save" your document with the new text it it, then "upload" the document.

All of that is out the window.

The word "server" is old-fashioned, but it's the closest word we have at the moment. What it really means is that your information is centralized or, as a better way to phrase it, "in the sky somewhere" and you access your data over the network, interacting with it in a series of transactions.

That makes the "server" into the "application", because that's where your data is being maintained, and it's the server that's doing the work of editing it. You're editing it by remote control, through a transaction metaphor.

What this means is that all document-centric software will be history relatively soon. I mean all of it. The idea of "open" and "save" will just go away. Photoshop will have to learn how to edit photographis transactionally over a network, rather than loading the whole thing into memory and "saving" it. Word will learn to edit text through transactions to a remote database, not a monolithic document model.

The nay-sayer in you is saying that this will never happen, yet it is already happening. Web pages are increasingly built through this model, because they are already in the sky somewhere, so the whole round trip of download-edit-save-upload makes no sense. Other document types will follow, until there is no such thing as a document or even a "file" any more.

Programming Languages

I've learned a lot of programming languages over my career. I started with BASIC, I think, back in the 1970's. There was Action! (a cartridge for the Atari 800), Pascal, DIBOL, C, sh, csh, and it's not even 1982 yet. In the 80's I learned PostScript, Lisp, and Objective C. In the 90's there was Java, C++, Perl, Python, Objective Pascal (!), and way too many conversions back and forth between C strings and Pascal strings. Now there's Ruby, PHP, and who knows what else?

Why do we (collectively) invent new programming languages? What's the point?

Well, I would say that each programming language really did improve on some shortcoming in predecessors, or at least that was the perception at the time. Some were more interesting than others.

Pascal is what's known as a strongly typed language. You can't assign a long integer to a short integer, even if the value is 0 or 1. The language won't let you. It's supposed to help you write better code. When you're learning to program, this is a good thing, which is why all of us at that time (late 1970's, early 1980's) were taught Pascal first.

You can contradict me, but I claim that C was invented, or at least rose to popularity, because it eliminated all the rules imposed by Pascal. You could cast one type of variable into another, essentially jamming anything you wanted into memory. Kind of like assembly language, which has no "types". C is powerful, like a chain saw or a sharp knife. And yes, people have hurt themselves with C, particularly in memory management, which is explicit (you allocate memory when you need it, and you free it up when you're done). People hurt themselves this way, and programs crash because of it.

C and Pascal are compiled languages, which generate machine code that runs native on the CPU. So you have to compile a C program separately to run on, say, an Intel CPU versus a Sun CPU, even if both are running Linux. This is both an advantage (fast performance) and a disadvantage (need to recompile) of compiled languages.

Java was perhaps the most revolutionary of all these languages, because it "fixed" many of the issues with C: it is an interpreted language (as opposed to being compiled) so it can run (theoretically) without modification on any kind of CPU. Sun marketed this as "write once, run anywhere". In reality it's more like "write many times, run nowhere", but the problems with Java in the late 90's were more that the toolkit kept changing, trying to emulate all existing operating systems. The language is intact, and it really is a nice language.

Java improved upon many other things missing/wrong in C, as well. Memory is "garbage collected" which means you don't have to worry about allocating it or disposing it, and you can't really have a memory crash bug, which is nice. Lack of control over memory can sometimes lead to performance issues, but on balance it's probably a good tradeoff.

My favorite thing in Java is actually the ability to glue strings together with the "+" operator (which can be done in C++ as well but it's more of a hack and requires an object type other than C strings). In Java you can just add strings together like:

myString = "this string " + 27 + " another string";

Java has become a web programming language, mostly because the need for a consistent toolkit across operating systems is greatly diminished. Server-side web programming in particular has been dominated, until recently, by Java.

Now there is PHP and Ruby and other interpreted languages designed specifically for server-side web programming. PHP is the most innovative of these, since it can live in harmony with HTML code in which it's embedded, which is a peculiarity of web programming.

Sorry about all the historical perspective here. I really was starting out to make a point. So here it is...

Programming languages are just tools, means to an end. Depending on what problem you're trying to solve, you may be able to choose from quite a few different languages. This is a Good Thing.

But when I eavesdrop at conventions and in coffee shops and I hear young kids talking about programming languages, what I hear most is, "I learned it over the weekend" or something along those lines. Ease of learning is not a good reason to use a programming language, in my opinion. Balsa wood is "easy to learn" when you're woodworking because it's soft and you can cut it with a pair of scissors. It turns out not to be such a good wood for, say, building a dresser or a bed.

What I observe is that the craft of software programming is being polluted by throngs of young people who are able to "pick up" a programming language and "hack something together" and it sort of works, because CPU's are so blindingly fast and the safety of interpreted languages with memory garbage collection means you don't really ever have to learn any Computer Science to make things work.

But the skill and the judgement of choosing the right tools and materials to build the best possible software are disappearing rapidly, in the same sort of way that house-building has turned into a profession of stapling pre-formed lumber together, and is a profession, when 150 years ago almost everyone knew how to build their own house, could cut and square timbers, and built houses that lasted many, many generations. Those skills and knowledge of materials are disappearing, too, along with the actual lumber, come to think of it.

Maybe nobody "needs" to know the difference between an 8-bit char data type and a 64-bit long integer, and maybe there's value in snap-together software. But I have a feeling that when we get to the point where everything is built out of Legos--houses, software, cars, everything--we will wish they still taught Industrial Arts and Programming in junior high school.

Razor Blades

In the computer industry, a common topic of conversation in discussions on "how to make money" is the old razor blade analogy. The idea is that you give away the printer, and make money selling ink cartridges. I think we've all been on the receiving end of that, when you realize how expensive the ink cartridges are, and how quickly you need them. "But I only paid $49 for the printer!" That's exactly how it works.

The other day an actual razor arrived in our mail at home, addressed to my wife. It was from Schick, and it's called the Quattro for Women. It has four blades ! I was sort of amazed that they'd send a whole razor, and some blades, which I knew cost something like $10 at the store. How often does somebody send you a $10 product unsolicited in the mail? Then I realized it was a gambit to try to get my wife hooked on it so she'd buy more blades. The exact same argument we constantly have in the computer industry. I actually chuckled to myself.

I suppose Schick is upset because they have early claim to the invention of the razor, by one Lieutenant Colonel Jacob Schick, in 1926. I am surprised to learn that Schick-Wilkinson Sword is now owned by Energizer (yes, the battery people) and that schick.com gives "404 not found". But I digress.

Gillette made a huge splash a few years ago with their Mach 3, which had three blades !

I remember when the twin-blade razors came out. Now that was a real revolution. It had two blades ! And they had lots of diagrams and pictures to show you how the first blade bent the hair over, and the second blade clipped it. It worked on me, and the 3-blade update even worked on me. I use a Mach 3 from Gillette to this day.

But wait! The 4-bladed razor isn't enough. Gillette fires back with the Fusion razor, which, you guessed it, has five blades ! Maybe this has something to do with Gillette's being acquired by Procter and Gamble. In researching this blog post I see now that the competing Quattro from Schick has been out since last year, but I didn't know about it. Maybe they started carpet-bombing the world with free razors because of Gillette's announcement in September of the 5-blade razor.

This is clearly getting ridiculous. I tried my wife's 4-blade razor and I can tell you it doesn't work as well as the 3-blade razor, and if I were objective and didn't like my Mach 3 so well, I'd probably have to admit that the 2-blade razors are fine, too. I don't know about you, but my face is not flat, and most surfaces that get shaved are not flat, so it's hard to see how more than two blades could be improving the situation much, especially on concave surfaces like underarms. But clearly that's not the point. We live in a culture where more is better almost by definition.

This escalation seems silly, yet there is big money chasing this industry, all because of the original concept of keeping the handle and having to buy the blades.

I'm sticking with my trusty Gillette Mach 3, and hoping that now that all these new-fangled 4- and 5-blade razors are out, my blades will get cheaper. And I have no doubt that Schick is busily at work on the 6-blade razor, and that both companies have skunkworks projects working on 7- and 8-blade razors. I can't wait.

That's Palo Alto for ya...

I had a quick dinner in downtown Palo Alto tonight after soccer practice, with my wife and two kids and one of my daughter's friends. We went to the California Pizza Kitchen.

To my amazement, within a 20-foot radius, also having a quick dinner with their families, was Ross Mayfield, the CEO of SocialText, a popular wiki provider; David Hornik, noted VC and major investor in Six Apart; and Jeff Jordan, the President of PayPal.

And people wonder why so many amazing things happen in Silicon Valley. We could practically have put together a deal right there, over Thai Chicken pizza. Instead, of course, we all enjoyed our dinners and went on our way, spending valuable time with our families.

But who knew? Maybe the California Pizza Kitchen is the new Buck's :)

Little Things for the customer

We've made a few little changes that you might not notice unless you were one of the folks who wrote to our Support team asking for it.

One thing is that the viewer for photographs just got better. Super-large photos are now resized automatically so they display at a good size for computer screens, and there's a navigation link to click through all the photos on a page without closing and opening the windows individually. A little thing, but a welcome improvement.

Podcast RSS feeds can now be subscribed to directly in iTunes (including videos!). This is pretty cool, actually. If you drag some audio and/or video files onto a Bubbler page and click the "RSS Feed" box in web settings, you are now podcasting, and people can subscribe to your podcast directly from iTunes (Advanced menu).

Another is that the "URL" field is no longer required when posting comments. This seemed to confuse some people who don't have blogs or web sites of their own, so now it's an optional field instead of a required field. A little thing, but important.

The Files list used to also include Photos. It doesn't now; it lists the "other" files that aren't photos.

The elves are always working here at Five Across, and although you don't always see the changes, things are always getting better, and faster.

If you go to our bubbler.net site and look around, you'll see that our web platform supports custom domain mapping.

It has been dawning on me, by reading some blogs (cybersonic ) and from talking to customers, that the way we do this is really far superior to the Virtual Host mechanism in Apache. So let me geek out for a second and talk about this, because it's cool.

DNS servers are one of those things that everybody knows they need to configure to get on the internet, but most people aren't quite sure what they do. It's pretty simple: they look up a "name", and return a "number". Like a giant phone book. They resolve a name like 'bubbler.net' to an IP address (66.201.44.131). That's pretty much all they do.

So when you type an address into a browser, it looks it up in the directory (DNS server) and opens an HTTP connection to that IP address. Simple, right?

But for "custom domains", what happens is that lots and lots of different domain names all map to the same IP address. In our system, not only does bubbler.net map to 66.201.44.131, so does blog.glennreid.com, m949.com, www.blodgettcommunications.com, and hundreds of others.

So how does the server sort this out, with all these domains coming to the exact same place, just an IP address?

The HTTP request header has the domain name that the user is surfing in on. The only question is what page to serve, as you don't want to give index.html to everybody. So you need to associate a user/page owner with each domain name.

With Apache, the administrator has to create a VirtualHost entry in the Apache config file, which is not for the faint of heart. The admin has to set up a "root directory" and permissions and decide whether or not to allow server-side includes and a bunch of stuff like that. It is not a trivial process. Then you have to restart the Apache server for it to take effect.

With our server, we just look at the incoming HTTP request header and see what domain it thinks it's being sent to, and we look it up on the fly to see if any of our users have claimed that domain for one of their pages, which they do by just typing it in, in the Rename Page dialog. It is instantaneous and highly scalable, unlike Apache, which reserves resources for each virtual host and you can only host a relatively small number on any given server. We can host hundreds, or thousands, of unique domains on a single server, without the administrator doing anything, or even knowing about it. The users can do it themselves. The only hard part is configuring the domain registrar's interfaces, which can be a bit challenging (we have partnered with one, PairNIC, who makes it fairly easy, and we have instructions on how to do it).

Anyway, it occured to me that we have a pretty great innovation in this area and as hosting providers discover this, I think they will be sort of amazed. It's not the kind of thing that gets a lot of attention in the press, to come up with a better way to do virtual host tables, but for the people who have to do this all day long--and there are a lot of them--it's pretty significant.

Web 2.0: the energy is building

I am excited about a lot of the news coming out of the Web 2.0 show. Our server engine to power many of these kinds of services and we're getting a ton of interest in it.

We're going to roll out a developer API relatively soon and we're looking for key developers to partner with to build innovative front-end applications on our platform. If you're interested, drop me an email.

We're about to announce some new OEM partners as well.

I do have to take issue with some of the press around Web 2.0 that is characterizing it as "frothy" or a "bubble economy". There is certainly some speculation happening, but it's too early to tell which things (voice over IP, social networking, blogging) will be the fabric of the new internet, and which are passing fads. We're agnostic, and believe that all of these things should be the basic building blocks of the next-generation internet. And we plan on powering it.

Software Design: Ease of Use vs. Discoverability

Almost every product you pick up, whether it's a hot glue gun or a $1000 impossibly complex piece of software, says this on it somewhere: "Easy to Use!"

But many products aren't so easy to use, as we all know. So this term has almost lost its meaning, like "intuitive" or "all natural". So what do you say about your product if it truly is easy to use? And what does that mean, anyway?

I want to make a distinction between ease of use, and ease of learning or discoverability.

Here's a simple example in software products: drag and drop. It may be easy to use, but how the heck do you discover that certain areas of certain windows can have things dropped on them? And just what kinds of things can you drop on them? The inverse of this is the File/Open menu item, which brings up an open panel in which you hunt around your hard drive in a tiny little modal window. That functionality is easy to discover (it's right there in the menu) but very tedious to use, particularly if you have a lot of files, in different places.

Another example is the use of styles in programs like InDesign and Word. They're really easy to figure out what they're supposed to do, and really hard to use. The problems range from scope (what in the heck will change when you click Apply) to the tedium of repeatedly selecting text then going back to the palette to click the style. NeXT Computer innovated in this area, it's now in many MacOS X apps, and still nobody has noticed: "Copy Style" and "Paste Style". You can load up the style you want to use and then, with one hand, select text; with the other, you "Paste Style" with the menu key equivalent. It's amazingly efficient and easy to accomplish. Why isn't this idea all over the place, in every product? Or Adobe Illustrator's "Transform Again" menu commmand. Brilliant.

In my view, the right choice is "easy to use, hard to discover", with some way to make it more discoverable. Tool tips, horrible as they are, were invented for this reason, to help you discover stuff that you might not otherwise have noticed. The dreaded "Tips" that pop up, with the handy check box, "Don't show me this again", are actually a really good idea. If they're telling you something you already know, at least you won't have to suffer through it again; and if you didn't know whatever it is they're telling you, often it's truly helpful. Microsoft really pioneered this approach, and, other than overdoing it with dancing paperclips and puppies, did a very good job of integrating it into their products. Their only mistake, I think, was having 38 small opt out preferences, rather than one big giant "leave me alone!" preference (I'm thinking of Word here, with all its helpful grammar checkers, date suggesters, "You seem to be writing a letter; want some help?" and stuff like that).

Ease of use boils down to this: can you remember, a month after you last used something, how to use it efficiently?

Discoverability is a bit different: can you figure out most of the functionality of a program within the first 10 minutes, "cruising the menus"?

I think one of the best (simple) ideas of all time in this category is, I believe, Microsoft's. It's the Recent Documents menu. It does exactly what you want 99% of the time, bringing back the documents you were most recently working on, regardless of where on your computer they might be living—and it is obvious how the feature works.

AppleMatters vs. iMovie

If you read this posting on the "AppleMatters" web site:

http://www.applematters.com/index.php/section/comments/540/

You would think that iMovie was just a modest adaptation of existing movie editing software. As the original author of iMovie, I wrote a comment on that site, which required me to register.

I received some spam as a result of registering, but my comment was never posted. This bothers me still, as it seems not to be such an open forum if comments are silently not posted. So I responded to the spam, which went as email to Hadely Stern, who never responded, and my comment is still not posted. I lost my original comment, but here's the text of my email to Hadley. At least I can comment over here on my blog and maybe somebody will read it :)

To: hadley@applematters.com

From: Glenn Reid <glenn@fiveacross.com>

Subject: Re: Win a Mac mini forum contest (really another issue)

Cc: 

Hi Hadley,

Your site requested that I registered in order to post a comment, and you have no problem sending me spam as a result of my registration, yet my comment never appeared on this article:

http://www.applematters.com/index.php/section/comments/540/

As the author of iMovie at Apple, I was trying to take issue with Chris Seibold's contentions that iMove was somehow derived from Final Cut Pro. It wasn't. It was written ground-up (by me). iMovie 1.0 was a dramatic sea change and ushered in the era of Digital Media. I and a very small team (3 total) wrote iMovie in just 9 months in 1998, and it first shipped on the iMac DV. It was DV-only, brought a copy/paste metaphor to the previously hobbyist-only marketplace that was video editing, and the iMac DV showed for the first time why you might want a PC with a large hard drive (though it was only a 6GB drive!). To say that this was not innovation is a bit short-sighted. To say this:

"Not only was the original iMovie limited it was also a program based on an application conceived outside of Apple. The Cupertino giant did not invent iMovie they merely purchased an existing program and polished to a point where the masses would fall in love. Far from being the exception to the rule this is the norm."

Is just plain wrong.

iMovie was the first ground-up application in a very long time at Apple (10 years maybe?). Big companies do usually just buy and repurpose apps. Apple, starting with iMovie, is writing some new ones. I also was the principle author of iPhoto, also written from the ground up (iTunes, it is worth noting, was an acquisition: it was originally called SoundJam). iMovie, iPhoto, Keynote, and Pages were all written from scratch and are trully innovative. Even Adobe and Microsoft don't write apps from scratch any more, as far as I can tell, with the possible exception of InDesign which took probably over 5 years.

Cheers,
Glenn Reid
Founder/CEO
Five Across, Inc.
http://www.fiveacross.com/company/team.shtml

>To the many hundreds of you who have registered over the past couple of days

>welcome to Apple Matters!

>

>To our older members hello! In case you haven't heard yet Apple Matters is

>having a competition running from now until October 31st. Each time you post

>to our new forums you get an entry to win a Mac mini setup worth over $700. 

>

>Details can be found here:

>http://www.applematters.com/index.php/section/comments/win_a_mac_mini_and_a

>_ministack/

>

>Why are we doing this? Well, because we want your help building the best

>forums on the Apple web.

>

>So keep posting!

>http://www.applematters.com/index.php/forums/

>

>Hadley Stern

>Publisher, Editor-in-Chief

>AppleMatters

>http://www.applematters.com

>hadley@applematters.com

Serving our own Food

Have you heard the phrase "eat your own dog food" as applied to the technology business? If you expect your dog to eat it, you should eat it too. Which means, use your own software, if you expect other people to use it!

We do this, at Five Across, and our business is practically run on the collaboration and file sharing that is provided by our Bubbler Instant Messenger application.

But yesterday we made a more important transition: now we're serving our own dog food too.

We moved our main bubbler.com site from Apache to our own Five Across web server. So the whole site bubbler.net is served by our web server, not just the blogs themselves. It is how we structure the product for our OEM customers, so we use it too.

This is a "transition" because we built out the bubbler.com web site before our own software was ready, so we had two sites (bubbler.com, which was powered by Verio, and bubbler.net, which was our blog hosting server). Now the whole thing is powered by our Five Across Web Platform, and it's performing beautifully. It handles server-side includes. It handles multiple IP addresses per server. It is a total replacement for Apache, yet it does way more. Blogs, file serving, podcasting, instant messaging -- all built directly into the web server itself--compiled C code, blazingly fast. It's THOUSANDS of times faster and more scalable than our competition, scripted things like Moveable Type. Perhaps 10's of thousands. We're planning to do some performance benchmarking soon.

This is getting to be really fun.

Performance

Underneath the hood of our "fastest blogging engine in the world" is in fact an engine. We built our own web server from scratch, and it is massively parallel and breathes fire. We weren't sure exactly how fast it was, but we knew it was pretty fast...

One of our OEM's, about to be announced, happens to be expert in web servers, and routinely deploy several different ones--Apache, of course, but also some more innovative high-performance servers. They benchmarked our server with some sophisticated test tools as part of the evaluation process...

Our server can handle roughly 600 times the traffic load that Apache can handle. We were clocking about 6 million hits a second across 20,000 parallel users. That's cooking with gas.

And we don't even sell it as a web server. It's just the engine on which we build lots of innovative services like blogging, podcasting, file sharing, etc.

What I think this means is that if you're considering offering a blogging service, you may need to buy one piece of hardware to run our solution, or 600 pieces of hardware to handle a comparable load with Apache. Except that the test wasn't of Perl scripts running through CGI, it was flat HTML serving. So maybe multiply that number by another 1,000 or so.

If you can't tell, I'm proud of our server. Put simply, it kicks butt.

Livewire

Last week our new OEM partner launched a great new community site called Livewire, powered entirely by the Five Across Server and our publishing and messaging client applications.

I am especially proud of our web server, which serves their entire site and is wickedly fast, handling large amounts of traffic as well as driving the blog/site hosting. We are benchmarking much, much faster than Apache and able to handle far more concurrent transactions, which is cool. And it runs great on FreeBSD, the OS of choice for our OEM partner.

The Livewire team have a great vision for their service and we're working hard with them to make it a success. I encourage you to check it out.

And if you have a dream of creating and launching a blog hosting service, a social networking site, or giving your customer base a place to comment, share ideas, blog, or communicate--drop me a line. That's what we do.

I Don't Like Dashboard or Spotlight

<rant>
I've upgraded to Apple's "Tiger" OS and I'm trying to like it, but really I don't.

I don't need or want Dashboard widgets, but there's NO WAY to turn them off, or opt out. The closest thing is to "Remove from the Dock" but all the widget processes are still running.

I also don't want Spotlight indexing everything on my computer, and there is no opt out for that either! I turned off all the check boxes for types of content in preferences but it's still indexing away and there's NO WAY to turn it off or stop it. That is totally bogus.

Do I have to go in and edit /etc/rc files to stop this?! That's crazy! New features are fine, but it's my CPU and I want an off switch for these new things!!

</rant>

Open Source

Thanks to Alan Kleymeyer for this pointer to an open-source "smackdown" posting on Forbes.com. Very interesting.

I have some opinions about open source. My old company, RightBrain Software, released several products as open source for NeXT computers in 1992, long before the current craze. It didn't work that well as an endeavor, mostly because people don't really want to see or touch the source code. "Open source" is a euphemism for "free". People want free stuff. It's as simple as that.

But is it? Most open source is almost complete and somewhat maintained. A long dig through sourceforge.net which is one of the biggest open source repositories will show you that a staggeringly large number of source projects are languishing (or rotting, frankly).

Open source projects usually come into existence when one extremely bright programmer builds something ambitious, but then tires of it, or gets a day job. Unable to just delete and forget the project, he/she pushes it into the open source community, where (if it's cool, and useful) it is swarmed by a half dozen programmers who "maintain" it for a while, or port it to BeOS, or fix compile errors in new versions of MacOS X or whatever it takes.

I've seen many good programmers use open source projects as "example code" to build commercial products. I've rarely seen open source actually become the foundation of anything useful. And when it does, it becomes extremely difficult to maintain, fix bugs, and move forward, because none of the original authors of the code are around to help.

It's not that open source is bad, it's just a lot more difficult to use effectively than most people think. And it's definitely not going to save the world.

SuperNova conference

David Weinberger did some great video interviews for c|net at the SuperNova show. Here's the link to the whole page with lots of interesting folks.

There's an interview of me talking about how blogging is a symptom of a bigger problem, that it's still way too hard to get a web presence.

WEB: Tangle, Weave

I'm old enough to have seen a few things go by in the technology world, some good, some bad. What fascinates me is when younger people accidentally re-invent something that has been done before. This happens a lot more than you might think.

A historical case in point....

A couple of decades ago or so, the grandfather of Computer Science, Donald Knuth, chairman of the CS department at Stanford for many, many years, invented a typesetting language called TeX. It was one of the first markup languages, and was created mostly to typeset mathematics, which is very hard to do. Knuth was one of the first people to be interested in digital typography and typesetting and in fact created a Digital Typography degree program at Stanford, which graduated I think only about a half dozen people, most of whom I know personally (Dan Mills, Carol Twombly, David Siegel, Cleo Huggins). But I digress...

Knuth created a system he called WEB in about 1982 (10 years before the "world wide web") which was a programming language (PASCAL, more or less) but the comments in the programming language were in fact instructions to a typesetting program that would typeset the text of the program.

The key idea here is that a single text file (a .web file) could be read by two different programs, and each would see something different:

• the PASCAL compiler would see source code


• the WEB compiler would see typesetting instructions

If I recall correctly, the interpreter that read the "program" code was called Tangle, and the interpreter that read the "typesetting" code was called Weave.

The notion of "structured comments" I think may have started here. By structured comments I mean information that technically is "comments" (not interpreted as part of the source code) but they are structured in such a way that other programs can make sense of them.

I borrowed this idea in 1985 or so to enhance and expand PostScript comments to contain information to be read by document processing systems. Inserting %%Page: 3 into a PostScript program allowed other programs to find the page boundaries.

This whole idea is being reinvented to some degree on the WWW now. What began as HTML tags have grown additional appendages or "tags" or "fields" which are used to communicate with other programs which read the HTML pages (search engine crawlers, or XML parsers, or whatever).

There are good and bad things about this. The good ideas are obvious: an HTML page can contain hidden, embedded instructions for other programs to read. The bad ideas are harder to spot, but are real, and insidious. One is this: validating these files is almost impossible. Information in a "comment" cannot be verified by the parser to which it is a comment, by definition. Even JavaScript programs look like "comments" to most HTML parsers, including search engines. You can't spot a JavaScript error except by running it through a JavaScript interpreter, which in turn sees HTML code as "comments".

I chuckle to myself when I hear terms like "micro-formats" and I see entire companies like Technorati being built around the idea of hiding metadata inside HTML comments. It will certainly work for a while, but it's extremely hard to standardize and police, it's trivial for competing standards to pop up, and eventually the whole thing collapses under the weight of micro-variations, competing non-standard implementations, and sometimes, just plain old questionable motives.

Ease of Use

I have probably blogged about this before, but "easy to use" has become a meaningless phrase in today's technology world. I ran a test through Google for the literal phrase (with quotes) "ease of use" and it told me that there are about 10,100,000 pages that match that. "user friendly" is even more: 15,000,000 results.

I see that IBM is the first entry in the results for "ease of use". I don't think IBM has ever made a product that is truly easy to use. Intel is right behind them. Intel has easy-to-use products? They make microchips!

We actually do have a product that's easy to use, but unfortunately we can't really say that, because the phrase has lost all meaning.

If you read this blog post, and there are words that actually mean something to you in evaluating software, I'd love to know what they are. Add a comment to this post or send me email. I'm betting against compelling, fast, innovative, and all the other words we use to describe our products.

I'm considering a marketing initiative in which we borrow from another lexicon. How about tasty or oaky or loyal or frictionless or maybe XML-enabled ?

Drag and Drop Web Publishing

During our public beta period we learned a lot, mostly from our customers. Overwhelmingly they told us: you are a site-building tool, and blogging is just a small part of it.

This is fascinating to me, because we launched the beta as a blogging tool. I now believe that a lot of the people who are investigating the blogging phenomenon don't really want blogs, they want web sites, but they want them to be dramatically easier to build and maintain.

So we added more templates that have horizontal menu bars and enhanced the multiple page and multiple site support. And what we ended up with is truly drag and drop web publishing.

It simply does not get any easier to get content onto a web site. Drop photos (or audio, or video) onto Bubbler, and your files are instantly live on the internet. Nothing else to do. Not even an OK button, much less a "publish and wait a few minutes" button.

We think that all web sites should be built this way: just take a handful of content and throw it, and it will stick to the web. Simple. Powerful.

Fixing problems

We are a real-time company. If you have problems with our software, tell us about it. We are responsive and will help you quickly and even fix problems as quickly as we can.

In the traditional software world, you had to wait six months for a bug fix or a new release of your favorite productivity tool. We've learned to "live with" bugs in software because the hopes of getting them fixed seem very dim. Can you imagine writing to a big software company's support address and either (a) getting an actual response from a human, or (b) seeing your problem addressed?

We've fixed a good number of problems within a few hours of hearing about it from our users. Horst-Dieter Schipporeit is one of our customers, in Germany. He writes to our support hotline and points out things, and we fix them. I think he would describe us as a responsive company, even if our response is "that's a great idea but it's a few months down the road"

Try us.

Life's Persistent Questions

I'm staying at the Marriott Marquis hotel on Times Square on the 26th floor for the Syndicate conference that starts tomorrow.

I was talking to my almost-9-year-old daughter at home on the phone, telling her about the hotel, and she came out with this perfect radio voice...

"On the 26th floor of the Acme building, one man is still trying to find the answers to life's persistent questions--Guy Noir, private eye...."

I had to laugh. That's me, I guess :)

Launching 1.0 in New York...

We're heading to Syndicate to officially take the wraps off our 1.0 product, and we'll have even more great business templates that can make some amazing sites with just a few clicks. I'm excited by this technology, and I'm not an easy guy to get excited about technology!

Sled dogs

A metaphor took shape for me today as I was composing email to an old friend...

First, a caveat: this isn't a reference to anybody I work with today, who are awesome -- just an overall reflection over almost 20 years of working in various places with different sets of people, often watching from the sidelines as things didn't get done, sometimes being one of the various kinds of sled dogs myself....

A work force is like a team of sled dogs, harnessed together, pulling something that's behind them, so most lose sight of exactly what the objective is -- it's just about running and pulling.

One thing I've seen very clearly, as a guy who's stood on quite a few sleds over the years, is that in any team of 12 sled dogs, only about 2 or 3 of them really do any work. The rest are just running along, or sometimes being pulled along.

It's like when you "help" carrying a couch and you're the third person: you realize you're not really bearing any weight, especially when the couch is headed up- or down-stairs and you're not on the bottom end. You realize, as you call out cautions about the "corner on your right!", that you are basically contributing nothing, and just perhaps, you're actually in the way.

I used to think that every dog knew who was doing the pulling, and that the rest were consciously along for the ride, kind of working the system. I don't believe that any more.

What I think now is that most people really think they are working hard, when in fact they're just barely keeping up with the harness, and are definitely not pulling the sled even a little bit. They just don't realize that some other dog is really straining against the harness, doing their work for them.

So if you're the guy on the sled, what exactly do you do? Do you shoot the dogs who aren't pulling, or just pull them out of the harness, leaving an empty slot? Then you have a harness for 12 but only 3 dogs. That probably is slower than having all 12 dogs. Do you stop, go out and buy a harness for 4, keep 3 good dogs and one marginal dog, and get rid of the other 8? By then, the race is over. And what happens when your 3 star dogs get tired? Is it possible, just possible, that one of the other dogs will one day get it, and become a ferocious puller? These are difficult questions indeed.

So most mushers just leave the status quo, and the hard-working sled dogs pull, and the others run, and the camera crews (on the off chance that there actually are camera crews filming the Iditarod) can't really tell the difference, and most of the dogs can't tell either.

At the end of the race, or at the end of several races, the musher may put the better pieces of food in the right 3 dishes, but the 3 dogs and the musher all know that it's not enough. The 3 dogs run and pull because that's what they do, that's what they're good at, and they don't know any other way. The musher knows that he can change nothing, and it's not worth the risk or controversy to be the only guy out there with a harness for 4 dogs.

And so the world continues. Instead of sled dogs we have people, and instead of harnesses we have phone lines and computers and keyboards, but the game is basically the same.

Cheerios

The thing I love about Cheerios is that they have not changed at all. Not during my lifetime, anyway. They have a good thing, they know it, and they don't mess with it. Cheerios have been around for 64 years. Here was the first box, back when it was called Cheeri Oats:

RSS feeds: the perfect marketing channel?

I'm sitting in a presentation by Bill Flitter, the Chief Marketing Officer of Pheedo , a company who specializes in serving advertising through RSS feeds.

I know the guys at SimpleFeed who are turning RSS into a targeted marketing channel.

Theoretically this is a pure channel because users "opt in" -- nobody has to read an RSS feed. It remains to be seen exactly how the ads are spliced into the feed stream such that I can opt in or out based on keywords, criteria, etc.

I think people wouldn't mind seeing advertising as corollary effects of reading content if the ads truly were targeted to them. "I'm kind of looking for a car, so if you serve me SUV ads in the $20,000-$30,000 range, that would be cool with me."

Countdown to 1.0

We're about to release the 1.0 version of Bubbler, on May 16 at the Syndicate conference in New York.

We have some work to do to finish it up but it's coming along great and we've gotten some amazing feedback during our Beta program.

For those of you who have been using it already, be sure to check out our special deal before we go live.

Software Engines

Please read the next two paragraphs of "marketing hyperbole":

We have developed an engine that delivers blogging, web site hosting, instant messaging, file sharing, revision control, email distribution, and many interesting combinations of all those things (uploading files to your web site with built-in revision control, posting notes to your blog with automatic email notifications, etc).

Our engine is also blazingly fast and has very high capacity for simultaneous users. It's not written in a slow interpreted language like Perl or PHP or even Java. It's written in ANSI C. It's small and has a low memory footprint.

I believe all that hype, and would like to convince you of it too. In fact I'd like to compare our engine to our competitors in a way that does not reflect my own bias, but is more like a benchmark. But I'm having a lot of trouble doing so....

There are no metrics for software engines. No concept of horsepower or displacement or torque or miles per gallon like automotive engines. No way to measure gigahertz or dual processors like hardware engines. You're just expected to evaluate a server on marketing materials and feature claims.

When hybrid cars were introduced, they could be compared to conventional cars in a way that people could understand. The tradeoff was lower horsepower in return for much better mileage.

We've been looking hard to try to find a benchmarking service that will help us calibrate our software engine against competition like Apache and Movable Type to back up our claims to speed and capacity. We can't find any benchmarking facilities at all so far. If you Google for "web load testing" you find hundreds of "tools" that let you test your web-built software application to see if you can handle 20 users or not. I've downloaded and tried to build a half dozen open source tools. They're terrible. They don't even compile on FreeBSD or OS X. The ones that do, don't work very well. Some of these tools boast that they can simulate "up to 256 simultaneous users!" That's nothing. How do we simulate up to 250,000 simultaneous users?

The tools, and the load-testing industry, and the press/analyst measurement and metrics, well, they're just not there.

Why is this? Web servers and software engines in general are becoming the underpinnings of modern society. Everything is running on a server somewhere nowadays. It seems important to be able to evaluate and benchmark these engines in the same ways that we can evaluate most other kinds of engines.

More on Blog Conversations

I just found Richi Jennings' href="http://richi.co.uk/blog/2005/02/blogs-as-conversations-yeah-right.html">post
about blogs as conversations in a Technorati search, and he's got me thinking
about this again. He writes:

Twaddle. What we have right now, is a messy prototype.
Comments are too prone to comment spam, most people find it hard to understand
the concept of trackbacks, and the whole thing is just too damned
difficult.

In thinking about it more, I realize that the
problem is that most blogging software is browser-based and it's really,
really hard to write web pages such that clicking on something (like an orange
RSS chiclet) pushes something useful upstream to the browser. In fact browsers
go to a lot of trouble to make sure this isn't possible for the most part,
because that "something useful" could well be a virus or something awful. So we
have abominations like bookmarklets that you're supposed to drag onto
your tool bar. Right. Great. Just because it works at all, people are slapping
each other on the back in congratulations. Not so fast, I say...

How do we allow people to write on specific parts of the web without (a)
spam, and (b) permissions problems from hell? This is the crux of the issue.

Sorry, Richi, I'm still thinking about it :)

The case against XML

If any of you happened to see the article in the Tech Monday section of the San Jose Mercury News about Bubbler, you may have seen me quoted as saying that XML is one of the most over-rated phenomena. I've gotten quite a few questions about that :)



Here's why I think XML is overrated.



XML is not really a technology. It's a syntax for tagging bits of data. It's not all that advanced in its evolution, harking back to SGML from some 20 years ago, which was actually better in many ways.



XML is syntax without any semantics. That's a big piece of what's wrong with it. Any program parsing an XML file still needs to know exactly what's in it in order to make sense of it (witness 5 different "flavors" of RSS).



But there are a lot of little things, too. To get an idea of what's wrong with XML, just open up any RSS file and take a look. The first thing you see is that XML does not nest worth a damn. You can't embed XML (or even HTML) within an XML file without escaping every last character, so it looks like &lt;tagname&gt; instead of <tagname> (it was hard enough to type this in and escape it correctly; I can't imagine what it looks like in an RSS feed :)



It doesn't stop there. The open and close delimiters are clunky, though I guess you can't blame XML for that as HTML has it too. The syntactic waste can double the file size easily. And parsing XML files requires reading the whole file before you can start to actually make sense of it. Audio and Video started this way, and guess what, it didn't work very well when transmitted over networks, so people worked really hard to coming up with streaming audio and video just to get around this shortcoming. Where's the streaming XML format? I rest my case.



XML is verbose, inefficient, suffers from whole-file syndrome, is difficult to parse correctly, has nesting/escaping problems to the nightmare degree ... and yet everybody is always raving about how great it is. I think it's overrated at best.

Unicode support for Bubbler

We are in the final testing stages of rolling out proper Unicode support for Bubbler so you can post in whatever language you like (I think; we've tried some German and French but we're not too good at typing in Chinese or Turkish or Greek).



I have to say that Unicode support on Windows is quite bizarrely implemented, with #ifdef _UNICODE and having to distinguish between "wide" characters and regular ones and all sorts of things that shouldn't be necessary. The Mac is not that far ahead of Windows, or slightly behind Windows, in many areas, but Unicode and multi-language support is WAY ahead. It "just works".

Blogging for people who have nothing to say

This phrase was going to be our tagline at one point. It seems that a lot of people sort of want to start a blog, because they think they're missing out on something, but they just don't have anything to say! Or at least they think they don't, which amounts to the same thing.

We've been thinking about this because the line is blurring between blogging, which is more of a social phenomenon than a technical one, and personal web publishing which is basically what you have if you're using blog software but you're not really "blogging" as much as just putting stuff on a web page.

So if you're worried about being called a "blogger", just think of it as the easiest way in the world to put a photo, or a Word file, or anything else, up on a web site so people can come and get it.

Directions to your house.

A party invitation.

A file that is too big to email to somebody.

Your resume.


Give it a try. You don't actually have to have anything to say!

Our live demo at the DEMO conference

We demo'ed the first public beta of Bubbler today onstage at the DEMO conference, which gives you a 6-minute slot to show off new products.



We took live photos of the audience and presenters, captured some live audio on an iPod ("podcasting"), and entered live text, and brought up a full multi-media blog in 58 seconds.



We then stepped back, showed off the page a little, played the audio clip, brought up a photo, then turned on a bubble machine to pump bubbles into the room. Total elapsed time under 2 minutes. We were done.



We were awarded the coveted DEMOgod award tonight at the awards banquet, which was a really wonderful experience.



The page we put up during the 58 seconds is still there, untouched, at this url: http://bubbler.net/demo if you want to see it. Note the A-list bloggers in the audience (Robert Scoble, Buzz Bruggemann, Renee Blodgett). It was a great time.

Our live demo at the DEMO conference

We launched Bubbler yesterday at http://www.demo.com/demo2 in Arizona. I'm just now starting my new blog with our own software.

My new Bubbler blog

Check out my new Bubbler blog over on bubbler.net/glenn.

Bubbler!

We launched our new Bubbler technology and blog hosting service today. I'm at the DEMO conference in Scottsdale where we're doing the launch. It's a busy day!

Wild about Wikis

A while back I said to a Red Herring reporter that I thought that wikis were "a fad - nothing more, nothing less."

Tonight I met Ross Mayfield and he mentioned it, or perhaps called me on it.

Okay, so I was caught up in the rush of actually having a Red Herring reporter ask for my opinion so I was a bit brash. What Ross and Socialtext are up to is very compelling and cool and bringing into a corporate setting makes a lot of sense for collaboration.

What I meant by "a fad" was that it has a lot of buzz right now but really is an evolutionary step along a path toward something much bigger, which is a two-way web. Maybe I"ll coin that term: 2WW :) And what I meant by "nothing more, nothing less", is that the "nothing less" part is not to be overlooked: fads are powerful and shape our culture more than almost anything else. So it was, in a backhanded sort of way, a token of respect. I should be so lucky to be surfing the cresting wave of a bona-fide fad (I'm not coining that tongue-twisted phrase).

It's about time that the network topology of the web evolved to be more push-me-pull-you instead of "posting forms" as a way of pushing things upstream.

So anyway I publicly take back my criticism of wikis, and I appreciate the intelligent, diplomatic, thoughtful conversation I had with Ross Mayfield. Thanks, Ross.

They All Died in Vain...

I try not to get into political discussions, particularly in my blog, but this article is an especially clear, riveting piece of journalism, from the Magic City News of Millinockett, Maine, a small mill town. If only we bloggers were so eloquent. I exhort you to read it, no matter what your political bent.

Blogging: Conversation or Soliloquy?

Blogging should be a conversation, not a long-winded speech with scattered applause....

But it's not. Yet. Reminds me of an old family joke I share with my family, when trying to coordinate:

If you get there first, make a blue chalk mark on the door.
If I get there first, I'll rub it out.

Bloggers all reference each other, but other than the weak comment mechanism, it's hard to create anything resembling a global conversation. I know I've blogged about this before but it keeps coming back to me.

At Five Across we have some pretty great messaging software. I have half a mind to turn it into blogging software and start turning the web into a conversation.

Lossless JPEG compression of 25%-30% !

I met Kevin Hughes yesterday and was checking out his excellent Kev's News, now in my blogroll. Kevin is one of only 6 people in the WWW hall of fame, created the idea of image maps among other things, and is an amazing guy.

I saw this article in Kev's News which backs up Allume's claim that they can losslessly compress JPEG files by up to 30%. This is amazing, dramatic, and has far-reaching consequences. I hope it is independently verified and turns out not to be a bogus claim, always a possibility with things you read on the web, though this looks legit to me.

It also points out that the JPEG compression algorithm could have been 25%-30% better than it is. Think of all those billions of bytes of wasted space all over the world! Think of how many more pictures you could have fit on your 256MB flash card! I think we should remove the "E" and call it JPG from now on (JPEG is an acronym for Joint Project Expert's Group) and give the "E" to Allume with great ceremony.

Allume, please combine your algorithm with JPEG and license it to camera manufacturers as soon as you can!

Casey at the Bat: It's All About Time

We've all read the classic poem Casey at the Bat, but do you remember it? Casey was a slugger, or so they said--a slugger with the hubris to let some pitches go by.

There was ease in Casey's manner as he stepped into his place,
there was pride in Casey's bearing and a smile lit Casey's face.

And when, responding to the cheers, he lightly doffed his hat,
no stranger in the crowd could doubt t'was Casey at the bat.

Ten thousand eyes were on him as he rubbed his hands with dirt.
Five thousand tongues applauded when he wiped them on his shirt.

Then, while the writhing pitcher ground the ball into his hip,
defiance flashed in Casey's eye, a sneer curled Casey's lip.

And now the leather-covered sphere came hurtling through the air,
and Casey stood a-watching it in haughty grandeur there.

Close by the sturdy batsman the ball unheeded sped --
"That ain't my style," said Casey.

"Strike one!" the umpire said.

I've been reading recently about time and its compression. Esther Dyson writes about this, or so I recall; I can't find the reference. Time-saving devices speed up the consumption of time, perhaps saving it only for other time-saving devices. We're harried, hurried, and yet we collect bits of time the way a madman collects shards of tin or lengths of twine: the lengths are no doubt useful, but for what?

Yet time is the ultimate currency, and it does seem that to let moments go by, without harvesting them somehow, is to let a pitch go by, without even swinging. strike two.

Oh, somewhere in this favored land the sun is shining bright.
The band is playing somewhere, and somewhere hearts are light.
And, somewhere men are laughing, and little children shout,

but there is no joy in Mudville --
mighty Casey has struck out.

And in the end, the love you take is equal to the love you make.

What's the Deal with Podcasting?

Okay, so I have to admit I'm baffled about podcasting. I've listened to a couple of podcasts and it's not bad, as internet radio goes.

But audio is so unbelievably low-tech and low-bandwidth. The amount of information in a one-hour block of audio can be assimilated in a very few minutes if it is read as text. Text can be accessed in any order; you can skip to the end, or rapidly scan it. You can search it, index it, copy/paste it if it's interesting, and reference it in your blog. But audio? What do you do with that?

Besides, audio is just video without the pictures. Surely podcasting will be cast off in favor of video blogging in almost no time.

I know two people who have mentioned actually listening to podcasts, and liking it. Both of them described burning it to CD and listening in the car or airplane.

I claim that anything you do on an airplane, where you're a captive, seat-belted, prohibited from moving for several hours, without an internet connection, is suspect. Things that you while driving are only slightly less suspect.

I know Adam Curry is a big force behind podcasting and he's famous and all that, but he's famous partly for MTV, right? Where's the V in podcasting? The very first song on MTV, by the Buggles, was Video Killed the Radio Star. Hmmmmmm. Maybe Adam is actually famous for being Tim Curry's son. Did he grow up in Transylvania?

But then, I see that MTV actually filed suit against Adam Curry for breach of contract. Maybe Audio is trying to kill the Video star. And can I just say that you can't call an audio show "Source Code"? I am in the source code business, and I just can't see the connection to audio. And it's not just that I'm disgruntled at having sent email to Adam Curry to which he never responded, because I listened to his podcast where he basically said he hardly ever responds to the zillions of email messages he gets. Fair enough. I have done the same thing at times in my life.

In any case, I belive podcasting to be an extremely short-term phenomenon at best, to be replaced by video content almost immediately, since audio is merely a subset of video.

Not that I'll be listening--or watching. My time is more valuable than that. I'll still be reading my favorite bloggers (see my blog roll).

MacWorld 2005: One More Thing...

I'm blogging this from the keynote at MacWorld expo though I can't get on the network so it will be posted later.

I've been to a lot of MacWorld keynotes and this one is right up there with the best of them, though it was off to a rocky start: the first three or four things that Steve demo'ed didn't go well.

I was glad to see the new Book support in iPhoto 5. The books are the coolest part of iPhoto and they are dramatically improved in 5. I wish there were more sizes but that will come. And the HD support in iMovie is just the right thing. I built the team that introduced iMovie 1.0 in 1999, or was it 2000? (that was five years ago!) and we were amazed at the time by the quality difference between Hi-8 and the new digital DV format. HD is even more dramatic an improvement over DV than DV was over Hi-8. It's unbelievable. "You have to see it to believe it."

The best part of the keynote had to be the president of Sony, who talked too long and kept interrupting Steve's attempts to finish the HD video segment. I can't wait to get my hands on one of the new Sony X-1 (?) HD cameras. Awesome.

I can't decide if I'm excited about the Mac Mini. I guess it's a G4 tower in a smaller box. BYODKM (bring your own display, keyboard, and mouse). If it ran Linux it would be great local workgroup server :) Friends asked me if I believed the rumo and I said "no way" because I couldn't imagine Apple introducing a computer that might be hooked up to a cheap VGA monitor. How wrong I was.

Publishing in the Age of Blogging

I have a long history in publishing software, having started working at Adobe Systems in 1985 when there were only 25 people there. I developed the original EPSF specification, wrote two books on PostScript, built a page layout application for NeXT computers, wrote the web and hard-bound book publishing back end to Apple's iPhoto application. It's all template-driven publishing, and not all that different from blogging, in my mind.

As the dust clears, and I think more generally about the Information Age and publishing in general, and the phenomenon of blogging in particular, I see some trends that I find fascinating. What it boils down to is that most information is published because it's easy, and because the person/company doing the publishing has some vested interested in it.

But what about the poor people who have to sift and sort through bookstores, the web, the blogosphere, looking for what they are interested in? The glut is getting bigger and bigger.

In the traditional publishing industries (books, music, fashion) for better or for worse, the process has long been that somebody else (the record labels) decide what you should read, or listen to. They promote, they payola, they send authors on the talk-show circuit. It's hard to get your writing published by Random House. It just is.

Now anybody with a keyboard can start typing into a blog, and, well, a few of them even get book deals. But for those of us with little time on our hands, we still need somebody to help guide us to what is "worth reading".

Technorati kind of does this, by tracking the blogosphere, the most popular bloggers, by making it searchable. But there's still very little editorial oversight. It's more like the yellow pages. You still end up asking your friends for their recommendations on a good dentist, rather than picking one out of the phone book.

I witnessed firsthand (and contributed to) the desktop publishing revolution. It was democracy in action. People would hang posters on their walls that said the power of the press belongs to those who own one. Graphic designers and typographers wrung their hands with despair as "anybody with a Mac" could publish printed pieces. Shocking! A lot of it did suck, and there were many pages that looked like ransom notes the fonts were changed so many times. But over time, people got the hang of it, and did pretty good work, and it has been both liberating and empowering.

Blogging is the same thing, but on a larger scale, because you don't have to staple your published piece to telephone poles to get other people to read it. You just post it to the blogosphere, and chances are, many people will read it.

I'm on the fence as to whether more editorial oversight would make the blogosphere better, or whether it will just evolve naturally and democratically. I, for one, would love somebody else to do some of the sifting for me and tell me what to read, but maybe that's just blog rolls and I'm not seeing it yet :)

Trackbacks/Comments are lame (hey Robert Scoble!)

I'm trying to participate in some blog conversations going on in the blogosphere, and basically it can't be done. This "global conversation" seems poorly designed.

Comments and trackbacks supposedly turn one-way blogging into a conversation, but it doesn't seem to me that it works very well. People post comments, but does anybody read the comments? Most bloggers seem to have trackbacks turned off.

There needs to be a better way. Maybe I'll build one. A global conversation should be just that: democratic, yet moderated. Usenet's moderated groups aren't a bad model, except that the topics are too many and yet too stringent (i.e. posting to a newsgroup is already categorized too finely before you start, whereas blogs can vary topics within the same "group").

I think the idea of threaded discussions needs to be brought to blogging, so conversations can be followed.

Robert Scoble just blogged about a problem for which we have the precise solution. It is in fact designed specifically to answer the question he (and Adam Curry) pose:

That's precisely why I no longer turn on my IM client. Well, that and that I have filled up my buddy list and can't add anymore people to it.

His solution? Let him advertise different status to different groups of people.

Oh, that is a killer feature! Does any IM have that? For instance, can I advertise to my family and boss that I'm online, but tell everyone else that I'm offline?

But since Scoble and Curry are A-List bloggers, paradoxically I have no good way to reach them and tell them about our IM that has groups and visibility control so you can be offline for weeks with one set of people and online constantly with 3 others. Oh well. Maybe they'll read this post. Yeah, right :)

[Later] It occurred to me that I could just email Robert, so I did. Sorry about the whining. I still think we need a better mechanism than trackbacks, though!

Jumping In: Thoughts on Identity

Okay, so I've read so little about Identity that I feel completely empowered to voice my opinion. I've learned over the years that sometimes the most naive "first take" on any complex issue is often quite relevant, so I'm posting my first thoughts about it, to be recanted later, or refuted by the experts :) I've been reading some offshoots of Doc Searls identity postings and getting interested.

I started by reading the Laws of Identity that, if not obeyed, will:

...leave behind us a wake of reinforcing side-effects that eventually undermine all resulting technology. The result is similar to what would happen if civil engineers were to flaunt the law of gravity.

I find it funny that the purpose of identity is not included in this lofty statement, because the laws are unanchored without a clear statement of what is being achieved when the laws are met. I would even go so far as to reject the laws out of hand as meaningless without stating a goal along with them. Can you really say, in boldface, that "The emergent system must conform to all of the laws?" without a precise definition of success or failure? I think not. Maybe this is implicit in the conversation and stated elsewhere, but given that this is an open conversation, and apparently an unsolved problem, then my Googling is probably as good as the next guy's.

What is the goal of Identity? The folks at RSA Security have laid out two that seem reasonable: common infrastructure, and a single, global, unique credential. I see some goals already from thinking about this for a while:

• a globally unique identifier
  
• validation, e.g. to prove I am who I say I am
  
• location/presence (e.g. if it's really "me" then I must be only one place)

Undoubtedly it's all of the above, but it seems to me that they follow one from another, starting with uniqueness and validation. After that you can do anything you want.

I immediately look to precedents, and I see two obvious ones: the Domain Name Service (DNS) and phone numbers / CallerID. Or even a third, a credit card number. This whole thing seems like a previously-solved problem to me. Phone numbers are going away (too slowly, but it's inevitable, as it's a bad system). Credit card numbers are not good as unique identifiers, though I think we computer geeks could learn a thing or two about validation and security by following an industry that has been moving money for decades (though the validation is extremely weak, it's clearly entrenched, and pretty well trusted worldwide).

Here's what I think, off the top of my head: use DNS, and extend it slightly:

Uniqueness: your email address which is globally unique, managed by the global (and obviously workable and successful) DNS infrastructure, portable to new vendors, and everything you want in a unique identifier, with the possible exception of spam vulnerability. Domains are unique via the hard work and deep infrastructure of DNS, and the "user@" in front of it is a natural for identity.

Validation: this should work by expanding DNS to allow encrypted validation that returns a public key instead of an IP address. Again, the infrastructure is already there, and proven. Why invent yet another central authority and try to propagate it out into the world?

Presence: this is harder, and relates to the notions of "logging in" and "sessions" and so forth. The DNS infrastructure clearly doesn't want to be in the business of tracking individual users and their sessions, but this could perhaps be delegated by DNS to a "current host IP address" that would represent the user's current session.

Thinking more about this, it could be a very interesting way to deal with the zilliions of individual logins on all the individual web sites at the moment. Have each of these web sites force the validation through DNS lookup and then track the sessions themselves.

Who owns DNS anyway? It's a big open source morass, right? Perfect :)