Automatic color temperature

Bill and I had an interesting conversation today about how computer displays (particularly on mobile devices) should automatically adjust not only the brightness of the backlight, but the color temperature of the pixels. For example, in a room with warm lighting, the “white” on the display should look reddish, the same color as the reflection of that ambient light off white paper.

See Bill’s blog post for the full story.

Sculley on Apple

At the risk of being like all the other bloggers, I feel the need to write down what I didn’t know or found most interesting about the recent interview with John Sculley, who was the CEO at Apple for about ten years.

First, Sculley made it clear that Apple has always been a digital consumer electronics company, and in many ways was the first such company. As digital components continue to become cheaper and more powerful, thus enabling better consumer electronics, it makes sense that Apple will continue to thrive. Another way of saying this is that Apple was so ahead of its time that even after 25 years the market conditions are only beginning to really align with their strategy.

Second, I often explain to people how Apple’s control of both hardware and software is key to their ability to innovate. There is a lot they simply couldn’t do if they didn’t control the whole pipeline. Sculley recounts an excellent example of this, dating back to the first Mac.

Sculley: The original Mac really had no operating system. People keep saying, “Well why didn’t we license the operating system?” The simple answer is that there wasn’t one. It was all done with lots of tricks with hardware and software. Microprocessors in those days were so weak compared to what we had today. In order to do graphics on a screen you had to consume all of the power of the processor. Then you had to glue chips all around it to enable you to offload other functions. Then you had to put what are called “calls to ROM.” There were 400 calls to ROM, which were all the little subroutines that had to be offloaded into the ROM because there was no way you could run these in real time. All these things were neatly held together. It was totally remarkable that you could deliver a machine when you think the first processor on the Mac was less than three MIPs (Million Instructions Per Second). (NOTE. For comparison, today’s entry-level iMac uses an Intel Core i3 chip, rated at over 40,000 MIPS!)

This approach continues to be important in every category of device Apple produces. For example, today’s iPhones and iPads have special-purpose hardware for video decoding (that’s why they can only play movies encoded in certain formats). Microsoft could not really enter the graphical operating system market until standard processors and graphics cards became powerful enough to do most of the graphics routines themselves. If Microsoft produces an innovative operating system that requires hardware that is too specialized or not readily available, the hardware manufacturers will say, “sorry, we can’t support it.” At Apple, Steve Jobs says, “We will find a way.”

There’s a great little quote about a meeting at Microsoft. “All the technical people are sitting there trying to add their ideas of what ought to be in the design. That’s a recipe for disaster.” Sculley thinks that’s part of the silicon valley culture started by HP, where engineers are most respected. At Apple, designers are on top. “It is only at Apple where design reports directly to the CEO.”

Sculley repeats over and over how good a designer Steve Jobs is. The following story is about a visit to the inventor of the Polaroid camera.

Dr Land had been kicked out of Polaroid. He had his own lab on the Charles River in Cambridge. It was a fascinating afternoon because we were sitting in this big conference room with an empty table. Dr Land and Steve were both looking at the center of the table the whole time they were talking. Dr Land was saying: “I could see what the  Polaroid camera should be. It was just as real to me as if it was sitting in front of me before I had ever built one.”
And Steve said: “Yeah, that’s exactly the way I saw the Macintosh.”

Dr Land had been kicked out of Polaroid. He had his own lab on the Charles River in Cambridge. […] We were sitting in this big conference room with an empty table. Dr Land and Steve were both looking at the center of the table the whole time they were talking. Dr Land was saying: “I could see what the  Polaroid camera should be. It was just as real to me as if it was sitting in front of me before I had ever built one.”

And Steve said: “Yeah, that’s exactly the way I saw the Macintosh.”

The item which I did not know (or maybe had forgotten) is that Apple’s Newton product played a central role in the creation of the ARM processor design, which is now used across the industry in most smartphones and other consumer electronics (including the iPhone, iPad, and Apple TV). Moreover:

The Newton actually saved Apple from going bankrupt. Most people don’t realize in order to build Newton, we had to build a new generation microprocessor. We joined together with  Olivetti and a man named Herman Hauser, who had started Acorn computer over in the U.K. out of Cambridge university. And Herman designed the ARM processor, and Apple and Olivetti funded it. Apple and Olivetti owned 47 percent of the company and Herman owned the rest. It was designed around Newton, around a world where small miniaturized devices with lots of graphics, intensive subroutines and all of that sort of stuff… when Apple got into desperate financial situation, it sold its interest in ARM for $800 million. […] That’s what gave Apple the cash to stay alive.

So while Newton failed as a product, and probably burnt through $100 million, it more than made it up with the ARM processor.

So the product that has become a “celebrated failure” of business school lore was actually one of the most successful products in the industry, when taking the long-term technological view. Not only did it save Apple from bankruptcy, it enabled an entirely new category of power-efficient, mobile computing devices. True, the marketing and business strategy used for the Newton failed. But the underlying technologies and vision not only saved Apple in the 90’s, but also formed the basis of its remarkable growth today.

Everything Apple does fails the first time because it is out on the bleeding edge. Lisa failed before the Mac. The Macintosh laptop failed before the PowerBook. It was not unusual for products to fail. The mistake we made with the Newton was we over-hyped the advertising. We hyped the expectation of what the product could actually [do], so it became a celebrated failure.

Apple has gotten much better at this over time. They are often accused of over-hyping their products, but if you look carefully, Steve Jobs and Apple advertising never claims that their products can do anything they can’t actually do. They say things like “1000 songs in your pocket” and show people dancing to those songs. Some people react with “oh my gosh, that’s what I actually want.” Other people say, “no thanks.”

Technologists complained when Apple described the iPad as “magical.” Obviously the device is not actually magical. But I think that word pretty well describes the actual reaction of many customers to the product.

High Dynamic Range

I’m impressed with the new “high dynamic range” (HDR) photography feature in iOS 4.1 for iPhone 4. The feature basically takes three versions of the image in quick succession, each using a different light setting. Software then combines the three photos using image processing algorithms. The goal is to avoid washed-out bright areas and dark, almost-black shadowed areas.

I took the picture below with HDR turned on. I did not use a tripod, did not set anything manually, and did no post-processing other than cropping. (Click it to see full resolution.)

Seattle skyline using iPhone with HDR

The plain, non-HDR version of the image looked pretty good too, but everything was more washed out, especially the buildings and sky. The trees were a bit brighter but didn’t look as rich. I think the HDR version looks astonishingly professional.

Steve Jobs’ fifth revolution

I think one of the most significant announcements at Apple’s media event today was that the iPod touch now has over 50% market share in the worldwide portable gaming industry — the iPod touch outsells the portable game consoles from Nintendo, Sony, and all other manufacturers, combined. Steve Jobs also said over 1.5 billion games have been downloaded so far to iPod touches alone. “It has become by far the most popular game player in the world.”

Steve Jobs discusses the iPod touch as a gaming platform

It’s widely recognized that Jobs has already revolutionized four industries: personal computers (Mac), digital music (iPod and iTunes), animated films (Pixar), and smartphones (iPhone). I think it’s now safe to add a fifth to that list: portable gaming.

His impact is a revolution both in terms of the new multi-touch user interface for gaming and the App Store platform for game distribution and payment. The major products involved are not just the iPod touch but also the iPhone and iPad.

So what will be number six?

Apple is making some progress on movies and TV shows. However, the studios and cable companies have all the power, and they are terrified about what happened to the music industry. It’s hard to find a path that transitions the industry from cable TV “channels” to browsing and paying for individual shows.

Another possibility for revolution is in textbooks and online education, where iTunes already carries recorded lectures and the iPad has started to inspire a new class of interactive educational content.

7″ iPad

I continue to see rumors that Apple will release a 7-inch iPad. The idea is that it would be closer in size to a paperback or Kindle; lighter and less expensive than the current iPad; and easier to fit in a purse.

I’m a bit scared of this vision because it means all of our apps would have to be redesigned for yet another screen size. iPhone apps already do run on the iPad, but they are awkward to use. Scaled-down iPad apps are not really an option because the touch targets would be too small. Apple could use a screen with the same number of pixels as the iPhone 4 (but bigger in size); that way, all retina-display-compatible apps would fit pixel-by-pixel on the device. Still, graphics would look too big and some interactions would still be awkward. In short, redesigning our apps would be necessary for a good user experience.

This redesign will be a lot easier than porting apps from the Mac to the iPad. Still, for the sake of my own sanity, I hope Apple waits a while before introducing the next screen size.


Update: On the other hand, most of our existing Mac apps have to be designed to work well at any screen resolution between the 13″ MacBook and the 30″ Cinema Display. From this point of view, having to support just two discrete iPad sizes should be comparatively easy.


Update 2: Steve Jobs just criticized the 7-inch form factor.


Signal Strength and Leaks

The extreme publicity over the iPhone 4 signal strength issue reminds me of the similarly overblown media coverage regarding leaks in the Frank Gehry-designed MIT Stata Center.

In both cases, the affected products are gorgeous, highly-acclaimed, innovative masterpieces. They’re already famous in their own right. They’re sufficiently innovative that some unforeseen problems are bound to crop up. And apparently, people love to find those flaws.

“That’s what you deserve for spending too much money on that product [which I secretly want and now feel better about not having].”

Of course, these reports leave for the last paragraph the fact that “the iPhone 4 enjoys better reception than any of its earlier models.” The same goes for quotes from Stata Center occupants, who maintain that “it is a joy to work in this building.”