iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Seth Shostak

GET UPDATES FROM Seth Shostak
 

The Ultimate Television

Posted: 02/01/2013 12:52 pm

After more than sixty years, televisions are as familiar as old boots. Once typecast as the indispensable altarpiece of a well-appointed living room, TVs have infected every human environment. The average American household has more television sets than people.

Today, if you've got the wall space and the wallet heft, you can have a mural-sized, high-definition plasma decorating your house, with picture quality that in some respects trumps what the local cineplex offered you a dozen years ago.

So what's next for TV? What's coming down the pike? Please understand: I'm not speaking about content (which will undoubtedly continue its relentless pursuit of greater erudition and artistic merit). I'm talking about picture quality.

Well, television technology is not in Kansas anymore. Image displays are about to go where no displays have gone before. Nonetheless, I figure they'll hit the equivalent of a brick wall within a decade or two. There will be an end point to how good TV pictures can get.

The boob tube has hugely benefited from the rapid advance of digital electronics. Consequently, the strategy for hardware has changed. In the old days, sets had to be as simple as Elmer Fudd to keep them inexpensive. All the technical "smarts" were at the transmitter end. But dumb TVs are no longer inevitable, because sophisticated electronics are cheap.

The most obvious dividend of this technical shift is greater resolution - the amount of detail in the picture. The longtime standard for American TV was 525 lines from top to bottom of the image. As a practical matter, that was roughly equivalent to 350 thousand pixels - pretty crude, given that photos made with your iPhone boast five million pixels. But those 525 lines were adequate to addict a generation to TV, soften the brains of billions of people, and spawn a new vegetable variety: the couch potato.

Hi-def TV - which is likely what you're watching these days - has the equivalent of 1,080 vertical lines and roughly 1,920 pixels per line, as well as sufficient detail to force your favorite on-air personalities to buy pancake makeup at a warehouse outlet.

However, this five-fold boost in pixel count - as impressive as it is - was no more than an opening move. Engineers are now experimenting with 4,096-line TV systems, suggesting that with the next generation of sets you'll be able to count the grass blades on the Superbowl field, an obvious lifestyle improvement.

In addition, new methods of encoding color are underway that will move television far beyond the compromised system originally developed in 1950 - a system that could show you only about one-third of the color range your eye can actually see. Then there's vastly improved sound, 3-D, and a faster frame rate for smoothly reproducing quick moves, such as the Green Lantern barreling through the lower stratosphere.

OK, great. TVs are getting better. But is there really an end point to the technology race?

I think so. In 1993, I wrote a paper for the Society of Motion Picture and Television Engineers in which I calculated how good a TV system must be to simulate reality. In other words, what set of specs would result in a TV able to appear as a window, not a screen - a set that could reproduce the world in a way that was indistinguishable from seeing it in person.

This dream TV would be wide screen of course, and I reckoned it would measure about 36,000 by 28,000 pixels. There'd be 17 bits of encoding for each of the primary colors, three-dimensional capability, and a frame rate of at least 60 images per second. Extrapolating the improvement of digital electronics two decades ago, I figured you could build a lab version of this "ultimate television system" by 2020. Several TV engineers who saw this paper opined that it was more suitable for publication in magazines such as Analog or Weird Tales. (At least they read it.)

However, you might want to put this in your Dunhill and smoke it: NHK, the Japanese national television organization, is already experimenting with a setup they call Super Hi-Vision. Ten bit color depth, 60 frames per second and 7,680 by 4,320 pixel imagery. Not quite my ultimate, but it's not quite the year 2020 either.

So what happens when your home television set provides a visual experience indistinguishable from "being there"? Well, it might cause a lot of TV engineers to retire. But would a television set boasting image quality as good as the local multiplex signal the death of movie theaters?

I doubt it. Teenagers will always like a dark place to go on a Saturday night. And who doesn't enjoy a good $15 bag of popcorn? Besides, sitting on the couch counting those grass blades could get tedious.

 
FOLLOW TV
After more than sixty years, televisions are as familiar as old boots. Once typecast as the indispensable altarpiece of a well-appointed living room, TVs have infected every human environment. The a...
After more than sixty years, televisions are as familiar as old boots. Once typecast as the indispensable altarpiece of a well-appointed living room, TVs have infected every human environment. The a...
 
 
  • Comments
  • 47
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
Page: 1 2  Next ›  Last »  (2 total)
04:20 PM on 02/11/2013
... sounds like the author knows a thing or two, but to proclaim that any tech will "Hit a wall" or "Stop getting better" is silly.

Perhaps we'll hit a pixel density that can simulate an image that looks perfectly real.. but then they'll get thinner, lighter, cheaper...

... then something will come along and make the whole technology obsolete.

At any rate, to suggest that technology that simulates images is going to stop progressing any time in the next millenia is silly.
This user has chosen to opt out of the Badges program
photo
Douglas Sinclair
sufferin' succotash!
09:46 PM on 02/04/2013
My favourite all-time T.V. was a little 9 inch black and white with a 2 inch speaker. Johnny Carson's Jack Benny deadpan look with the face slap still carried 25 feet across the room. Erudite...
photo
phal4875
The world is run by cats; we just feed them.
01:29 PM on 02/04/2013
I suppose it is obvious, but these technical improvements do not seem to change our lives all that radically. I am not sure that my current computer or my current television set make me much happier or more satisfied than those of a decade ago. Once we have something new, that is where the new bar is set. That bar quickly seems like it has always been at that height.
11:34 AM on 02/04/2013
Interesting read! Those that have expressed high interest in reading the paper written for SMPTE in 1993, may access it here: https://www.smpte.org/shostak
10:18 PM on 02/03/2013
It is always interesting to me to hear from some tech guru who lives in a completely wired, totally up to date region like New York or Silicon Valley lauding the wonders of the latest technology. Especially since, from where I sit, some 30 miles from downtown Washington DC there is no 4G telephony, no cable, no fiber optics, and, since the transition to HDTV, fewer TV channels to watch. The latter is the result of three facts: first that I live on the back side of a hill, second that some of the local TV stations decided or had the FCC decide for them to reduce power, and third because of the very sensitive nature of the ROC curve for DTV. In the old days of analog television, as the signal got weaker, the picture gradually became snowier, i.e., of lower quality, but this fall off was gradual. No more. People with cable, or who live close to and in the line of sight of the transmitter know nothing about this, but those of us in diffraction zones or who experience multipath know that the new scheme is worse not better than the old one. Yes, the picture was lousy, but at least you had a picture.
And, of course, we have to ask ourselves whether it is meaningful to have more pixels on the display when the information content continues its monotonic decline. For me, the answer is no.
This user has chosen to opt out of the Badges program
05:37 AM on 02/04/2013
"And, of course, we have to ask ourselves whether it is meaningful to have more pixels on the display when the information content continues its monotonic decline. For me, the answer is no."

Fully agree. And it seems to be a global trend.
01:30 PM on 02/03/2013
I remember having a similar conversation with a friend back in the early 80s.

I wondered how long it would be before digital animation would be indistinguishable from live action.

The response I got was something like "never, way too much computing power required". Today, CGI in movies is not far away from that day. Actors, beware.
HUFFPOST SUPER USER
realitytrumpsbull
Two 'alves of coconut!
10:48 AM on 02/03/2013
I hardly watch TV anymore, because I've gone to reading and 'blogging, and stuff. I don't need to see pictures of overpriced automotive equipment, fast food, football players' butts, medical equipment The Government will buy for me, or similar. I like a good story, though, and reading what other people have to say about issues du jour. TV? Being a passive listener while other people gossip and gab? Not so much. It's kind of the same, only different.
photo
HUFFPOST SUPER USER
KimberlyPeacock
Renegade Innovator
10:34 AM on 02/03/2013
I love the telepresence aspect. For Dinner you can be looking out over Paris, or you can have a 360 degree panorama of an African plain, watching the lions hunt for dinner as you eat dinner.

You can wake up to the sun rising over the ocean and your perspective is from the beach, even though you are in Manhattan. Cameras that monitor you and where you are looking, can adjust to create a 3d environment such that you feel wrapped inside the projection.
10:21 PM on 02/03/2013
Yes, but were you to save the money you spend on that TV set and the cable service, you might be able to actually experience the things of which you speak. Having had dinner while actually overlooking Paris, I'm confident that no virtual reality setup will ever be able to match the real thing.
photo
HUFFPOST SUPER USER
KimberlyPeacock
Renegade Innovator
03:31 AM on 02/04/2013
True enough but that data service, and TV are going to become less and less expensive, to the point that all walls become projection-viewer devices.
Also you get to wake up every day to Paris, or you can wake up and the Beach and then a second latter be watching the sun rise from the top of a mountain peak.
Or Have Virtual Wall half a world a way.
Sometimes the ability to travel at the speed of thought is as good as the real thing.
Also if we are talking about telepresence at some point we will be able to encode and transmit touch, as well as sound and visuals. We will be able to simulate reality with 100% fidelity. You won't be able to tell the difference between live and memorex. 
HUFFPOST SUPER USER
verflixed
It will come to pass
11:22 PM on 02/02/2013
What about instantly producible Holograms in 3D?
photo
HUFFPOST SUPER USER
Stewart Goss
Evil requires the sanction of the victim -Ayn Rand
10:22 PM on 02/02/2013
Aw c'mon use your imagination a little. Every once in a while an individual pronounces an end of the line for innovation and the line is duly crossed.

If I peer further into the future this is where I see television:

1. Holographic television.
2. Holographic television in which you are part of the story.
3. Direct transmittal to the brain of an alternate reality that is indistinguishable from our present one. In this environment all your senses are at work and the feedback is real and tactile.
07:25 PM on 02/03/2013
Sounds like something Philip K. Dick imagined over 50 years ago...
04:23 PM on 02/11/2013
I agree completely.

The author knows a thing or two, but to suggest that any tech will "Hit a wall" is silly - because everyone who's ever made that claim ends up looking the fool for it.
03:18 PM on 02/02/2013
High def.and extreme closeups can be nauseating. You can see every pimple, pore, and nosehair on someone's sweaty face.
photo
mrelmo
improvise, adapt, overcome...
12:11 PM on 02/02/2013
Hi-def resolution can only go so far. It's really more about the experience, when you think about it. I remember when I was a kid and Cinerama theaters opened. It was an amazing and different experience. Total immersion is the future of video.
photo
HUFFPOST SUPER USER
montemalone
oenophile, aquarist, francophone, radical moderate
08:38 AM on 02/02/2013
I'm picturing wrap around screens. A big half circle or more and you sit inside, with action all around. Eventually, and probably not too far off, holographic projection. No screen, you sit in an empty room, turn it on, and your there. Basically a holodeck.
photo
HUFFPOST SUPER USER
Stewart Goss
Evil requires the sanction of the victim -Ayn Rand
10:23 PM on 02/02/2013
Yep. Next step is a holodeck with all sensory inputs.
photo
phal4875
The world is run by cats; we just feed them.
01:34 PM on 02/04/2013
Fanned. You are probably right. Will we find all of these new experiences so breathtaking that we will no longer move out of the easy chair? It appears that some kids are already moving in that direction. Going out to play after school really means texting on some device.
photo
SolarPowerGuy
Ph.D., Immunology; Solar power @ home; Green Party
04:07 AM on 02/02/2013
In decades past, audiophiles spent huge sums of money pursuing the perfect stereo system, when blind listening tests showed that people really couldn't hear the differences they claimed to hear.

I've given the screen resolution issue some thought myself, and I've concluded that the pursuit of more pixels will soon be the same kind of thing. Videophiles will tell you how much better it looks, but they won't actually be able to tell.

Not at a normal viewing distance, anyway. Most people can't stand to be closer to a screen than its diagonal length -- i.e., you'll want to sit no closer than 52" from a 52" screen. Do the math. When viewed from one diagonal's distance, a pixel on a 1920 x 1080 screen subtends 0.026 degrees. That's already pretty close to the angular resolution of the human eye, which is one arc-minute, or 0.017 degrees. We need only to double the resolution of existing HDTV to get pixels that are too close for our eyes to separate.

I can see merits to all of the other changes you suggest: more bits per color, a larger color gamut, and frame rates of 60 Hz or even a little higher. But resolution is nearly played out.
ThinkCreeps
Seriously, it's time.
06:03 PM on 02/02/2013
That pixel size calculation doesn't take into account the eye's stereoscopy, that the pupil is 5mm across in low light, making about 0.2-arcmin resolution, or that you need to cross the first Airy ring with about ten pixels not one. There's also dynamic range and color rendering. Dr Shostak's old numbers look fairly good, although a bit optimistic.

The highest resolution region of the human eye's field of view is only about 20 degrees though, and so an adaptive display could work. Current flight simulators with helmet-mounted displays present a view indistinguishable from reality in the visor.
10:34 PM on 02/03/2013
Au contraire. Solarpower guy is pretty close to the mark. First off, when the light level gets low, the resolution of the eye diminishes, and, as it switches from rods to cones, there is a loss of color acuity. So to preserve color, the image needs to be relatively bright, meaning that full dilation of the pupil doesn't happen. Second, the 0.2 arcmin figure you give is a factor of two optimistic for the aperture and assumes that the aperture rather than the focal plane determines the MTF. In reality, the limit is about 1 arc minute as Solarpower guy says. Finally, you are also optimistic by a factor of 2 in your statement about the region of central vision: it's about 10 degrees, not 20.
photo
SolarPowerGuy
Ph.D., Immunology; Solar power @ home; Green Party
12:57 PM on 02/04/2013
Exactly how do you think that having two eyes affects the angular resolution?

Also, I don't think that the diffraction limit of the pupil is an issue. I think that the limiting factor is actually the density of photoreceptor cells on the retina.

I'd be happy to read any links which offer new information.
photo
TakeSake
The United States for All Americans
11:31 PM on 02/03/2013
CG to film was commonly rendered to 35mm at resolutions of 4096 x 3000 or thereabouts with 12 bits per color channel.

JPEG wiped out shadows and highlights, but with all the infrastructure that has it, we might be stuck with it for another 20 years.
photo
SolarPowerGuy
Ph.D., Immunology; Solar power @ home; Green Party
12:54 PM on 02/04/2013
In microscopy, data acquisition is typically done at 12 bits per pixel (per color). The extra four bits can be used to add dynamic range, and/or to give you subtler color gradations. I can tell you from direct experience that it makes a difference. In data collection, of course: but with the right display equipment, you can also see it. Switching back and forth between an 8-bit and a 12-bit image, you can see the graininess in the former.

4000 x 3000 is a pretty good choice for a movie-screen resolution. With the screen filling a 60-degree field of view (i.e, you are sitting VERY close to the movie screen), two adjacent pixels at the center of the screen subtend 0.014 degrees, which is 0.86 arc-minutes. Of course, you would probably sit farther back, which works to your advantage where resolution is concerned.

The only reason to choose a higher resolution than this would be to create the perfect IMAX-type experience. In an IMAX theater, the screen may span as much as 120 degrees of your field of view. But this article is about "the ultimate TELEVISION," and so I don't think we're talking about IMAX. We're talking about that flat panel on your family room wall.
02:25 AM on 02/02/2013
People in the West wll be able to have themselves uploaded into the Net or small Net that can be placed in orbit around the Sun...they can then live hundreds of millions of years in their own virtual worlds or until the go insane: but hey their carbon foot print on Earth will be zero.
03:04 PM on 02/02/2013
Not that it's a big deal, but for advanced technological societies, you need to head East.

I spend a significant proportion of every year in the Far East, and every time I head back to Europe, it's like going back into the past. I'm sure you didn't mean any harm by it, but the idea that the West is, even now, let alone in the future, the place where new technology will occur is a bit out-dated.