Polyphony Digital Shares Technical Document on GT Sport's HDR & Wide Color Support

This has been a pretty big change in PD's approach to the game in general. They've been sharing a lot about the dev process and I love that about them now, even if it all goes over my head.
Another presentation in Japanese : Procedural Hard Surface Design | Akira Saito | SIGGRAPH Asia 2018 (Tokyo)

I think all the buildings at Tokyo Expressway are made with Houdini. (And the speaker is wearing a Pikes Peak jacket :lol:)

In general, Poly is less secretive today wich is great! And the studio is still hiring, I wonder how many people work at Poly?
 
Another presentation in Japanese : Procedural Hard Surface Design | Akira Saito | SIGGRAPH Asia 2018 (Tokyo)

I think all the buildings at Tokyo Expressway are made with Houdini. (And the speaker is wearing a Pikes Peak jacket :lol:)

In general, Poly is less secretive today wich is great! And the studio is still hiring, I wonder how many people work at Poly?


Everytime i see this Procedural Hard Surface Design my mind goes wild thinking PD is secretly making a sequel to Omega Boost
 
Our new Samsung does HDR 10 and sometimes I'm not sure I prefer the HDR look over the SDR I've been playing in for a year.
 
VXR
Our new Samsung does HDR 10 and sometimes I'm not sure I prefer the HDR look over the SDR I've been playing in for a year.
You need to double check your settings. There is a huge difference in the realism of the lighting and overall graphic quality with HDR. Good HDR brings out detail in textures such as the road.
 
I just went through the slides. I didn't know before but I guessed they adapted HDR10 since most modern TVs with HDR have it. Lots of info there. Definitely worth a read for the enthusiasts of video rendering. Some of the solutions PD found to problems of implementing HDR is so simple and yet effective. HDR rendering still seems to be in an experimental phase because there seems to be world wide standard (maybe apart from BT.2020). These guys know what they have done is not perfect but they are aware of the bottlenecks and what areas need improvement. This is a masterpiece in progress.
 
alp
I just went through the slides. I didn't know before but I guessed they adapted HDR10 since most modern TVs with HDR have it. Lots of info there. Definitely worth a read for the enthusiasts of video rendering. Some of the solutions PD found to problems of implementing HDR is so simple and yet effective. HDR rendering still seems to be in an experimental phase because there seems to be world wide standard (maybe apart from BT.2020). These guys know what they have done is not perfect but they are aware of the bottlenecks and what areas need improvement. This is a masterpiece in progress.

One of the problems is that a system ideal for Polyphony isn't always exactly what is released by a dozen TV manufacturers. Often, it's not even what the engineers at those manufacturers wanted, nor what the photographers, scientists and technical folks wanted; the realities of life and work mean that you're going to get a mixed bag limited by time, money, pride and greed and try and deal with it.

Now, since this one is in English (interesting), there's not so much need to translate every slide like I did for the last one on Iris. But, I can explain a few things.

First, your typical display is a effectively 24-bit; 8 bits of Red, Green and Blue each. RGB, I'll use that a lot.

8 bits gives you 2^8 = 256 values (0-255) and thus, assuming that "greyscale" is when R, G and B are the same, that means you only have 256 levels/steps of brightness, from pure black to pure white.
In practice, since we see different colours as different brightness (even though they're the same) you can use tricks by making the gray slightly 1/256th more blue (darker) or R+G aka yellow (slightly lighter). This only works in the midrange, where the difference in saturation is relatively small. So you CAN sorta fake more brightness levels in, but technically it's a bit ghetto.

OK, back to the presentation. They go into what colours the human eye can see. Typically, we have 3 cones that detect R G and B. Since it's organic and biological, it's not linear, or consistent or 100% reliable, but pretty good. Fits >95 of the population damn well, so that's designated as normal.

Now, apparently the human eye can see 46-bits of precision. That's obviously not worth blowing absurd amounts of memory/storage space on, and building screens to that level, so Dolby Imaging got it down to a 1:10,000 range of brightness.

NOTE: for those of you who can't count in binary - 2^10 = 1,000-ish. Therefore, 13-bit precision i about 8,000-ish (14-bit is 16k) so if we're being proper we'd be using 13 bits per channel. But for RGB that means a 39-bit buffer, which is dumb. 3 times 10-bit buffers, one each for R+G+B gives you 30 bits, + 2 bits for other random things, which fits nicely in a 32-bit buffer. That's what they use in most game engines nowdays for Normal Map buffers, as well as HDR lighting buffers.

Again back to the presentation. The human eye can see differences as low as 1nm in wavelength. In english, that means a change in colour. Given we see about ~400nm band, that's a ~0.25% change in hue, impressive!
NOTE: this is different for men and women. Women are FAR, FAR, FAR more likely to be this sensitive to changes in hue than men (differences in eye and brain makeup). Lads, we see things differently, and also you're a lot more likely to be colourblind as well. We handle vision differently, relying more on the brain vs the eyes. It's assumed to be a hunter vs gatherer type thing from our evolutionary history.

One of the big problems they have is that the 'stantards' aren't yet set and enforced like they need to be. One 'HDR' isn't always like another.
NOTE: this drives everyone mad.
This is in part because of the different types of displays, so there isn't a huge amount you can do about this for now. Until there's either one type of screen, or both have enough overlap to fit the entire HDR spectrum, it's going to be a problem.

The curves, gamuts, gamma, etc are all different ways of manipulating that 256 or 1024 step gradient in different ways. As it turns out, since we don't see brightness as completely linear anyway, and most things we see are in 'patches' of brightness, we can clump those steps closer where we need to, and spread them out thinner where we can't notice the difference so much.
THEREFORE:
Now there's 999 different competing standards and different ways TVs, monitors, and softwares are set up from the factory. Great.

Thankfully, you can use math to compare them and find out the best one.

Skipped a fair bit, going to the tonemapping.

Tonemapping is the process of converting an 'unlimited, raw' brightness into something that's both pleasant to look at, works with the display to look realistic and handles 'changes of exposure', in games auto-magically.

Page 118 -123 explains this perfectly, and is what you really need to look at. The slight dip in the curve at the darker colours 'crushes the blacks' which is appealing to viewers. The dead straight linear section in the mid-tones is what makes things look photo-realistic, and by compressing the bright bits you can get away with saving some extra detail for the mids.

Therefore, you can have something that's good looking, stylish, photo-realistic and efficient all in one!
I'm not making this up when I say the people who do the tonemapping for Polyphony are worth their weight in gold. Seriously.

Skipping a bit, they go into some of the calibration tests they use for the cameras, The important part is they get everything 'neutral' so that they can align everything perfectly in-engine. Remember, you want to do lighting calculations with everything CORRECT and then at The End (post-processing) add tint/exposure/etc calculations. Keep the data as clean as possible, for as long as possible, otherwise you put dirty errors in and pay the price.

Then there's a lot of testing and specifications on format types.

And some more on colour grading. This is basically the artist-controlled version of tonemapping - whether you're combining RGB into one channel for a black and white / greyscale image, or your're tinting it warm or cool, or whatever. Functions much the same way, it's just an operation on the image you perform as post-processing.

One interesting note is that they do get some colour shift in the bright areas (and presumably very dark areas too). This is because they run the tonemapper per-channel I think. So as the RGB values are on different bits of the curve, they can get separated as the curve changes up/down. I would have thought they'd try and shift things into HSV and keep the HS locked 100%, but since it's only noticeable at very bright areas, and only if you're looking for it, they took what I assume is a slight performance boost by saving a step. Hey, when you need those tenths of a millisecond, every cut operation counts...

Anyway, that's the normal-people english version of their presentation. Hope that explains a few things.
 
You need to double check your settings. There is a huge difference in the realism of the lighting and overall graphic quality with HDR. Good HDR brings out detail in textures such as the road.

After reading through the slides I re-calibrated my TV (Samsung KS7000). Turns out I didn't light up the dark pieces enough because I didn't understand the principle behind it. Results are indeed noticeable.
 
giphy.gif
 
Interesting article, especially about the calibration and testing with the different tv's. But one thing i also would like to know is what color tone profile they would recommend, as it changes the image a lot.

On my tv I use warm2 (Samsung) as that was recommended by a digital foundry video. But it would be nice to know what the developers use and recommend.
 
Interesting article, especially about the calibration and testing with the different tv's. But one thing i also would like to know is what color tone profile they would recommend, as it changes the image a lot.

On my tv I use warm2 (Samsung) as that was recommended by a digital foundry video. But it would be nice to know what the developers use and recommend.

Warm 2 is the closest to D6500K and I believe that's the standard use by film makers and game developers.
 
You need to double check your settings. There is a huge difference in the realism of the lighting and overall graphic quality with HDR. Good HDR brings out detail in textures such as the road.

alp
After reading through the slides I re-calibrated my TV (Samsung KS7000). Turns out I didn't light up the dark pieces enough because I didn't understand the principle behind it. Results are indeed noticeable.

We have a similar TV I think, turns out despite selecting HDR on the PS4 and Game Mode, HDR was off by default on HDMI 3. Can definitely see the difference now.
 
VXR
We have a similar TV I think, turns out despite selecting HDR on the PS4 and Game Mode, HDR was off by default on HDMI 3. Can definitely see the difference now.

That's true. I did a lot of reading and watching about setting up PS4 for HDR compatible TVs. Hard to understand why Samsung TVs come with HDR off by default. Hopefully this is just a phase and future units will be more compatible and easier to setup.
 
...meantime GT has bacame the ugliest cockpit view "game" in industry. I drive everything which are available in the market. I have PC and PS4 Pro too, full HD and 4k display. GT Sport is ugly. Period.
 
...meantime GT has bacame the ugliest cockpit view "game" in industry. I drive everything which are available in the market. I have PC and PS4 Pro too, full HD and 4k display. GT Sport is ugly. Period.
Your loss, sir.

Perhaps this thread (it's a link, click on it) would be a better place to complain?
 
...meantime GT has bacame the ugliest cockpit view "game" in industry. I drive everything which are available in the market. I have PC and PS4 Pro too, full HD and 4k display. GT Sport is ugly. Period.

One of these things is not like the other,i understand the cockpit view having weird shadow effects making it ugly but then your other quote implies everything in GTS is ugly which is not true.
 
Update to my HDR post, if I switch to HDMI 3 using the Samsung remote and not the Sky Q remote, it automatically sets it to HDR and Game Mode. Puzzling, but one less hassle.
 


PD showing off their live replay movie creation and realtime raytracing

I really hope they give us some of these controls, the interior color swaps should totally be a thing. As well as slow mo shots plus all the other cool things
 


PD showing off their live replay movie creation and realtime raytracing

I really hope they give us some of these controls, the interior color swaps should totally be a thing. As well as slow mo shots plus all the other cool things


The real-time raytracing is the most interesting part. The soft and hard shadows and reflection quality looks so good and accurate. Plus, dynamic time change is back. Now we just need to hope Sony and AMD are creating a graphics card for PS5 that can handle this.
 
Back