Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding support for High Dynamic Range (HDR) imagery to HTML Canvas #917

Open
palemieux opened this issue Nov 13, 2023 · 16 comments
Open

Adding support for High Dynamic Range (HDR) imagery to HTML Canvas #917

palemieux opened this issue Nov 13, 2023 · 16 comments

Comments

@palemieux
Copy link

palemieux commented Nov 13, 2023

こんにちは TAG-さん!

The Color on the Web CG is kindly requesting a TAG review of its proposed modification to the Web Platform to support High Dynamic Range (HDR) imagery in HTML Canvas.

The complete proposal is at https://github.com/w3c/ColorWeb-CG/blob/hdr_canvas_r2/hdr_html_canvas_element.md

Today HTML Canvas supports only 8 bit per color channel and two PredefinedColorSpace color spaces (srgb and display-p3). This is insufficient for High-Dynamic Range (HDR) imagery, which is in widespread use today. Accordingly, the following API modifications are needed to manipulate HDR images in HTML Canvas:

  • add BT.2100 color spaces to PredefinedColorSpace
  • add higher bit depth capabilities to CanvasRenderingContext2DSettings
  • add higher bit depth capabilities to ImageDataSettings
  • add image color volume information to ImageDataSettings and CanvasRenderingContext2DSettings
  • add display color volume information to the Screen interface of the CSS Object Model, to determine the characteristics of the display on which the image is being reproduced

Please note that the proposed screenColorInfo property adds a fingerprinting surface. This feature is however intended primarily for advanced color volume mapping applications and is not believed to be generally necessary.

Contacts: @palemieux and @svgeesus (Color on the Web CG co-chairs)

Feedback, issues and questions are welcome at mailto:[email protected] and https://github.com/w3c/ColorWeb-CG/issues.

@palemieux palemieux added Progress: untriaged Review type: CG early review An early review of general direction from a Community Group labels Nov 13, 2023
@LeaVerou LeaVerou self-assigned this Nov 14, 2023
@plinss plinss added this to the 2023-11-20-week milestone Nov 16, 2023
@plinss plinss self-assigned this Nov 16, 2023
@svgeesus
Copy link

Hello TAG,

On 19 Feb 2024 in Tokyo there is a cross-SDO meeting HDR Stills Experts Day, with the International Color Consortium, W3C, and ISO TC 42/WG 23 (Photography) on the subject of HDR imagery. It would be super-useful to get any TAG input from this HDR in Canvas review ahead of that meeting

@palemieux
Copy link
Author

@svgeesus Where is the meeting announced in the context of W3C? Any requirements for participation?

@svgeesus
Copy link

@palemieux It is on the ICC site in the Member-only area. It isn't a public meeting. I will be there, and Chris Cameron also.

@palemieux
Copy link
Author

What is the process if myself and other W3C members wish to attend?

@palemieux
Copy link
Author

To be clear, my concern is with the output of the meeting being described as including an opinion from the W3C and/or input provided in the meeting be presented as W3C input, without such input having been discussed/reviewed by W3C participants.

@svgeesus
Copy link

I think the proposed modification to the Web Platform to support High Dynamic Range (HDR) imagery in HTML Canvas has been adequately discussed that it can be presented at the meeting, no?

@palemieux
Copy link
Author

Ok. Which document(s) are you planning on presenting -- beyond https://github.com/w3c/ColorWeb-CG/blob/hdr_canvas_r2/hdr_html_canvas_element.md? It would be good to inform their respective groups.

@jyasskin
Copy link
Contributor

jyasskin commented Feb 1, 2024

This doesn't seem like the right repository for this side discussion.

@LeaVerou
Copy link
Member

Hi there,

@plinss @ylafon and I looked at this today during a breakout.
We had a few thoughts and questions:

  1. The part of the API around checking whether a color is in within the volume of the output device and mapping it manually by the author seemed both too close to the hardware to be future-compatible, and too low level to have good DX. We think a higher level method to check whether a color is within the range of the output device would be preferable.
  2. The Canvas APIs do not seem like the right place to specify primitives for querying the volume of the output device, which are useful in APIs across the entire web platform.
  3. While we appreciated the discussion on volume mapping, we still had questions about the specifics. We see several cases where gamut/volume/tone mapping come into play, and we’d love some more detail on how these are handled (actually, the same questions apply to wider/smaller gamuts too):
    1. HDR image painted on a non-HDR canvas
    2. HDR canvas displayed non-HDR screen
    3. Author painting an HDR CSS color on a non-HDR canvas
  4. The used color space is a property of CanvasRenderingContext2D, but HTMLCanvasElement provides methods for exporting the canvas contents as an image (toBlob(), toDataURL()). Is the color space preserved during these operations? (again this also applies to wide gamut)

And some more minor comments:

  • Since CSS Color HDR has been approved as a workstream by the CSS WG, this work should probably reference it in the same way it references css-color-4.
  • screen.screenColorInfo seems a little repetitive, why not screen.colorInfo?

@svgeesus
Copy link

@ palemieux this issue is waiting for a response from ColorWeb CG and/or the proposers, regarding the questions from the TAG review

@palemieux
Copy link
Author

While we appreciated the discussion on volume mapping, we still had questions about the specifics.

@LeaVerou To make sure we address the question correctly, can you specify what is missing in Annex A?

@palemieux
Copy link
Author

palemieux commented Jun 19, 2024

The part of the API around checking whether a color is in within the volume of the output device

@LeaVerou Do you mean this part of the API.

If so, how is it too close to the hardware? Note the API does not require the returned values to match the hardware exactly, and may reflect user preferences/OS limitations/environmental conditions/etc.

That part of the API is intended for advanced applications. The vast majority of applications are expected to merely set the Canvas to an HDR colorspace and write pixels in that colorspace, letting the UA/OS/Device render the HDR pixels as appropriate based on current conditions.

@palemieux
Copy link
Author

FYI. Comments above have been entered at https://github.com/w3c/ColorWeb-CG/issues?q=is%3Aopen+is%3Aissue+label%3Atag-comment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment