[skia] TextBox doesnt work with IME

[292390450]

Current behavior

The text box does not accept input

Expected behavior

No response

How to reproduce it (as minimally and precisely as possible)

No response

Workaround

No response

Works on UWP/WinUI

None

Environment

Uno.WinUI / Uno.WinUI.WebAssembly / Uno.WinUI.Skia

NuGet package version(s)

4.1.21
6.0.18
5.0.13
5.2.13

Affected platforms

No response

IDE

Visual Studio 2022

IDE version

No response

Relevant plugins

No response

Anything else we need to know?

Set the FeatureConfiguration.TextBox.UseOverlayOnSkia=“true”

2024-05-13.153129.mp4

can't capture focus and accept input

[ramezgerges]

I can't reproduce this with FeatureConfiguration.TextBox.UseOverlayOnSkia = true or false

[MartinZikmund]

@292390450 can you please provide more detailed steps? Which OS is this - Windows/macOS/Linux? And which keyboard specifically? Can you please make a zip with a minimal repro?

[292390450]

@MartinZikmund
UnoApp2.zip
os: Windows 11 Default Input
tartget net8.0-desktop

[292390450]

@ramezgerges

@MartinZikmund UnoApp2.zip os: Windows 11 Default Input tartget net8.0-desktop

[Xiaoy312]

I can also repro on windows 10 with the default Microsoft Pinyin IME.
Technically any skia-desktop app, with a TextBox would repro this...
It is able to receive normal keyboard input in alphabet, or chinese if i just copy-paste them.
But IME doesnt work, also I've noticed the ime overlay isnt aligned next the the text-box, but to the top-left of the screen.
---
For anyone working on this, here is how to add the ime for testing: // probably other languages (korean,japense) that doesnt use alphabet&variants can also repro this

• in Settings\Language\Preferred Language, click Add a language
• choose "Chinese (Simplified, China)", and hit Next
• uncheck all "Optional language features" and hit Install
• select the newly added "Chinese (Simplified, China)", and click Options
• under "Keyboards", click "Add a keyboard" select "Microsoft PinYin"

And, to use it in the app:

• focus the desired app
• click on the IME icon from the system tray: // the icon may looks different depending on the current ime
  
• select "Microsoft PinYin"
• back to the app, select anything capable of receiving input
• just type any letter(s) except v followed by a number, ex: asd1

[ramezgerges]

At the moment, we don't have IME support in general (not only Chinese).

[Xiaoy312]

also with: FeatureConfiguration.TextBox.UseOverlayOnSkia = true;
the textbox just completely breaks:

• the current text value is lost on focus be chinese or english
• typing doesnt work IME or even just regular english keyboard

[ramezgerges]

There was a regression with all natively-hosted widgets on WPF, which also broke the TextBox overlay. It should now behave correctly and also work with IME (since it's WPF doing all the heavy lifting). I will leave this issue open since IME with the managed textbox is still needed.
@292390450 let us know if the linked PR fixes your problem