Incorrect characters

[kishorech0817]

Recently, I observed my text has incorrect characters after using the Premailer with adapter adapter::nokogiri_fast.
Issue:

body = "<div dir=\"auto\">Wow … I got paid this morning I will b over I’m so so sorry gotta get a new lock that lock has been giving me nothing but problems and I have to update my card information my job is crazy up to something I think .. Anyways see ya shortly </div><div><br><div class=\"gmail_quote\"><div dir=\"ltr\" class=\"gmail_attr\">"
premailer = Premailer.new(body, with_html_string: true, warn_level: Premailer::Warnings::NONE, adapter: :nokogiri_fast)
 premailer.to_plain_text

It returns "Wow â\u0080¦ I got paid this morning I will b over Iâ\u0080\u0099m so so sorry\ngotta get a new lock that lock has been giving me nothing but\nproblems and I have to update my card information my job is crazy\nup to something I think .. Anyways see ya shortlyÂ".

Is it a new issue here?

Premailer Version: premailer (1.11.1)

[grosser]

sounds similar to #430

[tagliala]

Yes, maybe this is not an issue anymore

@kishorech0817 is this still an issue?

[smeijer]

Had a similar issue, solved by setting the encoding to utf-8:

html.force_encoding('utf-8')

premailer = Premailer.new(
  html,
  with_html_string: true,
  input_encoding: 'utf-8'
)

[grosser]

can you make a PR to add to the readme to recommend how ppl should set this up ?

[tagliala]

I think that this issue is specific to some setups, it would be interesting also to understand the causes (like nokogiri version (which can't be below 1.16 atm, source file, variable encoding, etc.)