[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#1002532: pygments breaks ruby-pygments.rb autopkgtest: UTF-8 != ASCII-8BIT



Source: pygments, ruby-pygments.rb
Control: found -1 pygments/2.10.0+dfsg-1
Control: found -1 ruby-pygments.rb/1.2.1-2
Severity: serious
Tags: sid bookworm
X-Debbugs-CC: debian-ci@lists.debian.org
User: debian-ci@lists.debian.org
Usertags: breaks needs-update

Dear maintainer(s),

With a recent upload of pygments the autopkgtest of ruby-pygments.rb fails in testing when that autopkgtest is run with the binary packages of pygments from unstable. It passes when run with only packages from testing. In tabular form:

                       pass            fail
pygments               from testing    2.10.0+dfsg-1
ruby-pygments.rb       from testing    1.2.1-2
all others             from testing    from testing

I copied some of the output at the bottom of this report.

Currently this regression is blocking the migration of pygments to testing [1]. Due to the nature of this issue, I filed this bug report against both packages. Can you please investigate the situation and reassign the bug to the right package?

More information about this bug and the reason for filing it can be found on
https://wiki.debian.org/ContinuousIntegration/RegressionEmailInformation

Paul

[1] https://qa.debian.org/excuses.php?package=pygments

https://ci.debian.net/data/autopkgtest/testing/amd64/r/ruby-pygments.rb/17802854/log.gz


┌──────────────────────────────────────────────────────────────────────────────┐
│ Checking Rubygems dependency resolution on ruby2.7
└──────────────────────────────────────────────────────────────────────────────┘

NOTE: Gem::Specification#has_rdoc= is deprecated with no replacement. It will be removed in Rubygems 4
Gem::Specification#has_rdoc= called from pygments.rb.gemspec.gem2deb:15.
GEM_PATH= ruby2.7 -e gem\ \"pygments.rb\"

┌──────────────────────────────────────────────────────────────────────────────┐
│ Run tests for ruby2.7 from debian/ruby-tests.rake
└──────────────────────────────────────────────────────────────────────────────┘

mv lib ./.gem2deb.lib
RUBYLIB=. GEM_PATH= ruby2.7 -S rake -f debian/ruby-tests.rake
/usr/bin/ruby2.7 -w -I"test" /usr/share/rubygems-integration/all/gems/rake-13.0.3/lib/rake/rake_test_loader.rb "test/test_pygments.rb" -v /tmp/autopkgtest-lxc.w3sdlnr1/downtmp/build.2uD/src/test/test_pygments.rb:89: warning: assigned but unused variable - code Loaded suite /usr/share/rubygems-integration/all/gems/rake-13.0.3/lib/rake/rake_test_loader
Started
PygmentsConfigTest:   test_filters:						.: (0.256212)
  test_formatters:					.: (0.005894)
  test_lexers:						.: (0.002138)
  test_styles:						.: (0.000682)
PygmentsCssTest:   test_css:						.: (0.001871)
  test_css_colorful:					.: (0.001783)
  test_css_default:					.: (0.001030)
  test_css_options:					.: (0.001042)
  test_css_prefix:					.: (0.001095)
  test_css_prefix_and_options:				.: (0.001029)
PygmentsHighlightTest:   test_full_html_highlight:				.: (0.115936)
  test_full_table_highlight:				F
===============================================================================
Failure: test_full_table_highlight(PygmentsHighlightTest)
/tmp/autopkgtest-lxc.w3sdlnr1/downtmp/build.2uD/src/test/test_pygments.rb:32:in `test_full_table_highlight'
     29:   def test_full_table_highlight
     30:     code = P.highlight(RUBY_CODE, :options => {:linenos => true})
     31:     assert_match '<span class="ch">#!/usr/bin/ruby</span>', code
=> 32: assert_equal "<table class=\"highlighttable\"><tr><td class=\"linenos\"><div class=\"linenodiv\"><pre>1\n2</pre></div></td><td class=\"code\"><div class=\"highlight\"><pre><span></span><span class=\"ch\">#!/usr/bin/ruby</span>\n<span class=\"nb\">puts</span> <span class=\"s1\">&#39;foo&#39;</span>\n</pre></div>\n</td></tr></table>", code
     33:   end
     34:      35:   def test_highlight_works_with_larger_files
<"<table class=\"highlighttable\"><tr><td class=\"linenos\"><div class=\"linenodiv\"><pre>1\n" + "2</pre></div></td><td class=\"code\"><div class=\"highlight\"><pre><span></span><span class=\"ch\">#!/usr/bin/ruby</span>\n" +
"<span class=\"nb\">puts</span> <span class=\"s1\">&#39;foo&#39;</span>\n" +
"</pre></div>\n" +
"</td></tr></table>"> expected but was
<"<table class=\"highlighttable\"><tr><td class=\"linenos\"><div class=\"linenodiv\"><pre><span class=\"normal\">1</span>\n" + "<span class=\"normal\">2</span></pre></div></td><td class=\"code\"><div class=\"highlight\"><pre><span></span><span class=\"ch\">#!/usr/bin/ruby</span>\n" +
"<span class=\"nb\">puts</span> <span class=\"s1\">&#39;foo&#39;</span>\n" +
"</pre></div>\n" +
"</td></tr></table>">

diff:
? <table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span> ? <span class="normal">2</span></pre></div></td><td class="code"><div class="highlight"><pre><span></span><span class="ch">#!/usr/bin/ruby</span>
  <span class="nb">puts</span> <span class="s1">&#39;foo&#39;</span>
  </pre></div>
  </td></tr></table>
===============================================================================
: (0.040280)
  test_highlight_defaults_to_html:			.: (0.002654)
  test_highlight_formatter_bbcode:			.: (0.002273)
  test_highlight_formatter_terminal:			.: (0.002109)
  test_highlight_on_multi_threads:			.: (1.895618)
  test_highlight_options:				.: (0.002781)
  test_highlight_still_works_with_invalid_code:		.: (0.046907)
  test_highlight_works_on_utf8:				.: (0.001243)
  test_highlight_works_on_utf8_all_chars_automatically:	.: (0.001186)
  test_highlight_works_on_utf8_automatically:		.: (0.001127)
  test_highlight_works_with_larger_files:		.: (0.260678)
  test_highlight_works_with_multiple_newlines:		.: (0.002514)
  test_highlight_works_with_multiple_utf8:		.: (0.001222)
test_highlight_works_with_multiple_utf8_and_trailing_newline: .: (0.001248)
  test_highlight_works_with_null_bytes:			.: (0.001208)
  test_highlight_works_with_single_character_input:	.: (0.020496)
  test_highlight_works_with_trailing_cr:		.: (0.002364)
  test_highlight_works_with_trailing_newline:		.: (0.002217)
PygmentsLexerClassTest:   test_find:						.: (0.010705)
  test_find_by_alias:					.: (0.000189)
  test_find_by_name:					.: (0.000156)
  test_find_lexer_by_extname:				.: (0.000201)
  test_find_lexer_by_mimetype:				.: (0.000129)
PygmentsLexerTest:   test_lexer_by_content:				F
===============================================================================
Failure: test_lexer_by_content(PygmentsLexerTest)
/tmp/autopkgtest-lxc.w3sdlnr1/downtmp/build.2uD/src/test/test_pygments.rb:197:in `test_lexer_by_content'
     194:   end
     195:      196:   def test_lexer_by_content
  => 197:     assert_equal 'rb', P.lexer_name_for(RUBY_CODE)
     198:   end
     199:      200:   def test_lexer_by_nothing
<"rb">(UTF-8) expected but was
<"ruby">(ASCII-8BIT)

diff:
? ruby
  ? Encoding: UTF  -8   ?           ASCII  BIT
===============================================================================
: (0.006267)
  test_lexer_by_filename:				F
===============================================================================
Failure: test_lexer_by_filename(PygmentsLexerTest)
/tmp/autopkgtest-lxc.w3sdlnr1/downtmp/build.2uD/src/test/test_pygments.rb:182:in `test_lexer_by_filename'
     179:   end
     180:      181:   def test_lexer_by_filename
  => 182:     assert_equal 'rb', P.lexer_name_for(:filename => 'test.rb')
183: assert_equal 'scala', P.lexer_name_for(:filename => 'test.scala')
     184:   end
     185: <"rb">(UTF-8) expected but was
<"ruby">(ASCII-8BIT)

diff:
? ruby
  ? Encoding: UTF  -8   ?           ASCII  BIT
===============================================================================
: (0.061787)
  test_lexer_by_filename_and_content:			F
===============================================================================
Failure: test_lexer_by_filename_and_content(PygmentsLexerTest)
/tmp/autopkgtest-lxc.w3sdlnr1/downtmp/build.2uD/src/test/test_pygments.rb:193:in `test_lexer_by_filename_and_content'
     190:   end
     191:      192:   def test_lexer_by_filename_and_content
=> 193: assert_equal 'rb', P.lexer_name_for(RUBY_CODE, :filename => 'test.rb')
     194:   end
     195:      196:   def test_lexer_by_content
<"rb">(UTF-8) expected but was
<"ruby">(ASCII-8BIT)

diff:
? ruby
  ? Encoding: UTF  -8   ?           ASCII  BIT
===============================================================================
: (0.008853)
  test_lexer_by_mimetype:				F
===============================================================================
Failure: test_lexer_by_mimetype(PygmentsLexerTest)
/tmp/autopkgtest-lxc.w3sdlnr1/downtmp/build.2uD/src/test/test_pygments.rb:177:in `test_lexer_by_mimetype'
     174:   RUBY_CODE = "#!/usr/bin/ruby\nputs 'foo'"
     175:      176:   def test_lexer_by_mimetype
=> 177: assert_equal 'rb', P.lexer_name_for(:mimetype => 'text/x-ruby') 178: assert_equal 'json', P.lexer_name_for(:mimetype => 'application/json')
     179:   end
     180: <"rb">(UTF-8) expected but was
<"ruby">(ASCII-8BIT)

diff:
? ruby
  ? Encoding: UTF  -8   ?           ASCII  BIT
===============================================================================
: (0.006057)
  test_lexer_by_name:					F
===============================================================================
Failure: test_lexer_by_name(PygmentsLexerTest)
/tmp/autopkgtest-lxc.w3sdlnr1/downtmp/build.2uD/src/test/test_pygments.rb:187:in `test_lexer_by_name'
     184:   end
     185:      186:   def test_lexer_by_name
  => 187:     assert_equal 'rb', P.lexer_name_for(:lexer => 'ruby')
     188:     assert_equal 'python', P.lexer_name_for(:lexer => 'python')
     189:     assert_equal 'c', P.lexer_name_for(:lexer => 'c')
     190:   end
<"rb">(UTF-8) expected but was
<"ruby">(ASCII-8BIT)

diff:
? ruby
  ? Encoding: UTF  -8   ?           ASCII  BIT
===============================================================================
: (0.002949)
  test_lexer_by_nothing:				.: (0.002936)
PygmentsValidityTest:   test_add_ids_on_empty_string:				.: (0.000176)
  test_add_ids_with_padding:				.: (0.000093)
  test_add_ids_with_starting_slashes:			.: (0.000110)
  test_add_ids_with_unicode_data:			.: (0.000093)
  test_get_fixed_bits_from_header:			.: (0.000117)
  test_get_fixed_bits_from_header_works_with_large_headers:	.: (0.000178)
  test_size_check:					.: (0.000098)
  test_size_check_bad:					.: (0.000091)

Finished in 2.782595741 seconds.
-------------------------------------------------------------------------------
48 tests, 88 assertions, 6 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications
87.5% passed
-------------------------------------------------------------------------------
17.25 tests/s, 31.63 assertions/s
rake aborted!
Command failed with status (1): [ruby -w -I"test" /usr/share/rubygems-integration/all/gems/rake-13.0.3/lib/rake/rake_test_loader.rb "test/test_pygments.rb" -v] /usr/share/rubygems-integration/all/gems/rake-13.0.3/exe/rake:27:in `<top (required)>'
Tasks: TOP => default
(See full trace by running task with --trace)
mv ./.gem2deb.lib lib
autopkgtest [05:01:27]: test gem2deb-test-runner

Attachment: OpenPGP_signature
Description: OpenPGP digital signature


Reply to: