Skip to content

Ruby: Improved tokenization #3193

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
RunDevelopment merged 7 commits into from
Nov 22, 2021
Merged

Ruby: Improved tokenization #3193

RunDevelopment merged 7 commits into from
Nov 22, 2021

Conversation

@RunDevelopment
Copy link
Member

@RunDevelopment RunDevelopment commented Nov 10, 2021

Changes:

  • Simpler comment pattern
  • Proper operator and punctuation patterns
  • Added support for escaped interpolation
  • Reduced constant false positives
  • Added support for command literals
  • Improved symbol pattern
  • Improved string/regex tokenization and aliasing

@github-actions
Copy link

github-actions bot commented Nov 10, 2021 •
edited
Loading

JS File Size Changes (gzipped)

A total of 2 files have changed, with a combined diff of +353 B (+21.0%).

Details
file master pull size diff % diff
components/prism-crystal.min.js 575 B 580 B +5 B +0.9%
components/prism-ruby.min.js 1.11 KB 1.46 KB +348 B +31.4%

Generated by 🚫 dangerJS against bbd1949

@RunDevelopment RunDevelopment mentioned this pull request Nov 10, 2021
Merged
@RunDevelopment RunDevelopment merged commit 86028ad into PrismJS:master Nov 22, 2021
@RunDevelopment RunDevelopment deleted the ruby-impr branch November 22, 2021 12:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

enhancement language-definitions needs review

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@RunDevelopment