Skip to content

Latest commit

 

History

History
7 lines (4 loc) · 405 Bytes

README.md

File metadata and controls

7 lines (4 loc) · 405 Bytes

Tokey

Tokey is a configurable, general-purpose code tokenizer that supports comment and string skipping. When you need to find specific structures in a code block (such as imports in JavaScript, or URLs in CSS) and you don't want to use a full-blown parser, you can create a specific tokenizer to get the job done.

@tokey/core

Read more about the core package here.