js-lexer

A lexical analyzer — more commonly referred to as lexer — is a software component that takes a string and breaks it down into smaller units that are understandable by a language. These smaller units are called lexical tokens or lexemes.