Background
Before I go into the particular error I’m encountering, it’s worth mentioning how I got here: I was trying to make a scripting language in Ruby, because I was originally game developing in that language.
But the syntax began rapidly diverging from Ruby because I’m trying to implement a different syntax besides English, specifically using Francais. This is a whole story onto itself, and more in depth than I have time to go into here.
It is presently split into clemots ( equivalent to keywords or function names in Crystal ), numots ( technically suppose to be quoted strings, but I’m having to use snake case at the moment ), and symbols ( exactly the same as Ruby and Crystal symbols ).
Present Issue
In order to chunk each token, I essentially had to reach a document line by line, then after splitting each line by white space ( what seems to be causing issues in the scripting language, but not interactive mode ) I append each token into an array, and then read each array in a Crystal function. As this is is my first scripting language, I have no idea if this is even the right approach. But I’m presently trying to find alternative forms of terminators in string splitting, because “Hello World” keeps becoming “Hello and then World”.
So I’m trying to replace " " termination with multiple delimiters.
break_points = [%Q(" ), Q( ), Q( ")]
tokens = current_line.split(Regex.delimit(break_points))
total_tokens = tokens.size.to_i
token_index = 0
## The actual tokens you'll be parsing.
parsed_tokens = \[\] of String
Which causes this error:
Error: undefined method ‘delimit’ for Regex.class
Is anyone encountering that issue?
Present format
Presently I’m having to use work arounds by relying on solid_snake_case which isn’t super convenient for long term use.
Note before proposing regex, it’s worth point out this doesn’t necessarily fit my use case and is difficult to understand.
The rest of the scripting language seem to work fine oddly enough. It’s just not structured the way people might be used to, as everything is done in one line.
Yes I’ve tried asking other places, but they kept making my problem worse by “refactoring” into a format that isn’t even understood by myself, whose been at this for over a decade.