feat(tokenizer): string tokenizing

notes.org

@@ -212,13 +212,22 @@ i will use rustyline, since it seems like the most feature-complete
 
 * DONE remove uneeded error variants
 
-* STRT parse integers
+* DONE parse integers
 
-** TODO Function to get a token until condition is false
+** DONE Function to get a token until condition is false
 
-** TODO Parse the integer
+** DONE Parse the integer
 
-* TODO parse strings
+* DONE parse strings
+
+* TODO better error message display for unclosed " in string
+
+* TODO parse insert statements in the form
+insert <id:int> <username:string> <email:string>
+** TODO Row struct
+** TODO parse row insert
+** TODO serialize/deserialize row to/from raw bytes
+*** TODO look for best practices for creating binary formats
 
 * WAIT cli tests using insta-cmd
 https://insta.rs/docs/cmd/