tokenizer header: add multi-header support#39

prashanthpai wants to merge 2 commits intosuperfly:mainsuperfly/tokenizer:mainfrom

prashanthpai:ppai/custom-multi-header-supportprashanthpai/tokenizer:ppai/custom-multi-header-supportCopy head branch name to clipboard