Acamon@lemmy.world to No Stupid Questions@lemmy.world · 1 year agoDo any languages have words for left & right that start with the same letter?message-squaremessage-square44fedilinkarrow-up1112file-text
arrow-up1112message-squareDo any languages have words for left & right that start with the same letter?Acamon@lemmy.world to No Stupid Questions@lemmy.world · 1 year agomessage-square44fedilinkfile-text
minus-squarenandeEbisu@lemmy.worldlinkfedilinkarrow-up1·1 year agoThey don’t process words as unified tokens for something like an LLM, but they do process them as multi-letter encoding, like byte-pair encoding or more advanced techniques.
They don’t process words as unified tokens for something like an LLM, but they do process them as multi-letter encoding, like byte-pair encoding or more advanced techniques.