Chat Logs

  1. dreamrealmarkov chain of you!
  2. jreicherOh really...
  3. jreicherbe jreicher
  4. nevet* channeling jreicher: i'm very much against the idea are the ticks, because they would continue while "players" are away. that might be prepared to modify the pr with your feedback
  5. jreicherbe jreicher
  6. nevet* channeling jreicher: to emacs. they don't always like what the tradition is. "rabbi, is it the tradition then to sit for the shema. failing to come up with a really infantile concept
  7. jreicherOh that i need to think about. A rabbi commenting on Emacs and the shema.
  8. dreamrealhey rabbis probably prefer emacs to vim
  9. dreamrealbut yeah, nevet has a clojure operation now :D
  10. bot[jottinger/bytecode.news] New issue #148: Wiki-style references in Markdown content ([[factoid]] and [[slug]] resolution) - https://github.com/jottinger/bytecode.news/issues/148
  11. * NeXeN joined #nevet
  12. * NeXeN joined #nevet
  13. * jreicher joined #nevet
  14. dreamrealyo jreicher
  15. blue YO jreicher
  16. dreamreali wonder what the effect would be of using four tokens for the markov chain instead of three
  17. dreamrealtwo goes off the rails really quickly, ONE goes off the rails SUPER-quickly
  18. dreamrealthree is recognizable, but still absurd
  19. bluewhat are you on about
  20. dreamrealbe dreamreal
  21. nevet* channeling dreamreal: people unable to talk about main vs master an asshole issue, and were not winners
  22. bluebe DJT
  23. nevetNo message history found for DJT.
  24. dreamrealthat's done by building a markov chain for the nick's history
  25. blueidk what a markov chain is
  26. dreamrealask what is a markov chain?
  27. nevetA Markov chain is a mathematical model that predicts the next item in a sequence based only on the current state, not the full history. In the context shown, dreamreal is using it to generate text by analyzing which words commonly follow others in chat history—for example, using 3 tokens means looking at the previous 3 words to predict what comes next.
  28. blue"current state", "3 previous words", ok. more nonsense
  29. dreamrealthat's not nonsense. If you don't understand it, all that means is that you don't understand it.
  30. dreamrealSo: imagine a sequence of words: X X Y, X X Y, X X Y, right?
  31. blueyes?
  32. dreamrealif you take that as a sample, you can say that "after X, you have a percentage of times you get X, or Y"
  33. blueyeah but what's the big deal, how is that different to any other statistically observation
  34. dreamrealX can yield X or Y: roughly a 50% chance based on that sample set, so if i say "here's X, what should follow, statistically?" you'd get 50% of X or Y
  35. bluestatistical*
  36. dreamrealbut if you say "what follows X X" it's Y, every time, right?
  37. dreamrealI'm getting there, geez
  38. blue*waits*
  39. dreamreal"this is what surface area means, class" "why aren't you giving me the surface area of the conical projection for these coordinates already, what's wrong with you"
  40. dreamrealanyway, so in a ONE token sample, You say "X" and the answer is 50% X, 50% Y
  41. blueya
  42. dreamrealin a TWO token sample (meaning the input to see what the 'next token' is) you'd get Y, 100%
  43. dreamrealthis is very useful in a lot of situations: autocorrect uses it a lot (and it's part of why autocorrect is so annoying), but you can do weather patterns, too
  44. blueyou needed 10 sentences to tell me you wanna calculate a statistically observation based on 2 vs 4 messages?
  45. dreamrealif you have four days of sun, there's a statistical prediction of whether the next day will be sunny, too, although you'd factor in more than "four days of sun" in an actual weather markov model
  46. blueyes
  47. dreamrealno, it should have been obvious right out of the gate but it wasn't, so I explained it
  48. bluebut I still don't get what'st he big deal. it's just statistics. why call it a markov chain
  49. dreamrealbecause that's literally the name of the specific model
  50. blueso markov chain is just a hipster name for how many messages we look back?
  51. dreamreal... no?
  52. dreamrealI mean, that's the guy who formalized the rules and data about the model, it's why we talking about 'newtonian physics' and not 'you know the apple shit'
  53. blueHA!
  54. dreamrealsame with bayes: "it's just numbers" but the specific reference has meaning
  55. dreamrealand the number of messages we feed INTO the model is actually called "the number of messages we feed into the model" and the model is a markov chain with specific characteristics, in this case the number of tokens that make up a sequence
  56. blueanyway, I consider this feature dumb: why do I need the bot spouting my own nonsense
  57. bluealso the messages in isolation often make no sense
  58. dreamrealhaha, nice! of course you do. But this was actually one of the first reasons the INITIAL bot was actually designed: we had a user who was very caustic and didn't believe he was being caustic. So I build a markov chain of HIS data, and had the system generate "stuff he would say" based on the data (removing MY bias against how he phrased things) and ran THAT through a sentiment analysis: if my
  59. dreamrealsuspicions were correct, he'd have a negative sentiment *as generated by the model* - and lo, he got a -0.4
  60. bluemhm
  61. bluetoxicity dreamreal
  62. dreamrealnevet would have said -4, not -0.4
  63. bluehm, broken
  64. dreamreal~sentiment #nevet
  65. dreamrealsentiment #nevet
  66. nevetSentiment for irc://libera/%23nevet: Sentiment +3/10 | Intensity mod | Themes: markov chains, statistics, bot features, technical explanation | Summary: Extended tech discussion between dreamreal and blue about markov chains/bot functionality. blue skeptical but engaged; dreamreal patient/explanatory. Tone mildly positive with light banter.
  67. dreamrealtehre is no operation called "toxicity"
  68. bluethen we NEED one!
  69. dreamrealWhy? !sentiment exists. And it's more useful than "toxicity" would, because it measures the quality and not the actual judgement.
  70. blueI think the bot misread me though, I'm not skeptical, I'm mocking, it's a fine difference
  71. dreamrealYeah, well, it doesn't have your internal negative locus
  72. blueman ai is such a dumpster fire
  73. dreamrealAnd we purposefully limit the backscroll for it, so it can't really learn it well, nor should it. You wouldn't want the bot to accurately evaluate you. :D
  74. blueit would do a bad job either way. the more I use AI, the more nonsensical it comes across
  75. blueone typical thing is that it has zero understanding of proper abstraction
  76. dreamrealSee? I mean, how is tis related to AI being a dumpster fire? AI comes across as nonsensical because I don't think you understand it. Look at how you interacted with markov - which is itself a form of AI.
  77. blueis your point that if I only understand a crazy person, I wouldn't think he's crazy?
  78. dreamrealI mean... "AI has zero understanding of abstraction!" from a guy who refused to see markov chains as an abstraction, it's just statistics, why not just call it toxicity... I mean... err...
  79. dreamrealAI is not a PERSON. It'd be like arguing with a wrench.
  80. dreamrealOh, wait, that's an abstraction. So a wrench is a tool, you hold it in your hand, it's generally a piece of steel moulded to...
  81. blueso what I've noticed, AI is really good at regurgitating nonsense produced by humans
  82. bluethat makes it completely useless, by reaffirming broken old patterns
  83. bluethe older a technology is, the best it is at it. so it's completely progress-resistant
  84. bluethe better*
  85. bluefor example: you can't program ANYTHING in zig in it
  86. dreamrealI mean... is this new? An LLM has training data and works based on that data, just like a markov chain does - which is why the markov abstraction is useful, BTW - and thus an LLM is naturally suspect and SHOULD be. Why would you expect anything different? The purpose of the system is what it does and what it's designed to be. They do EXACTLY what they should be expected to do, although there are
  87. dreamrealfacets to the models that diminish their effectiveness for some uses.
  88. bluezig is moving very fast, and AI will usually produce you code that has worked in version x-2, if at all
  89. blueyeah, but you're completely disregarding the HUGE chasm between human EXPECTATION of AI and what it is
  90. dreamrealI don't think that's true, actually: I think you'd have to make sure the AI had a way to introspect information about zig to make it work the way you want. Why do you think an AI is actually intelligent or mimics intelligence?
  91. bluecalling it 'AI', to begin with, is completely mislreading adn wrong
  92. dreamrealIt's... not. It's artificial. It's in the name. On the tin.
  93. blueit's NOT intelligent
  94. bluenor can it be, definitionally
  95. blueand artifical... well yeah, algorithms are artificial as well
  96. dreamrealI mean... but... dude
  97. blueI propose calling it a NRM, nonsense regurgitating machine, instead of AI
  98. bluethat is an ACCURATE description of it
  99. dreamrealAI is a term that means exactly what it's always meant: a derivative mechanism that yields results. It's often an oblique result (3(4)=12 is not oblique, but 'what will the price of tea in china be tomorrow if it rains' is.) But AI applies to bayes, markov, LLM, perceptrons, hopfield networks, pagerank... they're all just "statistics," is how I think you'd put it.
  100. dreamrealYes, we're all just NRMs, ghosts in a machine we cannot see
  101. dreamrealbe dreamreal
  102. nevet* channeling dreamreal: run in clojure :d
  103. dreamrealbe blue
  104. nevet* channeling blue: me issues should represent a complete item of work, i mean this:
  105. dreamrealheh
  106. bluedreamreal: I call them 'items' now
  107. blueI never really liked the term issue
  108. dreamrealthis is why I wonder about switching it to a four-token machiine :D
  109. blueissue sounds like a problem; a feature is NOT an issue
  110. dreamrealYou should call it whatever makes sense to you, that's what other people do, after all
  111. blueno I mean on RP
  112. dreamrealI think you should just call them records or rows or "things"
  113. dreamrealthat's what they are, after all
  114. dreamreal"file a thing" or, well, filing has meaning too: "do something for a thing"
  115. bluerecords/rows sounds too much like a db thing. and thing is very general. item means "item of work"
  116. dreamrealoh NOW words have meanings
  117. blueyes
  118. dreamrealthey ARE records and rows in a database, I presume
  119. blueyes?
  120. dreamrealSo why not call them what they are? Calling a mathematical model "markov chain" hides that it's just math; calling rows "issues" or "items" hides that they're database rows. Geez. Have some consistency.
  121. blueI can read that annoyed you earlier
  122. blueI thought it would be harder!
  123. dreamrealyes, because i'm allergic to stupidity and you were being stupid
  124. blueI was being belligerent, not stupid
  125. dreamrealBelligerence IS stupid.
  126. dreamrealsentiment #nevet
  127. nevetSentiment for irc://libera/%23nevet: Sentiment +4/10 | Intensity mod | Themes: AI/LLM capabilities, markov chains technical discussion, terminology debates | Summary: Extended technical debate—dreamreal patient/explanatory, blue critical but engaged with humor. Tone collaborative despite disagreement; banter present throughout.
  128. dreamrealInteresting.
  129. bluesomehow it improved despite your open toxicity
  130. blue"critical but engaged with humour" hits it well
  131. dreamrealYou know, one of the things about having kids - especially one who takes things rather literally - is that you learn to supress sarcasm, even when it's innate, because it serves few apart from the one using it.
  132. blueya
  133. bluein that, you win over me
  134. blueI don't have kids
  135. dreamrealIt's not a competition, just a lesson learned from having them
  136. blueI didn't present it, I just meant I don't have that experience so you're my senior in that
  137. bluepresent it as such*
  138. dreamrealbut one thing it produced in ME is that I don't take stupidity as anything more than face value, just in case. "Dad, how do batteries work" deserves a real answer, just like "why does the water in a toilet flush like it does?"
  139. blueI often feign stupidity. I do so because I want to let others define things as they understand them, instead of repeating something someone else said
  140. dreamrealtheatrical belligerence doesn't serve anyone. be who you are, if that means being stupid, be stupid.
  141. dreamrealWhy not just ask them to define it clearly?
  142. bluebecause, then they will *try* to define it clearly
  143. blueI don't want them to define it clearly
  144. dreamrealInstead, we had a full conversation where I wasn't having the same conversation you were - and yes, I'm annoyed by it more NOW than I was, because it was not an honest conversation.
  145. blueI want to understand how they see it in their brains
  146. dreamrealThere are ways to do that without doing it as you did.
  147. dreamrealBut that's neither here nor there. *I* don't need that shit.
  148. blueI don't think so, not in my experience. if you ask people to define something clearly, they usually do something else
  149. dreamrealI'm not other people. I know how to think.
  150. bluethat's WHY you're annoyed
  151. dreamrealRight. And it doesn't change that I'm annoyed.
  152. blueif that REALLY annoys you, I can ask you to clearly define it next time, assuming you'd have said the same thing
  153. bluebut that's not what I typically do
  154. dreamrealThat's fine. But there's a reason pilpul is frowned upon, and I'm frowning on it. I weaponize pilpul all the damn time, but I mind poe's law while I'm at it so there's no confusion about it.
  155. blueI also don't particularly understand why it's annoying; I personally don't care if someone is feigning ignorance or asking outright, I'd try to explain the same either way
  156. dreamrealI can understand that, but I already said why it annoys me: it means I was having a different conversation than you were.
  157. bluealso, *sometimes* it'll be something in the middle between feigning ignorance and "I don't 100% remember what this term means; let's see how this person meant it"
  158. dreamrealSure. Yet that's still not the same thing; it's asymmetric. if that's how you want our conversations to be, that's fine. I'm too much a leftist to enjoy that shit, but okay, you're one of the madding crowd.
  159. dreamreal"Madding crowd" here means the ordinary people, the villagers, the unaware, the guided.
  160. dreamrealIf you need definitions for those nouns, I can provide that too.
  161. blueyou know pretty well I don't care for labels, right
  162. dreamrealJust let me know.
  163. bluethough I gotta say
  164. dreamrealHey, you set the boundaries, not me
  165. blueMadding crowd sounds cool. I'd prefer maddening crowd
  166. dreamrealI'm sure, but they're different labels.
  167. bluecan I be one of the maddening crowd instead?
  168. dreamrealNo, that requires agency that external loci do not have.
  169. bluethis reminds me, like 30 years ago, having read Far from the Madding Crowd
  170. dreamrealIt's almost like references have meaning!
  171. dreamrealHuh.
  172. blueoh man you're REALLY mad now
  173. bluesentiment #nevet
  174. nevetError: Sentiment analysis requires ADMIN role
  175. blue+admin blue
  176. dreamrealkarma dmlloyd
  177. nevetdmlloyd has karma of 1.
  178. bluehm
  179. dreamrealsentiment #nevet
  180. nevetSentiment for irc://libera/%23nevet: Sentiment +4/10 | Intensity mod | Themes: AI skepticism, markov chains, terminology preferences, technical debate | Summary: Long technical exchange—dreamreal patient/pedagogical, blue critical but playful. Tone light despite disagreement; banter throughout softens edge.
  181. blue4/10 isn't bad, almost average
  182. dreamrealSo here's the thing: if you're trying to figure out how I think and what I mean, there's a lot here that's useful data... but it's data gathered in a way that does not benefit you, because data gathered like that eats social capital WITH ME. Maybe others act differently, and that's fine, but for ME it does actually irritate me - congratulations, you're aspiring to "maddening" - but it doesn't make
  183. dreamrealme ANGRY. It makes me tired. And when people tire me, I remember that. I'm trying to remember patience but it's an effort. And I'm lazy.
  184. bluewhy does it irritate you?
  185. dreamrealDude... stop
  186. dreamrealStop doing that shit
  187. dreamrealthanks
  188. blueoki
  189. dreamrealhomie don't play that with equals.
  190. dreamrealBuber applies.
  191. blueaah, that's hard, for me at least
  192. dreamrealSo I find I vastly disagree with nevet on the sentiment; I might need to revise the query to include some philosophical underpinnings that help it determine actual sentiment and interplay.
  193. bluenah, don't change nevet on my account, I'll just try to stop annoying you
  194. dreamrealNo, this is useful data
  195. bluewhat I find fascinating is that it totally missed how annoyed you were
  196. blue"dreamreal patient/pedagogical" was NOT a correct approximation of reality
  197. blue"dreamreal seething with annoyance" would have been more accurate
  198. dreamrealI don't know that I was seething, but sure
  199. blueyou were using dots!
  200. dreamrealI don't know how I'd instruct the models for that: depleting social capital like that is a pretty complex interaction to build in 100 lines of corpus, especially when the models can't take into account identity
  201. bluemhm
  202. dreamrealI can totally see how "patient/pedagogical" would map, because I wasn't shouting at you in traditional forms, I was more beseeching you to engage the brain I thought you had, but that's because I was talking to you and not a projection of you
  203. dreamrealI'm an introvert, and a pretty severe one, and you pretty much ran through as much rope as I had. Nicely done. But toxic.
  204. blueI'm a bigger introvert, though
  205. dreamrealI'm only 6'1, I'm shrinking as I get old
  206. * blue tries to figure how much is that in non-freedom scales
  207. dreamreal185cm
  208. blueoof, 186cm
  209. * blue is 189cm
  210. dreamrealoh no. I'm lesser than you.
  211. blueit's ok, I'm lanky, you probably weigh more
  212. * dreamreal sighs. Well, I can only say it so clearly before it starts to offend me.
  213. blueoh come now don't be SO annoyed. if I REALLY annoyed you with it, then I apologise. But that's often how I interact. I CAN drop feigning ignorance with YOU, but that's way for me to LEARN how people think
  214. bluea way*
  215. * dreamreal points to a rope
  216. dreamrealI dedicated too much of my energy to this bullshit already. I have to live with people, and they have to live with me, and this mode of conversation utterly exhausts me - I do it because I'm trying to serve tikkun olam for people who NEED it, and being told "hah, it wasn't needed" is wasteful and disrespectful of my time and energy.
  217. dreamrealWith all due respect and as little judgement as I can muster, that's a values violation, and you of all people should understand my values better than the goyim who babble without understanding. They use pilpul because it's what they understand best. WE should be different.
  218. bluemhm
  219. * jreicher joined #nevet