Tag: Testing

All the articles with the tag "Testing".

• When an LLM removed duplicates from my notes, the remaining sentences lost what they pointed to

  27 Oct, 2026

  Removing note duplicates with an LLM left 'this technology stack' and 'also' pointing at nothing. I stopped adding code rules and had an LLM judge each edit.

• My LLM note-merge test passed, but the fixed code never ran once

  26 Oct, 2026

  I fixed an LLM note-merge bug in my Obsidian plugin and reran it on real notes. It passed, but the fixed code never ran until I restored the pre-merge state.

• I deleted the wrong example from my LLM note-merge rule, but the rule stayed

  25 Oct, 2026

  My Obsidian plugin's LLM rule for merging duplicate notes blocked even same-product notes. I traced it, tested real merges, and adopted Karpathy's LLM Wiki.

• In LLM summaries, a claim made once disappeared and one made twice survived

  23 Oct, 2026

  Chasing an LLM summary that dropped a source's causal claim, I ruled out grammar and counterintuitiveness with controls. A claim stated once vanished.

• I found a rule missing from the LLM merge prompt, and filling it in changed nothing

  22 Oct, 2026

  Chasing an LLM note merge that dropped one source's content, I found the merge prompt lacked an information-density rule. Adding it changed nothing.

• The code I carefully built to catch LLM language mixing turned out to have done nothing

  20 Oct, 2026

  I built code to detect and fix Korean sentences leaking into LLM-written English notes. It fixed zero. The real cause was a prompt missing a language rule.

• I tested my Obsidian plugin by remote-controlling Obsidian on another PC

  19 Oct, 2026

  To test an Obsidian plugin in the real app before each release, I drove Obsidian on another PC over the Chrome DevTools Protocol (CDP), deploy to button clicks.

• I fixed the LLM prompt rule twice, but the note should never have been split

  8 Oct, 2026

  An LLM-made sibling note kept coming out empty but for links. Two prompt fixes later, the source showed both courses shared one description: merge, don't split.

• Removing the embedding filter caught more duplicates, not fewer

  6 Oct, 2026

  I swapped an embedding filter plus LLM checks for one LLM review of all sibling notes to catch duplication. One hub-note rule took precision from 55% to 100%.

• Switching embedding models flipped the ranking

  4 Oct, 2026

  Moving from OpenAI's text-embedding-3-small to large flipped the order of true duplicate paragraphs and look-alike sentences mixed at cosine 0.72-0.80.