Package: evaldrift 0.1.0
evaldrift: Paraphrase-Drift Scoring for LLM Eval Sets
Paraphrase-heavy eval sets drift over time: answers get rewritten, questions get reworded, and nobody re-runs the comparison that justified keeping both versions. eval_drift() scores two texts with three plain similarity measures (word-shingle Jaccard, character-trigram Jaccard, normalized Levenshtein similarity) and one blended drift score. No model calls, no network access, pure base R. Companion to the eval-methodology writing on PastAGI <https://pastagi.com>.
Authors:
evaldrift_0.1.0.tar.gz
evaldrift_0.1.0.zip(r-4.7-any)evaldrift_0.1.0.zip(r-4.6-any)evaldrift_0.1.0.zip(r-4.5-any)
evaldrift_0.1.0.tgz(r-4.6-any)evaldrift_0.1.0.tgz(r-4.5-any)
evaldrift_0.1.0.tar.gz(r-4.7-any)evaldrift_0.1.0.tar.gz(r-4.6-any)
evaldrift_0.1.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION
card.svg |card.png
evaldrift/json (API)
| # Install 'evaldrift' in R: |
| install.packages('evaldrift', repos = c('https://scrapertweeter3-prog.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/scrapertweeter3-prog/evaldrift/issues
Last updated from:67b0f0530b. Checks:7 NOTE, 2 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel | NOTE | 203 | ||
| source / vignettes | OK | 325 | ||
| linux-release | NOTE | 157 | ||
| macos-release | NOTE | 132 | ||
| macos-oldrel | NOTE | 147 | ||
| windows-devel | NOTE | 139 | ||
| windows-release | NOTE | 137 | ||
| windows-oldrel | NOTE | 278 | ||
| wasm-release | OK | 225 |
Exports:eval_drift
Dependencies:
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Paraphrase-drift score for a pair of texts | eval_drift |
