Package: evaldrift 0.1.0

evaldrift: Paraphrase-Drift Scoring for LLM Eval Sets

Paraphrase-heavy eval sets drift over time: answers get rewritten, questions get reworded, and nobody re-runs the comparison that justified keeping both versions. eval_drift() scores two texts with three plain similarity measures (word-shingle Jaccard, character-trigram Jaccard, normalized Levenshtein similarity) and one blended drift score. No model calls, no network access, pure base R. Companion to the eval-methodology writing on PastAGI <https://pastagi.com>.

Authors:James Verlander [aut, cre]

evaldrift_0.1.0.tar.gz
evaldrift_0.1.0.zip(r-4.7-any)evaldrift_0.1.0.zip(r-4.6-any)evaldrift_0.1.0.zip(r-4.5-any)
evaldrift_0.1.0.tgz(r-4.6-any)evaldrift_0.1.0.tgz(r-4.5-any)
evaldrift_0.1.0.tar.gz(r-4.7-any)evaldrift_0.1.0.tar.gz(r-4.6-any)
evaldrift_0.1.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION
card.svg |card.png
evaldrift/json (API)

# Install 'evaldrift' in R:
install.packages('evaldrift', repos = c('https://scrapertweeter3-prog.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/scrapertweeter3-prog/evaldrift/issues

On CRAN:

Conda:

1.70 score 1 exports 0 dependencies

Last updated from:67b0f0530b. Checks:7 NOTE, 2 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-develNOTE203
source / vignettesOK325
linux-releaseNOTE157
macos-releaseNOTE132
macos-oldrelNOTE147
windows-develNOTE139
windows-releaseNOTE137
windows-oldrelNOTE278
wasm-releaseOK225

Exports:eval_drift

Dependencies: