normalizeToken function ✓ 100.0%

Last updated: 2026-02-24T21:07:57.585Z

Location

src/lib/shared/structured-signals.ts:49-57

Metrics

LOC: 9 Complexity: 1 Params: 1 Coverage: 100.0% (1/1 lines, 32905x executed)

Signature

normalizeToken(value: string): : string

Source Code

function normalizeToken(value: string): string {
  return value
    .toLowerCase()
    .normalize("NFD")
    .replace(/[\u0300-\u036f]/g, "")
    .replace(/[^a-z0-9\s]+/g, " ")
    .replace(/\s+/g, " ")
    .trim();
}

No outgoing dependencies.

Impact (Incoming)

graph LR normalizeToken["normalizeToken"] normalizeAndDedupe["normalizeAndDedupe"] normalizeDomFeatures["normalizeDomFeatures"] inferLanguageFromSignals["inferLanguageFromSignals"] buildFeatureText["buildFeatureText"] structuredSignalsFromField["structuredSignalsFromField"] normalizeAndDedupe -->|calls| normalizeToken normalizeDomFeatures -->|calls| normalizeToken inferLanguageFromSignals -->|calls| normalizeToken buildFeatureText -->|calls| normalizeToken structuredSignalsFromField -->|calls| normalizeToken style normalizeToken fill:#dbeafe,stroke:#2563eb,stroke-width:2px click normalizeToken "acab84a19ef8c65c.html" click normalizeAndDedupe "1c7d0c2fccdeffca.html" click normalizeDomFeatures "d69f9e503064213a.html" click inferLanguageFromSignals "e08bf6c443fa8af7.html" click buildFeatureText "3eec77682b581a7e.html" click structuredSignalsFromField "ab699edf98df2b23.html"

Source	Type
normalizeAndDedupe	calls
normalizeDomFeatures	calls
inferLanguageFromSignals	calls
buildFeatureText	calls
structuredSignalsFromField	calls